Project

General

Profile

Actions
Copy link

Bug #7355

closed

assert(0) in_make_pg() because EC getting enabled

Added by David Zafman about 10 years ago. Updated about 10 years ago.

Status:
Resolved
Priority:
Immediate
Assignee:
David Zafman
Category:
-
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Actions
Copy link
 #1

Updated by David Zafman about 10 years ago

  • Subject changed from 7354 to assert(0) in_make_pg() because EC getting enabled

2014-02-06T01:24:45.644 INFO:teuthology.task.workunit.client.0.err:[10.214.133.32]: + ceph osd pool delete fuggg fuggg --yes-i-really-really-mean-it
2014-02-06T01:24:45.918 INFO:teuthology.task.workunit.client.0.err:[10.214.133.32]: pool 'fuggg' does not exist
2014-02-06T01:24:45.930 INFO:teuthology.task.workunit.client.0.out:[10.214.133.32]: OK
2014-02-06T01:24:45.930 INFO:teuthology.task.workunit.client.0.err:[10.214.133.32]: + echo OK
2014-02-06T01:24:45.931 DEBUG:teuthology.orchestra.run:Running [10.214.133.32]: 'sudo rm rf - /home/ubuntu/cephtest/mnt.0/client.0/tmp'
2014-02-06T01:24:45.942 INFO:teuthology.task.workunit:Stopping mon/pool_ops.sh on client.0...
2014-02-06T01:24:45.942 DEBUG:teuthology.orchestra.run:Running [10.214.133.32]: 'rm rf - /home/ubuntu/cephtest/workunits.list /home/ubuntu/cephtest/workunit.client.0'
2014-02-06T01:24:46.016 DEBUG:teuthology.parallel:result is None
2014-02-06T01:24:46.016 DEBUG:teuthology.orchestra.run:Running [10.214.133.32]: 'rm rf - /home/ubuntu/cephtest/mnt.0/client.0'
2014-02-06T01:24:46.088 INFO:teuthology.task.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0
2014-02-06T01:24:46.088 DEBUG:teuthology.orchestra.run:Running [10.214.133.32]: 'rmdir -- /home/ubuntu/cephtest/mnt.0'
2014-02-06T01:24:46.158 INFO:teuthology.task.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0
2014-02-06T01:24:46.158 DEBUG:teuthology.run_tasks:Unwinding manager <contextlib.GeneratorContextManager object at 0x21a8b10>
2014-02-06T01:24:46.158 INFO:teuthology.misc:Shutting down mds daemons...
2014-02-06T01:24:46.159 DEBUG:teuthology.task.ceph.mds.a:waiting for process to exit
2014-02-06T01:24:46.159 INFO:teuthology.task.ceph.mds.a:Stopped
2014-02-06T01:24:46.159 INFO:teuthology.misc:Shutting down osd daemons...
2014-02-06T01:24:46.159 DEBUG:teuthology.task.ceph.osd.1:waiting for process to exit
2014-02-06T01:24:46.160 ERROR:teuthology.misc:Saw exception from osd.1
Traceback (most recent call last):
File "/home/teuthworker/teuthology-master/teuthology/misc.py", line 938, in stop_daemons_of_type
daemon.stop()
File "/home/teuthworker/teuthology-master/teuthology/task/ceph.py", line 55, in stop
run.wait([self.proc])
File "/home/teuthworker/teuthology-master/teuthology/orchestra/run.py", line 286, in wait
proc.exitstatus.get()
File "/usr/lib/python2.7/dist-packages/gevent/event.py", line 207, in get
raise self._exception
CommandFailedError: Command failed on 10.214.133.32 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f -i 1'

osd.1 log:
2014-02-06 01:23:58.282623 7fd9eea25700 1 -- 10.214.133.32:6800/646 <== mon.2 10.214.133.32:6791/0 99 ==== osd_pg_create(pg8.0,114; pg8.1,114; pg8.3,114; pg8.5,114; pg8.7,114; pg8.8,114; pg8.a,114; ) v2 ==== 348+0+0 (3221893965 0 0) 0x3533600 con 0x31469a0
2014-02-06 01:23:58.282766 7fd9eea25700 1 -- 10.214.133.32:6800/646 --> 10.214.133.32:6791/0 -- mon_subscribe({monmap=2+,osd_pg_creates=0,osdmap=113}) v2 -- ?+0 0x317f540 con 0x31469a0
2014-02-06 01:23:58.283518 7fd9eea25700 1 -- 10.214.133.32:6800/646 <== mon.2 10.214.133.32:6791/0 100 ==== osd_pg_create(pg8.0,114; pg8.1,114; pg8.3,114; pg8.5,114; pg8.7,114; pg8.8,114; pg8.a,114; ) v2 ==== 348+0+0 (3221893965 0 0) 0x3007400 con 0x31469a0
2014-02-06 01:23:58.283652 7fd9eea25700 1 -- 10.214.133.32:6800/646 <== mon.2 10.214.133.32:6791/0 101 ==== osd_map(113..114 src has 1..114) v3 ==== 1300+0+0 (1663387615 0 0) 0x327ad80 con 0x31469a0
2014-02-06 01:23:58.283739 7fd9eea25700 3 osd.1 112 handle_osd_map epochs [113,114], i have 112, src has [1,114]
2014-02-06 01:23:58.284309 7fd9eea25700 0 osd.1 114 crush map has features 344704942080, adjusting msgr requires for clients
2014-02-06 01:23:58.284319 7fd9eea25700 0 osd.1 114 crush map has features 344704942080, adjusting msgr requires for osds
2014-02-06 01:23:58.284323 7fd9eea25700 0 osd.1 114 check_osdmap_features enabling on-disk ERASURE CODES compat feature
2014-02-06 01:23:58.358200 7fd9eea25700 -1 osd/OSD.cc: In function 'PG* OSD::_make_pg(OSDMapRef, pg_t)' thread 7fd9eea25700 time 2014-02-06 01:23:58.355522
osd/OSD.cc: 1707: FAILED assert(0)

ceph version 0.76-437-g471c678 (471c67828cf98224f89bd8efb28d377f8d745b7a)
 1: (OSDService::send_pg_temp()+0) [0x6133f0]
 2: (OSD::_open_lock_pg(std::tr1::shared_ptr&lt;OSDMap const&gt;, pg_t, bool, bool)+0x4e) [0x6193de]
 3: (OSD::_create_lock_pg(std::tr1::shared_ptr&lt;OSDMap const&gt;, pg_t, bool, bool, bool, int, std::vector&lt;int, std::allocator&lt;int&gt; >&, std::vector&lt;int, std::allocator&lt;int&gt; >&, pg_history_t, std::map&lt;unsigned int, pg_interval_t, std::less&lt;unsigned int&gt;, std::allocator&lt;std::pair&lt;unsigned int const, pg_interval_t&gt; > >&, ObjectStore::Transaction&)+0x165) [0x64b545]
 4: (OSD::handle_pg_create(std::tr1::shared_ptr&lt;OpRequest&gt;)+0x179c) [0x64cfbc]
 5: (OSD::dispatch_op(std::tr1::shared_ptr&lt;OpRequest&gt;)+0x2bd) [0x65035d]
Actions
Copy link
 #2

Updated by David Zafman about 10 years ago

  • Status changed from New to In Progress
  • Assignee set to David Zafman
Actions
Copy link
 #3

Updated by David Zafman about 10 years ago

  • Status changed from In Progress to Resolved

42a64e19b7a06c1b3e0fd40e2d9c572103e3e426

Actions
Copy link

Also available in: Atom PDF