Project

General

Profile

Bug #11373 ยป osd-log.txt

Ilja Slepnev, 04/11/2015 06:09 PM

 
2015-04-11 20:59:43.259502 7f4bf83a7880 0 ceph version 0.94 (e61c4f093f88e44961d157f65091733580cea79a), process ceph-osd, pid 3304762
starting osd.30 at :/0 osd_data /var/lib/ceph/osd/ceph-30 /var/lib/ceph/osd/ceph-30/journal
2015-04-11 20:59:43.292995 7f4bf83a7880 0 filestore(/var/lib/ceph/osd/ceph-30) backend xfs (magic 0x58465342)
2015-04-11 20:59:43.296674 7f4bf83a7880 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-30) detect_features: FIEMAP ioctl is supported and appears to work
2015-04-11 20:59:43.296684 7f4bf83a7880 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-30) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
2015-04-11 20:59:43.300315 7f4bf83a7880 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-30) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
2015-04-11 20:59:43.300430 7f4bf83a7880 0 xfsfilestorebackend(/var/lib/ceph/osd/ceph-30) detect_feature: extsize is supported and kernel 3.10.0-123.9.2.el7.x86_64 >= 3.5
2015-04-11 20:59:43.303636 7f4bf83a7880 0 filestore(/var/lib/ceph/osd/ceph-30) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled
SG_IO: bad/missing sense data, sb[]: 70 00 05 00 00 00 00 0d 00 00 00 00 20 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2015-04-11 20:59:43.315007 7f4bf83a7880 1 journal _open /var/lib/ceph/osd/ceph-30/journal fd 19: 68718444544 bytes, block size 4096 bytes, directio = 1, aio = 1
SG_IO: bad/missing sense data, sb[]: 70 00 05 00 00 00 00 0d 00 00 00 00 20 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00
2015-04-11 20:59:43.319922 7f4bf83a7880 1 journal _open /var/lib/ceph/osd/ceph-30/journal fd 19: 68718444544 bytes, block size 4096 bytes, directio = 1, aio = 1
2015-04-11 20:59:43.325667 7f4bf83a7880 0 <cls> cls/hello/cls_hello.cc:271: loading cls_hello
2015-04-11 20:59:43.326800 7f4bf83a7880 0 osd.30 28642 crush map has features 1107558400, adjusting msgr requires for clients
2015-04-11 20:59:43.326810 7f4bf83a7880 0 osd.30 28642 crush map has features 1107558400 was 8705, adjusting msgr requires for mons
2015-04-11 20:59:43.326817 7f4bf83a7880 0 osd.30 28642 crush map has features 1107558400, adjusting msgr requires for osds
2015-04-11 20:59:43.326833 7f4bf83a7880 0 osd.30 28642 load_pgs
osd/OSD.h: In function 'OSDMapRef OSDService::get_map(epoch_t)' thread 7f4bf83a7880 time 2015-04-11 20:59:43.344831
osd/OSD.h: 716: FAILED assert(ret)
ceph version 0.94 (e61c4f093f88e44961d157f65091733580cea79a)
1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x85) [0xbc5195]
2: (OSDService::get_map(unsigned int)+0x3f) [0x6ff77f]
3: (OSD::load_pgs()+0x17c9) [0x6b7479]
4: (OSD::init()+0x729) [0x6b8b99]
5: (main()+0x27f3) [0x643b63]
6: (__libc_start_main()+0xf5) [0x7f4bf5744af5]
7: ceph-osd() [0x65cdc9]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2015-04-11 20:59:43.346451 7f4bf83a7880 -1 osd/OSD.h: In function 'OSDMapRef OSDService::get_map(epoch_t)' thread 7f4bf83a7880 time 2015-04-11 20:59:43.344831
osd/OSD.h: 716: FAILED assert(ret)

ceph version 0.94 (e61c4f093f88e44961d157f65091733580cea79a)
1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x85) [0xbc5195]
2: (OSDService::get_map(unsigned int)+0x3f) [0x6ff77f]
3: (OSD::load_pgs()+0x17c9) [0x6b7479]
4: (OSD::init()+0x729) [0x6b8b99]
5: (main()+0x27f3) [0x643b63]
6: (__libc_start_main()+0xf5) [0x7f4bf5744af5]
7: ceph-osd() [0x65cdc9]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- begin dump of recent events ---
-175> 2015-04-11 20:59:43.257625 7f4bf83a7880 5 asok(0x4ca8000) register_command perfcounters_dump hook 0x4c20050
-174> 2015-04-11 20:59:43.257688 7f4bf83a7880 5 asok(0x4ca8000) register_command 1 hook 0x4c20050
-173> 2015-04-11 20:59:43.257695 7f4bf83a7880 5 asok(0x4ca8000) register_command perf dump hook 0x4c20050
-172> 2015-04-11 20:59:43.257702 7f4bf83a7880 5 asok(0x4ca8000) register_command perfcounters_schema hook 0x4c20050
-171> 2015-04-11 20:59:43.257707 7f4bf83a7880 5 asok(0x4ca8000) register_command 2 hook 0x4c20050
-170> 2015-04-11 20:59:43.257710 7f4bf83a7880 5 asok(0x4ca8000) register_command perf schema hook 0x4c20050
-169> 2015-04-11 20:59:43.257714 7f4bf83a7880 5 asok(0x4ca8000) register_command perf reset hook 0x4c20050
-168> 2015-04-11 20:59:43.257717 7f4bf83a7880 5 asok(0x4ca8000) register_command config show hook 0x4c20050
-167> 2015-04-11 20:59:43.257721 7f4bf83a7880 5 asok(0x4ca8000) register_command config set hook 0x4c20050
-166> 2015-04-11 20:59:43.257724 7f4bf83a7880 5 asok(0x4ca8000) register_command config get hook 0x4c20050
-165> 2015-04-11 20:59:43.257728 7f4bf83a7880 5 asok(0x4ca8000) register_command config diff hook 0x4c20050
-164> 2015-04-11 20:59:43.257732 7f4bf83a7880 5 asok(0x4ca8000) register_command log flush hook 0x4c20050
-163> 2015-04-11 20:59:43.257736 7f4bf83a7880 5 asok(0x4ca8000) register_command log dump hook 0x4c20050
-162> 2015-04-11 20:59:43.257738 7f4bf83a7880 5 asok(0x4ca8000) register_command log reopen hook 0x4c20050
-161> 2015-04-11 20:59:43.259502 7f4bf83a7880 0 ceph version 0.94 (e61c4f093f88e44961d157f65091733580cea79a), process ceph-osd, pid 3304762
-160> 2015-04-11 20:59:43.260970 7f4bf83a7880 1 -- 159.93.120.149:0/0 learned my addr 159.93.120.149:0/0
-159> 2015-04-11 20:59:43.260983 7f4bf83a7880 1 accepter.accepter.bind my_inst.addr is 159.93.120.149:6810/3304762 need_addr=0
-158> 2015-04-11 20:59:43.261008 7f4bf83a7880 1 -- 10.8.7.22:0/0 learned my addr 10.8.7.22:0/0
-157> 2015-04-11 20:59:43.261014 7f4bf83a7880 1 accepter.accepter.bind my_inst.addr is 10.8.7.22:6802/3304762 need_addr=0
-156> 2015-04-11 20:59:43.261038 7f4bf83a7880 1 -- 10.8.7.22:0/0 learned my addr 10.8.7.22:0/0
-155> 2015-04-11 20:59:43.261044 7f4bf83a7880 1 accepter.accepter.bind my_inst.addr is 10.8.7.22:6808/3304762 need_addr=0
-154> 2015-04-11 20:59:43.261082 7f4bf83a7880 1 -- 159.93.120.149:0/0 learned my addr 159.93.120.149:0/0
-153> 2015-04-11 20:59:43.261088 7f4bf83a7880 1 accepter.accepter.bind my_inst.addr is 159.93.120.149:6815/3304762 need_addr=0
-152> 2015-04-11 20:59:43.282458 7f4bf83a7880 5 asok(0x4ca8000) init /var/run/ceph/ceph-osd.30.asok
-151> 2015-04-11 20:59:43.282473 7f4bf83a7880 5 asok(0x4ca8000) bind_and_listen /var/run/ceph/ceph-osd.30.asok
-150> 2015-04-11 20:59:43.283457 7f4bf83a7880 5 asok(0x4ca8000) register_command 0 hook 0x4c180a8
-149> 2015-04-11 20:59:43.283465 7f4bf83a7880 5 asok(0x4ca8000) register_command version hook 0x4c180a8
-148> 2015-04-11 20:59:43.283469 7f4bf83a7880 5 asok(0x4ca8000) register_command git_version hook 0x4c180a8
-147> 2015-04-11 20:59:43.283474 7f4bf83a7880 5 asok(0x4ca8000) register_command help hook 0x4c20150
-146> 2015-04-11 20:59:43.283477 7f4bf83a7880 5 asok(0x4ca8000) register_command get_command_descriptions hook 0x4c20140
-145> 2015-04-11 20:59:43.283514 7f4bf83a7880 10 monclient(hunting): build_initial_monmap
-144> 2015-04-11 20:59:43.283515 7f4bf3761700 5 asok(0x4ca8000) entry start
-143> 2015-04-11 20:59:43.292499 7f4bf83a7880 5 adding auth protocol: cephx
-142> 2015-04-11 20:59:43.292506 7f4bf83a7880 5 adding auth protocol: cephx
-141> 2015-04-11 20:59:43.292641 7f4bf83a7880 5 asok(0x4ca8000) register_command objecter_requests hook 0x4c20180
-140> 2015-04-11 20:59:43.292709 7f4bf83a7880 1 -- 159.93.120.149:6810/3304762 messenger.start
-139> 2015-04-11 20:59:43.292768 7f4bf83a7880 1 -- :/0 messenger.start
-138> 2015-04-11 20:59:43.292791 7f4bf83a7880 1 -- 159.93.120.149:6815/3304762 messenger.start
-137> 2015-04-11 20:59:43.292819 7f4bf83a7880 1 -- 10.8.7.22:6808/3304762 messenger.start
-136> 2015-04-11 20:59:43.292842 7f4bf83a7880 1 -- 10.8.7.22:6802/3304762 messenger.start
-135> 2015-04-11 20:59:43.292864 7f4bf83a7880 1 -- :/0 messenger.start
-134> 2015-04-11 20:59:43.292923 7f4bf83a7880 2 osd.30 0 mounting /var/lib/ceph/osd/ceph-30 /var/lib/ceph/osd/ceph-30/journal
-133> 2015-04-11 20:59:43.292995 7f4bf83a7880 0 filestore(/var/lib/ceph/osd/ceph-30) backend xfs (magic 0x58465342)
-132> 2015-04-11 20:59:43.296674 7f4bf83a7880 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-30) detect_features: FIEMAP ioctl is supported and appears to work
-131> 2015-04-11 20:59:43.296684 7f4bf83a7880 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-30) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option
-130> 2015-04-11 20:59:43.300315 7f4bf83a7880 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-30) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)
-129> 2015-04-11 20:59:43.300430 7f4bf83a7880 0 xfsfilestorebackend(/var/lib/ceph/osd/ceph-30) detect_feature: extsize is supported and kernel 3.10.0-123.9.2.el7.x86_64 >= 3.5
-128> 2015-04-11 20:59:43.303636 7f4bf83a7880 0 filestore(/var/lib/ceph/osd/ceph-30) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled
-127> 2015-04-11 20:59:43.308832 7f4bf83a7880 2 journal open /var/lib/ceph/osd/ceph-30/journal fsid 0c9a32e4-fc21-482d-9a60-4b97159a00ac fs_op_seq 2543474
-126> 2015-04-11 20:59:43.315007 7f4bf83a7880 1 journal _open /var/lib/ceph/osd/ceph-30/journal fd 19: 68718444544 bytes, block size 4096 bytes, directio = 1, aio = 1
-125> 2015-04-11 20:59:43.315288 7f4bf83a7880 2 journal read_entry 40415866880 : seq 2543475 138 bytes
-124> 2015-04-11 20:59:43.315306 7f4bf83a7880 2 journal read_entry 40415866880 : seq 2543475 138 bytes
-123> 2015-04-11 20:59:43.315310 7f4bf83a7880 3 journal journal_replay: applying op seq 2543475
-122> 2015-04-11 20:59:43.315396 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543475
-121> 2015-04-11 20:59:43.315507 7f4bf83a7880 2 journal read_entry 40415870976 : seq 2543476 137 bytes
-120> 2015-04-11 20:59:43.315533 7f4bf83a7880 3 journal journal_replay: applying op seq 2543476
-119> 2015-04-11 20:59:43.315553 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543476
-118> 2015-04-11 20:59:43.315585 7f4bf83a7880 2 journal read_entry 40415875072 : seq 2543477 137 bytes
-117> 2015-04-11 20:59:43.315590 7f4bf83a7880 3 journal journal_replay: applying op seq 2543477
-116> 2015-04-11 20:59:43.315604 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543477
-115> 2015-04-11 20:59:43.315613 7f4bf83a7880 2 journal read_entry 40415879168 : seq 2543478 138 bytes
-114> 2015-04-11 20:59:43.315616 7f4bf83a7880 3 journal journal_replay: applying op seq 2543478
-113> 2015-04-11 20:59:43.315643 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543478
-112> 2015-04-11 20:59:43.315652 7f4bf83a7880 2 journal read_entry 40415883264 : seq 2543479 138 bytes
-111> 2015-04-11 20:59:43.315655 7f4bf83a7880 3 journal journal_replay: applying op seq 2543479
-110> 2015-04-11 20:59:43.315667 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543479
-109> 2015-04-11 20:59:43.315721 7f4bf83a7880 2 journal read_entry 40415887360 : seq 2543480 138 bytes
-108> 2015-04-11 20:59:43.315725 7f4bf83a7880 3 journal journal_replay: applying op seq 2543480
-107> 2015-04-11 20:59:43.315758 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543480
-106> 2015-04-11 20:59:43.315767 7f4bf83a7880 2 journal read_entry 40415891456 : seq 2543481 138 bytes
-105> 2015-04-11 20:59:43.315790 7f4bf83a7880 3 journal journal_replay: applying op seq 2543481
-104> 2015-04-11 20:59:43.315804 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543481
-103> 2015-04-11 20:59:43.315812 7f4bf83a7880 2 journal read_entry 40415895552 : seq 2543482 138 bytes
-102> 2015-04-11 20:59:43.315816 7f4bf83a7880 3 journal journal_replay: applying op seq 2543482
-101> 2015-04-11 20:59:43.315827 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543482
-100> 2015-04-11 20:59:43.315835 7f4bf83a7880 2 journal read_entry 40415899648 : seq 2543483 137 bytes
-99> 2015-04-11 20:59:43.315838 7f4bf83a7880 3 journal journal_replay: applying op seq 2543483
-98> 2015-04-11 20:59:43.315853 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543483
-97> 2015-04-11 20:59:43.315861 7f4bf83a7880 2 journal read_entry 40415903744 : seq 2543484 138 bytes
-96> 2015-04-11 20:59:43.315864 7f4bf83a7880 3 journal journal_replay: applying op seq 2543484
-95> 2015-04-11 20:59:43.315875 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543484
-94> 2015-04-11 20:59:43.315882 7f4bf83a7880 2 journal read_entry 40415907840 : seq 2543485 138 bytes
-93> 2015-04-11 20:59:43.315886 7f4bf83a7880 3 journal journal_replay: applying op seq 2543485
-92> 2015-04-11 20:59:43.315897 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543485
-91> 2015-04-11 20:59:43.315905 7f4bf83a7880 2 journal read_entry 40415911936 : seq 2543486 138 bytes
-90> 2015-04-11 20:59:43.315909 7f4bf83a7880 3 journal journal_replay: applying op seq 2543486
-89> 2015-04-11 20:59:43.315919 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543486
-88> 2015-04-11 20:59:43.315927 7f4bf83a7880 2 journal read_entry 40415916032 : seq 2543487 137 bytes
-87> 2015-04-11 20:59:43.315930 7f4bf83a7880 3 journal journal_replay: applying op seq 2543487
-86> 2015-04-11 20:59:43.315941 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543487
-85> 2015-04-11 20:59:43.316036 7f4bf83a7880 2 journal read_entry 40415920128 : seq 2543488 138 bytes
-84> 2015-04-11 20:59:43.316041 7f4bf83a7880 3 journal journal_replay: applying op seq 2543488
-83> 2015-04-11 20:59:43.316056 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543488
-82> 2015-04-11 20:59:43.316064 7f4bf83a7880 2 journal read_entry 40415924224 : seq 2543489 137 bytes
-81> 2015-04-11 20:59:43.316068 7f4bf83a7880 3 journal journal_replay: applying op seq 2543489
-80> 2015-04-11 20:59:43.316082 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543489
-79> 2015-04-11 20:59:43.316090 7f4bf83a7880 2 journal read_entry 40415928320 : seq 2543490 138 bytes
-78> 2015-04-11 20:59:43.316094 7f4bf83a7880 3 journal journal_replay: applying op seq 2543490
-77> 2015-04-11 20:59:43.316105 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543490
-76> 2015-04-11 20:59:43.316137 7f4bf83a7880 2 journal read_entry 40415932416 : seq 2543491 138 bytes
-75> 2015-04-11 20:59:43.316141 7f4bf83a7880 3 journal journal_replay: applying op seq 2543491
-74> 2015-04-11 20:59:43.316154 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543491
-73> 2015-04-11 20:59:43.316162 7f4bf83a7880 2 journal read_entry 40415936512 : seq 2543492 136 bytes
-72> 2015-04-11 20:59:43.316165 7f4bf83a7880 3 journal journal_replay: applying op seq 2543492
-71> 2015-04-11 20:59:43.316179 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543492
-70> 2015-04-11 20:59:43.316189 7f4bf83a7880 2 journal read_entry 40415940608 : seq 2543493 137 bytes
-69> 2015-04-11 20:59:43.316192 7f4bf83a7880 3 journal journal_replay: applying op seq 2543493
-68> 2015-04-11 20:59:43.316203 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543493
-67> 2015-04-11 20:59:43.316211 7f4bf83a7880 2 journal read_entry 40415944704 : seq 2543494 138 bytes
-66> 2015-04-11 20:59:43.316214 7f4bf83a7880 3 journal journal_replay: applying op seq 2543494
-65> 2015-04-11 20:59:43.316225 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543494
-64> 2015-04-11 20:59:43.316233 7f4bf83a7880 2 journal read_entry 40415948800 : seq 2543495 136 bytes
-63> 2015-04-11 20:59:43.316236 7f4bf83a7880 3 journal journal_replay: applying op seq 2543495
-62> 2015-04-11 20:59:43.316247 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543495
-61> 2015-04-11 20:59:43.316255 7f4bf83a7880 2 journal read_entry 40415952896 : seq 2543496 137 bytes
-60> 2015-04-11 20:59:43.316258 7f4bf83a7880 3 journal journal_replay: applying op seq 2543496
-59> 2015-04-11 20:59:43.316269 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543496
-58> 2015-04-11 20:59:43.316277 7f4bf83a7880 2 journal read_entry 40415956992 : seq 2543497 137 bytes
-57> 2015-04-11 20:59:43.316280 7f4bf83a7880 3 journal journal_replay: applying op seq 2543497
-56> 2015-04-11 20:59:43.316292 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543497
-55> 2015-04-11 20:59:43.316300 7f4bf83a7880 2 journal read_entry 40415961088 : seq 2543498 137 bytes
-54> 2015-04-11 20:59:43.316303 7f4bf83a7880 3 journal journal_replay: applying op seq 2543498
-53> 2015-04-11 20:59:43.316314 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543498
-52> 2015-04-11 20:59:43.316328 7f4bf83a7880 2 journal read_entry 40415965184 : seq 2543499 137 bytes
-51> 2015-04-11 20:59:43.316332 7f4bf83a7880 3 journal journal_replay: applying op seq 2543499
-50> 2015-04-11 20:59:43.316344 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543499
-49> 2015-04-11 20:59:43.316352 7f4bf83a7880 2 journal read_entry 40415969280 : seq 2543500 136 bytes
-48> 2015-04-11 20:59:43.316354 7f4bf83a7880 3 journal journal_replay: applying op seq 2543500
-47> 2015-04-11 20:59:43.316364 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543500
-46> 2015-04-11 20:59:43.316372 7f4bf83a7880 2 journal read_entry 40415973376 : seq 2543501 137 bytes
-45> 2015-04-11 20:59:43.316375 7f4bf83a7880 3 journal journal_replay: applying op seq 2543501
-44> 2015-04-11 20:59:43.316386 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543501
-43> 2015-04-11 20:59:43.316393 7f4bf83a7880 2 journal read_entry 40415977472 : seq 2543502 137 bytes
-42> 2015-04-11 20:59:43.316397 7f4bf83a7880 3 journal journal_replay: applying op seq 2543502
-41> 2015-04-11 20:59:43.316407 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543502
-40> 2015-04-11 20:59:43.316417 7f4bf83a7880 2 journal read_entry 40415981568 : seq 2543503 136 bytes
-39> 2015-04-11 20:59:43.316420 7f4bf83a7880 3 journal journal_replay: applying op seq 2543503
-38> 2015-04-11 20:59:43.316432 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543503
-37> 2015-04-11 20:59:43.316536 7f4bf83a7880 2 journal read_entry 40415985664 : seq 2543504 138 bytes
-36> 2015-04-11 20:59:43.316541 7f4bf83a7880 3 journal journal_replay: applying op seq 2543504
-35> 2015-04-11 20:59:43.316557 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543504
-34> 2015-04-11 20:59:43.316565 7f4bf83a7880 2 journal read_entry 40415989760 : seq 2543505 138 bytes
-33> 2015-04-11 20:59:43.316569 7f4bf83a7880 3 journal journal_replay: applying op seq 2543505
-32> 2015-04-11 20:59:43.316581 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543505
-31> 2015-04-11 20:59:43.316589 7f4bf83a7880 2 journal read_entry 40415993856 : seq 2543506 137 bytes
-30> 2015-04-11 20:59:43.316593 7f4bf83a7880 3 journal journal_replay: applying op seq 2543506
-29> 2015-04-11 20:59:43.316605 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543506
-28> 2015-04-11 20:59:43.316615 7f4bf83a7880 2 journal read_entry 40415997952 : seq 2543507 136 bytes
-27> 2015-04-11 20:59:43.316618 7f4bf83a7880 3 journal journal_replay: applying op seq 2543507
-26> 2015-04-11 20:59:43.316630 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543507
-25> 2015-04-11 20:59:43.316638 7f4bf83a7880 2 journal read_entry 40416002048 : seq 2543508 138 bytes
-24> 2015-04-11 20:59:43.316641 7f4bf83a7880 3 journal journal_replay: applying op seq 2543508
-23> 2015-04-11 20:59:43.316654 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543508
-22> 2015-04-11 20:59:43.316661 7f4bf83a7880 2 journal read_entry 40416006144 : seq 2543509 137 bytes
-21> 2015-04-11 20:59:43.316665 7f4bf83a7880 3 journal journal_replay: applying op seq 2543509
-20> 2015-04-11 20:59:43.316675 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543509
-19> 2015-04-11 20:59:43.316701 7f4bf83a7880 2 journal read_entry 40416010240 : seq 2543510 137 bytes
-18> 2015-04-11 20:59:43.316704 7f4bf83a7880 3 journal journal_replay: applying op seq 2543510
-17> 2015-04-11 20:59:43.316717 7f4bf83a7880 3 journal journal_replay: r = 0, op_seq now 2543510
-16> 2015-04-11 20:59:43.316724 7f4bf83a7880 2 journal No further valid entries found, journal is most likely valid
-15> 2015-04-11 20:59:43.316730 7f4bf83a7880 3 journal journal_replay: end of journal, done.
-14> 2015-04-11 20:59:43.319922 7f4bf83a7880 1 journal _open /var/lib/ceph/osd/ceph-30/journal fd 19: 68718444544 bytes, block size 4096 bytes, directio = 1, aio = 1
-13> 2015-04-11 20:59:43.320175 7f4bf83a7880 2 osd.30 0 boot
-12> 2015-04-11 20:59:43.322833 7f4bf83a7880 1 <cls> cls/refcount/cls_refcount.cc:231: Loaded refcount class!
-11> 2015-04-11 20:59:43.322946 7f4bf83a7880 1 <cls> cls/replica_log/cls_replica_log.cc:141: Loaded replica log class!
-10> 2015-04-11 20:59:43.323048 7f4bf83a7880 1 <cls> cls/statelog/cls_statelog.cc:306: Loaded log class!
-9> 2015-04-11 20:59:43.323386 7f4bf83a7880 1 <cls> cls/log/cls_log.cc:312: Loaded log class!
-8> 2015-04-11 20:59:43.325417 7f4bf83a7880 1 <cls> cls/rgw/cls_rgw.cc:3046: Loaded rgw class!
-7> 2015-04-11 20:59:43.325541 7f4bf83a7880 1 <cls> cls/version/cls_version.cc:227: Loaded version class!
-6> 2015-04-11 20:59:43.325667 7f4bf83a7880 0 <cls> cls/hello/cls_hello.cc:271: loading cls_hello
-5> 2015-04-11 20:59:43.325767 7f4bf83a7880 1 <cls> cls/user/cls_user.cc:367: Loaded user class!
-4> 2015-04-11 20:59:43.326800 7f4bf83a7880 0 osd.30 28642 crush map has features 1107558400, adjusting msgr requires for clients
-3> 2015-04-11 20:59:43.326810 7f4bf83a7880 0 osd.30 28642 crush map has features 1107558400 was 8705, adjusting msgr requires for mons
-2> 2015-04-11 20:59:43.326817 7f4bf83a7880 0 osd.30 28642 crush map has features 1107558400, adjusting msgr requires for osds
-1> 2015-04-11 20:59:43.326833 7f4bf83a7880 0 osd.30 28642 load_pgs
0> 2015-04-11 20:59:43.346451 7f4bf83a7880 -1 osd/OSD.h: In function 'OSDMapRef OSDService::get_map(epoch_t)' thread 7f4bf83a7880 time 2015-04-11 20:59:43.344831
osd/OSD.h: 716: FAILED assert(ret)

ceph version 0.94 (e61c4f093f88e44961d157f65091733580cea79a)
1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x85) [0xbc5195]
2: (OSDService::get_map(unsigned int)+0x3f) [0x6ff77f]
3: (OSD::load_pgs()+0x17c9) [0x6b7479]
4: (OSD::init()+0x729) [0x6b8b99]
5: (main()+0x27f3) [0x643b63]
6: (__libc_start_main()+0xf5) [0x7f4bf5744af5]
7: ceph-osd() [0x65cdc9]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 rbd_replay
0/ 5 journaler
0/ 5 objectcacher
0/ 5 client
0/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 keyvaluestore
1/ 3 journal
0/ 5 ms
1/ 5 mon
0/10 monc
1/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 5 heartbeatmap
1/ 5 perfcounter
1/ 5 rgw
1/10 civetweb
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
0/ 0 refs
1/ 5 xio
-2/-2 (syslog threshold)
99/99 (stderr threshold)
max_recent 10000
max_new 1000
log_file
--- end dump of recent events ---
terminate called after throwing an instance of 'ceph::FailedAssertion'
*** Caught signal (Aborted) **
in thread 7f4bf83a7880
ceph version 0.94 (e61c4f093f88e44961d157f65091733580cea79a)
1: ceph-osd() [0xac51c2]
2: (()+0xf130) [0x7f4bf6d3e130]
3: (gsignal()+0x37) [0x7f4bf57585d7]
4: (abort()+0x148) [0x7f4bf5759cc8]
5: (__gnu_cxx::__verbose_terminate_handler()+0x165) [0x7f4bf605c9b5]
6: (()+0x5e926) [0x7f4bf605a926]
7: (()+0x5e953) [0x7f4bf605a953]
8: (()+0x5eb73) [0x7f4bf605ab73]
9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x27a) [0xbc538a]
10: (OSDService::get_map(unsigned int)+0x3f) [0x6ff77f]
11: (OSD::load_pgs()+0x17c9) [0x6b7479]
12: (OSD::init()+0x729) [0x6b8b99]
13: (main()+0x27f3) [0x643b63]
14: (__libc_start_main()+0xf5) [0x7f4bf5744af5]
15: ceph-osd() [0x65cdc9]
2015-04-11 20:59:43.350376 7f4bf83a7880 -1 *** Caught signal (Aborted) **
in thread 7f4bf83a7880

ceph version 0.94 (e61c4f093f88e44961d157f65091733580cea79a)
1: ceph-osd() [0xac51c2]
2: (()+0xf130) [0x7f4bf6d3e130]
3: (gsignal()+0x37) [0x7f4bf57585d7]
4: (abort()+0x148) [0x7f4bf5759cc8]
5: (__gnu_cxx::__verbose_terminate_handler()+0x165) [0x7f4bf605c9b5]
6: (()+0x5e926) [0x7f4bf605a926]
7: (()+0x5e953) [0x7f4bf605a953]
8: (()+0x5eb73) [0x7f4bf605ab73]
9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x27a) [0xbc538a]
10: (OSDService::get_map(unsigned int)+0x3f) [0x6ff77f]
11: (OSD::load_pgs()+0x17c9) [0x6b7479]
12: (OSD::init()+0x729) [0x6b8b99]
13: (main()+0x27f3) [0x643b63]
14: (__libc_start_main()+0xf5) [0x7f4bf5744af5]
15: ceph-osd() [0x65cdc9]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- begin dump of recent events ---
0> 2015-04-11 20:59:43.350376 7f4bf83a7880 -1 *** Caught signal (Aborted) **
in thread 7f4bf83a7880

ceph version 0.94 (e61c4f093f88e44961d157f65091733580cea79a)
1: ceph-osd() [0xac51c2]
2: (()+0xf130) [0x7f4bf6d3e130]
3: (gsignal()+0x37) [0x7f4bf57585d7]
4: (abort()+0x148) [0x7f4bf5759cc8]
5: (__gnu_cxx::__verbose_terminate_handler()+0x165) [0x7f4bf605c9b5]
6: (()+0x5e926) [0x7f4bf605a926]
7: (()+0x5e953) [0x7f4bf605a953]
8: (()+0x5eb73) [0x7f4bf605ab73]
9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x27a) [0xbc538a]
10: (OSDService::get_map(unsigned int)+0x3f) [0x6ff77f]
11: (OSD::load_pgs()+0x17c9) [0x6b7479]
12: (OSD::init()+0x729) [0x6b8b99]
13: (main()+0x27f3) [0x643b63]
14: (__libc_start_main()+0xf5) [0x7f4bf5744af5]
15: ceph-osd() [0x65cdc9]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 rbd_replay
0/ 5 journaler
0/ 5 objectcacher
0/ 5 client
0/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 keyvaluestore
1/ 3 journal
0/ 5 ms
1/ 5 mon
0/10 monc
1/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 5 heartbeatmap
1/ 5 perfcounter
1/ 5 rgw
1/10 civetweb
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
0/ 0 refs
1/ 5 xio
-2/-2 (syslog threshold)
99/99 (stderr threshold)
max_recent 10000
max_new 1000
log_file
--- end dump of recent events ---
    (1-1/1)