2013-10-29 16:11:33.435390 7f9e0cbe1780 0 ceph version 0.67.4 (ad85b8bfafea6232d64cb7ba76a8b6e8252fa0c7), process ceph-osd, pid 12810 2013-10-29 16:11:33.478556 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) limited size xattrs -- filestore_xattr_use_omap already enabled 2013-10-29 16:11:33.495165 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount FIEMAP ioctl is supported and appears to work 2013-10-29 16:11:33.495178 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option 2013-10-29 16:11:33.495395 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount did NOT detect btrfs 2013-10-29 16:11:33.497324 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount syscall(SYS_syncfs, fd) fully supported 2013-10-29 16:11:33.497529 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount found snaps <> 2013-10-29 16:11:33.500996 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount: enabling WRITEAHEAD journal mode: btrfs not detected 2013-10-29 16:11:33.511387 7f9e0cbe1780 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2013-10-29 16:11:33.511401 7f9e0cbe1780 1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 19: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0 2013-10-29 16:11:33.513704 7f9e0cbe1780 1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 19: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0 2013-10-29 16:11:33.514566 7f9e0cbe1780 1 journal close /var/lib/ceph/osd/ceph-6/journal 2013-10-29 16:11:33.579959 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) limited size xattrs -- filestore_xattr_use_omap already enabled 2013-10-29 16:11:33.630704 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount FIEMAP ioctl is supported and appears to work 2013-10-29 16:11:33.630716 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option 2013-10-29 16:11:33.630943 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount did NOT detect btrfs 2013-10-29 16:11:33.634664 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount syscall(SYS_syncfs, fd) fully supported 2013-10-29 16:11:33.634722 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount found snaps <> 2013-10-29 16:11:33.637314 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount: enabling WRITEAHEAD journal mode: btrfs not detected 2013-10-29 16:11:33.642122 7f9e0cbe1780 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2013-10-29 16:11:33.642134 7f9e0cbe1780 1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 19: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0 2013-10-29 16:11:33.645481 7f9e0cbe1780 1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 19: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0 2013-10-29 16:11:33.656195 7f9e0cbe1780 -1 osd/OSD.h: In function 'OSDMapRef OSDService::get_map(epoch_t)' thread 7f9e0cbe1780 time 2013-10-29 16:11:33.655368 osd/OSD.h: 447: FAILED assert(ret) ceph version 0.67.4 (ad85b8bfafea6232d64cb7ba76a8b6e8252fa0c7) 1: (OSD::load_pgs()+0x26fb) [0x69aefb] 2: (OSD::init()+0x122f) [0x69ca1f] 3: (main()+0x3210) [0x5af750] 4: (__libc_start_main()+0xfd) [0x3772a1ecdd] 5: /usr/bin/ceph-osd() [0x5ac189] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- begin dump of recent events --- -382> 2013-10-29 16:11:33.432558 7f9e0cbe1780 5 asok(0x18401c0) register_command perfcounters_dump hook 0x17f0010 -381> 2013-10-29 16:11:33.432615 7f9e0cbe1780 5 asok(0x18401c0) register_command 1 hook 0x17f0010 -380> 2013-10-29 16:11:33.432622 7f9e0cbe1780 5 asok(0x18401c0) register_command perf dump hook 0x17f0010 -379> 2013-10-29 16:11:33.432632 7f9e0cbe1780 5 asok(0x18401c0) register_command perfcounters_schema hook 0x17f0010 -378> 2013-10-29 16:11:33.432640 7f9e0cbe1780 5 asok(0x18401c0) register_command 2 hook 0x17f0010 -377> 2013-10-29 16:11:33.432643 7f9e0cbe1780 5 asok(0x18401c0) register_command perf schema hook 0x17f0010 -376> 2013-10-29 16:11:33.432650 7f9e0cbe1780 5 asok(0x18401c0) register_command config show hook 0x17f0010 -375> 2013-10-29 16:11:33.432657 7f9e0cbe1780 5 asok(0x18401c0) register_command config set hook 0x17f0010 -374> 2013-10-29 16:11:33.432663 7f9e0cbe1780 5 asok(0x18401c0) register_command config get hook 0x17f0010 -373> 2013-10-29 16:11:33.432669 7f9e0cbe1780 5 asok(0x18401c0) register_command log flush hook 0x17f0010 -372> 2013-10-29 16:11:33.432675 7f9e0cbe1780 5 asok(0x18401c0) register_command log dump hook 0x17f0010 -371> 2013-10-29 16:11:33.432682 7f9e0cbe1780 5 asok(0x18401c0) register_command log reopen hook 0x17f0010 -370> 2013-10-29 16:11:33.435390 7f9e0cbe1780 0 ceph version 0.67.4 (ad85b8bfafea6232d64cb7ba76a8b6e8252fa0c7), process ceph-osd, pid 12810 -369> 2013-10-29 16:11:33.436120 7f9e0cbe1780 1 -- [2400:7d00:110:2:225:b5ff:fe00:4f]:0/0 learned my addr [2400:7d00:110:2:225:b5ff:fe00:4f]:0/0 -368> 2013-10-29 16:11:33.436140 7f9e0cbe1780 1 accepter.accepter.bind my_inst.addr is [2400:7d00:110:2:225:b5ff:fe00:4f]:6800/12810 need_addr=0 -367> 2013-10-29 16:11:33.436167 7f9e0cbe1780 1 -- [2400:7d00:110:2:225:b5ff:fe00:4f]:0/0 learned my addr [2400:7d00:110:2:225:b5ff:fe00:4f]:0/0 -366> 2013-10-29 16:11:33.436178 7f9e0cbe1780 1 accepter.accepter.bind my_inst.addr is [2400:7d00:110:2:225:b5ff:fe00:4f]:6801/12810 need_addr=0 -365> 2013-10-29 16:11:33.436201 7f9e0cbe1780 1 -- [2400:7d00:110:2:225:b5ff:fe00:4f]:0/0 learned my addr [2400:7d00:110:2:225:b5ff:fe00:4f]:0/0 -364> 2013-10-29 16:11:33.436213 7f9e0cbe1780 1 accepter.accepter.bind my_inst.addr is [2400:7d00:110:2:225:b5ff:fe00:4f]:6802/12810 need_addr=0 -363> 2013-10-29 16:11:33.436233 7f9e0cbe1780 1 -- [2400:7d00:110:2:225:b5ff:fe00:4f]:0/0 learned my addr [2400:7d00:110:2:225:b5ff:fe00:4f]:0/0 -362> 2013-10-29 16:11:33.436245 7f9e0cbe1780 1 accepter.accepter.bind my_inst.addr is [2400:7d00:110:2:225:b5ff:fe00:4f]:6803/12810 need_addr=0 -361> 2013-10-29 16:11:33.436906 7f9e0cbe1780 1 finished global_init_daemonize -360> 2013-10-29 16:11:33.441119 7f9e0cbe1780 5 asok(0x18401c0) init /var/run/ceph/ceph-osd.6.asok -359> 2013-10-29 16:11:33.441152 7f9e0cbe1780 5 asok(0x18401c0) bind_and_listen /var/run/ceph/ceph-osd.6.asok -358> 2013-10-29 16:11:33.445156 7f9e0cbe1780 5 asok(0x18401c0) register_command 0 hook 0x17e80b8 -357> 2013-10-29 16:11:33.445227 7f9e0cbe1780 5 asok(0x18401c0) register_command version hook 0x17e80b8 -356> 2013-10-29 16:11:33.445232 7f9e0cbe1780 5 asok(0x18401c0) register_command git_version hook 0x17e80b8 -355> 2013-10-29 16:11:33.445237 7f9e0cbe1780 5 asok(0x18401c0) register_command help hook 0x17f00d0 -354> 2013-10-29 16:11:33.445241 7f9e0cbe1780 5 asok(0x18401c0) register_command get_command_descriptions hook 0x17f00c0 -353> 2013-10-29 16:11:33.445320 7f9e0b0a0700 5 asok(0x18401c0) entry start -352> 2013-10-29 16:11:33.478556 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) limited size xattrs -- filestore_xattr_use_omap already enabled -351> 2013-10-29 16:11:33.495165 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount FIEMAP ioctl is supported and appears to work -350> 2013-10-29 16:11:33.495178 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option -349> 2013-10-29 16:11:33.495395 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount did NOT detect btrfs -348> 2013-10-29 16:11:33.497324 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount syscall(SYS_syncfs, fd) fully supported -347> 2013-10-29 16:11:33.497529 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount found snaps <> -346> 2013-10-29 16:11:33.500996 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount: enabling WRITEAHEAD journal mode: btrfs not detected -345> 2013-10-29 16:11:33.511363 7f9e0cbe1780 2 journal open /var/lib/ceph/osd/ceph-6/journal fsid 29a27b41-490c-46c8-9f70-4a005e26c630 fs_op_seq 356420650 -344> 2013-10-29 16:11:33.511387 7f9e0cbe1780 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway -343> 2013-10-29 16:11:33.511401 7f9e0cbe1780 1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 19: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0 -342> 2013-10-29 16:11:33.511444 7f9e0cbe1780 2 journal read_entry 692121600 : seq 356420500 9836 bytes -341> 2013-10-29 16:11:33.511464 7f9e0cbe1780 2 journal read_entry 692129792 : seq 356420501 5740 bytes -340> 2013-10-29 16:11:33.511481 7f9e0cbe1780 2 journal read_entry 692137984 : seq 356420502 5775 bytes -339> 2013-10-29 16:11:33.511936 7f9e0cbe1780 2 journal read_entry 692518912 : seq 356420503 378779 bytes -338> 2013-10-29 16:11:33.511951 7f9e0cbe1780 2 journal read_entry 692523008 : seq 356420504 1095 bytes -337> 2013-10-29 16:11:33.511956 7f9e0cbe1780 2 journal read_entry 692527104 : seq 356420505 1095 bytes -336> 2013-10-29 16:11:33.511961 7f9e0cbe1780 2 journal read_entry 692531200 : seq 356420506 1094 bytes -335> 2013-10-29 16:11:33.511965 7f9e0cbe1780 2 journal read_entry 692535296 : seq 356420507 1094 bytes -334> 2013-10-29 16:11:33.511970 7f9e0cbe1780 2 journal read_entry 692539392 : seq 356420508 1094 bytes -333> 2013-10-29 16:11:33.511975 7f9e0cbe1780 2 journal read_entry 692543488 : seq 356420509 1102 bytes -332> 2013-10-29 16:11:33.511979 7f9e0cbe1780 2 journal read_entry 692547584 : seq 356420510 96 bytes -331> 2013-10-29 16:11:33.511983 7f9e0cbe1780 2 journal read_entry 692551680 : seq 356420511 101 bytes -330> 2013-10-29 16:11:33.511990 7f9e0cbe1780 2 journal read_entry 692555776 : seq 356420512 479 bytes -329> 2013-10-29 16:11:33.511998 7f9e0cbe1780 2 journal read_entry 692559872 : seq 356420513 58 bytes -328> 2013-10-29 16:11:33.512004 7f9e0cbe1780 2 journal read_entry 692563968 : seq 356420514 58 bytes -327> 2013-10-29 16:11:33.512011 7f9e0cbe1780 2 journal read_entry 692568064 : seq 356420515 58 bytes -326> 2013-10-29 16:11:33.512016 7f9e0cbe1780 2 journal read_entry 692572160 : seq 356420516 58 bytes -325> 2013-10-29 16:11:33.512021 7f9e0cbe1780 2 journal read_entry 692576256 : seq 356420517 58 bytes -324> 2013-10-29 16:11:33.512025 7f9e0cbe1780 2 journal read_entry 692580352 : seq 356420518 58 bytes -323> 2013-10-29 16:11:33.512029 7f9e0cbe1780 2 journal read_entry 692584448 : seq 356420519 58 bytes -322> 2013-10-29 16:11:33.512033 7f9e0cbe1780 2 journal read_entry 692588544 : seq 356420520 58 bytes -321> 2013-10-29 16:11:33.512037 7f9e0cbe1780 2 journal read_entry 692592640 : seq 356420521 58 bytes -320> 2013-10-29 16:11:33.512040 7f9e0cbe1780 2 journal read_entry 692596736 : seq 356420522 58 bytes -319> 2013-10-29 16:11:33.512044 7f9e0cbe1780 2 journal read_entry 692600832 : seq 356420523 58 bytes -318> 2013-10-29 16:11:33.512048 7f9e0cbe1780 2 journal read_entry 692604928 : seq 356420524 58 bytes -317> 2013-10-29 16:11:33.512057 7f9e0cbe1780 2 journal read_entry 692609024 : seq 356420525 58 bytes -316> 2013-10-29 16:11:33.512061 7f9e0cbe1780 2 journal read_entry 692613120 : seq 356420526 58 bytes -315> 2013-10-29 16:11:33.512065 7f9e0cbe1780 2 journal read_entry 692617216 : seq 356420527 58 bytes -314> 2013-10-29 16:11:33.512069 7f9e0cbe1780 2 journal read_entry 692621312 : seq 356420528 58 bytes -313> 2013-10-29 16:11:33.512073 7f9e0cbe1780 2 journal read_entry 692625408 : seq 356420529 58 bytes -312> 2013-10-29 16:11:33.512079 7f9e0cbe1780 2 journal read_entry 692629504 : seq 356420530 58 bytes -311> 2013-10-29 16:11:33.512084 7f9e0cbe1780 2 journal read_entry 692633600 : seq 356420531 56 bytes -310> 2013-10-29 16:11:33.512090 7f9e0cbe1780 2 journal read_entry 692637696 : seq 356420532 58 bytes -309> 2013-10-29 16:11:33.512095 7f9e0cbe1780 2 journal read_entry 692641792 : seq 356420533 58 bytes -308> 2013-10-29 16:11:33.512101 7f9e0cbe1780 2 journal read_entry 692645888 : seq 356420534 57 bytes -307> 2013-10-29 16:11:33.512106 7f9e0cbe1780 2 journal read_entry 692649984 : seq 356420535 58 bytes -306> 2013-10-29 16:11:33.512111 7f9e0cbe1780 2 journal read_entry 692654080 : seq 356420536 58 bytes -305> 2013-10-29 16:11:33.512115 7f9e0cbe1780 2 journal read_entry 692658176 : seq 356420537 58 bytes -304> 2013-10-29 16:11:33.512131 7f9e0cbe1780 2 journal read_entry 692662272 : seq 356420538 58 bytes -303> 2013-10-29 16:11:33.512135 7f9e0cbe1780 2 journal read_entry 692666368 : seq 356420539 58 bytes -302> 2013-10-29 16:11:33.512140 7f9e0cbe1780 2 journal read_entry 692670464 : seq 356420540 58 bytes -301> 2013-10-29 16:11:33.512145 7f9e0cbe1780 2 journal read_entry 692674560 : seq 356420541 58 bytes -300> 2013-10-29 16:11:33.512151 7f9e0cbe1780 2 journal read_entry 692678656 : seq 356420542 58 bytes -299> 2013-10-29 16:11:33.512156 7f9e0cbe1780 2 journal read_entry 692682752 : seq 356420543 58 bytes -298> 2013-10-29 16:11:33.512161 7f9e0cbe1780 2 journal read_entry 692686848 : seq 356420544 58 bytes -297> 2013-10-29 16:11:33.512165 7f9e0cbe1780 2 journal read_entry 692690944 : seq 356420545 58 bytes -296> 2013-10-29 16:11:33.512170 7f9e0cbe1780 2 journal read_entry 692695040 : seq 356420546 58 bytes -295> 2013-10-29 16:11:33.512174 7f9e0cbe1780 2 journal read_entry 692699136 : seq 356420547 57 bytes -294> 2013-10-29 16:11:33.512180 7f9e0cbe1780 2 journal read_entry 692703232 : seq 356420548 58 bytes -293> 2013-10-29 16:11:33.512185 7f9e0cbe1780 2 journal read_entry 692707328 : seq 356420549 58 bytes -292> 2013-10-29 16:11:33.512190 7f9e0cbe1780 2 journal read_entry 692711424 : seq 356420550 58 bytes -291> 2013-10-29 16:11:33.512194 7f9e0cbe1780 2 journal read_entry 692715520 : seq 356420551 58 bytes -290> 2013-10-29 16:11:33.512201 7f9e0cbe1780 2 journal read_entry 692719616 : seq 356420552 58 bytes -289> 2013-10-29 16:11:33.512205 7f9e0cbe1780 2 journal read_entry 692723712 : seq 356420553 58 bytes -288> 2013-10-29 16:11:33.512209 7f9e0cbe1780 2 journal read_entry 692727808 : seq 356420554 58 bytes -287> 2013-10-29 16:11:33.512213 7f9e0cbe1780 2 journal read_entry 692731904 : seq 356420555 58 bytes -286> 2013-10-29 16:11:33.512218 7f9e0cbe1780 2 journal read_entry 692736000 : seq 356420556 58 bytes -285> 2013-10-29 16:11:33.512223 7f9e0cbe1780 2 journal read_entry 692740096 : seq 356420557 58 bytes -284> 2013-10-29 16:11:33.512228 7f9e0cbe1780 2 journal read_entry 692744192 : seq 356420558 57 bytes -283> 2013-10-29 16:11:33.512234 7f9e0cbe1780 2 journal read_entry 692748288 : seq 356420559 58 bytes -282> 2013-10-29 16:11:33.512239 7f9e0cbe1780 2 journal read_entry 692752384 : seq 356420560 58 bytes -281> 2013-10-29 16:11:33.512244 7f9e0cbe1780 2 journal read_entry 692756480 : seq 356420561 58 bytes -280> 2013-10-29 16:11:33.512249 7f9e0cbe1780 2 journal read_entry 692760576 : seq 356420562 58 bytes -279> 2013-10-29 16:11:33.512254 7f9e0cbe1780 2 journal read_entry 692764672 : seq 356420563 58 bytes -278> 2013-10-29 16:11:33.512260 7f9e0cbe1780 2 journal read_entry 692768768 : seq 356420564 58 bytes -277> 2013-10-29 16:11:33.512265 7f9e0cbe1780 2 journal read_entry 692772864 : seq 356420565 58 bytes -276> 2013-10-29 16:11:33.512270 7f9e0cbe1780 2 journal read_entry 692776960 : seq 356420566 58 bytes -275> 2013-10-29 16:11:33.512279 7f9e0cbe1780 2 journal read_entry 692781056 : seq 356420567 58 bytes -274> 2013-10-29 16:11:33.512283 7f9e0cbe1780 2 journal read_entry 692785152 : seq 356420568 58 bytes -273> 2013-10-29 16:11:33.512287 7f9e0cbe1780 2 journal read_entry 692789248 : seq 356420569 58 bytes -272> 2013-10-29 16:11:33.512291 7f9e0cbe1780 2 journal read_entry 692793344 : seq 356420570 58 bytes -271> 2013-10-29 16:11:33.512296 7f9e0cbe1780 2 journal read_entry 692797440 : seq 356420571 58 bytes -270> 2013-10-29 16:11:33.512301 7f9e0cbe1780 2 journal read_entry 692801536 : seq 356420572 58 bytes -269> 2013-10-29 16:11:33.512306 7f9e0cbe1780 2 journal read_entry 692805632 : seq 356420573 58 bytes -268> 2013-10-29 16:11:33.512312 7f9e0cbe1780 2 journal read_entry 692809728 : seq 356420574 58 bytes -267> 2013-10-29 16:11:33.512317 7f9e0cbe1780 2 journal read_entry 692813824 : seq 356420575 58 bytes -266> 2013-10-29 16:11:33.512322 7f9e0cbe1780 2 journal read_entry 692817920 : seq 356420576 58 bytes -265> 2013-10-29 16:11:33.512327 7f9e0cbe1780 2 journal read_entry 692822016 : seq 356420577 57 bytes -264> 2013-10-29 16:11:33.512332 7f9e0cbe1780 2 journal read_entry 692826112 : seq 356420578 57 bytes -263> 2013-10-29 16:11:33.512338 7f9e0cbe1780 2 journal read_entry 692830208 : seq 356420579 57 bytes -262> 2013-10-29 16:11:33.512343 7f9e0cbe1780 2 journal read_entry 692834304 : seq 356420580 58 bytes -261> 2013-10-29 16:11:33.512348 7f9e0cbe1780 2 journal read_entry 692838400 : seq 356420581 58 bytes -260> 2013-10-29 16:11:33.512353 7f9e0cbe1780 2 journal read_entry 692842496 : seq 356420582 58 bytes -259> 2013-10-29 16:11:33.512363 7f9e0cbe1780 2 journal read_entry 692846592 : seq 356420583 58 bytes -258> 2013-10-29 16:11:33.512367 7f9e0cbe1780 2 journal read_entry 692850688 : seq 356420584 58 bytes -257> 2013-10-29 16:11:33.512371 7f9e0cbe1780 2 journal read_entry 692854784 : seq 356420585 57 bytes -256> 2013-10-29 16:11:33.512376 7f9e0cbe1780 2 journal read_entry 692858880 : seq 356420586 58 bytes -255> 2013-10-29 16:11:33.512381 7f9e0cbe1780 2 journal read_entry 692862976 : seq 356420587 58 bytes -254> 2013-10-29 16:11:33.512386 7f9e0cbe1780 2 journal read_entry 692867072 : seq 356420588 58 bytes -253> 2013-10-29 16:11:33.512392 7f9e0cbe1780 2 journal read_entry 692871168 : seq 356420589 58 bytes -252> 2013-10-29 16:11:33.512397 7f9e0cbe1780 2 journal read_entry 692875264 : seq 356420590 58 bytes -251> 2013-10-29 16:11:33.512402 7f9e0cbe1780 2 journal read_entry 692879360 : seq 356420591 58 bytes -250> 2013-10-29 16:11:33.512407 7f9e0cbe1780 2 journal read_entry 692883456 : seq 356420592 58 bytes -249> 2013-10-29 16:11:33.512412 7f9e0cbe1780 2 journal read_entry 692887552 : seq 356420593 58 bytes -248> 2013-10-29 16:11:33.512418 7f9e0cbe1780 2 journal read_entry 692891648 : seq 356420594 58 bytes -247> 2013-10-29 16:11:33.512423 7f9e0cbe1780 2 journal read_entry 692895744 : seq 356420595 57 bytes -246> 2013-10-29 16:11:33.512428 7f9e0cbe1780 2 journal read_entry 692899840 : seq 356420596 58 bytes -245> 2013-10-29 16:11:33.512433 7f9e0cbe1780 2 journal read_entry 692903936 : seq 356420597 58 bytes -244> 2013-10-29 16:11:33.512438 7f9e0cbe1780 2 journal read_entry 692908032 : seq 356420598 58 bytes -243> 2013-10-29 16:11:33.512444 7f9e0cbe1780 2 journal read_entry 692912128 : seq 356420599 56 bytes -242> 2013-10-29 16:11:33.512449 7f9e0cbe1780 2 journal read_entry 692916224 : seq 356420600 58 bytes -241> 2013-10-29 16:11:33.512454 7f9e0cbe1780 2 journal read_entry 692920320 : seq 356420601 58 bytes -240> 2013-10-29 16:11:33.512460 7f9e0cbe1780 2 journal read_entry 692924416 : seq 356420602 57 bytes -239> 2013-10-29 16:11:33.512465 7f9e0cbe1780 2 journal read_entry 692928512 : seq 356420603 58 bytes -238> 2013-10-29 16:11:33.512470 7f9e0cbe1780 2 journal read_entry 692932608 : seq 356420604 58 bytes -237> 2013-10-29 16:11:33.512475 7f9e0cbe1780 2 journal read_entry 692936704 : seq 356420605 58 bytes -236> 2013-10-29 16:11:33.512482 7f9e0cbe1780 2 journal read_entry 692940800 : seq 356420606 58 bytes -235> 2013-10-29 16:11:33.512487 7f9e0cbe1780 2 journal read_entry 692944896 : seq 356420607 58 bytes -234> 2013-10-29 16:11:33.512492 7f9e0cbe1780 2 journal read_entry 692948992 : seq 356420608 58 bytes -233> 2013-10-29 16:11:33.512497 7f9e0cbe1780 2 journal read_entry 692953088 : seq 356420609 58 bytes -232> 2013-10-29 16:11:33.512503 7f9e0cbe1780 2 journal read_entry 692957184 : seq 356420610 58 bytes -231> 2013-10-29 16:11:33.512508 7f9e0cbe1780 2 journal read_entry 692961280 : seq 356420611 58 bytes -230> 2013-10-29 16:11:33.512513 7f9e0cbe1780 2 journal read_entry 692965376 : seq 356420612 58 bytes -229> 2013-10-29 16:11:33.512518 7f9e0cbe1780 2 journal read_entry 692969472 : seq 356420613 58 bytes -228> 2013-10-29 16:11:33.512523 7f9e0cbe1780 2 journal read_entry 692973568 : seq 356420614 58 bytes -227> 2013-10-29 16:11:33.512528 7f9e0cbe1780 2 journal read_entry 692977664 : seq 356420615 58 bytes -226> 2013-10-29 16:11:33.512534 7f9e0cbe1780 2 journal read_entry 692981760 : seq 356420616 58 bytes -225> 2013-10-29 16:11:33.512539 7f9e0cbe1780 2 journal read_entry 692985856 : seq 356420617 58 bytes -224> 2013-10-29 16:11:33.512544 7f9e0cbe1780 2 journal read_entry 692989952 : seq 356420618 58 bytes -223> 2013-10-29 16:11:33.512549 7f9e0cbe1780 2 journal read_entry 692994048 : seq 356420619 58 bytes -222> 2013-10-29 16:11:33.512554 7f9e0cbe1780 2 journal read_entry 692998144 : seq 356420620 58 bytes -221> 2013-10-29 16:11:33.512560 7f9e0cbe1780 2 journal read_entry 693002240 : seq 356420621 58 bytes -220> 2013-10-29 16:11:33.512565 7f9e0cbe1780 2 journal read_entry 693006336 : seq 356420622 58 bytes -219> 2013-10-29 16:11:33.512570 7f9e0cbe1780 2 journal read_entry 693010432 : seq 356420623 58 bytes -218> 2013-10-29 16:11:33.512575 7f9e0cbe1780 2 journal read_entry 693014528 : seq 356420624 58 bytes -217> 2013-10-29 16:11:33.512580 7f9e0cbe1780 2 journal read_entry 693018624 : seq 356420625 58 bytes -216> 2013-10-29 16:11:33.512585 7f9e0cbe1780 2 journal read_entry 693022720 : seq 356420626 58 bytes -215> 2013-10-29 16:11:33.512590 7f9e0cbe1780 2 journal read_entry 693026816 : seq 356420627 58 bytes -214> 2013-10-29 16:11:33.512595 7f9e0cbe1780 2 journal read_entry 693030912 : seq 356420628 58 bytes -213> 2013-10-29 16:11:33.512601 7f9e0cbe1780 2 journal read_entry 693035008 : seq 356420629 58 bytes -212> 2013-10-29 16:11:33.512606 7f9e0cbe1780 2 journal read_entry 693039104 : seq 356420630 58 bytes -211> 2013-10-29 16:11:33.512611 7f9e0cbe1780 2 journal read_entry 693043200 : seq 356420631 58 bytes -210> 2013-10-29 16:11:33.512616 7f9e0cbe1780 2 journal read_entry 693047296 : seq 356420632 58 bytes -209> 2013-10-29 16:11:33.512621 7f9e0cbe1780 2 journal read_entry 693051392 : seq 356420633 58 bytes -208> 2013-10-29 16:11:33.512626 7f9e0cbe1780 2 journal read_entry 693055488 : seq 356420634 58 bytes -207> 2013-10-29 16:11:33.512631 7f9e0cbe1780 2 journal read_entry 693059584 : seq 356420635 58 bytes -206> 2013-10-29 16:11:33.512636 7f9e0cbe1780 2 journal read_entry 693063680 : seq 356420636 58 bytes -205> 2013-10-29 16:11:33.512641 7f9e0cbe1780 2 journal read_entry 693067776 : seq 356420637 58 bytes -204> 2013-10-29 16:11:33.512646 7f9e0cbe1780 2 journal read_entry 693071872 : seq 356420638 58 bytes -203> 2013-10-29 16:11:33.512652 7f9e0cbe1780 2 journal read_entry 693075968 : seq 356420639 58 bytes -202> 2013-10-29 16:11:33.512657 7f9e0cbe1780 2 journal read_entry 693080064 : seq 356420640 57 bytes -201> 2013-10-29 16:11:33.512662 7f9e0cbe1780 2 journal read_entry 693084160 : seq 356420641 57 bytes -200> 2013-10-29 16:11:33.512667 7f9e0cbe1780 2 journal read_entry 693088256 : seq 356420642 58 bytes -199> 2013-10-29 16:11:33.512672 7f9e0cbe1780 2 journal read_entry 693092352 : seq 356420643 58 bytes -198> 2013-10-29 16:11:33.512677 7f9e0cbe1780 2 journal read_entry 693096448 : seq 356420644 58 bytes -197> 2013-10-29 16:11:33.512682 7f9e0cbe1780 2 journal read_entry 693100544 : seq 356420645 58 bytes -196> 2013-10-29 16:11:33.512688 7f9e0cbe1780 2 journal read_entry 693104640 : seq 356420646 57 bytes -195> 2013-10-29 16:11:33.512693 7f9e0cbe1780 2 journal read_entry 693108736 : seq 356420647 58 bytes -194> 2013-10-29 16:11:33.512698 7f9e0cbe1780 2 journal read_entry 693112832 : seq 356420648 58 bytes -193> 2013-10-29 16:11:33.512703 7f9e0cbe1780 2 journal read_entry 693116928 : seq 356420649 58 bytes -192> 2013-10-29 16:11:33.512709 7f9e0cbe1780 2 journal read_entry 693121024 : seq 356420650 957 bytes -191> 2013-10-29 16:11:33.513319 7f9e0cbe1780 2 journal read_entry 693780480 : seq 356394430 652898 bytes -190> 2013-10-29 16:11:33.513680 7f9e0cbe1780 2 journal read_entry 693780480 : seq 356394430 652898 bytes -189> 2013-10-29 16:11:33.513685 7f9e0cbe1780 3 journal journal_replay: end of journal, done. -188> 2013-10-29 16:11:33.513704 7f9e0cbe1780 1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 19: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0 -187> 2013-10-29 16:11:33.514180 7f9e070bc700 1 FileStore::op_tp worker finish -186> 2013-10-29 16:11:33.514205 7f9e066bb700 1 FileStore::op_tp worker finish -185> 2013-10-29 16:11:33.514566 7f9e0cbe1780 1 journal close /var/lib/ceph/osd/ceph-6/journal -184> 2013-10-29 16:11:33.515230 7f9e0cbe1780 10 monclient(hunting): build_initial_monmap -183> 2013-10-29 16:11:33.515327 7f9e0cbe1780 5 adding auth protocol: none -182> 2013-10-29 16:11:33.515336 7f9e0cbe1780 5 adding auth protocol: none -181> 2013-10-29 16:11:33.515531 7f9e0cbe1780 1 -- [2400:7d00:110:2:225:b5ff:fe00:4f]:6800/12810 messenger.start -180> 2013-10-29 16:11:33.515553 7f9e0cbe1780 1 -- :/0 messenger.start -179> 2013-10-29 16:11:33.515565 7f9e0cbe1780 1 -- [2400:7d00:110:2:225:b5ff:fe00:4f]:6803/12810 messenger.start -178> 2013-10-29 16:11:33.515585 7f9e0cbe1780 1 -- [2400:7d00:110:2:225:b5ff:fe00:4f]:6802/12810 messenger.start -177> 2013-10-29 16:11:33.515610 7f9e0cbe1780 1 -- [2400:7d00:110:2:225:b5ff:fe00:4f]:6801/12810 messenger.start -176> 2013-10-29 16:11:33.515682 7f9e0cbe1780 2 osd.6 0 mounting /var/lib/ceph/osd/ceph-6 /var/lib/ceph/osd/ceph-6/journal -175> 2013-10-29 16:11:33.579959 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) limited size xattrs -- filestore_xattr_use_omap already enabled -174> 2013-10-29 16:11:33.630704 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount FIEMAP ioctl is supported and appears to work -173> 2013-10-29 16:11:33.630716 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option -172> 2013-10-29 16:11:33.630943 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount did NOT detect btrfs -171> 2013-10-29 16:11:33.634664 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount syscall(SYS_syncfs, fd) fully supported -170> 2013-10-29 16:11:33.634722 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount found snaps <> -169> 2013-10-29 16:11:33.637314 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount: enabling WRITEAHEAD journal mode: btrfs not detected -168> 2013-10-29 16:11:33.642098 7f9e0cbe1780 2 journal open /var/lib/ceph/osd/ceph-6/journal fsid 29a27b41-490c-46c8-9f70-4a005e26c630 fs_op_seq 356420650 -167> 2013-10-29 16:11:33.642122 7f9e0cbe1780 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway -166> 2013-10-29 16:11:33.642134 7f9e0cbe1780 1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 19: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0 -165> 2013-10-29 16:11:33.642168 7f9e0cbe1780 2 journal read_entry 692121600 : seq 356420500 9836 bytes -164> 2013-10-29 16:11:33.642183 7f9e0cbe1780 2 journal read_entry 692129792 : seq 356420501 5740 bytes -163> 2013-10-29 16:11:33.642195 7f9e0cbe1780 2 journal read_entry 692137984 : seq 356420502 5775 bytes -162> 2013-10-29 16:11:33.642594 7f9e0cbe1780 2 journal read_entry 692518912 : seq 356420503 378779 bytes -161> 2013-10-29 16:11:33.642614 7f9e0cbe1780 2 journal read_entry 692523008 : seq 356420504 1095 bytes -160> 2013-10-29 16:11:33.642622 7f9e0cbe1780 2 journal read_entry 692527104 : seq 356420505 1095 bytes -159> 2013-10-29 16:11:33.642630 7f9e0cbe1780 2 journal read_entry 692531200 : seq 356420506 1094 bytes -158> 2013-10-29 16:11:33.642637 7f9e0cbe1780 2 journal read_entry 692535296 : seq 356420507 1094 bytes -157> 2013-10-29 16:11:33.642645 7f9e0cbe1780 2 journal read_entry 692539392 : seq 356420508 1094 bytes -156> 2013-10-29 16:11:33.642652 7f9e0cbe1780 2 journal read_entry 692543488 : seq 356420509 1102 bytes -155> 2013-10-29 16:11:33.642659 7f9e0cbe1780 2 journal read_entry 692547584 : seq 356420510 96 bytes -154> 2013-10-29 16:11:33.642667 7f9e0cbe1780 2 journal read_entry 692551680 : seq 356420511 101 bytes -153> 2013-10-29 16:11:33.642674 7f9e0cbe1780 2 journal read_entry 692555776 : seq 356420512 479 bytes -152> 2013-10-29 16:11:33.642682 7f9e0cbe1780 2 journal read_entry 692559872 : seq 356420513 58 bytes -151> 2013-10-29 16:11:33.642691 7f9e0cbe1780 2 journal read_entry 692563968 : seq 356420514 58 bytes -150> 2013-10-29 16:11:33.642700 7f9e0cbe1780 2 journal read_entry 692568064 : seq 356420515 58 bytes -149> 2013-10-29 16:11:33.642709 7f9e0cbe1780 2 journal read_entry 692572160 : seq 356420516 58 bytes -148> 2013-10-29 16:11:33.642717 7f9e0cbe1780 2 journal read_entry 692576256 : seq 356420517 58 bytes -147> 2013-10-29 16:11:33.642726 7f9e0cbe1780 2 journal read_entry 692580352 : seq 356420518 58 bytes -146> 2013-10-29 16:11:33.642735 7f9e0cbe1780 2 journal read_entry 692584448 : seq 356420519 58 bytes -145> 2013-10-29 16:11:33.642744 7f9e0cbe1780 2 journal read_entry 692588544 : seq 356420520 58 bytes -144> 2013-10-29 16:11:33.642752 7f9e0cbe1780 2 journal read_entry 692592640 : seq 356420521 58 bytes -143> 2013-10-29 16:11:33.642761 7f9e0cbe1780 2 journal read_entry 692596736 : seq 356420522 58 bytes -142> 2013-10-29 16:11:33.642770 7f9e0cbe1780 2 journal read_entry 692600832 : seq 356420523 58 bytes -141> 2013-10-29 16:11:33.642779 7f9e0cbe1780 2 journal read_entry 692604928 : seq 356420524 58 bytes -140> 2013-10-29 16:11:33.642787 7f9e0cbe1780 2 journal read_entry 692609024 : seq 356420525 58 bytes -139> 2013-10-29 16:11:33.642796 7f9e0cbe1780 2 journal read_entry 692613120 : seq 356420526 58 bytes -138> 2013-10-29 16:11:33.642872 7f9e0cbe1780 2 journal read_entry 692617216 : seq 356420527 58 bytes -137> 2013-10-29 16:11:33.642879 7f9e0cbe1780 2 journal read_entry 692621312 : seq 356420528 58 bytes -136> 2013-10-29 16:11:33.642886 7f9e0cbe1780 2 journal read_entry 692625408 : seq 356420529 58 bytes -135> 2013-10-29 16:11:33.642892 7f9e0cbe1780 2 journal read_entry 692629504 : seq 356420530 58 bytes -134> 2013-10-29 16:11:33.642899 7f9e0cbe1780 2 journal read_entry 692633600 : seq 356420531 56 bytes -133> 2013-10-29 16:11:33.642905 7f9e0cbe1780 2 journal read_entry 692637696 : seq 356420532 58 bytes -132> 2013-10-29 16:11:33.642912 7f9e0cbe1780 2 journal read_entry 692641792 : seq 356420533 58 bytes -131> 2013-10-29 16:11:33.642918 7f9e0cbe1780 2 journal read_entry 692645888 : seq 356420534 57 bytes -130> 2013-10-29 16:11:33.642925 7f9e0cbe1780 2 journal read_entry 692649984 : seq 356420535 58 bytes -129> 2013-10-29 16:11:33.642932 7f9e0cbe1780 2 journal read_entry 692654080 : seq 356420536 58 bytes -128> 2013-10-29 16:11:33.642939 7f9e0cbe1780 2 journal read_entry 692658176 : seq 356420537 58 bytes -127> 2013-10-29 16:11:33.642948 7f9e0cbe1780 2 journal read_entry 692662272 : seq 356420538 58 bytes -126> 2013-10-29 16:11:33.642956 7f9e0cbe1780 2 journal read_entry 692666368 : seq 356420539 58 bytes -125> 2013-10-29 16:11:33.642965 7f9e0cbe1780 2 journal read_entry 692670464 : seq 356420540 58 bytes -124> 2013-10-29 16:11:33.642972 7f9e0cbe1780 2 journal read_entry 692674560 : seq 356420541 58 bytes -123> 2013-10-29 16:11:33.642980 7f9e0cbe1780 2 journal read_entry 692678656 : seq 356420542 58 bytes -122> 2013-10-29 16:11:33.642987 7f9e0cbe1780 2 journal read_entry 692682752 : seq 356420543 58 bytes -121> 2013-10-29 16:11:33.642993 7f9e0cbe1780 2 journal read_entry 692686848 : seq 356420544 58 bytes -120> 2013-10-29 16:11:33.643000 7f9e0cbe1780 2 journal read_entry 692690944 : seq 356420545 58 bytes -119> 2013-10-29 16:11:33.643008 7f9e0cbe1780 2 journal read_entry 692695040 : seq 356420546 58 bytes -118> 2013-10-29 16:11:33.643016 7f9e0cbe1780 2 journal read_entry 692699136 : seq 356420547 57 bytes -117> 2013-10-29 16:11:33.643024 7f9e0cbe1780 2 journal read_entry 692703232 : seq 356420548 58 bytes -116> 2013-10-29 16:11:33.643031 7f9e0cbe1780 2 journal read_entry 692707328 : seq 356420549 58 bytes -115> 2013-10-29 16:11:33.643039 7f9e0cbe1780 2 journal read_entry 692711424 : seq 356420550 58 bytes -114> 2013-10-29 16:11:33.643048 7f9e0cbe1780 2 journal read_entry 692715520 : seq 356420551 58 bytes -113> 2013-10-29 16:11:33.643057 7f9e0cbe1780 2 journal read_entry 692719616 : seq 356420552 58 bytes -112> 2013-10-29 16:11:33.643065 7f9e0cbe1780 2 journal read_entry 692723712 : seq 356420553 58 bytes -111> 2013-10-29 16:11:33.643072 7f9e0cbe1780 2 journal read_entry 692727808 : seq 356420554 58 bytes -110> 2013-10-29 16:11:33.643081 7f9e0cbe1780 2 journal read_entry 692731904 : seq 356420555 58 bytes -109> 2013-10-29 16:11:33.643089 7f9e0cbe1780 2 journal read_entry 692736000 : seq 356420556 58 bytes -108> 2013-10-29 16:11:33.643098 7f9e0cbe1780 2 journal read_entry 692740096 : seq 356420557 58 bytes -107> 2013-10-29 16:11:33.643106 7f9e0cbe1780 2 journal read_entry 692744192 : seq 356420558 57 bytes -106> 2013-10-29 16:11:33.643115 7f9e0cbe1780 2 journal read_entry 692748288 : seq 356420559 58 bytes -105> 2013-10-29 16:11:33.643124 7f9e0cbe1780 2 journal read_entry 692752384 : seq 356420560 58 bytes -104> 2013-10-29 16:11:33.643133 7f9e0cbe1780 2 journal read_entry 692756480 : seq 356420561 58 bytes -103> 2013-10-29 16:11:33.643141 7f9e0cbe1780 2 journal read_entry 692760576 : seq 356420562 58 bytes -102> 2013-10-29 16:11:33.643150 7f9e0cbe1780 2 journal read_entry 692764672 : seq 356420563 58 bytes -101> 2013-10-29 16:11:33.643158 7f9e0cbe1780 2 journal read_entry 692768768 : seq 356420564 58 bytes -100> 2013-10-29 16:11:33.643167 7f9e0cbe1780 2 journal read_entry 692772864 : seq 356420565 58 bytes -99> 2013-10-29 16:11:33.643176 7f9e0cbe1780 2 journal read_entry 692776960 : seq 356420566 58 bytes -98> 2013-10-29 16:11:33.643184 7f9e0cbe1780 2 journal read_entry 692781056 : seq 356420567 58 bytes -97> 2013-10-29 16:11:33.643193 7f9e0cbe1780 2 journal read_entry 692785152 : seq 356420568 58 bytes -96> 2013-10-29 16:11:33.643201 7f9e0cbe1780 2 journal read_entry 692789248 : seq 356420569 58 bytes -95> 2013-10-29 16:11:33.643210 7f9e0cbe1780 2 journal read_entry 692793344 : seq 356420570 58 bytes -94> 2013-10-29 16:11:33.643218 7f9e0cbe1780 2 journal read_entry 692797440 : seq 356420571 58 bytes -93> 2013-10-29 16:11:33.643226 7f9e0cbe1780 2 journal read_entry 692801536 : seq 356420572 58 bytes -92> 2013-10-29 16:11:33.643235 7f9e0cbe1780 2 journal read_entry 692805632 : seq 356420573 58 bytes -91> 2013-10-29 16:11:33.643244 7f9e0cbe1780 2 journal read_entry 692809728 : seq 356420574 58 bytes -90> 2013-10-29 16:11:33.643252 7f9e0cbe1780 2 journal read_entry 692813824 : seq 356420575 58 bytes -89> 2013-10-29 16:11:33.643261 7f9e0cbe1780 2 journal read_entry 692817920 : seq 356420576 58 bytes -88> 2013-10-29 16:11:33.643269 7f9e0cbe1780 2 journal read_entry 692822016 : seq 356420577 57 bytes -87> 2013-10-29 16:11:33.643278 7f9e0cbe1780 2 journal read_entry 692826112 : seq 356420578 57 bytes -86> 2013-10-29 16:11:33.643286 7f9e0cbe1780 2 journal read_entry 692830208 : seq 356420579 57 bytes -85> 2013-10-29 16:11:33.643295 7f9e0cbe1780 2 journal read_entry 692834304 : seq 356420580 58 bytes -84> 2013-10-29 16:11:33.643304 7f9e0cbe1780 2 journal read_entry 692838400 : seq 356420581 58 bytes -83> 2013-10-29 16:11:33.643312 7f9e0cbe1780 2 journal read_entry 692842496 : seq 356420582 58 bytes -82> 2013-10-29 16:11:33.643321 7f9e0cbe1780 2 journal read_entry 692846592 : seq 356420583 58 bytes -81> 2013-10-29 16:11:33.643329 7f9e0cbe1780 2 journal read_entry 692850688 : seq 356420584 58 bytes -80> 2013-10-29 16:11:33.643338 7f9e0cbe1780 2 journal read_entry 692854784 : seq 356420585 57 bytes -79> 2013-10-29 16:11:33.643349 7f9e0cbe1780 2 journal read_entry 692858880 : seq 356420586 58 bytes -78> 2013-10-29 16:11:33.643358 7f9e0cbe1780 2 journal read_entry 692862976 : seq 356420587 58 bytes -77> 2013-10-29 16:11:33.643366 7f9e0cbe1780 2 journal read_entry 692867072 : seq 356420588 58 bytes -76> 2013-10-29 16:11:33.643375 7f9e0cbe1780 2 journal read_entry 692871168 : seq 356420589 58 bytes -75> 2013-10-29 16:11:33.643383 7f9e0cbe1780 2 journal read_entry 692875264 : seq 356420590 58 bytes -74> 2013-10-29 16:11:33.643392 7f9e0cbe1780 2 journal read_entry 692879360 : seq 356420591 58 bytes -73> 2013-10-29 16:11:33.643401 7f9e0cbe1780 2 journal read_entry 692883456 : seq 356420592 58 bytes -72> 2013-10-29 16:11:33.643409 7f9e0cbe1780 2 journal read_entry 692887552 : seq 356420593 58 bytes -71> 2013-10-29 16:11:33.643418 7f9e0cbe1780 2 journal read_entry 692891648 : seq 356420594 58 bytes -70> 2013-10-29 16:11:33.643426 7f9e0cbe1780 2 journal read_entry 692895744 : seq 356420595 57 bytes -69> 2013-10-29 16:11:33.643435 7f9e0cbe1780 2 journal read_entry 692899840 : seq 356420596 58 bytes -68> 2013-10-29 16:11:33.643443 7f9e0cbe1780 2 journal read_entry 692903936 : seq 356420597 58 bytes -67> 2013-10-29 16:11:33.643452 7f9e0cbe1780 2 journal read_entry 692908032 : seq 356420598 58 bytes -66> 2013-10-29 16:11:33.643460 7f9e0cbe1780 2 journal read_entry 692912128 : seq 356420599 56 bytes -65> 2013-10-29 16:11:33.643469 7f9e0cbe1780 2 journal read_entry 692916224 : seq 356420600 58 bytes -64> 2013-10-29 16:11:33.643477 7f9e0cbe1780 2 journal read_entry 692920320 : seq 356420601 58 bytes -63> 2013-10-29 16:11:33.643486 7f9e0cbe1780 2 journal read_entry 692924416 : seq 356420602 57 bytes -62> 2013-10-29 16:11:33.643494 7f9e0cbe1780 2 journal read_entry 692928512 : seq 356420603 58 bytes -61> 2013-10-29 16:11:33.643503 7f9e0cbe1780 2 journal read_entry 692932608 : seq 356420604 58 bytes -60> 2013-10-29 16:11:33.643511 7f9e0cbe1780 2 journal read_entry 692936704 : seq 356420605 58 bytes -59> 2013-10-29 16:11:33.643520 7f9e0cbe1780 2 journal read_entry 692940800 : seq 356420606 58 bytes -58> 2013-10-29 16:11:33.643528 7f9e0cbe1780 2 journal read_entry 692944896 : seq 356420607 58 bytes -57> 2013-10-29 16:11:33.643537 7f9e0cbe1780 2 journal read_entry 692948992 : seq 356420608 58 bytes -56> 2013-10-29 16:11:33.643546 7f9e0cbe1780 2 journal read_entry 692953088 : seq 356420609 58 bytes -55> 2013-10-29 16:11:33.643558 7f9e0cbe1780 2 journal read_entry 692957184 : seq 356420610 58 bytes -54> 2013-10-29 16:11:33.643571 7f9e0cbe1780 2 journal read_entry 692961280 : seq 356420611 58 bytes -53> 2013-10-29 16:11:33.643580 7f9e0cbe1780 2 journal read_entry 692965376 : seq 356420612 58 bytes -52> 2013-10-29 16:11:33.643590 7f9e0cbe1780 2 journal read_entry 692969472 : seq 356420613 58 bytes -51> 2013-10-29 16:11:33.643599 7f9e0cbe1780 2 journal read_entry 692973568 : seq 356420614 58 bytes -50> 2013-10-29 16:11:33.643607 7f9e0cbe1780 2 journal read_entry 692977664 : seq 356420615 58 bytes -49> 2013-10-29 16:11:33.643616 7f9e0cbe1780 2 journal read_entry 692981760 : seq 356420616 58 bytes -48> 2013-10-29 16:11:33.643624 7f9e0cbe1780 2 journal read_entry 692985856 : seq 356420617 58 bytes -47> 2013-10-29 16:11:33.643633 7f9e0cbe1780 2 journal read_entry 692989952 : seq 356420618 58 bytes -46> 2013-10-29 16:11:33.643640 7f9e0cbe1780 2 journal read_entry 692994048 : seq 356420619 58 bytes -45> 2013-10-29 16:11:33.643646 7f9e0cbe1780 2 journal read_entry 692998144 : seq 356420620 58 bytes -44> 2013-10-29 16:11:33.643653 7f9e0cbe1780 2 journal read_entry 693002240 : seq 356420621 58 bytes -43> 2013-10-29 16:11:33.643665 7f9e0cbe1780 2 journal read_entry 693006336 : seq 356420622 58 bytes -42> 2013-10-29 16:11:33.643681 7f9e0cbe1780 2 journal read_entry 693010432 : seq 356420623 58 bytes -41> 2013-10-29 16:11:33.643695 7f9e0cbe1780 2 journal read_entry 693014528 : seq 356420624 58 bytes -40> 2013-10-29 16:11:33.643709 7f9e0cbe1780 2 journal read_entry 693018624 : seq 356420625 58 bytes -39> 2013-10-29 16:11:33.643723 7f9e0cbe1780 2 journal read_entry 693022720 : seq 356420626 58 bytes -38> 2013-10-29 16:11:33.643737 7f9e0cbe1780 2 journal read_entry 693026816 : seq 356420627 58 bytes -37> 2013-10-29 16:11:33.643751 7f9e0cbe1780 2 journal read_entry 693030912 : seq 356420628 58 bytes -36> 2013-10-29 16:11:33.643765 7f9e0cbe1780 2 journal read_entry 693035008 : seq 356420629 58 bytes -35> 2013-10-29 16:11:33.643779 7f9e0cbe1780 2 journal read_entry 693039104 : seq 356420630 58 bytes -34> 2013-10-29 16:11:33.643793 7f9e0cbe1780 2 journal read_entry 693043200 : seq 356420631 58 bytes -33> 2013-10-29 16:11:33.643813 7f9e0cbe1780 2 journal read_entry 693047296 : seq 356420632 58 bytes -32> 2013-10-29 16:11:33.643827 7f9e0cbe1780 2 journal read_entry 693051392 : seq 356420633 58 bytes -31> 2013-10-29 16:11:33.643841 7f9e0cbe1780 2 journal read_entry 693055488 : seq 356420634 58 bytes -30> 2013-10-29 16:11:33.643855 7f9e0cbe1780 2 journal read_entry 693059584 : seq 356420635 58 bytes -29> 2013-10-29 16:11:33.643868 7f9e0cbe1780 2 journal read_entry 693063680 : seq 356420636 58 bytes -28> 2013-10-29 16:11:33.643882 7f9e0cbe1780 2 journal read_entry 693067776 : seq 356420637 58 bytes -27> 2013-10-29 16:11:33.643896 7f9e0cbe1780 2 journal read_entry 693071872 : seq 356420638 58 bytes -26> 2013-10-29 16:11:33.643910 7f9e0cbe1780 2 journal read_entry 693075968 : seq 356420639 58 bytes -25> 2013-10-29 16:11:33.643924 7f9e0cbe1780 2 journal read_entry 693080064 : seq 356420640 57 bytes -24> 2013-10-29 16:11:33.643939 7f9e0cbe1780 2 journal read_entry 693084160 : seq 356420641 57 bytes -23> 2013-10-29 16:11:33.643953 7f9e0cbe1780 2 journal read_entry 693088256 : seq 356420642 58 bytes -22> 2013-10-29 16:11:33.643967 7f9e0cbe1780 2 journal read_entry 693092352 : seq 356420643 58 bytes -21> 2013-10-29 16:11:33.643981 7f9e0cbe1780 2 journal read_entry 693096448 : seq 356420644 58 bytes -20> 2013-10-29 16:11:33.643995 7f9e0cbe1780 2 journal read_entry 693100544 : seq 356420645 58 bytes -19> 2013-10-29 16:11:33.644009 7f9e0cbe1780 2 journal read_entry 693104640 : seq 356420646 57 bytes -18> 2013-10-29 16:11:33.644022 7f9e0cbe1780 2 journal read_entry 693108736 : seq 356420647 58 bytes -17> 2013-10-29 16:11:33.644036 7f9e0cbe1780 2 journal read_entry 693112832 : seq 356420648 58 bytes -16> 2013-10-29 16:11:33.644050 7f9e0cbe1780 2 journal read_entry 693116928 : seq 356420649 58 bytes -15> 2013-10-29 16:11:33.644065 7f9e0cbe1780 2 journal read_entry 693121024 : seq 356420650 957 bytes -14> 2013-10-29 16:11:33.644727 7f9e0cbe1780 2 journal read_entry 693780480 : seq 356394430 652898 bytes -13> 2013-10-29 16:11:33.645437 7f9e0cbe1780 2 journal read_entry 693780480 : seq 356394430 652898 bytes -12> 2013-10-29 16:11:33.645447 7f9e0cbe1780 3 journal journal_replay: end of journal, done. -11> 2013-10-29 16:11:33.645481 7f9e0cbe1780 1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 19: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0 -10> 2013-10-29 16:11:33.645795 7f9e0cbe1780 2 osd.6 0 boot -9> 2013-10-29 16:11:33.646572 7f9e0cbe1780 1 cls/log/cls_log.cc:313: Loaded log class! -8> 2013-10-29 16:11:33.646766 7f9e0cbe1780 1 cls/replica_log/cls_replica_log.cc:141: Loaded replica log class! -7> 2013-10-29 16:11:33.647415 7f9e0cbe1780 1 cls/version/cls_version.cc:227: Loaded version class! -6> 2013-10-29 16:11:33.651423 7f9e0cbe1780 1 cls/refcount/cls_refcount.cc:231: Loaded refcount class! -5> 2013-10-29 16:11:33.651548 7f9e0cbe1780 1 cls/statelog/cls_statelog.cc:306: Loaded log class! -4> 2013-10-29 16:11:33.653624 7f9e0cbe1780 1 cls/rgw/cls_rgw.cc:1596: Loaded rgw class! -3> 2013-10-29 16:11:33.655029 7f9e0cbe1780 5 osd.6 pg_epoch: 4944 pg[0.6(unlocked)] enter Initial -2> 2013-10-29 16:11:33.655257 7f9e0cbe1780 5 osd.6 pg_epoch: 4944 pg[0.6( empty local-les=4823 n=0 ec=1 les/c 4823/4841 4819/4819/1484) [6,12] r=0 lpr=0 mlcod 0'0 inactive] exit Initial 0.000229 0 0.000000 -1> 2013-10-29 16:11:33.655287 7f9e0cbe1780 5 osd.6 pg_epoch: 4944 pg[0.6( empty local-les=4823 n=0 ec=1 les/c 4823/4841 4819/4819/1484) [6,12] r=0 lpr=0 mlcod 0'0 inactive] enter Reset 0> 2013-10-29 16:11:33.656195 7f9e0cbe1780 -1 osd/OSD.h: In function 'OSDMapRef OSDService::get_map(epoch_t)' thread 7f9e0cbe1780 time 2013-10-29 16:11:33.655368 osd/OSD.h: 447: FAILED assert(ret) ceph version 0.67.4 (ad85b8bfafea6232d64cb7ba76a8b6e8252fa0c7) 1: (OSD::load_pgs()+0x26fb) [0x69aefb] 2: (OSD::init()+0x122f) [0x69ca1f] 3: (main()+0x3210) [0x5af750] 4: (__libc_start_main()+0xfd) [0x3772a1ecdd] 5: /usr/bin/ceph-osd() [0x5ac189] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 0/ 5 osd 0/ 5 optracker 0/ 5 objclass 1/ 3 filestore 1/ 3 journal 0/ 5 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/ 5 hadoop 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle -2/-2 (syslog threshold) -1/-1 (stderr threshold) max_recent 10000 max_new 1000 log_file /var/log/ceph/ceph-osd.6.log --- end dump of recent events --- 2013-10-29 16:11:33.659731 7f9e0cbe1780 -1 *** Caught signal (Aborted) ** in thread 7f9e0cbe1780 ceph version 0.67.4 (ad85b8bfafea6232d64cb7ba76a8b6e8252fa0c7) 1: /usr/bin/ceph-osd() [0x80a589] 2: /lib64/libpthread.so.0() [0x377320f500] 3: (gsignal()+0x35) [0x3772a328a5] 4: (abort()+0x175) [0x3772a34085] 5: (__gnu_cxx::__verbose_terminate_handler()+0x12d) [0x37762bea5d] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- begin dump of recent events --- 0> 2013-10-29 16:11:33.659731 7f9e0cbe1780 -1 *** Caught signal (Aborted) ** in thread 7f9e0cbe1780 ceph version 0.67.4 (ad85b8bfafea6232d64cb7ba76a8b6e8252fa0c7) 1: /usr/bin/ceph-osd() [0x80a589] 2: /lib64/libpthread.so.0() [0x377320f500] 3: (gsignal()+0x35) [0x3772a328a5] 4: (abort()+0x175) [0x3772a34085] 5: (__gnu_cxx::__verbose_terminate_handler()+0x12d) [0x37762bea5d] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 0/ 5 osd 0/ 5 optracker 0/ 5 objclass 1/ 3 filestore 1/ 3 journal 0/ 5 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/ 5 hadoop 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle -2/-2 (syslog threshold) -1/-1 (stderr threshold) max_recent 10000 max_new 1000 log_file /var/log/ceph/ceph-osd.6.log --- end dump of recent events ---