Project

General

Profile

Bug #6671 » ceph-osd.6.log

log from OSD - Tom Lanyon, 10/28/2013 11:16 PM

 
2013-10-29 16:11:33.435390 7f9e0cbe1780 0 ceph version 0.67.4 (ad85b8bfafea6232d64cb7ba76a8b6e8252fa0c7), process ceph-osd, pid 12810
2013-10-29 16:11:33.478556 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) limited size xattrs -- filestore_xattr_use_omap already enabled
2013-10-29 16:11:33.495165 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount FIEMAP ioctl is supported and appears to work
2013-10-29 16:11:33.495178 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option
2013-10-29 16:11:33.495395 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount did NOT detect btrfs
2013-10-29 16:11:33.497324 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount syscall(SYS_syncfs, fd) fully supported
2013-10-29 16:11:33.497529 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount found snaps <>
2013-10-29 16:11:33.500996 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount: enabling WRITEAHEAD journal mode: btrfs not detected
2013-10-29 16:11:33.511387 7f9e0cbe1780 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
2013-10-29 16:11:33.511401 7f9e0cbe1780 1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 19: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0
2013-10-29 16:11:33.513704 7f9e0cbe1780 1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 19: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0
2013-10-29 16:11:33.514566 7f9e0cbe1780 1 journal close /var/lib/ceph/osd/ceph-6/journal
2013-10-29 16:11:33.579959 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) limited size xattrs -- filestore_xattr_use_omap already enabled
2013-10-29 16:11:33.630704 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount FIEMAP ioctl is supported and appears to work
2013-10-29 16:11:33.630716 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option
2013-10-29 16:11:33.630943 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount did NOT detect btrfs
2013-10-29 16:11:33.634664 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount syscall(SYS_syncfs, fd) fully supported
2013-10-29 16:11:33.634722 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount found snaps <>
2013-10-29 16:11:33.637314 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount: enabling WRITEAHEAD journal mode: btrfs not detected
2013-10-29 16:11:33.642122 7f9e0cbe1780 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
2013-10-29 16:11:33.642134 7f9e0cbe1780 1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 19: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0
2013-10-29 16:11:33.645481 7f9e0cbe1780 1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 19: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0
2013-10-29 16:11:33.656195 7f9e0cbe1780 -1 osd/OSD.h: In function 'OSDMapRef OSDService::get_map(epoch_t)' thread 7f9e0cbe1780 time 2013-10-29 16:11:33.655368
osd/OSD.h: 447: FAILED assert(ret)

ceph version 0.67.4 (ad85b8bfafea6232d64cb7ba76a8b6e8252fa0c7)
1: (OSD::load_pgs()+0x26fb) [0x69aefb]
2: (OSD::init()+0x122f) [0x69ca1f]
3: (main()+0x3210) [0x5af750]
4: (__libc_start_main()+0xfd) [0x3772a1ecdd]
5: /usr/bin/ceph-osd() [0x5ac189]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- begin dump of recent events ---
-382> 2013-10-29 16:11:33.432558 7f9e0cbe1780 5 asok(0x18401c0) register_command perfcounters_dump hook 0x17f0010
-381> 2013-10-29 16:11:33.432615 7f9e0cbe1780 5 asok(0x18401c0) register_command 1 hook 0x17f0010
-380> 2013-10-29 16:11:33.432622 7f9e0cbe1780 5 asok(0x18401c0) register_command perf dump hook 0x17f0010
-379> 2013-10-29 16:11:33.432632 7f9e0cbe1780 5 asok(0x18401c0) register_command perfcounters_schema hook 0x17f0010
-378> 2013-10-29 16:11:33.432640 7f9e0cbe1780 5 asok(0x18401c0) register_command 2 hook 0x17f0010
-377> 2013-10-29 16:11:33.432643 7f9e0cbe1780 5 asok(0x18401c0) register_command perf schema hook 0x17f0010
-376> 2013-10-29 16:11:33.432650 7f9e0cbe1780 5 asok(0x18401c0) register_command config show hook 0x17f0010
-375> 2013-10-29 16:11:33.432657 7f9e0cbe1780 5 asok(0x18401c0) register_command config set hook 0x17f0010
-374> 2013-10-29 16:11:33.432663 7f9e0cbe1780 5 asok(0x18401c0) register_command config get hook 0x17f0010
-373> 2013-10-29 16:11:33.432669 7f9e0cbe1780 5 asok(0x18401c0) register_command log flush hook 0x17f0010
-372> 2013-10-29 16:11:33.432675 7f9e0cbe1780 5 asok(0x18401c0) register_command log dump hook 0x17f0010
-371> 2013-10-29 16:11:33.432682 7f9e0cbe1780 5 asok(0x18401c0) register_command log reopen hook 0x17f0010
-370> 2013-10-29 16:11:33.435390 7f9e0cbe1780 0 ceph version 0.67.4 (ad85b8bfafea6232d64cb7ba76a8b6e8252fa0c7), process ceph-osd, pid 12810
-369> 2013-10-29 16:11:33.436120 7f9e0cbe1780 1 -- [2400:7d00:110:2:225:b5ff:fe00:4f]:0/0 learned my addr [2400:7d00:110:2:225:b5ff:fe00:4f]:0/0
-368> 2013-10-29 16:11:33.436140 7f9e0cbe1780 1 accepter.accepter.bind my_inst.addr is [2400:7d00:110:2:225:b5ff:fe00:4f]:6800/12810 need_addr=0
-367> 2013-10-29 16:11:33.436167 7f9e0cbe1780 1 -- [2400:7d00:110:2:225:b5ff:fe00:4f]:0/0 learned my addr [2400:7d00:110:2:225:b5ff:fe00:4f]:0/0
-366> 2013-10-29 16:11:33.436178 7f9e0cbe1780 1 accepter.accepter.bind my_inst.addr is [2400:7d00:110:2:225:b5ff:fe00:4f]:6801/12810 need_addr=0
-365> 2013-10-29 16:11:33.436201 7f9e0cbe1780 1 -- [2400:7d00:110:2:225:b5ff:fe00:4f]:0/0 learned my addr [2400:7d00:110:2:225:b5ff:fe00:4f]:0/0
-364> 2013-10-29 16:11:33.436213 7f9e0cbe1780 1 accepter.accepter.bind my_inst.addr is [2400:7d00:110:2:225:b5ff:fe00:4f]:6802/12810 need_addr=0
-363> 2013-10-29 16:11:33.436233 7f9e0cbe1780 1 -- [2400:7d00:110:2:225:b5ff:fe00:4f]:0/0 learned my addr [2400:7d00:110:2:225:b5ff:fe00:4f]:0/0
-362> 2013-10-29 16:11:33.436245 7f9e0cbe1780 1 accepter.accepter.bind my_inst.addr is [2400:7d00:110:2:225:b5ff:fe00:4f]:6803/12810 need_addr=0
-361> 2013-10-29 16:11:33.436906 7f9e0cbe1780 1 finished global_init_daemonize
-360> 2013-10-29 16:11:33.441119 7f9e0cbe1780 5 asok(0x18401c0) init /var/run/ceph/ceph-osd.6.asok
-359> 2013-10-29 16:11:33.441152 7f9e0cbe1780 5 asok(0x18401c0) bind_and_listen /var/run/ceph/ceph-osd.6.asok
-358> 2013-10-29 16:11:33.445156 7f9e0cbe1780 5 asok(0x18401c0) register_command 0 hook 0x17e80b8
-357> 2013-10-29 16:11:33.445227 7f9e0cbe1780 5 asok(0x18401c0) register_command version hook 0x17e80b8
-356> 2013-10-29 16:11:33.445232 7f9e0cbe1780 5 asok(0x18401c0) register_command git_version hook 0x17e80b8
-355> 2013-10-29 16:11:33.445237 7f9e0cbe1780 5 asok(0x18401c0) register_command help hook 0x17f00d0
-354> 2013-10-29 16:11:33.445241 7f9e0cbe1780 5 asok(0x18401c0) register_command get_command_descriptions hook 0x17f00c0
-353> 2013-10-29 16:11:33.445320 7f9e0b0a0700 5 asok(0x18401c0) entry start
-352> 2013-10-29 16:11:33.478556 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) limited size xattrs -- filestore_xattr_use_omap already enabled
-351> 2013-10-29 16:11:33.495165 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount FIEMAP ioctl is supported and appears to work
-350> 2013-10-29 16:11:33.495178 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option
-349> 2013-10-29 16:11:33.495395 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount did NOT detect btrfs
-348> 2013-10-29 16:11:33.497324 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount syscall(SYS_syncfs, fd) fully supported
-347> 2013-10-29 16:11:33.497529 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount found snaps <>
-346> 2013-10-29 16:11:33.500996 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount: enabling WRITEAHEAD journal mode: btrfs not detected
-345> 2013-10-29 16:11:33.511363 7f9e0cbe1780 2 journal open /var/lib/ceph/osd/ceph-6/journal fsid 29a27b41-490c-46c8-9f70-4a005e26c630 fs_op_seq 356420650
-344> 2013-10-29 16:11:33.511387 7f9e0cbe1780 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
-343> 2013-10-29 16:11:33.511401 7f9e0cbe1780 1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 19: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0
-342> 2013-10-29 16:11:33.511444 7f9e0cbe1780 2 journal read_entry 692121600 : seq 356420500 9836 bytes
-341> 2013-10-29 16:11:33.511464 7f9e0cbe1780 2 journal read_entry 692129792 : seq 356420501 5740 bytes
-340> 2013-10-29 16:11:33.511481 7f9e0cbe1780 2 journal read_entry 692137984 : seq 356420502 5775 bytes
-339> 2013-10-29 16:11:33.511936 7f9e0cbe1780 2 journal read_entry 692518912 : seq 356420503 378779 bytes
-338> 2013-10-29 16:11:33.511951 7f9e0cbe1780 2 journal read_entry 692523008 : seq 356420504 1095 bytes
-337> 2013-10-29 16:11:33.511956 7f9e0cbe1780 2 journal read_entry 692527104 : seq 356420505 1095 bytes
-336> 2013-10-29 16:11:33.511961 7f9e0cbe1780 2 journal read_entry 692531200 : seq 356420506 1094 bytes
-335> 2013-10-29 16:11:33.511965 7f9e0cbe1780 2 journal read_entry 692535296 : seq 356420507 1094 bytes
-334> 2013-10-29 16:11:33.511970 7f9e0cbe1780 2 journal read_entry 692539392 : seq 356420508 1094 bytes
-333> 2013-10-29 16:11:33.511975 7f9e0cbe1780 2 journal read_entry 692543488 : seq 356420509 1102 bytes
-332> 2013-10-29 16:11:33.511979 7f9e0cbe1780 2 journal read_entry 692547584 : seq 356420510 96 bytes
-331> 2013-10-29 16:11:33.511983 7f9e0cbe1780 2 journal read_entry 692551680 : seq 356420511 101 bytes
-330> 2013-10-29 16:11:33.511990 7f9e0cbe1780 2 journal read_entry 692555776 : seq 356420512 479 bytes
-329> 2013-10-29 16:11:33.511998 7f9e0cbe1780 2 journal read_entry 692559872 : seq 356420513 58 bytes
-328> 2013-10-29 16:11:33.512004 7f9e0cbe1780 2 journal read_entry 692563968 : seq 356420514 58 bytes
-327> 2013-10-29 16:11:33.512011 7f9e0cbe1780 2 journal read_entry 692568064 : seq 356420515 58 bytes
-326> 2013-10-29 16:11:33.512016 7f9e0cbe1780 2 journal read_entry 692572160 : seq 356420516 58 bytes
-325> 2013-10-29 16:11:33.512021 7f9e0cbe1780 2 journal read_entry 692576256 : seq 356420517 58 bytes
-324> 2013-10-29 16:11:33.512025 7f9e0cbe1780 2 journal read_entry 692580352 : seq 356420518 58 bytes
-323> 2013-10-29 16:11:33.512029 7f9e0cbe1780 2 journal read_entry 692584448 : seq 356420519 58 bytes
-322> 2013-10-29 16:11:33.512033 7f9e0cbe1780 2 journal read_entry 692588544 : seq 356420520 58 bytes
-321> 2013-10-29 16:11:33.512037 7f9e0cbe1780 2 journal read_entry 692592640 : seq 356420521 58 bytes
-320> 2013-10-29 16:11:33.512040 7f9e0cbe1780 2 journal read_entry 692596736 : seq 356420522 58 bytes
-319> 2013-10-29 16:11:33.512044 7f9e0cbe1780 2 journal read_entry 692600832 : seq 356420523 58 bytes
-318> 2013-10-29 16:11:33.512048 7f9e0cbe1780 2 journal read_entry 692604928 : seq 356420524 58 bytes
-317> 2013-10-29 16:11:33.512057 7f9e0cbe1780 2 journal read_entry 692609024 : seq 356420525 58 bytes
-316> 2013-10-29 16:11:33.512061 7f9e0cbe1780 2 journal read_entry 692613120 : seq 356420526 58 bytes
-315> 2013-10-29 16:11:33.512065 7f9e0cbe1780 2 journal read_entry 692617216 : seq 356420527 58 bytes
-314> 2013-10-29 16:11:33.512069 7f9e0cbe1780 2 journal read_entry 692621312 : seq 356420528 58 bytes
-313> 2013-10-29 16:11:33.512073 7f9e0cbe1780 2 journal read_entry 692625408 : seq 356420529 58 bytes
-312> 2013-10-29 16:11:33.512079 7f9e0cbe1780 2 journal read_entry 692629504 : seq 356420530 58 bytes
-311> 2013-10-29 16:11:33.512084 7f9e0cbe1780 2 journal read_entry 692633600 : seq 356420531 56 bytes
-310> 2013-10-29 16:11:33.512090 7f9e0cbe1780 2 journal read_entry 692637696 : seq 356420532 58 bytes
-309> 2013-10-29 16:11:33.512095 7f9e0cbe1780 2 journal read_entry 692641792 : seq 356420533 58 bytes
-308> 2013-10-29 16:11:33.512101 7f9e0cbe1780 2 journal read_entry 692645888 : seq 356420534 57 bytes
-307> 2013-10-29 16:11:33.512106 7f9e0cbe1780 2 journal read_entry 692649984 : seq 356420535 58 bytes
-306> 2013-10-29 16:11:33.512111 7f9e0cbe1780 2 journal read_entry 692654080 : seq 356420536 58 bytes
-305> 2013-10-29 16:11:33.512115 7f9e0cbe1780 2 journal read_entry 692658176 : seq 356420537 58 bytes
-304> 2013-10-29 16:11:33.512131 7f9e0cbe1780 2 journal read_entry 692662272 : seq 356420538 58 bytes
-303> 2013-10-29 16:11:33.512135 7f9e0cbe1780 2 journal read_entry 692666368 : seq 356420539 58 bytes
-302> 2013-10-29 16:11:33.512140 7f9e0cbe1780 2 journal read_entry 692670464 : seq 356420540 58 bytes
-301> 2013-10-29 16:11:33.512145 7f9e0cbe1780 2 journal read_entry 692674560 : seq 356420541 58 bytes
-300> 2013-10-29 16:11:33.512151 7f9e0cbe1780 2 journal read_entry 692678656 : seq 356420542 58 bytes
-299> 2013-10-29 16:11:33.512156 7f9e0cbe1780 2 journal read_entry 692682752 : seq 356420543 58 bytes
-298> 2013-10-29 16:11:33.512161 7f9e0cbe1780 2 journal read_entry 692686848 : seq 356420544 58 bytes
-297> 2013-10-29 16:11:33.512165 7f9e0cbe1780 2 journal read_entry 692690944 : seq 356420545 58 bytes
-296> 2013-10-29 16:11:33.512170 7f9e0cbe1780 2 journal read_entry 692695040 : seq 356420546 58 bytes
-295> 2013-10-29 16:11:33.512174 7f9e0cbe1780 2 journal read_entry 692699136 : seq 356420547 57 bytes
-294> 2013-10-29 16:11:33.512180 7f9e0cbe1780 2 journal read_entry 692703232 : seq 356420548 58 bytes
-293> 2013-10-29 16:11:33.512185 7f9e0cbe1780 2 journal read_entry 692707328 : seq 356420549 58 bytes
-292> 2013-10-29 16:11:33.512190 7f9e0cbe1780 2 journal read_entry 692711424 : seq 356420550 58 bytes
-291> 2013-10-29 16:11:33.512194 7f9e0cbe1780 2 journal read_entry 692715520 : seq 356420551 58 bytes
-290> 2013-10-29 16:11:33.512201 7f9e0cbe1780 2 journal read_entry 692719616 : seq 356420552 58 bytes
-289> 2013-10-29 16:11:33.512205 7f9e0cbe1780 2 journal read_entry 692723712 : seq 356420553 58 bytes
-288> 2013-10-29 16:11:33.512209 7f9e0cbe1780 2 journal read_entry 692727808 : seq 356420554 58 bytes
-287> 2013-10-29 16:11:33.512213 7f9e0cbe1780 2 journal read_entry 692731904 : seq 356420555 58 bytes
-286> 2013-10-29 16:11:33.512218 7f9e0cbe1780 2 journal read_entry 692736000 : seq 356420556 58 bytes
-285> 2013-10-29 16:11:33.512223 7f9e0cbe1780 2 journal read_entry 692740096 : seq 356420557 58 bytes
-284> 2013-10-29 16:11:33.512228 7f9e0cbe1780 2 journal read_entry 692744192 : seq 356420558 57 bytes
-283> 2013-10-29 16:11:33.512234 7f9e0cbe1780 2 journal read_entry 692748288 : seq 356420559 58 bytes
-282> 2013-10-29 16:11:33.512239 7f9e0cbe1780 2 journal read_entry 692752384 : seq 356420560 58 bytes
-281> 2013-10-29 16:11:33.512244 7f9e0cbe1780 2 journal read_entry 692756480 : seq 356420561 58 bytes
-280> 2013-10-29 16:11:33.512249 7f9e0cbe1780 2 journal read_entry 692760576 : seq 356420562 58 bytes
-279> 2013-10-29 16:11:33.512254 7f9e0cbe1780 2 journal read_entry 692764672 : seq 356420563 58 bytes
-278> 2013-10-29 16:11:33.512260 7f9e0cbe1780 2 journal read_entry 692768768 : seq 356420564 58 bytes
-277> 2013-10-29 16:11:33.512265 7f9e0cbe1780 2 journal read_entry 692772864 : seq 356420565 58 bytes
-276> 2013-10-29 16:11:33.512270 7f9e0cbe1780 2 journal read_entry 692776960 : seq 356420566 58 bytes
-275> 2013-10-29 16:11:33.512279 7f9e0cbe1780 2 journal read_entry 692781056 : seq 356420567 58 bytes
-274> 2013-10-29 16:11:33.512283 7f9e0cbe1780 2 journal read_entry 692785152 : seq 356420568 58 bytes
-273> 2013-10-29 16:11:33.512287 7f9e0cbe1780 2 journal read_entry 692789248 : seq 356420569 58 bytes
-272> 2013-10-29 16:11:33.512291 7f9e0cbe1780 2 journal read_entry 692793344 : seq 356420570 58 bytes
-271> 2013-10-29 16:11:33.512296 7f9e0cbe1780 2 journal read_entry 692797440 : seq 356420571 58 bytes
-270> 2013-10-29 16:11:33.512301 7f9e0cbe1780 2 journal read_entry 692801536 : seq 356420572 58 bytes
-269> 2013-10-29 16:11:33.512306 7f9e0cbe1780 2 journal read_entry 692805632 : seq 356420573 58 bytes
-268> 2013-10-29 16:11:33.512312 7f9e0cbe1780 2 journal read_entry 692809728 : seq 356420574 58 bytes
-267> 2013-10-29 16:11:33.512317 7f9e0cbe1780 2 journal read_entry 692813824 : seq 356420575 58 bytes
-266> 2013-10-29 16:11:33.512322 7f9e0cbe1780 2 journal read_entry 692817920 : seq 356420576 58 bytes
-265> 2013-10-29 16:11:33.512327 7f9e0cbe1780 2 journal read_entry 692822016 : seq 356420577 57 bytes
-264> 2013-10-29 16:11:33.512332 7f9e0cbe1780 2 journal read_entry 692826112 : seq 356420578 57 bytes
-263> 2013-10-29 16:11:33.512338 7f9e0cbe1780 2 journal read_entry 692830208 : seq 356420579 57 bytes
-262> 2013-10-29 16:11:33.512343 7f9e0cbe1780 2 journal read_entry 692834304 : seq 356420580 58 bytes
-261> 2013-10-29 16:11:33.512348 7f9e0cbe1780 2 journal read_entry 692838400 : seq 356420581 58 bytes
-260> 2013-10-29 16:11:33.512353 7f9e0cbe1780 2 journal read_entry 692842496 : seq 356420582 58 bytes
-259> 2013-10-29 16:11:33.512363 7f9e0cbe1780 2 journal read_entry 692846592 : seq 356420583 58 bytes
-258> 2013-10-29 16:11:33.512367 7f9e0cbe1780 2 journal read_entry 692850688 : seq 356420584 58 bytes
-257> 2013-10-29 16:11:33.512371 7f9e0cbe1780 2 journal read_entry 692854784 : seq 356420585 57 bytes
-256> 2013-10-29 16:11:33.512376 7f9e0cbe1780 2 journal read_entry 692858880 : seq 356420586 58 bytes
-255> 2013-10-29 16:11:33.512381 7f9e0cbe1780 2 journal read_entry 692862976 : seq 356420587 58 bytes
-254> 2013-10-29 16:11:33.512386 7f9e0cbe1780 2 journal read_entry 692867072 : seq 356420588 58 bytes
-253> 2013-10-29 16:11:33.512392 7f9e0cbe1780 2 journal read_entry 692871168 : seq 356420589 58 bytes
-252> 2013-10-29 16:11:33.512397 7f9e0cbe1780 2 journal read_entry 692875264 : seq 356420590 58 bytes
-251> 2013-10-29 16:11:33.512402 7f9e0cbe1780 2 journal read_entry 692879360 : seq 356420591 58 bytes
-250> 2013-10-29 16:11:33.512407 7f9e0cbe1780 2 journal read_entry 692883456 : seq 356420592 58 bytes
-249> 2013-10-29 16:11:33.512412 7f9e0cbe1780 2 journal read_entry 692887552 : seq 356420593 58 bytes
-248> 2013-10-29 16:11:33.512418 7f9e0cbe1780 2 journal read_entry 692891648 : seq 356420594 58 bytes
-247> 2013-10-29 16:11:33.512423 7f9e0cbe1780 2 journal read_entry 692895744 : seq 356420595 57 bytes
-246> 2013-10-29 16:11:33.512428 7f9e0cbe1780 2 journal read_entry 692899840 : seq 356420596 58 bytes
-245> 2013-10-29 16:11:33.512433 7f9e0cbe1780 2 journal read_entry 692903936 : seq 356420597 58 bytes
-244> 2013-10-29 16:11:33.512438 7f9e0cbe1780 2 journal read_entry 692908032 : seq 356420598 58 bytes
-243> 2013-10-29 16:11:33.512444 7f9e0cbe1780 2 journal read_entry 692912128 : seq 356420599 56 bytes
-242> 2013-10-29 16:11:33.512449 7f9e0cbe1780 2 journal read_entry 692916224 : seq 356420600 58 bytes
-241> 2013-10-29 16:11:33.512454 7f9e0cbe1780 2 journal read_entry 692920320 : seq 356420601 58 bytes
-240> 2013-10-29 16:11:33.512460 7f9e0cbe1780 2 journal read_entry 692924416 : seq 356420602 57 bytes
-239> 2013-10-29 16:11:33.512465 7f9e0cbe1780 2 journal read_entry 692928512 : seq 356420603 58 bytes
-238> 2013-10-29 16:11:33.512470 7f9e0cbe1780 2 journal read_entry 692932608 : seq 356420604 58 bytes
-237> 2013-10-29 16:11:33.512475 7f9e0cbe1780 2 journal read_entry 692936704 : seq 356420605 58 bytes
-236> 2013-10-29 16:11:33.512482 7f9e0cbe1780 2 journal read_entry 692940800 : seq 356420606 58 bytes
-235> 2013-10-29 16:11:33.512487 7f9e0cbe1780 2 journal read_entry 692944896 : seq 356420607 58 bytes
-234> 2013-10-29 16:11:33.512492 7f9e0cbe1780 2 journal read_entry 692948992 : seq 356420608 58 bytes
-233> 2013-10-29 16:11:33.512497 7f9e0cbe1780 2 journal read_entry 692953088 : seq 356420609 58 bytes
-232> 2013-10-29 16:11:33.512503 7f9e0cbe1780 2 journal read_entry 692957184 : seq 356420610 58 bytes
-231> 2013-10-29 16:11:33.512508 7f9e0cbe1780 2 journal read_entry 692961280 : seq 356420611 58 bytes
-230> 2013-10-29 16:11:33.512513 7f9e0cbe1780 2 journal read_entry 692965376 : seq 356420612 58 bytes
-229> 2013-10-29 16:11:33.512518 7f9e0cbe1780 2 journal read_entry 692969472 : seq 356420613 58 bytes
-228> 2013-10-29 16:11:33.512523 7f9e0cbe1780 2 journal read_entry 692973568 : seq 356420614 58 bytes
-227> 2013-10-29 16:11:33.512528 7f9e0cbe1780 2 journal read_entry 692977664 : seq 356420615 58 bytes
-226> 2013-10-29 16:11:33.512534 7f9e0cbe1780 2 journal read_entry 692981760 : seq 356420616 58 bytes
-225> 2013-10-29 16:11:33.512539 7f9e0cbe1780 2 journal read_entry 692985856 : seq 356420617 58 bytes
-224> 2013-10-29 16:11:33.512544 7f9e0cbe1780 2 journal read_entry 692989952 : seq 356420618 58 bytes
-223> 2013-10-29 16:11:33.512549 7f9e0cbe1780 2 journal read_entry 692994048 : seq 356420619 58 bytes
-222> 2013-10-29 16:11:33.512554 7f9e0cbe1780 2 journal read_entry 692998144 : seq 356420620 58 bytes
-221> 2013-10-29 16:11:33.512560 7f9e0cbe1780 2 journal read_entry 693002240 : seq 356420621 58 bytes
-220> 2013-10-29 16:11:33.512565 7f9e0cbe1780 2 journal read_entry 693006336 : seq 356420622 58 bytes
-219> 2013-10-29 16:11:33.512570 7f9e0cbe1780 2 journal read_entry 693010432 : seq 356420623 58 bytes
-218> 2013-10-29 16:11:33.512575 7f9e0cbe1780 2 journal read_entry 693014528 : seq 356420624 58 bytes
-217> 2013-10-29 16:11:33.512580 7f9e0cbe1780 2 journal read_entry 693018624 : seq 356420625 58 bytes
-216> 2013-10-29 16:11:33.512585 7f9e0cbe1780 2 journal read_entry 693022720 : seq 356420626 58 bytes
-215> 2013-10-29 16:11:33.512590 7f9e0cbe1780 2 journal read_entry 693026816 : seq 356420627 58 bytes
-214> 2013-10-29 16:11:33.512595 7f9e0cbe1780 2 journal read_entry 693030912 : seq 356420628 58 bytes
-213> 2013-10-29 16:11:33.512601 7f9e0cbe1780 2 journal read_entry 693035008 : seq 356420629 58 bytes
-212> 2013-10-29 16:11:33.512606 7f9e0cbe1780 2 journal read_entry 693039104 : seq 356420630 58 bytes
-211> 2013-10-29 16:11:33.512611 7f9e0cbe1780 2 journal read_entry 693043200 : seq 356420631 58 bytes
-210> 2013-10-29 16:11:33.512616 7f9e0cbe1780 2 journal read_entry 693047296 : seq 356420632 58 bytes
-209> 2013-10-29 16:11:33.512621 7f9e0cbe1780 2 journal read_entry 693051392 : seq 356420633 58 bytes
-208> 2013-10-29 16:11:33.512626 7f9e0cbe1780 2 journal read_entry 693055488 : seq 356420634 58 bytes
-207> 2013-10-29 16:11:33.512631 7f9e0cbe1780 2 journal read_entry 693059584 : seq 356420635 58 bytes
-206> 2013-10-29 16:11:33.512636 7f9e0cbe1780 2 journal read_entry 693063680 : seq 356420636 58 bytes
-205> 2013-10-29 16:11:33.512641 7f9e0cbe1780 2 journal read_entry 693067776 : seq 356420637 58 bytes
-204> 2013-10-29 16:11:33.512646 7f9e0cbe1780 2 journal read_entry 693071872 : seq 356420638 58 bytes
-203> 2013-10-29 16:11:33.512652 7f9e0cbe1780 2 journal read_entry 693075968 : seq 356420639 58 bytes
-202> 2013-10-29 16:11:33.512657 7f9e0cbe1780 2 journal read_entry 693080064 : seq 356420640 57 bytes
-201> 2013-10-29 16:11:33.512662 7f9e0cbe1780 2 journal read_entry 693084160 : seq 356420641 57 bytes
-200> 2013-10-29 16:11:33.512667 7f9e0cbe1780 2 journal read_entry 693088256 : seq 356420642 58 bytes
-199> 2013-10-29 16:11:33.512672 7f9e0cbe1780 2 journal read_entry 693092352 : seq 356420643 58 bytes
-198> 2013-10-29 16:11:33.512677 7f9e0cbe1780 2 journal read_entry 693096448 : seq 356420644 58 bytes
-197> 2013-10-29 16:11:33.512682 7f9e0cbe1780 2 journal read_entry 693100544 : seq 356420645 58 bytes
-196> 2013-10-29 16:11:33.512688 7f9e0cbe1780 2 journal read_entry 693104640 : seq 356420646 57 bytes
-195> 2013-10-29 16:11:33.512693 7f9e0cbe1780 2 journal read_entry 693108736 : seq 356420647 58 bytes
-194> 2013-10-29 16:11:33.512698 7f9e0cbe1780 2 journal read_entry 693112832 : seq 356420648 58 bytes
-193> 2013-10-29 16:11:33.512703 7f9e0cbe1780 2 journal read_entry 693116928 : seq 356420649 58 bytes
-192> 2013-10-29 16:11:33.512709 7f9e0cbe1780 2 journal read_entry 693121024 : seq 356420650 957 bytes
-191> 2013-10-29 16:11:33.513319 7f9e0cbe1780 2 journal read_entry 693780480 : seq 356394430 652898 bytes
-190> 2013-10-29 16:11:33.513680 7f9e0cbe1780 2 journal read_entry 693780480 : seq 356394430 652898 bytes
-189> 2013-10-29 16:11:33.513685 7f9e0cbe1780 3 journal journal_replay: end of journal, done.
-188> 2013-10-29 16:11:33.513704 7f9e0cbe1780 1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 19: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0
-187> 2013-10-29 16:11:33.514180 7f9e070bc700 1 FileStore::op_tp worker finish
-186> 2013-10-29 16:11:33.514205 7f9e066bb700 1 FileStore::op_tp worker finish
-185> 2013-10-29 16:11:33.514566 7f9e0cbe1780 1 journal close /var/lib/ceph/osd/ceph-6/journal
-184> 2013-10-29 16:11:33.515230 7f9e0cbe1780 10 monclient(hunting): build_initial_monmap
-183> 2013-10-29 16:11:33.515327 7f9e0cbe1780 5 adding auth protocol: none
-182> 2013-10-29 16:11:33.515336 7f9e0cbe1780 5 adding auth protocol: none
-181> 2013-10-29 16:11:33.515531 7f9e0cbe1780 1 -- [2400:7d00:110:2:225:b5ff:fe00:4f]:6800/12810 messenger.start
-180> 2013-10-29 16:11:33.515553 7f9e0cbe1780 1 -- :/0 messenger.start
-179> 2013-10-29 16:11:33.515565 7f9e0cbe1780 1 -- [2400:7d00:110:2:225:b5ff:fe00:4f]:6803/12810 messenger.start
-178> 2013-10-29 16:11:33.515585 7f9e0cbe1780 1 -- [2400:7d00:110:2:225:b5ff:fe00:4f]:6802/12810 messenger.start
-177> 2013-10-29 16:11:33.515610 7f9e0cbe1780 1 -- [2400:7d00:110:2:225:b5ff:fe00:4f]:6801/12810 messenger.start
-176> 2013-10-29 16:11:33.515682 7f9e0cbe1780 2 osd.6 0 mounting /var/lib/ceph/osd/ceph-6 /var/lib/ceph/osd/ceph-6/journal
-175> 2013-10-29 16:11:33.579959 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) limited size xattrs -- filestore_xattr_use_omap already enabled
-174> 2013-10-29 16:11:33.630704 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount FIEMAP ioctl is supported and appears to work
-173> 2013-10-29 16:11:33.630716 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option
-172> 2013-10-29 16:11:33.630943 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount did NOT detect btrfs
-171> 2013-10-29 16:11:33.634664 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount syscall(SYS_syncfs, fd) fully supported
-170> 2013-10-29 16:11:33.634722 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount found snaps <>
-169> 2013-10-29 16:11:33.637314 7f9e0cbe1780 0 filestore(/var/lib/ceph/osd/ceph-6) mount: enabling WRITEAHEAD journal mode: btrfs not detected
-168> 2013-10-29 16:11:33.642098 7f9e0cbe1780 2 journal open /var/lib/ceph/osd/ceph-6/journal fsid 29a27b41-490c-46c8-9f70-4a005e26c630 fs_op_seq 356420650
-167> 2013-10-29 16:11:33.642122 7f9e0cbe1780 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway
-166> 2013-10-29 16:11:33.642134 7f9e0cbe1780 1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 19: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0
-165> 2013-10-29 16:11:33.642168 7f9e0cbe1780 2 journal read_entry 692121600 : seq 356420500 9836 bytes
-164> 2013-10-29 16:11:33.642183 7f9e0cbe1780 2 journal read_entry 692129792 : seq 356420501 5740 bytes
-163> 2013-10-29 16:11:33.642195 7f9e0cbe1780 2 journal read_entry 692137984 : seq 356420502 5775 bytes
-162> 2013-10-29 16:11:33.642594 7f9e0cbe1780 2 journal read_entry 692518912 : seq 356420503 378779 bytes
-161> 2013-10-29 16:11:33.642614 7f9e0cbe1780 2 journal read_entry 692523008 : seq 356420504 1095 bytes
-160> 2013-10-29 16:11:33.642622 7f9e0cbe1780 2 journal read_entry 692527104 : seq 356420505 1095 bytes
-159> 2013-10-29 16:11:33.642630 7f9e0cbe1780 2 journal read_entry 692531200 : seq 356420506 1094 bytes
-158> 2013-10-29 16:11:33.642637 7f9e0cbe1780 2 journal read_entry 692535296 : seq 356420507 1094 bytes
-157> 2013-10-29 16:11:33.642645 7f9e0cbe1780 2 journal read_entry 692539392 : seq 356420508 1094 bytes
-156> 2013-10-29 16:11:33.642652 7f9e0cbe1780 2 journal read_entry 692543488 : seq 356420509 1102 bytes
-155> 2013-10-29 16:11:33.642659 7f9e0cbe1780 2 journal read_entry 692547584 : seq 356420510 96 bytes
-154> 2013-10-29 16:11:33.642667 7f9e0cbe1780 2 journal read_entry 692551680 : seq 356420511 101 bytes
-153> 2013-10-29 16:11:33.642674 7f9e0cbe1780 2 journal read_entry 692555776 : seq 356420512 479 bytes
-152> 2013-10-29 16:11:33.642682 7f9e0cbe1780 2 journal read_entry 692559872 : seq 356420513 58 bytes
-151> 2013-10-29 16:11:33.642691 7f9e0cbe1780 2 journal read_entry 692563968 : seq 356420514 58 bytes
-150> 2013-10-29 16:11:33.642700 7f9e0cbe1780 2 journal read_entry 692568064 : seq 356420515 58 bytes
-149> 2013-10-29 16:11:33.642709 7f9e0cbe1780 2 journal read_entry 692572160 : seq 356420516 58 bytes
-148> 2013-10-29 16:11:33.642717 7f9e0cbe1780 2 journal read_entry 692576256 : seq 356420517 58 bytes
-147> 2013-10-29 16:11:33.642726 7f9e0cbe1780 2 journal read_entry 692580352 : seq 356420518 58 bytes
-146> 2013-10-29 16:11:33.642735 7f9e0cbe1780 2 journal read_entry 692584448 : seq 356420519 58 bytes
-145> 2013-10-29 16:11:33.642744 7f9e0cbe1780 2 journal read_entry 692588544 : seq 356420520 58 bytes
-144> 2013-10-29 16:11:33.642752 7f9e0cbe1780 2 journal read_entry 692592640 : seq 356420521 58 bytes
-143> 2013-10-29 16:11:33.642761 7f9e0cbe1780 2 journal read_entry 692596736 : seq 356420522 58 bytes
-142> 2013-10-29 16:11:33.642770 7f9e0cbe1780 2 journal read_entry 692600832 : seq 356420523 58 bytes
-141> 2013-10-29 16:11:33.642779 7f9e0cbe1780 2 journal read_entry 692604928 : seq 356420524 58 bytes
-140> 2013-10-29 16:11:33.642787 7f9e0cbe1780 2 journal read_entry 692609024 : seq 356420525 58 bytes
-139> 2013-10-29 16:11:33.642796 7f9e0cbe1780 2 journal read_entry 692613120 : seq 356420526 58 bytes
-138> 2013-10-29 16:11:33.642872 7f9e0cbe1780 2 journal read_entry 692617216 : seq 356420527 58 bytes
-137> 2013-10-29 16:11:33.642879 7f9e0cbe1780 2 journal read_entry 692621312 : seq 356420528 58 bytes
-136> 2013-10-29 16:11:33.642886 7f9e0cbe1780 2 journal read_entry 692625408 : seq 356420529 58 bytes
-135> 2013-10-29 16:11:33.642892 7f9e0cbe1780 2 journal read_entry 692629504 : seq 356420530 58 bytes
-134> 2013-10-29 16:11:33.642899 7f9e0cbe1780 2 journal read_entry 692633600 : seq 356420531 56 bytes
-133> 2013-10-29 16:11:33.642905 7f9e0cbe1780 2 journal read_entry 692637696 : seq 356420532 58 bytes
-132> 2013-10-29 16:11:33.642912 7f9e0cbe1780 2 journal read_entry 692641792 : seq 356420533 58 bytes
-131> 2013-10-29 16:11:33.642918 7f9e0cbe1780 2 journal read_entry 692645888 : seq 356420534 57 bytes
-130> 2013-10-29 16:11:33.642925 7f9e0cbe1780 2 journal read_entry 692649984 : seq 356420535 58 bytes
-129> 2013-10-29 16:11:33.642932 7f9e0cbe1780 2 journal read_entry 692654080 : seq 356420536 58 bytes
-128> 2013-10-29 16:11:33.642939 7f9e0cbe1780 2 journal read_entry 692658176 : seq 356420537 58 bytes
-127> 2013-10-29 16:11:33.642948 7f9e0cbe1780 2 journal read_entry 692662272 : seq 356420538 58 bytes
-126> 2013-10-29 16:11:33.642956 7f9e0cbe1780 2 journal read_entry 692666368 : seq 356420539 58 bytes
-125> 2013-10-29 16:11:33.642965 7f9e0cbe1780 2 journal read_entry 692670464 : seq 356420540 58 bytes
-124> 2013-10-29 16:11:33.642972 7f9e0cbe1780 2 journal read_entry 692674560 : seq 356420541 58 bytes
-123> 2013-10-29 16:11:33.642980 7f9e0cbe1780 2 journal read_entry 692678656 : seq 356420542 58 bytes
-122> 2013-10-29 16:11:33.642987 7f9e0cbe1780 2 journal read_entry 692682752 : seq 356420543 58 bytes
-121> 2013-10-29 16:11:33.642993 7f9e0cbe1780 2 journal read_entry 692686848 : seq 356420544 58 bytes
-120> 2013-10-29 16:11:33.643000 7f9e0cbe1780 2 journal read_entry 692690944 : seq 356420545 58 bytes
-119> 2013-10-29 16:11:33.643008 7f9e0cbe1780 2 journal read_entry 692695040 : seq 356420546 58 bytes
-118> 2013-10-29 16:11:33.643016 7f9e0cbe1780 2 journal read_entry 692699136 : seq 356420547 57 bytes
-117> 2013-10-29 16:11:33.643024 7f9e0cbe1780 2 journal read_entry 692703232 : seq 356420548 58 bytes
-116> 2013-10-29 16:11:33.643031 7f9e0cbe1780 2 journal read_entry 692707328 : seq 356420549 58 bytes
-115> 2013-10-29 16:11:33.643039 7f9e0cbe1780 2 journal read_entry 692711424 : seq 356420550 58 bytes
-114> 2013-10-29 16:11:33.643048 7f9e0cbe1780 2 journal read_entry 692715520 : seq 356420551 58 bytes
-113> 2013-10-29 16:11:33.643057 7f9e0cbe1780 2 journal read_entry 692719616 : seq 356420552 58 bytes
-112> 2013-10-29 16:11:33.643065 7f9e0cbe1780 2 journal read_entry 692723712 : seq 356420553 58 bytes
-111> 2013-10-29 16:11:33.643072 7f9e0cbe1780 2 journal read_entry 692727808 : seq 356420554 58 bytes
-110> 2013-10-29 16:11:33.643081 7f9e0cbe1780 2 journal read_entry 692731904 : seq 356420555 58 bytes
-109> 2013-10-29 16:11:33.643089 7f9e0cbe1780 2 journal read_entry 692736000 : seq 356420556 58 bytes
-108> 2013-10-29 16:11:33.643098 7f9e0cbe1780 2 journal read_entry 692740096 : seq 356420557 58 bytes
-107> 2013-10-29 16:11:33.643106 7f9e0cbe1780 2 journal read_entry 692744192 : seq 356420558 57 bytes
-106> 2013-10-29 16:11:33.643115 7f9e0cbe1780 2 journal read_entry 692748288 : seq 356420559 58 bytes
-105> 2013-10-29 16:11:33.643124 7f9e0cbe1780 2 journal read_entry 692752384 : seq 356420560 58 bytes
-104> 2013-10-29 16:11:33.643133 7f9e0cbe1780 2 journal read_entry 692756480 : seq 356420561 58 bytes
-103> 2013-10-29 16:11:33.643141 7f9e0cbe1780 2 journal read_entry 692760576 : seq 356420562 58 bytes
-102> 2013-10-29 16:11:33.643150 7f9e0cbe1780 2 journal read_entry 692764672 : seq 356420563 58 bytes
-101> 2013-10-29 16:11:33.643158 7f9e0cbe1780 2 journal read_entry 692768768 : seq 356420564 58 bytes
-100> 2013-10-29 16:11:33.643167 7f9e0cbe1780 2 journal read_entry 692772864 : seq 356420565 58 bytes
-99> 2013-10-29 16:11:33.643176 7f9e0cbe1780 2 journal read_entry 692776960 : seq 356420566 58 bytes
-98> 2013-10-29 16:11:33.643184 7f9e0cbe1780 2 journal read_entry 692781056 : seq 356420567 58 bytes
-97> 2013-10-29 16:11:33.643193 7f9e0cbe1780 2 journal read_entry 692785152 : seq 356420568 58 bytes
-96> 2013-10-29 16:11:33.643201 7f9e0cbe1780 2 journal read_entry 692789248 : seq 356420569 58 bytes
-95> 2013-10-29 16:11:33.643210 7f9e0cbe1780 2 journal read_entry 692793344 : seq 356420570 58 bytes
-94> 2013-10-29 16:11:33.643218 7f9e0cbe1780 2 journal read_entry 692797440 : seq 356420571 58 bytes
-93> 2013-10-29 16:11:33.643226 7f9e0cbe1780 2 journal read_entry 692801536 : seq 356420572 58 bytes
-92> 2013-10-29 16:11:33.643235 7f9e0cbe1780 2 journal read_entry 692805632 : seq 356420573 58 bytes
-91> 2013-10-29 16:11:33.643244 7f9e0cbe1780 2 journal read_entry 692809728 : seq 356420574 58 bytes
-90> 2013-10-29 16:11:33.643252 7f9e0cbe1780 2 journal read_entry 692813824 : seq 356420575 58 bytes
-89> 2013-10-29 16:11:33.643261 7f9e0cbe1780 2 journal read_entry 692817920 : seq 356420576 58 bytes
-88> 2013-10-29 16:11:33.643269 7f9e0cbe1780 2 journal read_entry 692822016 : seq 356420577 57 bytes
-87> 2013-10-29 16:11:33.643278 7f9e0cbe1780 2 journal read_entry 692826112 : seq 356420578 57 bytes
-86> 2013-10-29 16:11:33.643286 7f9e0cbe1780 2 journal read_entry 692830208 : seq 356420579 57 bytes
-85> 2013-10-29 16:11:33.643295 7f9e0cbe1780 2 journal read_entry 692834304 : seq 356420580 58 bytes
-84> 2013-10-29 16:11:33.643304 7f9e0cbe1780 2 journal read_entry 692838400 : seq 356420581 58 bytes
-83> 2013-10-29 16:11:33.643312 7f9e0cbe1780 2 journal read_entry 692842496 : seq 356420582 58 bytes
-82> 2013-10-29 16:11:33.643321 7f9e0cbe1780 2 journal read_entry 692846592 : seq 356420583 58 bytes
-81> 2013-10-29 16:11:33.643329 7f9e0cbe1780 2 journal read_entry 692850688 : seq 356420584 58 bytes
-80> 2013-10-29 16:11:33.643338 7f9e0cbe1780 2 journal read_entry 692854784 : seq 356420585 57 bytes
-79> 2013-10-29 16:11:33.643349 7f9e0cbe1780 2 journal read_entry 692858880 : seq 356420586 58 bytes
-78> 2013-10-29 16:11:33.643358 7f9e0cbe1780 2 journal read_entry 692862976 : seq 356420587 58 bytes
-77> 2013-10-29 16:11:33.643366 7f9e0cbe1780 2 journal read_entry 692867072 : seq 356420588 58 bytes
-76> 2013-10-29 16:11:33.643375 7f9e0cbe1780 2 journal read_entry 692871168 : seq 356420589 58 bytes
-75> 2013-10-29 16:11:33.643383 7f9e0cbe1780 2 journal read_entry 692875264 : seq 356420590 58 bytes
-74> 2013-10-29 16:11:33.643392 7f9e0cbe1780 2 journal read_entry 692879360 : seq 356420591 58 bytes
-73> 2013-10-29 16:11:33.643401 7f9e0cbe1780 2 journal read_entry 692883456 : seq 356420592 58 bytes
-72> 2013-10-29 16:11:33.643409 7f9e0cbe1780 2 journal read_entry 692887552 : seq 356420593 58 bytes
-71> 2013-10-29 16:11:33.643418 7f9e0cbe1780 2 journal read_entry 692891648 : seq 356420594 58 bytes
-70> 2013-10-29 16:11:33.643426 7f9e0cbe1780 2 journal read_entry 692895744 : seq 356420595 57 bytes
-69> 2013-10-29 16:11:33.643435 7f9e0cbe1780 2 journal read_entry 692899840 : seq 356420596 58 bytes
-68> 2013-10-29 16:11:33.643443 7f9e0cbe1780 2 journal read_entry 692903936 : seq 356420597 58 bytes
-67> 2013-10-29 16:11:33.643452 7f9e0cbe1780 2 journal read_entry 692908032 : seq 356420598 58 bytes
-66> 2013-10-29 16:11:33.643460 7f9e0cbe1780 2 journal read_entry 692912128 : seq 356420599 56 bytes
-65> 2013-10-29 16:11:33.643469 7f9e0cbe1780 2 journal read_entry 692916224 : seq 356420600 58 bytes
-64> 2013-10-29 16:11:33.643477 7f9e0cbe1780 2 journal read_entry 692920320 : seq 356420601 58 bytes
-63> 2013-10-29 16:11:33.643486 7f9e0cbe1780 2 journal read_entry 692924416 : seq 356420602 57 bytes
-62> 2013-10-29 16:11:33.643494 7f9e0cbe1780 2 journal read_entry 692928512 : seq 356420603 58 bytes
-61> 2013-10-29 16:11:33.643503 7f9e0cbe1780 2 journal read_entry 692932608 : seq 356420604 58 bytes
-60> 2013-10-29 16:11:33.643511 7f9e0cbe1780 2 journal read_entry 692936704 : seq 356420605 58 bytes
-59> 2013-10-29 16:11:33.643520 7f9e0cbe1780 2 journal read_entry 692940800 : seq 356420606 58 bytes
-58> 2013-10-29 16:11:33.643528 7f9e0cbe1780 2 journal read_entry 692944896 : seq 356420607 58 bytes
-57> 2013-10-29 16:11:33.643537 7f9e0cbe1780 2 journal read_entry 692948992 : seq 356420608 58 bytes
-56> 2013-10-29 16:11:33.643546 7f9e0cbe1780 2 journal read_entry 692953088 : seq 356420609 58 bytes
-55> 2013-10-29 16:11:33.643558 7f9e0cbe1780 2 journal read_entry 692957184 : seq 356420610 58 bytes
-54> 2013-10-29 16:11:33.643571 7f9e0cbe1780 2 journal read_entry 692961280 : seq 356420611 58 bytes
-53> 2013-10-29 16:11:33.643580 7f9e0cbe1780 2 journal read_entry 692965376 : seq 356420612 58 bytes
-52> 2013-10-29 16:11:33.643590 7f9e0cbe1780 2 journal read_entry 692969472 : seq 356420613 58 bytes
-51> 2013-10-29 16:11:33.643599 7f9e0cbe1780 2 journal read_entry 692973568 : seq 356420614 58 bytes
-50> 2013-10-29 16:11:33.643607 7f9e0cbe1780 2 journal read_entry 692977664 : seq 356420615 58 bytes
-49> 2013-10-29 16:11:33.643616 7f9e0cbe1780 2 journal read_entry 692981760 : seq 356420616 58 bytes
-48> 2013-10-29 16:11:33.643624 7f9e0cbe1780 2 journal read_entry 692985856 : seq 356420617 58 bytes
-47> 2013-10-29 16:11:33.643633 7f9e0cbe1780 2 journal read_entry 692989952 : seq 356420618 58 bytes
-46> 2013-10-29 16:11:33.643640 7f9e0cbe1780 2 journal read_entry 692994048 : seq 356420619 58 bytes
-45> 2013-10-29 16:11:33.643646 7f9e0cbe1780 2 journal read_entry 692998144 : seq 356420620 58 bytes
-44> 2013-10-29 16:11:33.643653 7f9e0cbe1780 2 journal read_entry 693002240 : seq 356420621 58 bytes
-43> 2013-10-29 16:11:33.643665 7f9e0cbe1780 2 journal read_entry 693006336 : seq 356420622 58 bytes
-42> 2013-10-29 16:11:33.643681 7f9e0cbe1780 2 journal read_entry 693010432 : seq 356420623 58 bytes
-41> 2013-10-29 16:11:33.643695 7f9e0cbe1780 2 journal read_entry 693014528 : seq 356420624 58 bytes
-40> 2013-10-29 16:11:33.643709 7f9e0cbe1780 2 journal read_entry 693018624 : seq 356420625 58 bytes
-39> 2013-10-29 16:11:33.643723 7f9e0cbe1780 2 journal read_entry 693022720 : seq 356420626 58 bytes
-38> 2013-10-29 16:11:33.643737 7f9e0cbe1780 2 journal read_entry 693026816 : seq 356420627 58 bytes
-37> 2013-10-29 16:11:33.643751 7f9e0cbe1780 2 journal read_entry 693030912 : seq 356420628 58 bytes
-36> 2013-10-29 16:11:33.643765 7f9e0cbe1780 2 journal read_entry 693035008 : seq 356420629 58 bytes
-35> 2013-10-29 16:11:33.643779 7f9e0cbe1780 2 journal read_entry 693039104 : seq 356420630 58 bytes
-34> 2013-10-29 16:11:33.643793 7f9e0cbe1780 2 journal read_entry 693043200 : seq 356420631 58 bytes
-33> 2013-10-29 16:11:33.643813 7f9e0cbe1780 2 journal read_entry 693047296 : seq 356420632 58 bytes
-32> 2013-10-29 16:11:33.643827 7f9e0cbe1780 2 journal read_entry 693051392 : seq 356420633 58 bytes
-31> 2013-10-29 16:11:33.643841 7f9e0cbe1780 2 journal read_entry 693055488 : seq 356420634 58 bytes
-30> 2013-10-29 16:11:33.643855 7f9e0cbe1780 2 journal read_entry 693059584 : seq 356420635 58 bytes
-29> 2013-10-29 16:11:33.643868 7f9e0cbe1780 2 journal read_entry 693063680 : seq 356420636 58 bytes
-28> 2013-10-29 16:11:33.643882 7f9e0cbe1780 2 journal read_entry 693067776 : seq 356420637 58 bytes
-27> 2013-10-29 16:11:33.643896 7f9e0cbe1780 2 journal read_entry 693071872 : seq 356420638 58 bytes
-26> 2013-10-29 16:11:33.643910 7f9e0cbe1780 2 journal read_entry 693075968 : seq 356420639 58 bytes
-25> 2013-10-29 16:11:33.643924 7f9e0cbe1780 2 journal read_entry 693080064 : seq 356420640 57 bytes
-24> 2013-10-29 16:11:33.643939 7f9e0cbe1780 2 journal read_entry 693084160 : seq 356420641 57 bytes
-23> 2013-10-29 16:11:33.643953 7f9e0cbe1780 2 journal read_entry 693088256 : seq 356420642 58 bytes
-22> 2013-10-29 16:11:33.643967 7f9e0cbe1780 2 journal read_entry 693092352 : seq 356420643 58 bytes
-21> 2013-10-29 16:11:33.643981 7f9e0cbe1780 2 journal read_entry 693096448 : seq 356420644 58 bytes
-20> 2013-10-29 16:11:33.643995 7f9e0cbe1780 2 journal read_entry 693100544 : seq 356420645 58 bytes
-19> 2013-10-29 16:11:33.644009 7f9e0cbe1780 2 journal read_entry 693104640 : seq 356420646 57 bytes
-18> 2013-10-29 16:11:33.644022 7f9e0cbe1780 2 journal read_entry 693108736 : seq 356420647 58 bytes
-17> 2013-10-29 16:11:33.644036 7f9e0cbe1780 2 journal read_entry 693112832 : seq 356420648 58 bytes
-16> 2013-10-29 16:11:33.644050 7f9e0cbe1780 2 journal read_entry 693116928 : seq 356420649 58 bytes
-15> 2013-10-29 16:11:33.644065 7f9e0cbe1780 2 journal read_entry 693121024 : seq 356420650 957 bytes
-14> 2013-10-29 16:11:33.644727 7f9e0cbe1780 2 journal read_entry 693780480 : seq 356394430 652898 bytes
-13> 2013-10-29 16:11:33.645437 7f9e0cbe1780 2 journal read_entry 693780480 : seq 356394430 652898 bytes
-12> 2013-10-29 16:11:33.645447 7f9e0cbe1780 3 journal journal_replay: end of journal, done.
-11> 2013-10-29 16:11:33.645481 7f9e0cbe1780 1 journal _open /var/lib/ceph/osd/ceph-6/journal fd 19: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0
-10> 2013-10-29 16:11:33.645795 7f9e0cbe1780 2 osd.6 0 boot
-9> 2013-10-29 16:11:33.646572 7f9e0cbe1780 1 <cls> cls/log/cls_log.cc:313: Loaded log class!
-8> 2013-10-29 16:11:33.646766 7f9e0cbe1780 1 <cls> cls/replica_log/cls_replica_log.cc:141: Loaded replica log class!
-7> 2013-10-29 16:11:33.647415 7f9e0cbe1780 1 <cls> cls/version/cls_version.cc:227: Loaded version class!
-6> 2013-10-29 16:11:33.651423 7f9e0cbe1780 1 <cls> cls/refcount/cls_refcount.cc:231: Loaded refcount class!
-5> 2013-10-29 16:11:33.651548 7f9e0cbe1780 1 <cls> cls/statelog/cls_statelog.cc:306: Loaded log class!
-4> 2013-10-29 16:11:33.653624 7f9e0cbe1780 1 <cls> cls/rgw/cls_rgw.cc:1596: Loaded rgw class!
-3> 2013-10-29 16:11:33.655029 7f9e0cbe1780 5 osd.6 pg_epoch: 4944 pg[0.6(unlocked)] enter Initial
-2> 2013-10-29 16:11:33.655257 7f9e0cbe1780 5 osd.6 pg_epoch: 4944 pg[0.6( empty local-les=4823 n=0 ec=1 les/c 4823/4841 4819/4819/1484) [6,12] r=0 lpr=0 mlcod 0'0 inactive] exit Initial 0.000229 0 0.000000
-1> 2013-10-29 16:11:33.655287 7f9e0cbe1780 5 osd.6 pg_epoch: 4944 pg[0.6( empty local-les=4823 n=0 ec=1 les/c 4823/4841 4819/4819/1484) [6,12] r=0 lpr=0 mlcod 0'0 inactive] enter Reset
0> 2013-10-29 16:11:33.656195 7f9e0cbe1780 -1 osd/OSD.h: In function 'OSDMapRef OSDService::get_map(epoch_t)' thread 7f9e0cbe1780 time 2013-10-29 16:11:33.655368
osd/OSD.h: 447: FAILED assert(ret)

ceph version 0.67.4 (ad85b8bfafea6232d64cb7ba76a8b6e8252fa0c7)
1: (OSD::load_pgs()+0x26fb) [0x69aefb]
2: (OSD::init()+0x122f) [0x69ca1f]
3: (main()+0x3210) [0x5af750]
4: (__libc_start_main()+0xfd) [0x3772a1ecdd]
5: /usr/bin/ceph-osd() [0x5ac189]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 journaler
0/ 5 objectcacher
0/ 5 client
0/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 journal
0/ 5 ms
1/ 5 mon
0/10 monc
1/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 5 heartbeatmap
1/ 5 perfcounter
1/ 5 rgw
1/ 5 hadoop
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
-2/-2 (syslog threshold)
-1/-1 (stderr threshold)
max_recent 10000
max_new 1000
log_file /var/log/ceph/ceph-osd.6.log
--- end dump of recent events ---
2013-10-29 16:11:33.659731 7f9e0cbe1780 -1 *** Caught signal (Aborted) **
in thread 7f9e0cbe1780

ceph version 0.67.4 (ad85b8bfafea6232d64cb7ba76a8b6e8252fa0c7)
1: /usr/bin/ceph-osd() [0x80a589]
2: /lib64/libpthread.so.0() [0x377320f500]
3: (gsignal()+0x35) [0x3772a328a5]
4: (abort()+0x175) [0x3772a34085]
5: (__gnu_cxx::__verbose_terminate_handler()+0x12d) [0x37762bea5d]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- begin dump of recent events ---
0> 2013-10-29 16:11:33.659731 7f9e0cbe1780 -1 *** Caught signal (Aborted) **
in thread 7f9e0cbe1780

ceph version 0.67.4 (ad85b8bfafea6232d64cb7ba76a8b6e8252fa0c7)
1: /usr/bin/ceph-osd() [0x80a589]
2: /lib64/libpthread.so.0() [0x377320f500]
3: (gsignal()+0x35) [0x3772a328a5]
4: (abort()+0x175) [0x3772a34085]
5: (__gnu_cxx::__verbose_terminate_handler()+0x12d) [0x37762bea5d]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 journaler
0/ 5 objectcacher
0/ 5 client
0/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 journal
0/ 5 ms
1/ 5 mon
0/10 monc
1/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 5 heartbeatmap
1/ 5 perfcounter
1/ 5 rgw
1/ 5 hadoop
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
-2/-2 (syslog threshold)
-1/-1 (stderr threshold)
max_recent 10000
max_new 1000
log_file /var/log/ceph/ceph-osd.6.log
--- end dump of recent events ---
(1-1/2)