2015-12-05 16:30:11.265375 7f1d35c577c0 0 ceph version 10.0.0-855-g15a81bb (15a81bb7121799ba1b71b88b356998ebc8effec9), process ceph-osd, pid 1941 2015-12-05 16:30:11.288984 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) dump_stop 2015-12-05 16:30:11.289421 7f1d35c577c0 1 -- :/0 messenger.start 2015-12-05 16:30:11.289472 7f1d35c577c0 1 -- :/538171159 mark_down_all 2015-12-05 16:30:11.289631 7f1d35c577c0 1 -- :/538171159 shutdown complete. 2015-12-05 16:30:11.289670 7f1d35c577c0 1 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) mkfs in /var/lib/ceph/tmp/mnt.hsbJP2 2015-12-05 16:30:11.289707 7f1d35c577c0 1 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) mkfs fsid is already set to cfa4d906-2c4e-4545-98f1-82a2f7ccc6ed 2015-12-05 16:30:11.289720 7f1d35c577c0 1 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) write_version_stamp 4 2015-12-05 16:30:11.305179 7f1d35c577c0 0 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) backend xfs (magic 0x58465342) 2015-12-05 16:30:11.326242 7f1d35c577c0 1 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) leveldb db exists/created 2015-12-05 16:30:11.326310 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) open_journal at /var/lib/ceph/tmp/mnt.hsbJP2/journal 2015-12-05 16:30:11.326965 7f1d35c577c0 10 journal _open_block_device: ignoring osd journal size. We'll use the entire block device (size: 103809536) 2015-12-05 16:30:11.326993 7f1d35c577c0 10 journal _check_disk_write_cache: not root, NOT checking disk write cache on raw block device /var/lib/ceph/tmp/mnt.hsbJP2/journal 2015-12-05 16:30:11.327041 7f1d35c577c0 1 journal _open /var/lib/ceph/tmp/mnt.hsbJP2/journal fd 11: 103809024 bytes, block size 4096 bytes, directio = 1, aio = 1 2015-12-05 16:30:11.327059 7f1d35c577c0 10 journal read_header 2015-12-05 16:30:11.328958 7f1d35c577c0 10 journal header: block_size 4096 alignment 4096 max_size 103809024 2015-12-05 16:30:11.328983 7f1d35c577c0 10 journal header: start 245760 2015-12-05 16:30:11.328986 7f1d35c577c0 10 journal write_pos 0 2015-12-05 16:30:11.328991 7f1d35c577c0 1 journal check: header looks ok 2015-12-05 16:30:11.329017 7f1d35c577c0 1 journal close /var/lib/ceph/tmp/mnt.hsbJP2/journal 2015-12-05 16:30:11.358906 7f1d35c577c0 1 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) mkfs done in /var/lib/ceph/tmp/mnt.hsbJP2 2015-12-05 16:30:11.358989 7f1d35c577c0 5 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) basedir /var/lib/ceph/tmp/mnt.hsbJP2 journal /var/lib/ceph/tmp/mnt.hsbJP2/journal 2015-12-05 16:30:11.359032 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) mount fsid is cfa4d906-2c4e-4545-98f1-82a2f7ccc6ed 2015-12-05 16:30:11.359057 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) version_stamp_is_valid was 4 vs target 4 2015-12-05 16:30:11.359086 7f1d35c577c0 0 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) backend xfs (magic 0x58465342) 2015-12-05 16:30:11.359603 7f1d35c577c0 0 genericfilestorebackend(/var/lib/ceph/tmp/mnt.hsbJP2) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option 2015-12-05 16:30:11.359619 7f1d35c577c0 0 genericfilestorebackend(/var/lib/ceph/tmp/mnt.hsbJP2) detect_features: SEEK_DATA/SEEK_HOLE is disabled via 'filestore seek data hole' config option 2015-12-05 16:30:11.359643 7f1d35c577c0 0 genericfilestorebackend(/var/lib/ceph/tmp/mnt.hsbJP2) detect_features: splice is supported 2015-12-05 16:30:11.364707 7f1d35c577c0 0 genericfilestorebackend(/var/lib/ceph/tmp/mnt.hsbJP2) detect_features: syncfs(2) syscall fully supported (by glibc and kernel) 2015-12-05 16:30:11.364782 7f1d35c577c0 0 xfsfilestorebackend(/var/lib/ceph/tmp/mnt.hsbJP2) detect_features: extsize is supported and your kernel >= 3.5 2015-12-05 16:30:11.365203 7f1d35c577c0 5 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) mount op_seq is 1 2015-12-05 16:30:11.373961 7f1d35c577c0 20 filestore (init)dbobjectmap: seq is 1 2015-12-05 16:30:11.373980 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) open_journal at /var/lib/ceph/tmp/mnt.hsbJP2/journal 2015-12-05 16:30:11.374011 7f1d35c577c0 0 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled 2015-12-05 16:30:11.374020 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) list_collections 2015-12-05 16:30:11.374143 7f1d35c577c0 10 journal journal_replay fs op_seq 1 2015-12-05 16:30:11.374155 7f1d35c577c0 2 journal open /var/lib/ceph/tmp/mnt.hsbJP2/journal fsid cfa4d906-2c4e-4545-98f1-82a2f7ccc6ed fs_op_seq 1 2015-12-05 16:30:11.374187 7f1d35c577c0 10 journal _open_block_device: ignoring osd journal size. We'll use the entire block device (size: 103809536) 2015-12-05 16:30:11.374193 7f1d35c577c0 10 journal _check_disk_write_cache: not root, NOT checking disk write cache on raw block device /var/lib/ceph/tmp/mnt.hsbJP2/journal 2015-12-05 16:30:11.374173 7f1d301c0700 20 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) sync_entry waiting for max_interval 5.000000 2015-12-05 16:30:11.374210 7f1d35c577c0 1 journal _open /var/lib/ceph/tmp/mnt.hsbJP2/journal fd 17: 103809024 bytes, block size 4096 bytes, directio = 1, aio = 1 2015-12-05 16:30:11.374215 7f1d35c577c0 10 journal read_header 2015-12-05 16:30:11.390754 7f1d35c577c0 10 journal header: block_size 4096 alignment 4096 max_size 103809024 2015-12-05 16:30:11.390771 7f1d35c577c0 10 journal header: start 245760 2015-12-05 16:30:11.390773 7f1d35c577c0 10 journal write_pos 4096 2015-12-05 16:30:11.390806 7f1d35c577c0 10 journal open header.fsid = cfa4d906-2c4e-4545-98f1-82a2f7ccc6ed 2015-12-05 16:30:11.518783 7f1d35c577c0 2 journal No further valid entries found, journal is most likely valid 2015-12-05 16:30:11.518823 7f1d35c577c0 10 journal open reached end of journal. 2015-12-05 16:30:11.518842 7f1d35c577c0 -1 journal Unable to read past sequence 2 but header indicates the journal has committed up through 20, journal is corrupt 2015-12-05 16:30:11.523995 7f1d35c577c0 -1 os/FileJournal.cc: In function 'bool FileJournal::read_entry(ceph::bufferlist&, uint64_t&, bool*)' thread 7f1d35c577c0 time 2015-12-05 16:30:11.518858 os/FileJournal.cc: 1907: FAILED assert(0) ceph version 10.0.0-855-g15a81bb (15a81bb7121799ba1b71b88b356998ebc8effec9) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x85) [0x7f1d36595f25] 2: (FileJournal::read_entry(ceph::buffer::list&, unsigned long&, bool*)+0x8ad) [0x7f1d363683ed] 3: (JournalingObjectStore::journal_replay(unsigned long)+0x218) [0x7f1d362e2468] 4: (FileStore::mount()+0x3caf) [0x7f1d362b9d8f] 5: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x190) [0x7f1d35f997f0] 6: (main()+0xb94) [0x7f1d35f3b414] 7: (__libc_start_main()+0xf5) [0x7f1d32db8af5] 8: (()+0x308e99) [0x7f1d35f7ce99] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- begin dump of recent events --- -75> 2015-12-05 16:30:11.259425 7f1d35c577c0 5 asok(0x7f1d3a220000) register_command perfcounters_dump hook 0x7f1d3a178030 -74> 2015-12-05 16:30:11.259462 7f1d35c577c0 5 asok(0x7f1d3a220000) register_command 1 hook 0x7f1d3a178030 -73> 2015-12-05 16:30:11.259465 7f1d35c577c0 5 asok(0x7f1d3a220000) register_command perf dump hook 0x7f1d3a178030 -72> 2015-12-05 16:30:11.259468 7f1d35c577c0 5 asok(0x7f1d3a220000) register_command perfcounters_schema hook 0x7f1d3a178030 -71> 2015-12-05 16:30:11.259470 7f1d35c577c0 5 asok(0x7f1d3a220000) register_command 2 hook 0x7f1d3a178030 -70> 2015-12-05 16:30:11.259474 7f1d35c577c0 5 asok(0x7f1d3a220000) register_command perf schema hook 0x7f1d3a178030 -69> 2015-12-05 16:30:11.259477 7f1d35c577c0 5 asok(0x7f1d3a220000) register_command perf reset hook 0x7f1d3a178030 -68> 2015-12-05 16:30:11.259479 7f1d35c577c0 5 asok(0x7f1d3a220000) register_command config show hook 0x7f1d3a178030 -67> 2015-12-05 16:30:11.259481 7f1d35c577c0 5 asok(0x7f1d3a220000) register_command config set hook 0x7f1d3a178030 -66> 2015-12-05 16:30:11.259484 7f1d35c577c0 5 asok(0x7f1d3a220000) register_command config get hook 0x7f1d3a178030 -65> 2015-12-05 16:30:11.259488 7f1d35c577c0 5 asok(0x7f1d3a220000) register_command config diff hook 0x7f1d3a178030 -64> 2015-12-05 16:30:11.259490 7f1d35c577c0 5 asok(0x7f1d3a220000) register_command log flush hook 0x7f1d3a178030 -63> 2015-12-05 16:30:11.259493 7f1d35c577c0 5 asok(0x7f1d3a220000) register_command log dump hook 0x7f1d3a178030 -62> 2015-12-05 16:30:11.259495 7f1d35c577c0 5 asok(0x7f1d3a220000) register_command log reopen hook 0x7f1d3a178030 -61> 2015-12-05 16:30:11.265275 7f1d35c577c0 0 set uid:gid to 167:167 -60> 2015-12-05 16:30:11.265375 7f1d35c577c0 0 ceph version 10.0.0-855-g15a81bb (15a81bb7121799ba1b71b88b356998ebc8effec9), process ceph-osd, pid 1941 -59> 2015-12-05 16:30:11.288984 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) dump_stop -58> 2015-12-05 16:30:11.289013 7f1d35c577c0 5 asok(0x7f1d3a220000) init /var/run/ceph/ceph-osd.4.asok -57> 2015-12-05 16:30:11.289028 7f1d35c577c0 5 asok(0x7f1d3a220000) bind_and_listen /var/run/ceph/ceph-osd.4.asok -56> 2015-12-05 16:30:11.289163 7f1d35c577c0 5 asok(0x7f1d3a220000) register_command 0 hook 0x7f1d3a1740c0 -55> 2015-12-05 16:30:11.289176 7f1d35c577c0 5 asok(0x7f1d3a220000) register_command version hook 0x7f1d3a1740c0 -54> 2015-12-05 16:30:11.289181 7f1d35c577c0 5 asok(0x7f1d3a220000) register_command git_version hook 0x7f1d3a1740c0 -53> 2015-12-05 16:30:11.289184 7f1d35c577c0 5 asok(0x7f1d3a220000) register_command help hook 0x7f1d3a178140 -52> 2015-12-05 16:30:11.289186 7f1d35c577c0 5 asok(0x7f1d3a220000) register_command get_command_descriptions hook 0x7f1d3a178150 -51> 2015-12-05 16:30:11.289240 7f1d35c577c0 10 monclient(hunting): build_initial_monmap -50> 2015-12-05 16:30:11.289240 7f1d309c1700 5 asok(0x7f1d3a220000) entry start -49> 2015-12-05 16:30:11.289316 7f1d35c577c0 10 monclient(hunting): get_monmap_privately -48> 2015-12-05 16:30:11.289421 7f1d35c577c0 1 -- :/0 messenger.start -47> 2015-12-05 16:30:11.289464 7f1d35c577c0 10 monclient(hunting): have 1 fsid 369e4618-1c88-464e-ad9c-87d4c005286a -46> 2015-12-05 16:30:11.289472 7f1d35c577c0 1 -- :/538171159 mark_down_all -45> 2015-12-05 16:30:11.289631 7f1d35c577c0 1 -- :/538171159 shutdown complete. -44> 2015-12-05 16:30:11.289670 7f1d35c577c0 1 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) mkfs in /var/lib/ceph/tmp/mnt.hsbJP2 -43> 2015-12-05 16:30:11.289707 7f1d35c577c0 1 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) mkfs fsid is already set to cfa4d906-2c4e-4545-98f1-82a2f7ccc6ed -42> 2015-12-05 16:30:11.289720 7f1d35c577c0 1 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) write_version_stamp 4 -41> 2015-12-05 16:30:11.305179 7f1d35c577c0 0 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) backend xfs (magic 0x58465342) -40> 2015-12-05 16:30:11.326242 7f1d35c577c0 1 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) leveldb db exists/created -39> 2015-12-05 16:30:11.326310 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) open_journal at /var/lib/ceph/tmp/mnt.hsbJP2/journal -38> 2015-12-05 16:30:11.326965 7f1d35c577c0 10 journal _open_block_device: ignoring osd journal size. We'll use the entire block device (size: 103809536) -37> 2015-12-05 16:30:11.326993 7f1d35c577c0 10 journal _check_disk_write_cache: not root, NOT checking disk write cache on raw block device /var/lib/ceph/tmp/mnt.hsbJP2/journal -36> 2015-12-05 16:30:11.327041 7f1d35c577c0 1 journal _open /var/lib/ceph/tmp/mnt.hsbJP2/journal fd 11: 103809024 bytes, block size 4096 bytes, directio = 1, aio = 1 -35> 2015-12-05 16:30:11.327059 7f1d35c577c0 10 journal read_header -34> 2015-12-05 16:30:11.328958 7f1d35c577c0 10 journal header: block_size 4096 alignment 4096 max_size 103809024 -33> 2015-12-05 16:30:11.328983 7f1d35c577c0 10 journal header: start 245760 -32> 2015-12-05 16:30:11.328986 7f1d35c577c0 10 journal write_pos 0 -31> 2015-12-05 16:30:11.328991 7f1d35c577c0 1 journal check: header looks ok -30> 2015-12-05 16:30:11.329017 7f1d35c577c0 1 journal close /var/lib/ceph/tmp/mnt.hsbJP2/journal -29> 2015-12-05 16:30:11.358906 7f1d35c577c0 1 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) mkfs done in /var/lib/ceph/tmp/mnt.hsbJP2 -28> 2015-12-05 16:30:11.358989 7f1d35c577c0 5 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) basedir /var/lib/ceph/tmp/mnt.hsbJP2 journal /var/lib/ceph/tmp/mnt.hsbJP2/journal -27> 2015-12-05 16:30:11.359032 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) mount fsid is cfa4d906-2c4e-4545-98f1-82a2f7ccc6ed -26> 2015-12-05 16:30:11.359057 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) version_stamp_is_valid was 4 vs target 4 -25> 2015-12-05 16:30:11.359086 7f1d35c577c0 0 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) backend xfs (magic 0x58465342) -24> 2015-12-05 16:30:11.359603 7f1d35c577c0 0 genericfilestorebackend(/var/lib/ceph/tmp/mnt.hsbJP2) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option -23> 2015-12-05 16:30:11.359619 7f1d35c577c0 0 genericfilestorebackend(/var/lib/ceph/tmp/mnt.hsbJP2) detect_features: SEEK_DATA/SEEK_HOLE is disabled via 'filestore seek data hole' config option -22> 2015-12-05 16:30:11.359643 7f1d35c577c0 0 genericfilestorebackend(/var/lib/ceph/tmp/mnt.hsbJP2) detect_features: splice is supported -21> 2015-12-05 16:30:11.364707 7f1d35c577c0 0 genericfilestorebackend(/var/lib/ceph/tmp/mnt.hsbJP2) detect_features: syncfs(2) syscall fully supported (by glibc and kernel) -20> 2015-12-05 16:30:11.364782 7f1d35c577c0 0 xfsfilestorebackend(/var/lib/ceph/tmp/mnt.hsbJP2) detect_features: extsize is supported and your kernel >= 3.5 -19> 2015-12-05 16:30:11.365203 7f1d35c577c0 5 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) mount op_seq is 1 -18> 2015-12-05 16:30:11.373961 7f1d35c577c0 20 filestore (init)dbobjectmap: seq is 1 -17> 2015-12-05 16:30:11.373980 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) open_journal at /var/lib/ceph/tmp/mnt.hsbJP2/journal -16> 2015-12-05 16:30:11.374011 7f1d35c577c0 0 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled -15> 2015-12-05 16:30:11.374020 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) list_collections -14> 2015-12-05 16:30:11.374143 7f1d35c577c0 10 journal journal_replay fs op_seq 1 -13> 2015-12-05 16:30:11.374155 7f1d35c577c0 2 journal open /var/lib/ceph/tmp/mnt.hsbJP2/journal fsid cfa4d906-2c4e-4545-98f1-82a2f7ccc6ed fs_op_seq 1 -12> 2015-12-05 16:30:11.374187 7f1d35c577c0 10 journal _open_block_device: ignoring osd journal size. We'll use the entire block device (size: 103809536) -11> 2015-12-05 16:30:11.374193 7f1d35c577c0 10 journal _check_disk_write_cache: not root, NOT checking disk write cache on raw block device /var/lib/ceph/tmp/mnt.hsbJP2/journal -10> 2015-12-05 16:30:11.374173 7f1d301c0700 20 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) sync_entry waiting for max_interval 5.000000 -9> 2015-12-05 16:30:11.374210 7f1d35c577c0 1 journal _open /var/lib/ceph/tmp/mnt.hsbJP2/journal fd 17: 103809024 bytes, block size 4096 bytes, directio = 1, aio = 1 -8> 2015-12-05 16:30:11.374215 7f1d35c577c0 10 journal read_header -7> 2015-12-05 16:30:11.390754 7f1d35c577c0 10 journal header: block_size 4096 alignment 4096 max_size 103809024 -6> 2015-12-05 16:30:11.390771 7f1d35c577c0 10 journal header: start 245760 -5> 2015-12-05 16:30:11.390773 7f1d35c577c0 10 journal write_pos 4096 -4> 2015-12-05 16:30:11.390806 7f1d35c577c0 10 journal open header.fsid = cfa4d906-2c4e-4545-98f1-82a2f7ccc6ed -3> 2015-12-05 16:30:11.518783 7f1d35c577c0 2 journal No further valid entries found, journal is most likely valid -2> 2015-12-05 16:30:11.518823 7f1d35c577c0 10 journal open reached end of journal. -1> 2015-12-05 16:30:11.518842 7f1d35c577c0 -1 journal Unable to read past sequence 2 but header indicates the journal has committed up through 20, journal is corrupt 0> 2015-12-05 16:30:11.523995 7f1d35c577c0 -1 os/FileJournal.cc: In function 'bool FileJournal::read_entry(ceph::bufferlist&, uint64_t&, bool*)' thread 7f1d35c577c0 time 2015-12-05 16:30:11.518858 os/FileJournal.cc: 1907: FAILED assert(0) ceph version 10.0.0-855-g15a81bb (15a81bb7121799ba1b71b88b356998ebc8effec9) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x85) [0x7f1d36595f25] 2: (FileJournal::read_entry(ceph::buffer::list&, unsigned long&, bool*)+0x8ad) [0x7f1d363683ed] 3: (JournalingObjectStore::journal_replay(unsigned long)+0x218) [0x7f1d362e2468] 4: (FileStore::mount()+0x3caf) [0x7f1d362b9d8f] 5: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x190) [0x7f1d35f997f0] 6: (main()+0xb94) [0x7f1d35f3b414] 7: (__libc_start_main()+0xf5) [0x7f1d32db8af5] 8: (()+0x308e99) [0x7f1d35f7ce99] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_replay 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 20/20 osd 0/ 5 optracker 0/ 5 objclass 20/20 filestore 1/ 3 keyvaluestore 20/20 journal 1/ 1 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/10 civetweb 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 xio 1/ 5 compressor 1/ 5 newstore -2/-2 (syslog threshold) -1/-1 (stderr threshold) max_recent 10000 max_new 1000 log_file /var/log/ceph/ceph-osd.4.log --- end dump of recent events --- 2015-12-05 16:30:11.524816 7f1d35c577c0 -1 OSD::mkfs: caught unknown exception. 2015-12-05 16:30:11.524838 7f1d35c577c0 5 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) umount /var/lib/ceph/tmp/mnt.hsbJP2 2015-12-05 16:30:11.524842 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) flush 2015-12-05 16:30:11.524847 7f1d35c577c0 10 journal waiting for completions to empty 2015-12-05 16:30:11.524849 7f1d35c577c0 10 journal flush waiting for finisher 2015-12-05 16:30:11.524859 7f1d35c577c0 10 journal flush done 2015-12-05 16:30:11.524860 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) flush draining ondisk finisher 2015-12-05 16:30:11.524863 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) _flush_op_queue draining op tp 2015-12-05 16:30:11.524868 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) _flush_op_queue waiting for apply finisher 2015-12-05 16:30:11.524871 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) flush complete 2015-12-05 16:30:11.524889 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) start_sync 2015-12-05 16:30:11.524891 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) sync waiting 2015-12-05 16:30:11.525086 7f1d301c0700 20 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) sync_entry force_sync set 2015-12-05 16:30:11.525121 7f1d301c0700 10 journal commit_start max_applied_seq 1, open_ops 0 2015-12-05 16:30:11.525126 7f1d301c0700 10 journal commit_start blocked, all open_ops have completed 2015-12-05 16:30:11.525128 7f1d301c0700 10 journal commit_start nothing to do 2015-12-05 16:30:11.525130 7f1d301c0700 10 journal commit_start 2015-12-05 16:30:11.525142 7f1d301c0700 20 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) sync_entry waiting for max_interval 5.000000 2015-12-05 16:30:11.525187 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) sync done 2015-12-05 16:30:11.525193 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) do_force_sync 2015-12-05 16:30:11.525226 7f1d301c0700 20 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) sync_entry force_sync set 2015-12-05 16:30:11.525231 7f1d301c0700 10 journal commit_start max_applied_seq 1, open_ops 0 2015-12-05 16:30:11.525233 7f1d301c0700 10 journal commit_start blocked, all open_ops have completed 2015-12-05 16:30:11.525234 7f1d301c0700 10 journal commit_start nothing to do 2015-12-05 16:30:11.525236 7f1d301c0700 10 journal commit_start 2015-12-05 16:30:11.529510 7f1d35c577c0 -1 common/config.cc: In function 'void md_config_t::remove_observer(md_config_obs_t*)' thread 7f1d35c577c0 time 2015-12-05 16:30:11.525429 common/config.cc: 198: FAILED assert(found_obs) ceph version 10.0.0-855-g15a81bb (15a81bb7121799ba1b71b88b356998ebc8effec9) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x85) [0x7f1d36595f25] 2: (md_config_t::remove_observer(md_config_obs_t*)+0xfc) [0x7f1d365be38c] 3: (ThreadPool::stop(bool)+0x1e1) [0x7f1d36584111] 4: (FileStore::umount()+0x193) [0x7f1d36291b33] 5: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x638) [0x7f1d35f99c98] 6: (main()+0xb94) [0x7f1d35f3b414] 7: (__libc_start_main()+0xf5) [0x7f1d32db8af5] 8: (()+0x308e99) [0x7f1d35f7ce99] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- begin dump of recent events --- -25> 2015-12-05 16:30:11.524816 7f1d35c577c0 -1 OSD::mkfs: caught unknown exception. -24> 2015-12-05 16:30:11.524838 7f1d35c577c0 5 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) umount /var/lib/ceph/tmp/mnt.hsbJP2 -23> 2015-12-05 16:30:11.524842 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) flush -22> 2015-12-05 16:30:11.524847 7f1d35c577c0 10 journal waiting for completions to empty -21> 2015-12-05 16:30:11.524849 7f1d35c577c0 10 journal flush waiting for finisher -20> 2015-12-05 16:30:11.524859 7f1d35c577c0 10 journal flush done -19> 2015-12-05 16:30:11.524860 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) flush draining ondisk finisher -18> 2015-12-05 16:30:11.524863 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) _flush_op_queue draining op tp -17> 2015-12-05 16:30:11.524868 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) _flush_op_queue waiting for apply finisher -16> 2015-12-05 16:30:11.524871 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) flush complete -15> 2015-12-05 16:30:11.524889 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) start_sync -14> 2015-12-05 16:30:11.524891 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) sync waiting -13> 2015-12-05 16:30:11.525086 7f1d301c0700 20 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) sync_entry force_sync set -12> 2015-12-05 16:30:11.525121 7f1d301c0700 10 journal commit_start max_applied_seq 1, open_ops 0 -11> 2015-12-05 16:30:11.525126 7f1d301c0700 10 journal commit_start blocked, all open_ops have completed -10> 2015-12-05 16:30:11.525128 7f1d301c0700 10 journal commit_start nothing to do -9> 2015-12-05 16:30:11.525130 7f1d301c0700 10 journal commit_start -8> 2015-12-05 16:30:11.525142 7f1d301c0700 20 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) sync_entry waiting for max_interval 5.000000 -7> 2015-12-05 16:30:11.525187 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) sync done -6> 2015-12-05 16:30:11.525193 7f1d35c577c0 10 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) do_force_sync -5> 2015-12-05 16:30:11.525226 7f1d301c0700 20 filestore(/var/lib/ceph/tmp/mnt.hsbJP2) sync_entry force_sync set -4> 2015-12-05 16:30:11.525231 7f1d301c0700 10 journal commit_start max_applied_seq 1, open_ops 0 -3> 2015-12-05 16:30:11.525233 7f1d301c0700 10 journal commit_start blocked, all open_ops have completed -2> 2015-12-05 16:30:11.525234 7f1d301c0700 10 journal commit_start nothing to do -1> 2015-12-05 16:30:11.525236 7f1d301c0700 10 journal commit_start 0> 2015-12-05 16:30:11.529510 7f1d35c577c0 -1 common/config.cc: In function 'void md_config_t::remove_observer(md_config_obs_t*)' thread 7f1d35c577c0 time 2015-12-05 16:30:11.525429 common/config.cc: 198: FAILED assert(found_obs) ceph version 10.0.0-855-g15a81bb (15a81bb7121799ba1b71b88b356998ebc8effec9) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x85) [0x7f1d36595f25] 2: (md_config_t::remove_observer(md_config_obs_t*)+0xfc) [0x7f1d365be38c] 3: (ThreadPool::stop(bool)+0x1e1) [0x7f1d36584111] 4: (FileStore::umount()+0x193) [0x7f1d36291b33] 5: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x638) [0x7f1d35f99c98] 6: (main()+0xb94) [0x7f1d35f3b414] 7: (__libc_start_main()+0xf5) [0x7f1d32db8af5] 8: (()+0x308e99) [0x7f1d35f7ce99] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_replay 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 20/20 osd 0/ 5 optracker 0/ 5 objclass 20/20 filestore 1/ 3 keyvaluestore 20/20 journal 1/ 1 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/10 civetweb 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 xio 1/ 5 compressor 1/ 5 newstore -2/-2 (syslog threshold) -1/-1 (stderr threshold) max_recent 10000 max_new 1000 log_file /var/log/ceph/ceph-osd.4.log --- end dump of recent events --- 2015-12-05 16:30:11.532353 7f1d35c577c0 -1 *** Caught signal (Aborted) ** in thread 7f1d35c577c0 ceph version 10.0.0-855-g15a81bb (15a81bb7121799ba1b71b88b356998ebc8effec9) 1: (()+0x827632) [0x7f1d3649b632] 2: (()+0xf130) [0x7f1d345ec130] 3: (gsignal()+0x37) [0x7f1d32dcc5d7] 4: (abort()+0x148) [0x7f1d32dcdcc8] 5: (__gnu_cxx::__verbose_terminate_handler()+0x165) [0x7f1d336d09b5] 6: (()+0x5e926) [0x7f1d336ce926] 7: (()+0x5e953) [0x7f1d336ce953] 8: (()+0x5eb73) [0x7f1d336ceb73] 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x27a) [0x7f1d3659611a] 10: (md_config_t::remove_observer(md_config_obs_t*)+0xfc) [0x7f1d365be38c] 11: (ThreadPool::stop(bool)+0x1e1) [0x7f1d36584111] 12: (FileStore::umount()+0x193) [0x7f1d36291b33] 13: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x638) [0x7f1d35f99c98] 14: (main()+0xb94) [0x7f1d35f3b414] 15: (__libc_start_main()+0xf5) [0x7f1d32db8af5] 16: (()+0x308e99) [0x7f1d35f7ce99] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- begin dump of recent events --- 0> 2015-12-05 16:30:11.532353 7f1d35c577c0 -1 *** Caught signal (Aborted) ** in thread 7f1d35c577c0 ceph version 10.0.0-855-g15a81bb (15a81bb7121799ba1b71b88b356998ebc8effec9) 1: (()+0x827632) [0x7f1d3649b632] 2: (()+0xf130) [0x7f1d345ec130] 3: (gsignal()+0x37) [0x7f1d32dcc5d7] 4: (abort()+0x148) [0x7f1d32dcdcc8] 5: (__gnu_cxx::__verbose_terminate_handler()+0x165) [0x7f1d336d09b5] 6: (()+0x5e926) [0x7f1d336ce926] 7: (()+0x5e953) [0x7f1d336ce953] 8: (()+0x5eb73) [0x7f1d336ceb73] 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x27a) [0x7f1d3659611a] 10: (md_config_t::remove_observer(md_config_obs_t*)+0xfc) [0x7f1d365be38c] 11: (ThreadPool::stop(bool)+0x1e1) [0x7f1d36584111] 12: (FileStore::umount()+0x193) [0x7f1d36291b33] 13: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x638) [0x7f1d35f99c98] 14: (main()+0xb94) [0x7f1d35f3b414] 15: (__libc_start_main()+0xf5) [0x7f1d32db8af5] 16: (()+0x308e99) [0x7f1d35f7ce99] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_replay 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 20/20 osd 0/ 5 optracker 0/ 5 objclass 20/20 filestore 1/ 3 keyvaluestore 20/20 journal 1/ 1 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/10 civetweb 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 xio 1/ 5 compressor 1/ 5 newstore -2/-2 (syslog threshold) -1/-1 (stderr threshold) max_recent 10000 max_new 1000 log_file /var/log/ceph/ceph-osd.4.log --- end dump of recent events --- 2015-12-05 16:30:15.390901 7f2664cbc7c0 0 ceph version 10.0.0-855-g15a81bb (15a81bb7121799ba1b71b88b356998ebc8effec9), process ceph-osd, pid 2015 2015-12-05 16:30:15.415188 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) dump_stop 2015-12-05 16:30:15.415662 7f2664cbc7c0 1 -- :/0 messenger.start 2015-12-05 16:30:15.415696 7f2664cbc7c0 1 -- :/3918120233 mark_down_all 2015-12-05 16:30:15.415826 7f2664cbc7c0 1 -- :/3918120233 shutdown complete. 2015-12-05 16:30:15.415850 7f2664cbc7c0 1 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) mkfs in /var/lib/ceph/tmp/mnt.Bch3JW 2015-12-05 16:30:15.415876 7f2664cbc7c0 1 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) mkfs fsid is already set to cfa4d906-2c4e-4545-98f1-82a2f7ccc6ed 2015-12-05 16:30:15.415886 7f2664cbc7c0 1 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) write_version_stamp 4 2015-12-05 16:30:15.418327 7f2664cbc7c0 0 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) backend xfs (magic 0x58465342) 2015-12-05 16:30:15.441177 7f2664cbc7c0 1 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) leveldb db exists/created 2015-12-05 16:30:15.441234 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) open_journal at /var/lib/ceph/tmp/mnt.Bch3JW/journal 2015-12-05 16:30:15.441443 7f2664cbc7c0 10 journal _open_block_device: ignoring osd journal size. We'll use the entire block device (size: 103809536) 2015-12-05 16:30:15.441466 7f2664cbc7c0 10 journal _check_disk_write_cache: not root, NOT checking disk write cache on raw block device /var/lib/ceph/tmp/mnt.Bch3JW/journal 2015-12-05 16:30:15.441488 7f2664cbc7c0 1 journal _open /var/lib/ceph/tmp/mnt.Bch3JW/journal fd 11: 103809024 bytes, block size 4096 bytes, directio = 1, aio = 1 2015-12-05 16:30:15.441497 7f2664cbc7c0 10 journal read_header 2015-12-05 16:30:15.443136 7f2664cbc7c0 10 journal header: block_size 4096 alignment 4096 max_size 103809024 2015-12-05 16:30:15.443155 7f2664cbc7c0 10 journal header: start 245760 2015-12-05 16:30:15.443158 7f2664cbc7c0 10 journal write_pos 0 2015-12-05 16:30:15.443162 7f2664cbc7c0 1 journal check: header looks ok 2015-12-05 16:30:15.443172 7f2664cbc7c0 1 journal close /var/lib/ceph/tmp/mnt.Bch3JW/journal 2015-12-05 16:30:15.501158 7f2664cbc7c0 1 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) mkfs done in /var/lib/ceph/tmp/mnt.Bch3JW 2015-12-05 16:30:15.501215 7f2664cbc7c0 5 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) basedir /var/lib/ceph/tmp/mnt.Bch3JW journal /var/lib/ceph/tmp/mnt.Bch3JW/journal 2015-12-05 16:30:15.501261 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) mount fsid is cfa4d906-2c4e-4545-98f1-82a2f7ccc6ed 2015-12-05 16:30:15.501315 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) version_stamp_is_valid was 4 vs target 4 2015-12-05 16:30:15.501373 7f2664cbc7c0 0 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) backend xfs (magic 0x58465342) 2015-12-05 16:30:15.509653 7f2664cbc7c0 0 genericfilestorebackend(/var/lib/ceph/tmp/mnt.Bch3JW) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option 2015-12-05 16:30:15.509693 7f2664cbc7c0 0 genericfilestorebackend(/var/lib/ceph/tmp/mnt.Bch3JW) detect_features: SEEK_DATA/SEEK_HOLE is disabled via 'filestore seek data hole' config option 2015-12-05 16:30:15.509746 7f2664cbc7c0 0 genericfilestorebackend(/var/lib/ceph/tmp/mnt.Bch3JW) detect_features: splice is supported 2015-12-05 16:30:15.515329 7f2664cbc7c0 0 genericfilestorebackend(/var/lib/ceph/tmp/mnt.Bch3JW) detect_features: syncfs(2) syscall fully supported (by glibc and kernel) 2015-12-05 16:30:15.515485 7f2664cbc7c0 0 xfsfilestorebackend(/var/lib/ceph/tmp/mnt.Bch3JW) detect_features: extsize is supported and your kernel >= 3.5 2015-12-05 16:30:15.516267 7f2664cbc7c0 5 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) mount op_seq is 1 2015-12-05 16:30:15.526622 7f2664cbc7c0 20 filestore (init)dbobjectmap: seq is 1 2015-12-05 16:30:15.526668 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) open_journal at /var/lib/ceph/tmp/mnt.Bch3JW/journal 2015-12-05 16:30:15.526720 7f2664cbc7c0 0 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled 2015-12-05 16:30:15.526732 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) list_collections 2015-12-05 16:30:15.526923 7f2664cbc7c0 10 journal journal_replay fs op_seq 1 2015-12-05 16:30:15.526948 7f2664cbc7c0 2 journal open /var/lib/ceph/tmp/mnt.Bch3JW/journal fsid cfa4d906-2c4e-4545-98f1-82a2f7ccc6ed fs_op_seq 1 2015-12-05 16:30:15.527004 7f2664cbc7c0 10 journal _open_block_device: ignoring osd journal size. We'll use the entire block device (size: 103809536) 2015-12-05 16:30:15.526971 7f265f225700 20 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) sync_entry waiting for max_interval 5.000000 2015-12-05 16:30:15.527016 7f2664cbc7c0 10 journal _check_disk_write_cache: not root, NOT checking disk write cache on raw block device /var/lib/ceph/tmp/mnt.Bch3JW/journal 2015-12-05 16:30:15.527045 7f2664cbc7c0 1 journal _open /var/lib/ceph/tmp/mnt.Bch3JW/journal fd 17: 103809024 bytes, block size 4096 bytes, directio = 1, aio = 1 2015-12-05 16:30:15.527069 7f2664cbc7c0 10 journal read_header 2015-12-05 16:30:15.540936 7f2664cbc7c0 10 journal header: block_size 4096 alignment 4096 max_size 103809024 2015-12-05 16:30:15.540961 7f2664cbc7c0 10 journal header: start 245760 2015-12-05 16:30:15.540964 7f2664cbc7c0 10 journal write_pos 4096 2015-12-05 16:30:15.540971 7f2664cbc7c0 10 journal open header.fsid = cfa4d906-2c4e-4545-98f1-82a2f7ccc6ed 2015-12-05 16:30:15.668964 7f2664cbc7c0 2 journal No further valid entries found, journal is most likely valid 2015-12-05 16:30:15.669006 7f2664cbc7c0 10 journal open reached end of journal. 2015-12-05 16:30:15.669028 7f2664cbc7c0 -1 journal Unable to read past sequence 2 but header indicates the journal has committed up through 20, journal is corrupt 2015-12-05 16:30:15.673736 7f2664cbc7c0 -1 os/FileJournal.cc: In function 'bool FileJournal::read_entry(ceph::bufferlist&, uint64_t&, bool*)' thread 7f2664cbc7c0 time 2015-12-05 16:30:15.669047 os/FileJournal.cc: 1907: FAILED assert(0) ceph version 10.0.0-855-g15a81bb (15a81bb7121799ba1b71b88b356998ebc8effec9) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x85) [0x7f26655faf25] 2: (FileJournal::read_entry(ceph::buffer::list&, unsigned long&, bool*)+0x8ad) [0x7f26653cd3ed] 3: (JournalingObjectStore::journal_replay(unsigned long)+0x218) [0x7f2665347468] 4: (FileStore::mount()+0x3caf) [0x7f266531ed8f] 5: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x190) [0x7f2664ffe7f0] 6: (main()+0xb94) [0x7f2664fa0414] 7: (__libc_start_main()+0xf5) [0x7f2661e1daf5] 8: (()+0x308e99) [0x7f2664fe1e99] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- begin dump of recent events --- -75> 2015-12-05 16:30:15.384988 7f2664cbc7c0 5 asok(0x7f26690be000) register_command perfcounters_dump hook 0x7f2669016030 -74> 2015-12-05 16:30:15.385016 7f2664cbc7c0 5 asok(0x7f26690be000) register_command 1 hook 0x7f2669016030 -73> 2015-12-05 16:30:15.385022 7f2664cbc7c0 5 asok(0x7f26690be000) register_command perf dump hook 0x7f2669016030 -72> 2015-12-05 16:30:15.385025 7f2664cbc7c0 5 asok(0x7f26690be000) register_command perfcounters_schema hook 0x7f2669016030 -71> 2015-12-05 16:30:15.385027 7f2664cbc7c0 5 asok(0x7f26690be000) register_command 2 hook 0x7f2669016030 -70> 2015-12-05 16:30:15.385028 7f2664cbc7c0 5 asok(0x7f26690be000) register_command perf schema hook 0x7f2669016030 -69> 2015-12-05 16:30:15.385031 7f2664cbc7c0 5 asok(0x7f26690be000) register_command perf reset hook 0x7f2669016030 -68> 2015-12-05 16:30:15.385033 7f2664cbc7c0 5 asok(0x7f26690be000) register_command config show hook 0x7f2669016030 -67> 2015-12-05 16:30:15.385035 7f2664cbc7c0 5 asok(0x7f26690be000) register_command config set hook 0x7f2669016030 -66> 2015-12-05 16:30:15.385039 7f2664cbc7c0 5 asok(0x7f26690be000) register_command config get hook 0x7f2669016030 -65> 2015-12-05 16:30:15.385041 7f2664cbc7c0 5 asok(0x7f26690be000) register_command config diff hook 0x7f2669016030 -64> 2015-12-05 16:30:15.385043 7f2664cbc7c0 5 asok(0x7f26690be000) register_command log flush hook 0x7f2669016030 -63> 2015-12-05 16:30:15.385051 7f2664cbc7c0 5 asok(0x7f26690be000) register_command log dump hook 0x7f2669016030 -62> 2015-12-05 16:30:15.385054 7f2664cbc7c0 5 asok(0x7f26690be000) register_command log reopen hook 0x7f2669016030 -61> 2015-12-05 16:30:15.390790 7f2664cbc7c0 0 set uid:gid to 167:167 -60> 2015-12-05 16:30:15.390901 7f2664cbc7c0 0 ceph version 10.0.0-855-g15a81bb (15a81bb7121799ba1b71b88b356998ebc8effec9), process ceph-osd, pid 2015 -59> 2015-12-05 16:30:15.415188 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) dump_stop -58> 2015-12-05 16:30:15.415211 7f2664cbc7c0 5 asok(0x7f26690be000) init /var/run/ceph/ceph-osd.4.asok -57> 2015-12-05 16:30:15.415221 7f2664cbc7c0 5 asok(0x7f26690be000) bind_and_listen /var/run/ceph/ceph-osd.4.asok -56> 2015-12-05 16:30:15.415447 7f2664cbc7c0 5 asok(0x7f26690be000) register_command 0 hook 0x7f26690120c0 -55> 2015-12-05 16:30:15.415462 7f2664cbc7c0 5 asok(0x7f26690be000) register_command version hook 0x7f26690120c0 -54> 2015-12-05 16:30:15.415465 7f2664cbc7c0 5 asok(0x7f26690be000) register_command git_version hook 0x7f26690120c0 -53> 2015-12-05 16:30:15.415468 7f2664cbc7c0 5 asok(0x7f26690be000) register_command help hook 0x7f2669016140 -52> 2015-12-05 16:30:15.415471 7f2664cbc7c0 5 asok(0x7f26690be000) register_command get_command_descriptions hook 0x7f2669016150 -51> 2015-12-05 16:30:15.415518 7f2664cbc7c0 10 monclient(hunting): build_initial_monmap -50> 2015-12-05 16:30:15.415529 7f265fa26700 5 asok(0x7f26690be000) entry start -49> 2015-12-05 16:30:15.415568 7f2664cbc7c0 10 monclient(hunting): get_monmap_privately -48> 2015-12-05 16:30:15.415662 7f2664cbc7c0 1 -- :/0 messenger.start -47> 2015-12-05 16:30:15.415691 7f2664cbc7c0 10 monclient(hunting): have 1 fsid 369e4618-1c88-464e-ad9c-87d4c005286a -46> 2015-12-05 16:30:15.415696 7f2664cbc7c0 1 -- :/3918120233 mark_down_all -45> 2015-12-05 16:30:15.415826 7f2664cbc7c0 1 -- :/3918120233 shutdown complete. -44> 2015-12-05 16:30:15.415850 7f2664cbc7c0 1 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) mkfs in /var/lib/ceph/tmp/mnt.Bch3JW -43> 2015-12-05 16:30:15.415876 7f2664cbc7c0 1 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) mkfs fsid is already set to cfa4d906-2c4e-4545-98f1-82a2f7ccc6ed -42> 2015-12-05 16:30:15.415886 7f2664cbc7c0 1 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) write_version_stamp 4 -41> 2015-12-05 16:30:15.418327 7f2664cbc7c0 0 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) backend xfs (magic 0x58465342) -40> 2015-12-05 16:30:15.441177 7f2664cbc7c0 1 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) leveldb db exists/created -39> 2015-12-05 16:30:15.441234 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) open_journal at /var/lib/ceph/tmp/mnt.Bch3JW/journal -38> 2015-12-05 16:30:15.441443 7f2664cbc7c0 10 journal _open_block_device: ignoring osd journal size. We'll use the entire block device (size: 103809536) -37> 2015-12-05 16:30:15.441466 7f2664cbc7c0 10 journal _check_disk_write_cache: not root, NOT checking disk write cache on raw block device /var/lib/ceph/tmp/mnt.Bch3JW/journal -36> 2015-12-05 16:30:15.441488 7f2664cbc7c0 1 journal _open /var/lib/ceph/tmp/mnt.Bch3JW/journal fd 11: 103809024 bytes, block size 4096 bytes, directio = 1, aio = 1 -35> 2015-12-05 16:30:15.441497 7f2664cbc7c0 10 journal read_header -34> 2015-12-05 16:30:15.443136 7f2664cbc7c0 10 journal header: block_size 4096 alignment 4096 max_size 103809024 -33> 2015-12-05 16:30:15.443155 7f2664cbc7c0 10 journal header: start 245760 -32> 2015-12-05 16:30:15.443158 7f2664cbc7c0 10 journal write_pos 0 -31> 2015-12-05 16:30:15.443162 7f2664cbc7c0 1 journal check: header looks ok -30> 2015-12-05 16:30:15.443172 7f2664cbc7c0 1 journal close /var/lib/ceph/tmp/mnt.Bch3JW/journal -29> 2015-12-05 16:30:15.501158 7f2664cbc7c0 1 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) mkfs done in /var/lib/ceph/tmp/mnt.Bch3JW -28> 2015-12-05 16:30:15.501215 7f2664cbc7c0 5 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) basedir /var/lib/ceph/tmp/mnt.Bch3JW journal /var/lib/ceph/tmp/mnt.Bch3JW/journal -27> 2015-12-05 16:30:15.501261 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) mount fsid is cfa4d906-2c4e-4545-98f1-82a2f7ccc6ed -26> 2015-12-05 16:30:15.501315 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) version_stamp_is_valid was 4 vs target 4 -25> 2015-12-05 16:30:15.501373 7f2664cbc7c0 0 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) backend xfs (magic 0x58465342) -24> 2015-12-05 16:30:15.509653 7f2664cbc7c0 0 genericfilestorebackend(/var/lib/ceph/tmp/mnt.Bch3JW) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option -23> 2015-12-05 16:30:15.509693 7f2664cbc7c0 0 genericfilestorebackend(/var/lib/ceph/tmp/mnt.Bch3JW) detect_features: SEEK_DATA/SEEK_HOLE is disabled via 'filestore seek data hole' config option -22> 2015-12-05 16:30:15.509746 7f2664cbc7c0 0 genericfilestorebackend(/var/lib/ceph/tmp/mnt.Bch3JW) detect_features: splice is supported -21> 2015-12-05 16:30:15.515329 7f2664cbc7c0 0 genericfilestorebackend(/var/lib/ceph/tmp/mnt.Bch3JW) detect_features: syncfs(2) syscall fully supported (by glibc and kernel) -20> 2015-12-05 16:30:15.515485 7f2664cbc7c0 0 xfsfilestorebackend(/var/lib/ceph/tmp/mnt.Bch3JW) detect_features: extsize is supported and your kernel >= 3.5 -19> 2015-12-05 16:30:15.516267 7f2664cbc7c0 5 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) mount op_seq is 1 -18> 2015-12-05 16:30:15.526622 7f2664cbc7c0 20 filestore (init)dbobjectmap: seq is 1 -17> 2015-12-05 16:30:15.526668 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) open_journal at /var/lib/ceph/tmp/mnt.Bch3JW/journal -16> 2015-12-05 16:30:15.526720 7f2664cbc7c0 0 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled -15> 2015-12-05 16:30:15.526732 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) list_collections -14> 2015-12-05 16:30:15.526923 7f2664cbc7c0 10 journal journal_replay fs op_seq 1 -13> 2015-12-05 16:30:15.526948 7f2664cbc7c0 2 journal open /var/lib/ceph/tmp/mnt.Bch3JW/journal fsid cfa4d906-2c4e-4545-98f1-82a2f7ccc6ed fs_op_seq 1 -12> 2015-12-05 16:30:15.527004 7f2664cbc7c0 10 journal _open_block_device: ignoring osd journal size. We'll use the entire block device (size: 103809536) -11> 2015-12-05 16:30:15.526971 7f265f225700 20 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) sync_entry waiting for max_interval 5.000000 -10> 2015-12-05 16:30:15.527016 7f2664cbc7c0 10 journal _check_disk_write_cache: not root, NOT checking disk write cache on raw block device /var/lib/ceph/tmp/mnt.Bch3JW/journal -9> 2015-12-05 16:30:15.527045 7f2664cbc7c0 1 journal _open /var/lib/ceph/tmp/mnt.Bch3JW/journal fd 17: 103809024 bytes, block size 4096 bytes, directio = 1, aio = 1 -8> 2015-12-05 16:30:15.527069 7f2664cbc7c0 10 journal read_header -7> 2015-12-05 16:30:15.540936 7f2664cbc7c0 10 journal header: block_size 4096 alignment 4096 max_size 103809024 -6> 2015-12-05 16:30:15.540961 7f2664cbc7c0 10 journal header: start 245760 -5> 2015-12-05 16:30:15.540964 7f2664cbc7c0 10 journal write_pos 4096 -4> 2015-12-05 16:30:15.540971 7f2664cbc7c0 10 journal open header.fsid = cfa4d906-2c4e-4545-98f1-82a2f7ccc6ed -3> 2015-12-05 16:30:15.668964 7f2664cbc7c0 2 journal No further valid entries found, journal is most likely valid -2> 2015-12-05 16:30:15.669006 7f2664cbc7c0 10 journal open reached end of journal. -1> 2015-12-05 16:30:15.669028 7f2664cbc7c0 -1 journal Unable to read past sequence 2 but header indicates the journal has committed up through 20, journal is corrupt 0> 2015-12-05 16:30:15.673736 7f2664cbc7c0 -1 os/FileJournal.cc: In function 'bool FileJournal::read_entry(ceph::bufferlist&, uint64_t&, bool*)' thread 7f2664cbc7c0 time 2015-12-05 16:30:15.669047 os/FileJournal.cc: 1907: FAILED assert(0) ceph version 10.0.0-855-g15a81bb (15a81bb7121799ba1b71b88b356998ebc8effec9) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x85) [0x7f26655faf25] 2: (FileJournal::read_entry(ceph::buffer::list&, unsigned long&, bool*)+0x8ad) [0x7f26653cd3ed] 3: (JournalingObjectStore::journal_replay(unsigned long)+0x218) [0x7f2665347468] 4: (FileStore::mount()+0x3caf) [0x7f266531ed8f] 5: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x190) [0x7f2664ffe7f0] 6: (main()+0xb94) [0x7f2664fa0414] 7: (__libc_start_main()+0xf5) [0x7f2661e1daf5] 8: (()+0x308e99) [0x7f2664fe1e99] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_replay 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 20/20 osd 0/ 5 optracker 0/ 5 objclass 20/20 filestore 1/ 3 keyvaluestore 20/20 journal 1/ 1 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/10 civetweb 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 xio 1/ 5 compressor 1/ 5 newstore -2/-2 (syslog threshold) -1/-1 (stderr threshold) max_recent 10000 max_new 1000 log_file /var/log/ceph/ceph-osd.4.log --- end dump of recent events --- 2015-12-05 16:30:15.674566 7f2664cbc7c0 -1 OSD::mkfs: caught unknown exception. 2015-12-05 16:30:15.674583 7f2664cbc7c0 5 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) umount /var/lib/ceph/tmp/mnt.Bch3JW 2015-12-05 16:30:15.674586 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) flush 2015-12-05 16:30:15.674591 7f2664cbc7c0 10 journal waiting for completions to empty 2015-12-05 16:30:15.674594 7f2664cbc7c0 10 journal flush waiting for finisher 2015-12-05 16:30:15.674600 7f2664cbc7c0 10 journal flush done 2015-12-05 16:30:15.674601 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) flush draining ondisk finisher 2015-12-05 16:30:15.674604 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) _flush_op_queue draining op tp 2015-12-05 16:30:15.674609 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) _flush_op_queue waiting for apply finisher 2015-12-05 16:30:15.674612 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) flush complete 2015-12-05 16:30:15.674629 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) start_sync 2015-12-05 16:30:15.674632 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) sync waiting 2015-12-05 16:30:15.674905 7f265f225700 20 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) sync_entry force_sync set 2015-12-05 16:30:15.674921 7f265f225700 10 journal commit_start max_applied_seq 1, open_ops 0 2015-12-05 16:30:15.674925 7f265f225700 10 journal commit_start blocked, all open_ops have completed 2015-12-05 16:30:15.674927 7f265f225700 10 journal commit_start nothing to do 2015-12-05 16:30:15.674930 7f265f225700 10 journal commit_start 2015-12-05 16:30:15.674943 7f265f225700 20 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) sync_entry waiting for max_interval 5.000000 2015-12-05 16:30:15.674981 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) sync done 2015-12-05 16:30:15.674987 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) do_force_sync 2015-12-05 16:30:15.675009 7f265f225700 20 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) sync_entry force_sync set 2015-12-05 16:30:15.675014 7f265f225700 10 journal commit_start max_applied_seq 1, open_ops 0 2015-12-05 16:30:15.675016 7f265f225700 10 journal commit_start blocked, all open_ops have completed 2015-12-05 16:30:15.675017 7f265f225700 10 journal commit_start nothing to do 2015-12-05 16:30:15.675019 7f265f225700 10 journal commit_start 2015-12-05 16:30:15.679658 7f2664cbc7c0 -1 common/config.cc: In function 'void md_config_t::remove_observer(md_config_obs_t*)' thread 7f2664cbc7c0 time 2015-12-05 16:30:15.675242 common/config.cc: 198: FAILED assert(found_obs) ceph version 10.0.0-855-g15a81bb (15a81bb7121799ba1b71b88b356998ebc8effec9) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x85) [0x7f26655faf25] 2: (md_config_t::remove_observer(md_config_obs_t*)+0xfc) [0x7f266562338c] 3: (ThreadPool::stop(bool)+0x1e1) [0x7f26655e9111] 4: (FileStore::umount()+0x193) [0x7f26652f6b33] 5: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x638) [0x7f2664ffec98] 6: (main()+0xb94) [0x7f2664fa0414] 7: (__libc_start_main()+0xf5) [0x7f2661e1daf5] 8: (()+0x308e99) [0x7f2664fe1e99] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- begin dump of recent events --- -25> 2015-12-05 16:30:15.674566 7f2664cbc7c0 -1 OSD::mkfs: caught unknown exception. -24> 2015-12-05 16:30:15.674583 7f2664cbc7c0 5 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) umount /var/lib/ceph/tmp/mnt.Bch3JW -23> 2015-12-05 16:30:15.674586 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) flush -22> 2015-12-05 16:30:15.674591 7f2664cbc7c0 10 journal waiting for completions to empty -21> 2015-12-05 16:30:15.674594 7f2664cbc7c0 10 journal flush waiting for finisher -20> 2015-12-05 16:30:15.674600 7f2664cbc7c0 10 journal flush done -19> 2015-12-05 16:30:15.674601 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) flush draining ondisk finisher -18> 2015-12-05 16:30:15.674604 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) _flush_op_queue draining op tp -17> 2015-12-05 16:30:15.674609 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) _flush_op_queue waiting for apply finisher -16> 2015-12-05 16:30:15.674612 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) flush complete -15> 2015-12-05 16:30:15.674629 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) start_sync -14> 2015-12-05 16:30:15.674632 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) sync waiting -13> 2015-12-05 16:30:15.674905 7f265f225700 20 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) sync_entry force_sync set -12> 2015-12-05 16:30:15.674921 7f265f225700 10 journal commit_start max_applied_seq 1, open_ops 0 -11> 2015-12-05 16:30:15.674925 7f265f225700 10 journal commit_start blocked, all open_ops have completed -10> 2015-12-05 16:30:15.674927 7f265f225700 10 journal commit_start nothing to do -9> 2015-12-05 16:30:15.674930 7f265f225700 10 journal commit_start -8> 2015-12-05 16:30:15.674943 7f265f225700 20 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) sync_entry waiting for max_interval 5.000000 -7> 2015-12-05 16:30:15.674981 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) sync done -6> 2015-12-05 16:30:15.674987 7f2664cbc7c0 10 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) do_force_sync -5> 2015-12-05 16:30:15.675009 7f265f225700 20 filestore(/var/lib/ceph/tmp/mnt.Bch3JW) sync_entry force_sync set -4> 2015-12-05 16:30:15.675014 7f265f225700 10 journal commit_start max_applied_seq 1, open_ops 0 -3> 2015-12-05 16:30:15.675016 7f265f225700 10 journal commit_start blocked, all open_ops have completed -2> 2015-12-05 16:30:15.675017 7f265f225700 10 journal commit_start nothing to do -1> 2015-12-05 16:30:15.675019 7f265f225700 10 journal commit_start 0> 2015-12-05 16:30:15.679658 7f2664cbc7c0 -1 common/config.cc: In function 'void md_config_t::remove_observer(md_config_obs_t*)' thread 7f2664cbc7c0 time 2015-12-05 16:30:15.675242 common/config.cc: 198: FAILED assert(found_obs) ceph version 10.0.0-855-g15a81bb (15a81bb7121799ba1b71b88b356998ebc8effec9) 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x85) [0x7f26655faf25] 2: (md_config_t::remove_observer(md_config_obs_t*)+0xfc) [0x7f266562338c] 3: (ThreadPool::stop(bool)+0x1e1) [0x7f26655e9111] 4: (FileStore::umount()+0x193) [0x7f26652f6b33] 5: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x638) [0x7f2664ffec98] 6: (main()+0xb94) [0x7f2664fa0414] 7: (__libc_start_main()+0xf5) [0x7f2661e1daf5] 8: (()+0x308e99) [0x7f2664fe1e99] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_replay 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 20/20 osd 0/ 5 optracker 0/ 5 objclass 20/20 filestore 1/ 3 keyvaluestore 20/20 journal 1/ 1 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/10 civetweb 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 xio 1/ 5 compressor 1/ 5 newstore -2/-2 (syslog threshold) -1/-1 (stderr threshold) max_recent 10000 max_new 1000 log_file /var/log/ceph/ceph-osd.4.log --- end dump of recent events --- 2015-12-05 16:30:15.682879 7f2664cbc7c0 -1 *** Caught signal (Aborted) ** in thread 7f2664cbc7c0 ceph version 10.0.0-855-g15a81bb (15a81bb7121799ba1b71b88b356998ebc8effec9) 1: (()+0x827632) [0x7f2665500632] 2: (()+0xf130) [0x7f2663651130] 3: (gsignal()+0x37) [0x7f2661e315d7] 4: (abort()+0x148) [0x7f2661e32cc8] 5: (__gnu_cxx::__verbose_terminate_handler()+0x165) [0x7f26627359b5] 6: (()+0x5e926) [0x7f2662733926] 7: (()+0x5e953) [0x7f2662733953] 8: (()+0x5eb73) [0x7f2662733b73] 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x27a) [0x7f26655fb11a] 10: (md_config_t::remove_observer(md_config_obs_t*)+0xfc) [0x7f266562338c] 11: (ThreadPool::stop(bool)+0x1e1) [0x7f26655e9111] 12: (FileStore::umount()+0x193) [0x7f26652f6b33] 13: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x638) [0x7f2664ffec98] 14: (main()+0xb94) [0x7f2664fa0414] 15: (__libc_start_main()+0xf5) [0x7f2661e1daf5] 16: (()+0x308e99) [0x7f2664fe1e99] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- begin dump of recent events --- 0> 2015-12-05 16:30:15.682879 7f2664cbc7c0 -1 *** Caught signal (Aborted) ** in thread 7f2664cbc7c0 ceph version 10.0.0-855-g15a81bb (15a81bb7121799ba1b71b88b356998ebc8effec9) 1: (()+0x827632) [0x7f2665500632] 2: (()+0xf130) [0x7f2663651130] 3: (gsignal()+0x37) [0x7f2661e315d7] 4: (abort()+0x148) [0x7f2661e32cc8] 5: (__gnu_cxx::__verbose_terminate_handler()+0x165) [0x7f26627359b5] 6: (()+0x5e926) [0x7f2662733926] 7: (()+0x5e953) [0x7f2662733953] 8: (()+0x5eb73) [0x7f2662733b73] 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x27a) [0x7f26655fb11a] 10: (md_config_t::remove_observer(md_config_obs_t*)+0xfc) [0x7f266562338c] 11: (ThreadPool::stop(bool)+0x1e1) [0x7f26655e9111] 12: (FileStore::umount()+0x193) [0x7f26652f6b33] 13: (OSD::mkfs(CephContext*, ObjectStore*, std::string const&, uuid_d, int)+0x638) [0x7f2664ffec98] 14: (main()+0xb94) [0x7f2664fa0414] 15: (__libc_start_main()+0xf5) [0x7f2661e1daf5] 16: (()+0x308e99) [0x7f2664fe1e99] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 rbd_replay 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 20/20 osd 0/ 5 optracker 0/ 5 objclass 20/20 filestore 1/ 3 keyvaluestore 20/20 journal 1/ 1 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 0/ 5 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/10 civetweb 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle 0/ 0 refs 1/ 5 xio 1/ 5 compressor 1/ 5 newstore -2/-2 (syslog threshold) -1/-1 (stderr threshold) max_recent 10000 max_new 1000 log_file /var/log/ceph/ceph-osd.4.log --- end dump of recent events ---