Ceph

2014-08-14 10:58:00.735648 7f69e0b35800 0 ceph version 0.83-428-g0279503 (02795034ea5b03e2c38dcb6f21de33f9949f9624), process ceph-osd, pid 18632

2014-08-14 10:58:00.735797 7f69e0b35800 10 filestore(/ceph0) dump_stop

2014-08-14 10:58:00.735873 7f69e0b35800 10 monclient(hunting): build_initial_monmap

2014-08-14 10:58:00.735893 7f69e0b35800 10 monclient(hunting): get_monmap_privately

2014-08-14 10:58:00.735963 7f69e0b35800 10 monclient(hunting): have 0 fsid 3627692e-e777-4634-b161-35e9a11cf0a9

2014-08-14 10:58:00.736083 7f69e0b35800 1 filestore(/ceph0) mkfs in /ceph0

2014-08-14 10:58:00.736149 7f69e0b35800 1 filestore(/ceph0) mkfs generated fsid 7dcd93fb-ae59-4f6f-a096-64bb88d1ae47

2014-08-14 10:58:00.780885 7f69e0b35800 10 filestore(/ceph0) mkfs fsid is 7dcd93fb-ae59-4f6f-a096-64bb88d1ae47

2014-08-14 10:58:00.853639 7f69e0b35800 0 filestore(/ceph0) backend generic (magic 0xef53)

2014-08-14 10:58:00.920706 7f69e0b35800 1 filestore(/ceph0) leveldb db exists/created

2014-08-14 10:58:00.920756 7f69e0b35800 10 filestore(/ceph0) open_journal at /dev/sdc1

2014-08-14 10:58:00.920832 7f69e0b35800 10 journal _open_block_device: ignoring osd journal size. We'll use the entire block device (size: 15032385536)

2014-08-14 10:58:00.934019 7f69e0b35800 20 journal _check_disk_write_cache: disk write cache is on, but your kernel is new enough to handle it correctly. (fn:/dev/sdc1)

2014-08-14 10:58:00.934254 7f69e0b35800 1 journal _open /dev/sdc1 fd 10: 15032385536 bytes, block size 4096 bytes, directio = 1, aio = 1

2014-08-14 10:58:00.934288 7f69e0b35800 10 journal read_header

2014-08-14 10:58:00.934643 7f69e0b35800 -1 journal read_header error decoding journal header

2014-08-14 10:58:00.934759 7f69e0b35800 2 journal create /dev/sdc1 fsid 7dcd93fb-ae59-4f6f-a096-64bb88d1ae47

2014-08-14 10:58:00.934791 7f69e0b35800 10 journal _open_block_device: ignoring osd journal size. We'll use the entire block device (size: 15032385536)

2014-08-14 10:58:00.943999 7f69e0b35800 20 journal _check_disk_write_cache: disk write cache is on, but your kernel is new enough to handle it correctly. (fn:/dev/sdc1)

2014-08-14 10:58:00.944247 7f69e0b35800 1 journal _open /dev/sdc1 fd 10: 15032385536 bytes, block size 4096 bytes, directio = 1, aio = 1

2014-08-14 10:58:00.944275 7f69e0b35800 10 journal header: block_size 4096 alignment 4096 max_size 15032385536

2014-08-14 10:58:00.944278 7f69e0b35800 10 journal header: start 4096

2014-08-14 10:58:00.944279 7f69e0b35800 10 journal write_pos 0

2014-08-14 10:58:00.945051 7f69e0b35800 2 journal create done

2014-08-14 10:58:00.945085 7f69e0b35800 0 filestore(/ceph0) mkjournal created journal on /dev/sdc1

2014-08-14 10:58:00.945115 7f69e0b35800 1 filestore(/ceph0) mkfs done in /ceph0

2014-08-14 10:58:00.945143 7f69e0b35800 5 filestore(/ceph0) basedir /ceph0 journal /dev/sdc1

2014-08-14 10:58:00.945192 7f69e0b35800 10 filestore(/ceph0) mount fsid is 7dcd93fb-ae59-4f6f-a096-64bb88d1ae47

2014-08-14 10:58:00.945279 7f69e0b35800 0 filestore(/ceph0) backend generic (magic 0xef53)

2014-08-14 10:58:00.968996 7f69e0b35800 0 genericfilestorebackend(/ceph0) detect_features: FIEMAP ioctl is supported and appears to work

2014-08-14 10:58:00.969019 7f69e0b35800 0 genericfilestorebackend(/ceph0) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option

2014-08-14 10:58:01.005331 7f69e0b35800 0 genericfilestorebackend(/ceph0) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)

2014-08-14 10:58:01.071603 7f69e0b35800 0 filestore(/ceph0) limited size xattrs

2014-08-14 10:58:01.071764 7f69e0b35800 5 filestore(/ceph0) mount op_seq is 1

2014-08-14 10:58:01.109042 7f69e0b35800 20 filestore (init)dbobjectmap: seq is 1

2014-08-14 10:58:01.109075 7f69e0b35800 10 filestore(/ceph0) open_journal at /dev/sdc1

2014-08-14 10:58:01.109099 7f69e0b35800 0 filestore(/ceph0) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled

2014-08-14 10:58:01.109109 7f69e0b35800 10 filestore(/ceph0) list_collections

2014-08-14 10:58:01.109212 7f69e0b35800 10 journal journal_replay fs op_seq 1

2014-08-14 10:58:01.109224 7f69e0b35800 2 journal open /dev/sdc1 fsid 7dcd93fb-ae59-4f6f-a096-64bb88d1ae47 fs_op_seq 1

2014-08-14 10:58:01.109223 7f69dc50f700 20 filestore(/ceph0) sync_entry waiting for max_interval 5.000000

2014-08-14 10:58:01.109250 7f69e0b35800 10 journal _open_block_device: ignoring osd journal size. We'll use the entire block device (size: 15032385536)

2014-08-14 10:58:01.113164 7f69e0b35800 20 journal _check_disk_write_cache: disk write cache is on, but your kernel is new enough to handle it correctly. (fn:/dev/sdc1)

2014-08-14 10:58:01.113409 7f69e0b35800 1 journal _open /dev/sdc1 fd 16: 15032385536 bytes, block size 4096 bytes, directio = 1, aio = 1

2014-08-14 10:58:01.113429 7f69e0b35800 10 journal read_header

2014-08-14 10:58:01.113621 7f69e0b35800 10 journal header: block_size 4096 alignment 4096 max_size 15032385536

2014-08-14 10:58:01.113635 7f69e0b35800 10 journal header: start 4096

2014-08-14 10:58:01.113638 7f69e0b35800 10 journal write_pos 4096

2014-08-14 10:58:01.113641 7f69e0b35800 10 journal open header.fsid = 7dcd93fb-ae59-4f6f-a096-64bb88d1ae47

2014-08-14 10:58:01.113720 7f69e0b35800 2 journal No further valid entries found, journal is most likely valid

2014-08-14 10:58:01.113723 7f69e0b35800 10 journal open reached end of journal.

2014-08-14 10:58:01.113732 7f69e0b35800 2 journal No further valid entries found, journal is most likely valid

2014-08-14 10:58:01.113733 7f69e0b35800 3 journal journal_replay: end of journal, done.

2014-08-14 10:58:01.113735 7f69e0b35800 10 journal make_writeable

2014-08-14 10:58:01.113879 7f69e0b35800 10 journal _open_block_device: ignoring osd journal size. We'll use the entire block device (size: 15032385536)

2014-08-14 10:58:01.123182 7f69e0b35800 20 journal _check_disk_write_cache: disk write cache is on, but your kernel is new enough to handle it correctly. (fn:/dev/sdc1)

2014-08-14 10:58:01.123443 7f69e0b35800 1 journal _open /dev/sdc1 fd 16: 15032385536 bytes, block size 4096 bytes, directio = 1, aio = 1

2014-08-14 10:58:01.123545 7f69e0b35800 10 journal journal_start

2014-08-14 10:58:01.123546 7f69dbd0e700 10 journal write_thread_entry start

2014-08-14 10:58:01.123564 7f69dbd0e700 20 journal prepare_multi_write queue_pos now 4096

2014-08-14 10:58:01.123581 7f69dad0c700 10 journal write_finish_thread_entry enter

2014-08-14 10:58:01.123593 7f69dad0c700 20 journal write_finish_thread_entry sleeping

2014-08-14 10:58:01.123602 7f69dbd0e700 15 journal do_aio_write writing 4096~0 + header

2014-08-14 10:58:01.123607 7f69dbd0e700 20 journal write_aio_bl 0~4096 seq 0

2014-08-14 10:58:01.123666 7f69dbd0e700 20 journal write_aio_bl .. 0~4096 in 1

2014-08-14 10:58:01.123717 7f69dbd0e700 20 journal write_aio_bl 4096~0 seq 0

2014-08-14 10:58:01.123729 7f69dbd0e700 5 journal put_throttle finished 0 ops and 0 bytes, now 0 ops and 0 bytes

2014-08-14 10:58:01.123769 7f69dbd0e700 20 journal write_thread_entry going to sleep

2014-08-14 10:58:01.123787 7f69dad0c700 20 journal write_finish_thread_entry waiting for aio(s)

2014-08-14 10:58:01.123811 7f69e0b35800 15 filestore(/ceph0) read meta/23c2fcde/osd_superblock/0//-1 0~0

2014-08-14 10:58:01.123840 7f69dad0c700 10 journal write_finish_thread_entry aio 0~4096 done

2014-08-14 10:58:01.123852 7f69dad0c700 20 journal check_aio_completion

2014-08-14 10:58:01.123854 7f69dad0c700 20 journal check_aio_completion completed seq 0 0~4096

2014-08-14 10:58:01.123857 7f69dad0c700 20 journal check_aio_completion queueing finishers through seq 0

2014-08-14 10:58:01.123865 7f69dad0c700 20 journal write_finish_thread_entry sleeping

2014-08-14 10:58:01.123881 7f69e0b35800 -1 filestore(/ceph0) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory

2014-08-14 10:58:01.123905 7f69e0b35800 10 filestore(/ceph0) FileStore::read(meta/23c2fcde/osd_superblock/0//-1) open error: (2) No such file or directory

2014-08-14 10:58:01.123952 7f69e0b35800 5 filestore(/ceph0) queue_transactions new osr(default 0x25e2b90)/0x25e2b90

2014-08-14 10:58:01.123965 7f69e0b35800 10 journal op_submit_start 2

2014-08-14 10:58:01.123967 7f69e0b35800 5 filestore(/ceph0) queue_transactions (writeahead) 2 0x7fff46519a50

2014-08-14 10:58:01.123972 7f69e0b35800 10 journal op_journal_transactions 2 0x7fff46519a50

2014-08-14 10:58:01.123976 7f69e0b35800 5 journal submit_entry seq 2 len 505 (0x25a3270)

2014-08-14 10:58:01.123988 7f69e0b35800 10 journal op_submit_finish 2

2014-08-14 10:58:01.123996 7f69dbd0e700 20 journal write_thread_entry woke up

2014-08-14 10:58:01.124010 7f69dbd0e700 10 journal room 15032381439 max_size 15032385536 pos 4096 header.start 4096 top 4096

2014-08-14 10:58:01.124018 7f69dbd0e700 10 journal check_for_full at 4096 : 4096 < 15032381439

2014-08-14 10:58:01.124022 7f69dbd0e700 15 journal prepare_single_write 1 will write 4096 : seq 2 len 505 -> 4096 (head 40 pre_pad 0 ebl 505 post_pad 3511 tail 40) (ebl alignment -1)

2014-08-14 10:58:01.124054 7f69dbd0e700 20 journal prepare_multi_write queue_pos now 8192

2014-08-14 10:58:01.124059 7f69dbd0e700 15 journal do_aio_write writing 4096~4096

2014-08-14 10:58:01.124069 7f69dbd0e700 20 journal write_aio_bl 4096~4096 seq 2

2014-08-14 10:58:01.124079 7f69dbd0e700 20 journal write_aio_bl .. 4096~4096 in 1

2014-08-14 10:58:01.124115 7f69dbd0e700 5 journal put_throttle finished 1 ops and 505 bytes, now 0 ops and 0 bytes

2014-08-14 10:58:01.124122 7f69dbd0e700 20 journal write_thread_entry going to sleep

2014-08-14 10:58:01.124151 7f69dad0c700 20 journal write_finish_thread_entry waiting for aio(s)

2014-08-14 10:58:01.124282 7f69dad0c700 10 journal write_finish_thread_entry aio 4096~4096 done

2014-08-14 10:58:01.124298 7f69dad0c700 20 journal check_aio_completion

2014-08-14 10:58:01.124300 7f69dad0c700 20 journal check_aio_completion completed seq 2 4096~4096

2014-08-14 10:58:01.124306 7f69dad0c700 20 journal check_aio_completion queueing finishers through seq 2

2014-08-14 10:58:01.124309 7f69dad0c700 10 journal queue_completions_thru seq 2 queueing seq 2 0x25a3270 lat 0.000328

2014-08-14 10:58:01.124331 7f69dad0c700 20 journal write_finish_thread_entry sleeping

2014-08-14 10:58:01.124343 7f69da50b700 5 filestore(/ceph0) _journaled_ahead 0x25a46e0 seq 2 osr(default 0x25e2b90) 0x7fff46519a50

2014-08-14 10:58:01.124357 7f69da50b700 5 filestore(/ceph0) queue_op 0x25a46e0 seq 2 osr(default 0x25e2b90) 499 bytes (queue has 1 ops and 499 bytes)

2014-08-14 10:58:01.124394 7f69d9d0a700 10 journal op_apply_start 2 open_ops 0 -> 1

2014-08-14 10:58:01.124406 7f69d9d0a700 5 filestore(/ceph0) _do_op 0x25a46e0 seq 2 osr(default 0x25e2b90)/0x25e2b90 start

2014-08-14 10:58:01.124416 7f69d9d0a700 10 filestore(/ceph0) _do_transaction on 0x7fff46519a50

2014-08-14 10:58:01.124452 7f69d9d0a700 15 filestore(/ceph0) create_collection /ceph0/current/meta

2014-08-14 10:58:01.124532 7f69d9d0a700 10 filestore(/ceph0) create_collection /ceph0/current/meta = 0

2014-08-14 10:58:01.124622 7f69d9d0a700 10 filestore(/ceph0) _set_replay_guard 2.0.0

2014-08-14 10:58:01.133133 7f69d9d0a700 20 filestore dbobjectmap: seq is 1

2014-08-14 10:58:01.163349 7f69d9d0a700 10 filestore(/ceph0) _set_replay_guard 2.0.0 done

2014-08-14 10:58:01.163403 7f69d9d0a700 15 filestore(/ceph0) write meta/23c2fcde/osd_superblock/0//-1 0~358

2014-08-14 10:58:01.163539 7f69d9d0a700 10 filestore(/ceph0) write meta/23c2fcde/osd_superblock/0//-1 0~358 = 358

2014-08-14 10:58:01.163545 7f69d9d0a700 10 journal op_apply_finish 2 open_ops 1 -> 0, max_applied_seq 1 -> 2

2014-08-14 10:58:01.163547 7f69d9d0a700 10 filestore(/ceph0) _do_op 0x25a46e0 seq 2 r = 0, finisher 0x25a3210 0

2014-08-14 10:58:01.163550 7f69d9d0a700 10 filestore(/ceph0) _finish_op 0x25a46e0 seq 2 osr(default 0x25e2b90)/0x25e2b90

2014-08-14 10:58:01.163576 7f69e0b35800 10 filestore(/ceph0) sync_and_flush

2014-08-14 10:58:01.163579 7f69e0b35800 10 journal waiting for completions to empty

2014-08-14 10:58:01.163580 7f69e0b35800 10 journal flush waiting for finisher

2014-08-14 10:58:01.163581 7f69e0b35800 10 journal flush done

2014-08-14 10:58:01.163581 7f69e0b35800 10 filestore(/ceph0) _flush_op_queue draining op tp

2014-08-14 10:58:01.163583 7f69e0b35800 10 filestore(/ceph0) _flush_op_queue waiting for apply finisher

2014-08-14 10:58:01.163584 7f69e0b35800 10 filestore(/ceph0) sync_and_flush done

2014-08-14 10:58:01.285007 7f69e0b35800 5 filestore(/ceph0) umount /ceph0

2014-08-14 10:58:01.285041 7f69dc50f700 20 filestore(/ceph0) sync_entry force_sync set

2014-08-14 10:58:01.285074 7f69dc50f700 10 journal commit_start max_applied_seq 2, open_ops 0

2014-08-14 10:58:01.285080 7f69dc50f700 10 journal commit_start blocked, all open_ops have completed

2014-08-14 10:58:01.285081 7f69dc50f700 10 journal commit_start committing 2, still blocked

2014-08-14 10:58:01.285083 7f69dc50f700 10 journal commit_start

2014-08-14 10:58:01.285101 7f69dc50f700 15 filestore(/ceph0) sync_entry committing 2 sync_epoch 1

2014-08-14 10:58:01.285107 7f69dc50f700 10 journal commit_started committing 2, unblocking

2014-08-14 10:58:01.285116 7f69dc50f700 15 genericfilestorebackend(/ceph0) syncfs: doing a full sync (syncfs(2) if possible)

2014-08-14 10:58:01.345228 7f69dc50f700 10 filestore(/ceph0) sync_entry commit took 0.060144, interval was 0.236006

2014-08-14 10:58:01.345251 7f69dc50f700 10 journal commit_finish thru 2

2014-08-14 10:58:01.345256 7f69dc50f700 5 journal committed_thru 2 (last_committed_seq 1)

2014-08-14 10:58:01.345260 7f69dc50f700 10 journal header: block_size 4096 alignment 4096 max_size 15032385536

2014-08-14 10:58:01.345262 7f69dc50f700 10 journal header: start 8192

2014-08-14 10:58:01.345263 7f69dc50f700 10 journal write_pos 8192

2014-08-14 10:58:01.345264 7f69dc50f700 10 journal committed_thru done

2014-08-14 10:58:01.345275 7f69dc50f700 15 filestore(/ceph0) sync_entry committed to op_seq 2

2014-08-14 10:58:01.345592 7f69e0b35800 10 journal journal_stop

2014-08-14 10:58:01.345740 7f69e0b35800 1 journal close /dev/sdc1

2014-08-14 10:58:01.345800 7f69dbd0e700 20 journal write_thread_entry woke up

2014-08-14 10:58:01.345802 7f69dad0c700 10 journal write_finish_thread_entry exit

2014-08-14 10:58:01.345813 7f69dbd0e700 20 journal prepare_multi_write queue_pos now 8192

2014-08-14 10:58:01.345833 7f69dbd0e700 15 journal do_aio_write writing 8192~0 + header

2014-08-14 10:58:01.345837 7f69dbd0e700 20 journal write_aio_bl 0~4096 seq 0

2014-08-14 10:58:01.345842 7f69dbd0e700 20 journal write_aio_bl .. 0~4096 in 1

2014-08-14 10:58:01.345887 7f69dbd0e700 20 journal write_aio_bl 8192~0 seq 2

2014-08-14 10:58:01.345890 7f69dbd0e700 5 journal put_throttle finished 0 ops and 0 bytes, now 0 ops and 0 bytes

2014-08-14 10:58:01.345891 7f69dbd0e700 10 journal write_thread_entry finish

2014-08-14 10:58:01.346518 7f69e0b35800 -1 created object store /ceph0 journal /dev/sdc1 for osd.0 fsid 3627692e-e777-4634-b161-35e9a11cf0a9

2014-08-14 10:58:01.540839 7f944f5e4800 0 ceph version 0.83-428-g0279503 (02795034ea5b03e2c38dcb6f21de33f9949f9624), process ceph-osd, pid 18719

2014-08-14 10:58:01.541507 7f944f5e4800 10 filestore(/var/lib/ceph/osd/ceph-0) dump_stop

2014-08-14 10:58:01.541611 7f944f5e4800 5 filestore(/var/lib/ceph/osd/ceph-0) basedir /var/lib/ceph/osd/ceph-0 journal /var/lib/ceph/osd/ceph-0/journal

2014-08-14 10:58:01.541639 7f944f5e4800 10 filestore(/var/lib/ceph/osd/ceph-0) mount fsid is 7dcd93fb-ae59-4f6f-a096-64bb88d1ae47

2014-08-14 10:58:01.541724 7f944f5e4800 0 filestore(/var/lib/ceph/osd/ceph-0) backend generic (magic 0xef53)

2014-08-14 10:58:01.567649 7f944f5e4800 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: FIEMAP ioctl is supported and appears to work

2014-08-14 10:58:01.567671 7f944f5e4800 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option

2014-08-14 10:58:01.597827 7f944f5e4800 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)

2014-08-14 10:58:01.664146 7f944f5e4800 0 filestore(/var/lib/ceph/osd/ceph-0) limited size xattrs

2014-08-14 10:58:01.664301 7f944f5e4800 5 filestore(/var/lib/ceph/osd/ceph-0) mount op_seq is 2

2014-08-14 10:58:01.731520 7f944f5e4800 20 filestore (init)dbobjectmap: seq is 1

2014-08-14 10:58:01.731544 7f944f5e4800 10 filestore(/var/lib/ceph/osd/ceph-0) open_journal at /var/lib/ceph/osd/ceph-0/journal

2014-08-14 10:58:01.731586 7f944f5e4800 0 filestore(/var/lib/ceph/osd/ceph-0) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled

2014-08-14 10:58:01.731595 7f944f5e4800 10 filestore(/var/lib/ceph/osd/ceph-0) list_collections

2014-08-14 10:58:01.731753 7f944f5e4800 10 journal journal_replay fs op_seq 2

2014-08-14 10:58:01.731767 7f944f5e4800 2 journal open /var/lib/ceph/osd/ceph-0/journal fsid 7dcd93fb-ae59-4f6f-a096-64bb88d1ae47 fs_op_seq 2

2014-08-14 10:58:01.731802 7f944f5e4800 10 journal _open_block_device: ignoring osd journal size. We'll use the entire block device (size: 15032385536)

2014-08-14 10:58:01.731811 7f944a7bd700 20 filestore(/var/lib/ceph/osd/ceph-0) sync_entry waiting for max_interval 5.000000

2014-08-14 10:58:01.735317 7f944f5e4800 20 journal _check_disk_write_cache: disk write cache is on, but your kernel is new enough to handle it correctly. (fn:/var/lib/ceph/osd/ceph-0/journal)

2014-08-14 10:58:01.735576 7f944f5e4800 1 journal _open /var/lib/ceph/osd/ceph-0/journal fd 20: 15032385536 bytes, block size 4096 bytes, directio = 1, aio = 1

2014-08-14 10:58:01.735595 7f944f5e4800 10 journal read_header

2014-08-14 10:58:01.735953 7f944f5e4800 -1 journal read_header error decoding journal header

2014-08-14 10:58:01.735976 7f944f5e4800 3 journal journal_replay open failed with (22) Invalid argument

2014-08-14 10:58:01.736016 7f944f5e4800 -1 filestore(/var/lib/ceph/osd/ceph-0) mount failed to open journal /var/lib/ceph/osd/ceph-0/journal: (22) Invalid argument

2014-08-14 10:58:01.736078 7f944a7bd700 20 filestore(/var/lib/ceph/osd/ceph-0) sync_entry woke after 0.004266

2014-08-14 10:58:01.736100 7f944a7bd700 20 filestore(/var/lib/ceph/osd/ceph-0) sync_entry waiting for another 0.005734 to reach min interval 0.010000

2014-08-14 10:58:01.741933 7f944a7bd700 10 journal commit_start max_applied_seq 2, open_ops 0

2014-08-14 10:58:01.741945 7f944a7bd700 10 journal commit_start blocked, all open_ops have completed

2014-08-14 10:58:01.741947 7f944a7bd700 10 journal commit_start nothing to do

2014-08-14 10:58:01.742194 7f944f5e4800 -1  ** ERROR: error converting store /var/lib/ceph/osd/ceph-0: (22) Invalid argument

2014-08-14 10:58:01.927388 7fc92b2d2800 0 ceph version 0.83-428-g0279503 (02795034ea5b03e2c38dcb6f21de33f9949f9624), process ceph-osd, pid 18784

2014-08-14 10:58:01.928083 7fc92b2d2800 10 filestore(/var/lib/ceph/osd/ceph-0) dump_stop

2014-08-14 10:58:01.928191 7fc92b2d2800 5 filestore(/var/lib/ceph/osd/ceph-0) basedir /var/lib/ceph/osd/ceph-0 journal /var/lib/ceph/osd/ceph-0/journal

2014-08-14 10:58:01.928222 7fc92b2d2800 10 filestore(/var/lib/ceph/osd/ceph-0) mount fsid is 7dcd93fb-ae59-4f6f-a096-64bb88d1ae47

2014-08-14 10:58:01.928286 7fc92b2d2800 0 filestore(/var/lib/ceph/osd/ceph-0) backend generic (magic 0xef53)

2014-08-14 10:58:01.959833 7fc92b2d2800 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: FIEMAP ioctl is supported and appears to work

2014-08-14 10:58:01.959847 7fc92b2d2800 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option

2014-08-14 10:58:01.996290 7fc92b2d2800 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)

2014-08-14 10:58:02.068799 7fc92b2d2800 0 filestore(/var/lib/ceph/osd/ceph-0) limited size xattrs

2014-08-14 10:58:02.068886 7fc92b2d2800 5 filestore(/var/lib/ceph/osd/ceph-0) mount op_seq is 2

2014-08-14 10:58:02.111989 7fc92b2d2800 20 filestore (init)dbobjectmap: seq is 1

2014-08-14 10:58:02.112012 7fc92b2d2800 10 filestore(/var/lib/ceph/osd/ceph-0) open_journal at /var/lib/ceph/osd/ceph-0/journal

2014-08-14 10:58:02.112051 7fc92b2d2800 0 filestore(/var/lib/ceph/osd/ceph-0) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled

2014-08-14 10:58:02.112059 7fc92b2d2800 10 filestore(/var/lib/ceph/osd/ceph-0) list_collections

2014-08-14 10:58:02.112201 7fc92b2d2800 10 journal journal_replay fs op_seq 2

2014-08-14 10:58:02.112214 7fc92b2d2800 2 journal open /var/lib/ceph/osd/ceph-0/journal fsid 7dcd93fb-ae59-4f6f-a096-64bb88d1ae47 fs_op_seq 2

2014-08-14 10:58:02.112247 7fc92b2d2800 10 journal _open_block_device: ignoring osd journal size. We'll use the entire block device (size: 15032385536)

2014-08-14 10:58:02.112236 7fc9264ab700 20 filestore(/var/lib/ceph/osd/ceph-0) sync_entry waiting for max_interval 5.000000

2014-08-14 10:58:02.114773 7fc92b2d2800 20 journal _check_disk_write_cache: disk write cache is on, but your kernel is new enough to handle it correctly. (fn:/var/lib/ceph/osd/ceph-0/journal)

2014-08-14 10:58:02.115007 7fc92b2d2800 1 journal _open /var/lib/ceph/osd/ceph-0/journal fd 20: 15032385536 bytes, block size 4096 bytes, directio = 1, aio = 1

2014-08-14 10:58:02.115026 7fc92b2d2800 10 journal read_header

2014-08-14 10:58:02.115340 7fc92b2d2800 -1 journal read_header error decoding journal header

2014-08-14 10:58:02.115357 7fc92b2d2800 3 journal journal_replay open failed with (22) Invalid argument

2014-08-14 10:58:02.115399 7fc92b2d2800 -1 filestore(/var/lib/ceph/osd/ceph-0) mount failed to open journal /var/lib/ceph/osd/ceph-0/journal: (22) Invalid argument

2014-08-14 10:58:02.115437 7fc9264ab700 20 filestore(/var/lib/ceph/osd/ceph-0) sync_entry woke after 0.003201

2014-08-14 10:58:02.115452 7fc9264ab700 20 filestore(/var/lib/ceph/osd/ceph-0) sync_entry waiting for another 0.006799 to reach min interval 0.010000

2014-08-14 10:58:02.122373 7fc9264ab700 10 journal commit_start max_applied_seq 2, open_ops 0

2014-08-14 10:58:02.122391 7fc9264ab700 10 journal commit_start blocked, all open_ops have completed

2014-08-14 10:58:02.122395 7fc9264ab700 10 journal commit_start nothing to do

2014-08-14 10:58:02.122553 7fc92b2d2800 -1  ** ERROR: error converting store /var/lib/ceph/osd/ceph-0: (22) Invalid argument

2014-08-14 10:58:02.318591 7f6200fb0800 0 ceph version 0.83-428-g0279503 (02795034ea5b03e2c38dcb6f21de33f9949f9624), process ceph-osd, pid 18848

2014-08-14 10:58:02.319442 7f6200fb0800 10 filestore(/var/lib/ceph/osd/ceph-0) dump_stop

2014-08-14 10:58:02.319588 7f6200fb0800 5 filestore(/var/lib/ceph/osd/ceph-0) basedir /var/lib/ceph/osd/ceph-0 journal /var/lib/ceph/osd/ceph-0/journal

2014-08-14 10:58:02.319624 7f6200fb0800 10 filestore(/var/lib/ceph/osd/ceph-0) mount fsid is 7dcd93fb-ae59-4f6f-a096-64bb88d1ae47

2014-08-14 10:58:02.319707 7f6200fb0800 0 filestore(/var/lib/ceph/osd/ceph-0) backend generic (magic 0xef53)

2014-08-14 10:58:02.346327 7f6200fb0800 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: FIEMAP ioctl is supported and appears to work

2014-08-14 10:58:02.346341 7f6200fb0800 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option

2014-08-14 10:58:02.955574 7f6200fb0800 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)

2014-08-14 10:58:03.043093 7f6200fb0800 0 filestore(/var/lib/ceph/osd/ceph-0) limited size xattrs

2014-08-14 10:58:03.043298 7f6200fb0800 5 filestore(/var/lib/ceph/osd/ceph-0) mount op_seq is 2

2014-08-14 10:58:03.092292 7f6200fb0800 20 filestore (init)dbobjectmap: seq is 1

2014-08-14 10:58:03.092316 7f6200fb0800 10 filestore(/var/lib/ceph/osd/ceph-0) open_journal at /var/lib/ceph/osd/ceph-0/journal

2014-08-14 10:58:03.092360 7f6200fb0800 0 filestore(/var/lib/ceph/osd/ceph-0) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled

2014-08-14 10:58:03.092368 7f6200fb0800 10 filestore(/var/lib/ceph/osd/ceph-0) list_collections

2014-08-14 10:58:03.092523 7f6200fb0800 10 journal journal_replay fs op_seq 2

2014-08-14 10:58:03.092537 7f6200fb0800 2 journal open /var/lib/ceph/osd/ceph-0/journal fsid 7dcd93fb-ae59-4f6f-a096-64bb88d1ae47 fs_op_seq 2

2014-08-14 10:58:03.092572 7f6200fb0800 10 journal _open_block_device: ignoring osd journal size. We'll use the entire block device (size: 15032385536)

2014-08-14 10:58:03.092562 7f61fc189700 20 filestore(/var/lib/ceph/osd/ceph-0) sync_entry waiting for max_interval 5.000000

2014-08-14 10:58:03.105222 7f6200fb0800 20 journal _check_disk_write_cache: disk write cache is on, but your kernel is new enough to handle it correctly. (fn:/var/lib/ceph/osd/ceph-0/journal)

2014-08-14 10:58:03.105405 7f6200fb0800 1 journal _open /var/lib/ceph/osd/ceph-0/journal fd 20: 15032385536 bytes, block size 4096 bytes, directio = 1, aio = 1

2014-08-14 10:58:03.105423 7f6200fb0800 10 journal read_header

2014-08-14 10:58:03.105807 7f6200fb0800 -1 journal read_header error decoding journal header

2014-08-14 10:58:03.105820 7f6200fb0800 3 journal journal_replay open failed with (22) Invalid argument

2014-08-14 10:58:03.105845 7f6200fb0800 -1 filestore(/var/lib/ceph/osd/ceph-0) mount failed to open journal /var/lib/ceph/osd/ceph-0/journal: (22) Invalid argument

2014-08-14 10:58:03.105885 7f61fc189700 20 filestore(/var/lib/ceph/osd/ceph-0) sync_entry woke after 0.013323

2014-08-14 10:58:03.105920 7f61fc189700 10 journal commit_start max_applied_seq 2, open_ops 0

2014-08-14 10:58:03.105926 7f61fc189700 10 journal commit_start blocked, all open_ops have completed

2014-08-14 10:58:03.105934 7f61fc189700 10 journal commit_start nothing to do

2014-08-14 10:58:03.106178 7f6200fb0800 -1  ** ERROR: error converting store /var/lib/ceph/osd/ceph-0: (22) Invalid argument

2014-08-14 10:58:03.284023 7f98a7ba3800 0 ceph version 0.83-428-g0279503 (02795034ea5b03e2c38dcb6f21de33f9949f9624), process ceph-osd, pid 18913

2014-08-14 10:58:03.284844 7f98a7ba3800 10 filestore(/var/lib/ceph/osd/ceph-0) dump_stop

2014-08-14 10:58:03.284993 7f98a7ba3800 5 filestore(/var/lib/ceph/osd/ceph-0) basedir /var/lib/ceph/osd/ceph-0 journal /var/lib/ceph/osd/ceph-0/journal

2014-08-14 10:58:03.285027 7f98a7ba3800 10 filestore(/var/lib/ceph/osd/ceph-0) mount fsid is 7dcd93fb-ae59-4f6f-a096-64bb88d1ae47

2014-08-14 10:58:03.285111 7f98a7ba3800 0 filestore(/var/lib/ceph/osd/ceph-0) backend generic (magic 0xef53)

2014-08-14 10:58:03.308559 7f98a7ba3800 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: FIEMAP ioctl is supported and appears to work

2014-08-14 10:58:03.308573 7f98a7ba3800 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option

2014-08-14 10:58:03.338991 7f98a7ba3800 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)

2014-08-14 10:58:03.429192 7f98a7ba3800 0 filestore(/var/lib/ceph/osd/ceph-0) limited size xattrs

2014-08-14 10:58:03.429395 7f98a7ba3800 5 filestore(/var/lib/ceph/osd/ceph-0) mount op_seq is 2

2014-08-14 10:58:03.478492 7f98a7ba3800 20 filestore (init)dbobjectmap: seq is 1

2014-08-14 10:58:03.478525 7f98a7ba3800 10 filestore(/var/lib/ceph/osd/ceph-0) open_journal at /var/lib/ceph/osd/ceph-0/journal

2014-08-14 10:58:03.478568 7f98a7ba3800 0 filestore(/var/lib/ceph/osd/ceph-0) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled

2014-08-14 10:58:03.478577 7f98a7ba3800 10 filestore(/var/lib/ceph/osd/ceph-0) list_collections

2014-08-14 10:58:03.478734 7f98a7ba3800 10 journal journal_replay fs op_seq 2

2014-08-14 10:58:03.478747 7f98a7ba3800 2 journal open /var/lib/ceph/osd/ceph-0/journal fsid 7dcd93fb-ae59-4f6f-a096-64bb88d1ae47 fs_op_seq 2

2014-08-14 10:58:03.478782 7f98a7ba3800 10 journal _open_block_device: ignoring osd journal size. We'll use the entire block device (size: 15032385536)

2014-08-14 10:58:03.478768 7f98a2d7c700 20 filestore(/var/lib/ceph/osd/ceph-0) sync_entry waiting for max_interval 5.000000

2014-08-14 10:58:03.490960 7f98a7ba3800 20 journal _check_disk_write_cache: disk write cache is on, but your kernel is new enough to handle it correctly. (fn:/var/lib/ceph/osd/ceph-0/journal)

2014-08-14 10:58:03.491199 7f98a7ba3800 1 journal _open /var/lib/ceph/osd/ceph-0/journal fd 20: 15032385536 bytes, block size 4096 bytes, directio = 1, aio = 1

2014-08-14 10:58:03.491217 7f98a7ba3800 10 journal read_header

2014-08-14 10:58:03.491546 7f98a7ba3800 -1 journal read_header error decoding journal header

2014-08-14 10:58:03.491572 7f98a7ba3800 3 journal journal_replay open failed with (22) Invalid argument

2014-08-14 10:58:03.491635 7f98a7ba3800 -1 filestore(/var/lib/ceph/osd/ceph-0) mount failed to open journal /var/lib/ceph/osd/ceph-0/journal: (22) Invalid argument

2014-08-14 10:58:03.491683 7f98a2d7c700 20 filestore(/var/lib/ceph/osd/ceph-0) sync_entry woke after 0.012914

2014-08-14 10:58:03.491718 7f98a2d7c700 10 journal commit_start max_applied_seq 2, open_ops 0

2014-08-14 10:58:03.491723 7f98a2d7c700 10 journal commit_start blocked, all open_ops have completed

2014-08-14 10:58:03.491729 7f98a2d7c700 10 journal commit_start nothing to do

2014-08-14 10:58:03.491928 7f98a7ba3800 -1  ** ERROR: error converting store /var/lib/ceph/osd/ceph-0: (22) Invalid argument

2014-08-14 10:58:03.686358 7fcb0250e800 0 ceph version 0.83-428-g0279503 (02795034ea5b03e2c38dcb6f21de33f9949f9624), process ceph-osd, pid 18978

2014-08-14 10:58:03.687238 7fcb0250e800 10 filestore(/var/lib/ceph/osd/ceph-0) dump_stop

2014-08-14 10:58:03.687418 7fcb0250e800 5 filestore(/var/lib/ceph/osd/ceph-0) basedir /var/lib/ceph/osd/ceph-0 journal /var/lib/ceph/osd/ceph-0/journal

2014-08-14 10:58:03.687460 7fcb0250e800 10 filestore(/var/lib/ceph/osd/ceph-0) mount fsid is 7dcd93fb-ae59-4f6f-a096-64bb88d1ae47

2014-08-14 10:58:03.687541 7fcb0250e800 0 filestore(/var/lib/ceph/osd/ceph-0) backend generic (magic 0xef53)

2014-08-14 10:58:03.712601 7fcb0250e800 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: FIEMAP ioctl is supported and appears to work

2014-08-14 10:58:03.712616 7fcb0250e800 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option

2014-08-14 10:58:03.743036 7fcb0250e800 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)

2014-08-14 10:58:03.815673 7fcb0250e800 0 filestore(/var/lib/ceph/osd/ceph-0) limited size xattrs

2014-08-14 10:58:03.815818 7fcb0250e800 5 filestore(/var/lib/ceph/osd/ceph-0) mount op_seq is 2

2014-08-14 10:58:03.858842 7fcb0250e800 20 filestore (init)dbobjectmap: seq is 1

2014-08-14 10:58:03.858864 7fcb0250e800 10 filestore(/var/lib/ceph/osd/ceph-0) open_journal at /var/lib/ceph/osd/ceph-0/journal

2014-08-14 10:58:03.858903 7fcb0250e800 0 filestore(/var/lib/ceph/osd/ceph-0) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled

2014-08-14 10:58:03.858911 7fcb0250e800 10 filestore(/var/lib/ceph/osd/ceph-0) list_collections

2014-08-14 10:58:03.859052 7fcb0250e800 10 journal journal_replay fs op_seq 2

2014-08-14 10:58:03.859065 7fcb0250e800 2 journal open /var/lib/ceph/osd/ceph-0/journal fsid 7dcd93fb-ae59-4f6f-a096-64bb88d1ae47 fs_op_seq 2

2014-08-14 10:58:03.859097 7fcb0250e800 10 journal _open_block_device: ignoring osd journal size. We'll use the entire block device (size: 15032385536)

2014-08-14 10:58:03.859095 7fcafd6e7700 20 filestore(/var/lib/ceph/osd/ceph-0) sync_entry waiting for max_interval 5.000000

2014-08-14 10:58:03.861940 7fcb0250e800 20 journal _check_disk_write_cache: disk write cache is on, but your kernel is new enough to handle it correctly. (fn:/var/lib/ceph/osd/ceph-0/journal)

2014-08-14 10:58:03.862176 7fcb0250e800 1 journal _open /var/lib/ceph/osd/ceph-0/journal fd 20: 15032385536 bytes, block size 4096 bytes, directio = 1, aio = 1

2014-08-14 10:58:03.862194 7fcb0250e800 10 journal read_header

2014-08-14 10:58:03.862538 7fcb0250e800 -1 journal read_header error decoding journal header

2014-08-14 10:58:03.862560 7fcb0250e800 3 journal journal_replay open failed with (22) Invalid argument

2014-08-14 10:58:03.862604 7fcb0250e800 -1 filestore(/var/lib/ceph/osd/ceph-0) mount failed to open journal /var/lib/ceph/osd/ceph-0/journal: (22) Invalid argument

2014-08-14 10:58:03.862642 7fcafd6e7700 20 filestore(/var/lib/ceph/osd/ceph-0) sync_entry woke after 0.003546

2014-08-14 10:58:03.862656 7fcafd6e7700 20 filestore(/var/lib/ceph/osd/ceph-0) sync_entry waiting for another 0.006454 to reach min interval 0.010000

2014-08-14 10:58:03.869232 7fcafd6e7700 10 journal commit_start max_applied_seq 2, open_ops 0

2014-08-14 10:58:03.869250 7fcafd6e7700 10 journal commit_start blocked, all open_ops have completed

2014-08-14 10:58:03.869254 7fcafd6e7700 10 journal commit_start nothing to do

2014-08-14 10:58:03.869479 7fcb0250e800 -1  ** ERROR: error converting store /var/lib/ceph/osd/ceph-0: (22) Invalid argument

2014-08-14 10:58:04.061609 7fad1fdbc800 0 ceph version 0.83-428-g0279503 (02795034ea5b03e2c38dcb6f21de33f9949f9624), process ceph-osd, pid 19042

2014-08-14 10:58:04.062440 7fad1fdbc800 10 filestore(/var/lib/ceph/osd/ceph-0) dump_stop

2014-08-14 10:58:04.062568 7fad1fdbc800 5 filestore(/var/lib/ceph/osd/ceph-0) basedir /var/lib/ceph/osd/ceph-0 journal /var/lib/ceph/osd/ceph-0/journal

2014-08-14 10:58:04.062603 7fad1fdbc800 10 filestore(/var/lib/ceph/osd/ceph-0) mount fsid is 7dcd93fb-ae59-4f6f-a096-64bb88d1ae47

2014-08-14 10:58:04.062674 7fad1fdbc800 0 filestore(/var/lib/ceph/osd/ceph-0) backend generic (magic 0xef53)

2014-08-14 10:58:04.093183 7fad1fdbc800 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: FIEMAP ioctl is supported and appears to work

2014-08-14 10:58:04.093198 7fad1fdbc800 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: FIEMAP ioctl is disabled via 'filestore fiemap' config option

2014-08-14 10:58:04.123575 7fad1fdbc800 0 genericfilestorebackend(/var/lib/ceph/osd/ceph-0) detect_features: syncfs(2) syscall fully supported (by glibc and kernel)

2014-08-14 10:58:04.195794 7fad1fdbc800 0 filestore(/var/lib/ceph/osd/ceph-0) limited size xattrs

2014-08-14 10:58:04.195958 7fad1fdbc800 5 filestore(/var/lib/ceph/osd/ceph-0) mount op_seq is 2

2014-08-14 10:58:04.244963 7fad1fdbc800 20 filestore (init)dbobjectmap: seq is 1

2014-08-14 10:58:04.244987 7fad1fdbc800 10 filestore(/var/lib/ceph/osd/ceph-0) open_journal at /var/lib/ceph/osd/ceph-0/journal

2014-08-14 10:58:04.245018 7fad1fdbc800 0 filestore(/var/lib/ceph/osd/ceph-0) mount: enabling WRITEAHEAD journal mode: checkpoint is not enabled

2014-08-14 10:58:04.245026 7fad1fdbc800 10 filestore(/var/lib/ceph/osd/ceph-0) list_collections

2014-08-14 10:58:04.245178 7fad1fdbc800 10 journal journal_replay fs op_seq 2

2014-08-14 10:58:04.245190 7fad1fdbc800 2 journal open /var/lib/ceph/osd/ceph-0/journal fsid 7dcd93fb-ae59-4f6f-a096-64bb88d1ae47 fs_op_seq 2

2014-08-14 10:58:04.245211 7fad1af95700 20 filestore(/var/lib/ceph/osd/ceph-0) sync_entry waiting for max_interval 5.000000

2014-08-14 10:58:04.245224 7fad1fdbc800 10 journal _open_block_device: ignoring osd journal size. We'll use the entire block device (size: 15032385536)

2014-08-14 10:58:04.258183 7fad1fdbc800 20 journal _check_disk_write_cache: disk write cache is on, but your kernel is new enough to handle it correctly. (fn:/var/lib/ceph/osd/ceph-0/journal)

2014-08-14 10:58:04.258404 7fad1fdbc800 1 journal _open /var/lib/ceph/osd/ceph-0/journal fd 20: 15032385536 bytes, block size 4096 bytes, directio = 1, aio = 1

2014-08-14 10:58:04.258420 7fad1fdbc800 10 journal read_header

2014-08-14 10:58:04.258813 7fad1fdbc800 -1 journal read_header error decoding journal header

2014-08-14 10:58:04.258837 7fad1fdbc800 3 journal journal_replay open failed with (22) Invalid argument

2014-08-14 10:58:04.258893 7fad1fdbc800 -1 filestore(/var/lib/ceph/osd/ceph-0) mount failed to open journal /var/lib/ceph/osd/ceph-0/journal: (22) Invalid argument

2014-08-14 10:58:04.258967 7fad1af95700 20 filestore(/var/lib/ceph/osd/ceph-0) sync_entry woke after 0.013756

2014-08-14 10:58:04.258995 7fad1af95700 10 journal commit_start max_applied_seq 2, open_ops 0

2014-08-14 10:58:04.258999 7fad1af95700 10 journal commit_start blocked, all open_ops have completed

2014-08-14 10:58:04.259000 7fad1af95700 10 journal commit_start nothing to do

2014-08-14 10:58:04.259170 7fad1fdbc800 -1  ** ERROR: error converting store /var/lib/ceph/osd/ceph-0: (22) Invalid argument