2013-08-14 10:51:29.883788 7fae80c69780 0 ceph version 0.61.7 (8f010aff684e820ecc837c25ac77c7a05d7191ff), process ceph-osd, pid 1389 2013-08-14 10:51:29.883809 7fae80c69780 -1  ** ERROR: unable to open OSD superblock on /var/lib/ceph/osd/ceph-3: (2) No such file or directory 2013-08-14 11:02:03.099139 7f9f571ee780 0 ceph version 0.61.7 (8f010aff684e820ecc837c25ac77c7a05d7191ff), process ceph-osd, pid 1371 2013-08-14 11:02:03.099160 7f9f571ee780 -1  ** ERROR: unable to open OSD superblock on /var/lib/ceph/osd/ceph-3: (2) No such file or directory 2013-08-14 11:06:51.062877 7f5417127780 0 ceph version 0.61.7 (8f010aff684e820ecc837c25ac77c7a05d7191ff), process ceph-osd, pid 5017 2013-08-14 11:06:51.066365 7f5417127780 1 filestore(/var/lib/ceph/osd/ceph-3) mkfs in /var/lib/ceph/osd/ceph-3 2013-08-14 11:06:51.066725 7f5417127780 1 filestore(/var/lib/ceph/osd/ceph-3) mkfs generated fsid cb4062db-e763-4b76-bbf8-745e315f87be 2013-08-14 11:06:51.240351 7f5417127780 1 filestore(/var/lib/ceph/osd/ceph-3) leveldb db exists/created 2013-08-14 11:06:51.240504 7f5417127780 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2013-08-14 11:06:51.240751 7f5417127780 1 journal _open /var/lib/ceph/osd/ceph-3/journal fd 10: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0 2013-08-14 11:06:51.241107 7f5417127780 0 filestore(/var/lib/ceph/osd/ceph-3) mkjournal created journal on /var/lib/ceph/osd/ceph-3/journal 2013-08-14 11:06:51.241122 7f5417127780 1 filestore(/var/lib/ceph/osd/ceph-3) mkfs done in /var/lib/ceph/osd/ceph-3 2013-08-14 11:06:51.244609 7f5417127780 0 filestore(/var/lib/ceph/osd/ceph-3) mount FIEMAP ioctl is supported and appears to work 2013-08-14 11:06:51.244627 7f5417127780 0 filestore(/var/lib/ceph/osd/ceph-3) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option 2013-08-14 11:06:51.245051 7f5417127780 0 filestore(/var/lib/ceph/osd/ceph-3) mount did NOT detect btrfs 2013-08-14 11:06:51.246141 7f5417127780 0 filestore(/var/lib/ceph/osd/ceph-3) mount syncfs(2) syscall fully supported (by glibc and kernel) 2013-08-14 11:06:51.246211 7f5417127780 0 filestore(/var/lib/ceph/osd/ceph-3) mount found snaps <> 2013-08-14 11:06:51.247272 7f5417127780 0 filestore(/var/lib/ceph/osd/ceph-3) mount: enabling WRITEAHEAD journal mode: btrfs not detected 2013-08-14 11:06:51.247376 7f5417127780 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2013-08-14 11:06:51.247392 7f5417127780 1 journal _open /var/lib/ceph/osd/ceph-3/journal fd 16: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0 2013-08-14 11:06:51.247567 7f5417127780 1 journal _open /var/lib/ceph/osd/ceph-3/journal fd 16: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0 2013-08-14 11:06:51.247920 7f5417127780 -1 filestore(/var/lib/ceph/osd/ceph-3) could not find 23c2fcde/osd_superblock/0//-1 in index: (2) No such file or directory 2013-08-14 11:06:51.265238 7f5417127780 1 journal close /var/lib/ceph/osd/ceph-3/journal 2013-08-14 11:06:51.265572 7f5417127780 -1 created object store /var/lib/ceph/osd/ceph-3 journal /var/lib/ceph/osd/ceph-3/journal for osd.3 fsid d5ebc320-db52-4b88-9ddc-0242a477fc8f 2013-08-14 11:06:51.265619 7f5417127780 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2013-08-14 11:06:51.265715 7f5417127780 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2013-08-14 11:08:10.130602 7fdeb815f780 0 ceph version 0.61.7 (8f010aff684e820ecc837c25ac77c7a05d7191ff), process ceph-osd, pid 8707 2013-08-14 11:08:10.139030 7fdeb815f780 0 filestore(/var/lib/ceph/osd/ceph-3) mount FIEMAP ioctl is supported and appears to work 2013-08-14 11:08:10.139054 7fdeb815f780 0 filestore(/var/lib/ceph/osd/ceph-3) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option 2013-08-14 11:08:10.139473 7fdeb815f780 0 filestore(/var/lib/ceph/osd/ceph-3) mount did NOT detect btrfs 2013-08-14 11:08:10.164461 7fdeb815f780 0 filestore(/var/lib/ceph/osd/ceph-3) mount syncfs(2) syscall fully supported (by glibc and kernel) 2013-08-14 11:08:10.164570 7fdeb815f780 0 filestore(/var/lib/ceph/osd/ceph-3) mount found snaps <> 2013-08-14 11:08:10.166365 7fdeb815f780 0 filestore(/var/lib/ceph/osd/ceph-3) mount: enabling WRITEAHEAD journal mode: btrfs not detected 2013-08-14 11:08:10.166560 7fdeb815f780 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2013-08-14 11:08:10.166581 7fdeb815f780 1 journal _open /var/lib/ceph/osd/ceph-3/journal fd 19: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0 2013-08-14 11:08:10.166813 7fdeb815f780 1 journal _open /var/lib/ceph/osd/ceph-3/journal fd 19: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0 2013-08-14 11:08:10.167289 7fdeb815f780 1 journal close /var/lib/ceph/osd/ceph-3/journal 2013-08-14 11:08:10.171520 7fdeb815f780 0 filestore(/var/lib/ceph/osd/ceph-3) mount FIEMAP ioctl is supported and appears to work 2013-08-14 11:08:10.171532 7fdeb815f780 0 filestore(/var/lib/ceph/osd/ceph-3) mount FIEMAP ioctl is disabled via 'filestore fiemap' config option 2013-08-14 11:08:10.171960 7fdeb815f780 0 filestore(/var/lib/ceph/osd/ceph-3) mount did NOT detect btrfs 2013-08-14 11:08:10.172580 7fdeb815f780 0 filestore(/var/lib/ceph/osd/ceph-3) mount syncfs(2) syscall fully supported (by glibc and kernel) 2013-08-14 11:08:10.172633 7fdeb815f780 0 filestore(/var/lib/ceph/osd/ceph-3) mount found snaps <> 2013-08-14 11:08:10.173758 7fdeb815f780 0 filestore(/var/lib/ceph/osd/ceph-3) mount: enabling WRITEAHEAD journal mode: btrfs not detected 2013-08-14 11:08:10.173873 7fdeb815f780 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2013-08-14 11:08:10.173889 7fdeb815f780 1 journal _open /var/lib/ceph/osd/ceph-3/journal fd 27: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0 2013-08-14 11:08:10.173960 7fdeb815f780 1 journal _open /var/lib/ceph/osd/ceph-3/journal fd 27: 1048576000 bytes, block size 4096 bytes, directio = 1, aio = 0 2013-08-14 11:09:29.969693 7fdea20be700 0 -- 10.202.1.54:6804/8707 >> 10.202.1.54:6801/7819 pipe(0x22a6c80 sd=30 :39356 s=2 pgs=3 cs=1 l=0).fault with nothing to send, going to standby 2013-08-14 11:09:33.203474 7fdea4dc8700 0 log [INF] : 0.16 deep-scrub ok 2013-08-14 11:09:34.192063 7fdea4dc8700 0 log [INF] : 0.5f deep-scrub ok 2013-08-14 11:09:36.192503 7fdea4dc8700 0 log [INF] : 0.8b deep-scrub ok 2013-08-14 11:09:40.193020 7fdea4dc8700 0 log [INF] : 0.9f deep-scrub ok 2013-08-14 11:09:43.193446 7fdea4dc8700 0 log [INF] : 0.b2 deep-scrub ok 2013-08-14 11:09:44.193617 7fdea4dc8700 0 log [INF] : 0.c4 deep-scrub ok 2013-08-14 11:09:49.194184 7fdea4dc8700 0 log [INF] : 0.f6 deep-scrub ok 2013-08-14 11:09:52.194508 7fdea4dc8700 0 log [INF] : 0.10e deep-scrub ok 2013-08-14 11:09:54.194876 7fdea4dc8700 0 log [INF] : 0.193 deep-scrub ok 2013-08-14 11:09:57.195496 7fdea4dc8700 0 log [INF] : 0.19f deep-scrub ok 2013-08-14 11:09:58.195582 7fdea4dc8700 0 log [INF] : 0.1a7 deep-scrub ok 2013-08-14 11:10:02.196094 7fdea4dc8700 0 log [INF] : 0.1b6 deep-scrub ok 2013-08-14 11:11:57.230411 7fdea4dc8700 0 log [INF] : 0.2 deep-scrub ok 2013-08-14 11:11:58.230571 7fdea4dc8700 0 log [INF] : 0.3 deep-scrub ok 2013-08-14 11:12:03.231857 7fdea4dc8700 0 log [INF] : 0.5 deep-scrub ok 2013-08-14 11:12:04.233223 7fdea4dc8700 0 log [INF] : 0.c deep-scrub ok 2013-08-14 11:12:06.232275 7fdea4dc8700 0 log [INF] : 0.10 deep-scrub ok 2013-08-14 11:12:08.233189 7fdea4dc8700 0 log [INF] : 0.12 deep-scrub ok 2013-08-14 11:12:13.233116 7fdea4dc8700 0 log [INF] : 0.18 deep-scrub ok 2013-08-14 11:12:19.233685 7fdea4dc8700 0 log [INF] : 0.19 deep-scrub ok 2013-08-14 11:12:22.234049 7fdea4dc8700 0 log [INF] : 0.2b deep-scrub ok 2013-08-14 11:12:23.234175 7fdea4dc8700 0 log [INF] : 0.2d deep-scrub ok 2013-08-14 11:12:28.236278 7fdea4dc8700 0 log [INF] : 0.32 deep-scrub ok 2013-08-14 11:12:30.234879 7fdea4dc8700 0 log [INF] : 0.37 deep-scrub ok 2013-08-14 11:12:32.235152 7fdea4dc8700 0 log [INF] : 0.3a deep-scrub ok 2013-08-14 11:12:39.235811 7fdea4dc8700 0 log [INF] : 0.4d deep-scrub ok 2013-08-14 11:12:42.236161 7fdea4dc8700 0 log [INF] : 0.5a deep-scrub ok 2013-08-14 11:12:44.236417 7fdea4dc8700 0 log [INF] : 0.5b deep-scrub ok 2013-08-14 11:12:49.236821 7fdea4dc8700 0 log [INF] : 0.6f deep-scrub ok 2013-08-14 11:12:51.237190 7fdea4dc8700 0 log [INF] : 0.75 deep-scrub ok 2013-08-14 11:13:03.238396 7fdea4dc8700 0 log [INF] : 0.7e deep-scrub ok 2013-08-14 11:13:09.238943 7fdea4dc8700 0 log [INF] : 0.84 deep-scrub ok 2013-08-14 11:13:10.239291 7fdea4dc8700 0 log [INF] : 0.8d deep-scrub ok 2013-08-14 11:13:13.239453 7fdea4dc8700 0 log [INF] : 0.98 deep-scrub ok 2013-08-14 11:13:14.239537 7fdea4dc8700 0 log [INF] : 0.99 deep-scrub ok 2013-08-14 11:13:15.239683 7fdea4dc8700 0 log [INF] : 0.a2 deep-scrub ok 2013-08-14 11:13:16.240044 7fdea4dc8700 0 log [INF] : 0.a7 deep-scrub ok 2013-08-14 11:13:19.240318 7fdea4dc8700 0 log [INF] : 0.a9 deep-scrub ok 2013-08-14 11:13:22.240712 7fdea4dc8700 0 log [INF] : 0.ae deep-scrub ok 2013-08-14 11:13:24.240847 7fdea4dc8700 0 log [INF] : 0.b6 deep-scrub ok 2013-08-14 11:13:27.241221 7fdea4dc8700 0 log [INF] : 0.bf deep-scrub ok 2013-08-14 11:13:28.241364 7fdea4dc8700 0 log [INF] : 0.c8 deep-scrub ok 2013-08-14 11:13:33.241913 7fdea4dc8700 0 log [INF] : 0.d1 deep-scrub ok 2013-08-14 11:13:36.242194 7fdea4dc8700 0 log [INF] : 0.d2 deep-scrub ok 2013-08-14 11:13:37.242380 7fdea4dc8700 0 log [INF] : 0.e3 deep-scrub ok 2013-08-14 11:13:41.242900 7fdea4dc8700 0 log [INF] : 0.e6 deep-scrub ok 2013-08-14 11:13:42.242939 7fdea4dc8700 0 log [INF] : 0.e9 deep-scrub ok 2013-08-14 11:13:43.243368 7fdea4dc8700 0 log [INF] : 0.f1 deep-scrub ok 2013-08-14 11:13:45.243564 7fdea4dc8700 0 log [INF] : 0.f4 deep-scrub ok 2013-08-14 11:13:46.243669 7fdea4dc8700 0 log [INF] : 0.114 deep-scrub ok 2013-08-14 11:13:53.244753 7fdea4dc8700 0 log [INF] : 0.117 deep-scrub ok 2013-08-14 11:13:57.245109 7fdea4dc8700 0 log [INF] : 0.127 deep-scrub ok 2013-08-14 11:14:01.245643 7fdea4dc8700 0 log [INF] : 0.12c deep-scrub ok 2013-08-14 11:14:06.246054 7fdea4dc8700 0 log [INF] : 0.12f deep-scrub ok 2013-08-14 11:14:07.246225 7fdea4dc8700 0 log [INF] : 0.131 deep-scrub ok 2013-08-14 11:14:10.246612 7fdea4dc8700 0 log [INF] : 0.134 deep-scrub ok 2013-08-14 11:14:14.247047 7fdea4dc8700 0 log [INF] : 0.143 deep-scrub ok 2013-08-14 11:14:17.247516 7fdea4dc8700 0 log [INF] : 0.155 deep-scrub ok 2013-08-14 11:14:20.247788 7fdea4dc8700 0 log [INF] : 0.15c deep-scrub ok 2013-08-14 11:14:23.248256 7fdea4dc8700 0 log [INF] : 0.162 deep-scrub ok 2013-08-14 11:14:24.248271 7fdea4dc8700 0 log [INF] : 0.166 deep-scrub ok 2013-08-14 11:14:25.248644 7fdea4dc8700 0 log [INF] : 0.169 deep-scrub ok 2013-08-14 11:14:28.248963 7fdea4dc8700 0 log [INF] : 0.16b deep-scrub ok 2013-08-14 11:14:29.249156 7fdea4dc8700 0 log [INF] : 0.170 deep-scrub ok 2013-08-14 11:14:30.249224 7fdea4dc8700 0 log [INF] : 0.178 deep-scrub ok 2013-08-14 11:14:32.249572 7fdea4dc8700 0 log [INF] : 0.17d deep-scrub ok 2013-08-14 11:14:33.249666 7fdea4dc8700 0 log [INF] : 0.19c deep-scrub ok 2013-08-14 11:14:34.249871 7fdea4dc8700 0 log [INF] : 0.1a2 deep-scrub ok 2013-08-14 11:14:36.250231 7fdea4dc8700 0 log [INF] : 0.1ab deep-scrub ok 2013-08-14 11:14:38.250411 7fdea4dc8700 0 log [INF] : 0.1b1 deep-scrub ok 2013-08-14 11:14:47.251446 7fdea4dc8700 0 log [INF] : 0.1b7 deep-scrub ok 2013-08-14 11:14:48.251509 7fdea4dc8700 0 log [INF] : 0.1ba deep-scrub ok 2013-08-14 11:14:52.251986 7fdea4dc8700 0 log [INF] : 1.1 deep-scrub ok 2013-08-14 11:14:56.252325 7fdea4dc8700 0 log [INF] : 1.2 deep-scrub ok 2013-08-14 11:15:01.253438 7fdea4dc8700 0 log [INF] : 1.4 deep-scrub ok 2013-08-14 11:15:04.254683 7fdea4dc8700 0 log [INF] : 0.6a deep-scrub ok