-- Reboot -- Sep 12 22:28:10 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:28:23 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:28:23 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:28:23 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:28:30 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 12 22:28:30 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 12 22:28:31 node1.ceph ceph-osd[1686]: 2017-09-12 22:28:31.014197 7f922c909d00 -1 Public network was set, but cluster network was not set Sep 12 22:28:31 node1.ceph ceph-osd[1686]: 2017-09-12 22:28:31.014248 7f922c909d00 -1 Using public network also for cluster network Sep 12 22:28:31 node1.ceph ceph-osd[1686]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 12 22:28:31 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:28:31 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:28:31 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:28:52 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:28:52 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:28:52 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:29:12 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:29:12 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:29:13 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:29:14 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:14.412833 7f922c909d00 -1 osd.1 16543 PGs are upgrading Sep 12 22:29:14 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:14.413789 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.3a4( v 16543'6100770 (16516'6097676,16543'6100770] local-lis/les=16409/16409 n=3199 ec=2543/2543 lis/c 16407/16407 les/c/f 16409/16463/0 16403/16407/16259) [33,21,1] r=2 lpr=0 crt=16543'6100770 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:14 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:14.454569 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.2e( v 16543'20454134 (16528'20451077,16543'20454134] local-lis/les=16202/16202 n=3064 ec=104/104 lis/c 16201/16201 les/c/f 16202/16219/0 16200/16201/16201) [13,11,1] r=2 lpr=0 crt=16543'20454134 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:14 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:14.516992 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.86( v 16543'7285791 (16485'7282784,16543'7285791] local-lis/les=16373/16373 n=3249 ec=107/107 lis/c 16372/16372 les/c/f 16373/16469/0 16371/16372/16372) [23,1,16] r=1 lpr=0 crt=16543'7285791 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:14 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:14.561138 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.1ad( v 16543'4296862 (16541'4293815,16543'4296862] local-lis/les=16260/16260 n=3067 ec=104/104 lis/c 16259/16259 les/c/f 16260/16261/0 16258/16259/16259) [33,1,31] r=1 lpr=0 crt=16543'4296862 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:14 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:14.581209 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.20a( v 16543'6767870 (16485'6764841,16543'6767870] local-lis/les=16437/16437 n=3081 ec=2543/2543 lis/c 16436/16436 les/c/f 16437/16471/0 16436/16436/16250) [38,18,1] r=2 lpr=0 crt=16543'6767870 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:14 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:14.604792 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.5a( v 16543'7710819 (16469'7707774,16543'7710819] local-lis/les=16503/16503 n=2995 ec=104/104 lis/c 16502/16502 les/c/f 16503/16503/0 16437/16502/16171) [1,32,20] r=0 lpr=0 crt=16543'7710819 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:14 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:14.628578 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.41( v 16543'989063 (16328'985971,16543'989063] local-lis/les=16410/16410 n=1236 ec=6474/6474 lis/c 16405/16405 les/c/f 16410/16467/0 16404/16405/16171) [1,26,40] r=0 lpr=0 crt=16543'989063 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 9 Sep 12 22:29:14 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:14.669175 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.16f( v 16543'1561982 (16461'1558913,16543'1561982] local-lis/les=16267/16267 n=1138 ec=6474/6474 lis/c 16266/16266 les/c/f 16267/16267/0 16265/16266/16266) [40,27,1] r=2 lpr=0 crt=16543'1561982 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:14 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:14.723355 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.61( v 16543'10284902 (16497'10281825,16543'10284902] local-lis/les=16410/16410 n=2922 ec=104/104 lis/c 16407/16407 les/c/f 16410/16469/0 16404/16407/16407) [26,10,1] r=2 lpr=0 crt=16543'10284902 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:14 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:14.758826 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.b5( v 16543'6319443 (16485'6316385,16543'6319443] local-lis/les=16466/16466 n=2980 ec=104/104 lis/c 16465/16465 les/c/f 16466/16469/0 16464/16465/16171) [1,32,36] r=0 lpr=0 crt=16543'6319443 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:14 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:14.786434 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.c2( v 16543'12858537 (16514'12855459,16543'12858537] local-lis/les=16466/16466 n=3045 ec=104/104 lis/c 16465/16465 les/c/f 16466/16469/0 16464/16465/16171) [1,17,36] r=0 lpr=0 crt=16543'12858537 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:14 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:14.806470 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.d6( v 16543'11075697 (16511'11072691,16543'11075697] local-lis/les=16373/16373 n=3020 ec=104/104 lis/c 16372/16372 les/c/f 16373/16430/0 16371/16372/16171) [1,39,23] r=0 lpr=0 crt=16543'11075697 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:14 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:14.860590 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.ac( v 16543'588683 (16120'585587,16543'588683] local-lis/les=16367/16367 n=1157 ec=6474/6474 lis/c 16366/16366 les/c/f 16367/16463/0 16365/16366/16235) [28,1,24] r=1 lpr=0 crt=16543'588683 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:14 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:14.900589 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.11( v 16543'7804506 (16479'7801474,16543'7804506] local-lis/les=16267/16267 n=3335 ec=107/107 lis/c 16266/16266 les/c/f 16267/16267/0 16265/16266/16266) [40,1,7] r=1 lpr=0 crt=16543'7804506 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:14 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:14.975617 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.37b( v 16543'13069781 (16522'13066759,16543'13069781] local-lis/les=16254/16254 n=2990 ec=2543/2543 lis/c 16253/16253 les/c/f 16254/16261/0 16252/16253/16253) [35,17,1] r=2 lpr=0 crt=16543'13069781 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.017822 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.b7( v 16543'1092482 (16461'1089449,16543'1092482] local-lis/les=16227/16227 n=1194 ec=6474/6474 lis/c 16226/16226 les/c/f 16227/16240/0 16225/16226/16171) [1,13,32] r=0 lpr=0 crt=16543'1092482 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 9 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.054172 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.13a( v 16543'7206154 (16461'7203057,16543'7206154] local-lis/les=16407/16407 n=3036 ec=104/104 lis/c 16406/16406 les/c/f 16407/16430/0 16403/16406/16239) [29,21,1] r=2 lpr=0 crt=16543'7206154 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.080353 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.124( v 16543'3181930 (16430'3178860,16543'3181930] local-lis/les=16426/16426 n=3376 ec=107/107 lis/c 16425/16425 les/c/f 16426/16473/0 16422/16425/16244) [39,1,25] r=1 lpr=0 crt=16543'3181930 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.108307 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.156( v 16543'14488260 (16524'14485225,16543'14488260] local-lis/les=16376/16376 n=3050 ec=104/104 lis/c 16375/16375 les/c/f 16376/16467/0 16374/16375/16171) [1,22,27] r=0 lpr=0 crt=16543'14488260 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.122209 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.15e( v 16543'5597921 (16461'5594873,16543'5597921] local-lis/les=16230/16230 n=2988 ec=104/104 lis/c 16229/16229 les/c/f 16230/16240/0 16228/16229/16171) [1,30,12] r=0 lpr=0 crt=16543'5597921 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.148300 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.ea( v 16543'714745 (16430'711726,16543'714745] local-lis/les=16254/16254 n=1302 ec=6474/6474 lis/c 16253/16253 les/c/f 16254/16261/0 16252/16253/16239) [29,35,1] r=2 lpr=0 crt=16543'714745 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.187495 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.27b( v 16543'4877126 (16485'4874119,16543'4877126] local-lis/les=16466/16466 n=2974 ec=2543/2543 lis/c 16465/16465 les/c/f 16466/16477/0 16464/16465/16183) [7,36,1] r=2 lpr=0 crt=16543'4877126 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.215078 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.17f( v 16543'7876448 (16479'7873405,16543'7876448] local-lis/les=16251/16251 n=3102 ec=104/104 lis/c 16250/16250 les/c/f 16251/16261/0 16249/16250/16171) [1,38,27] r=0 lpr=0 crt=16543'7876448 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.243147 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.185( v 16543'7883943 (16489'7880844,16543'7883943] local-lis/les=16254/16254 n=3007 ec=104/104 lis/c 16253/16253 les/c/f 16254/16261/0 16252/16253/16171) [1,35,27] r=0 lpr=0 crt=16543'7883943 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.286170 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.1a5( v 16543'9287085 (16516'9284031,16543'9287085] local-lis/les=16230/16230 n=3021 ec=104/104 lis/c 16229/16229 les/c/f 16230/16240/0 16228/16229/16171) [1,14,30] r=0 lpr=0 crt=16543'9287085 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.335090 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.1c4( v 16543'6583483 (16477'6580415,16543'6583483] local-lis/les=16410/16410 n=3056 ec=104/104 lis/c 16408/16408 les/c/f 16410/16469/0 16404/16408/16171) [1,26,10] r=0 lpr=0 crt=16543'6583483 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.361776 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.40( v 16543'3050228 (16328'3047223,16543'3050228] local-lis/les=16233/16233 n=3290 ec=107/107 lis/c 16232/16232 les/c/f 16233/16240/0 16231/16232/16232) [31,1,6] r=1 lpr=0 crt=16543'3050228 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.421697 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.d9( v 16543'2512149 (16451'2509091,16543'2512149] local-lis/les=16414/16414 n=3410 ec=107/107 lis/c 16413/16413 les/c/f 16414/16469/0 16410/16413/16256) [37,1,18] r=1 lpr=0 crt=16543'2512149 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.467850 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.28( v 16543'24892659 (16528'24889595,16543'24892659] local-lis/les=16251/16251 n=3025 ec=104/104 lis/c 16250/16250 les/c/f 16251/16261/0 16249/16250/16250) [38,9,1] r=2 lpr=0 crt=16543'24892659 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.525161 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.249( v 16543'8073285 (16461'8070213,16543'8073285] local-lis/les=16466/16466 n=3064 ec=2543/2543 lis/c 16465/16465 les/c/f 16466/16477/0 16464/16465/16465) [36,1,23] r=1 lpr=0 crt=16543'8073285 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.542510 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.1df( v 16543'5471094 (16501'5468064,16543'5471094] local-lis/les=16376/16376 n=3092 ec=104/104 lis/c 16375/16375 les/c/f 16376/16467/0 16374/16375/16171) [1,31,22] r=0 lpr=0 crt=16543'5471094 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.614797 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.1eb( v 16543'3730747 (16477'3727739,16543'3730747] local-lis/les=16410/16410 n=3365 ec=107/107 lis/c 16405/16405 les/c/f 16410/16463/0 16404/16405/16405) [26,1,13] r=1 lpr=0 crt=16543'3730747 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.648408 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.1eb( v 16543'4299299 (16321'4289991,16543'4299299] local-lis/les=16438/16438 n=3025 ec=104/104 lis/c 16437/16331 les/c/f 16438/16331/0 16437/16437/16171) [1,20,40]/[1,40] r=0 lpr=0 pi=[16330,16437)/4 crt=16543'4299299 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.698958 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.d2( v 16543'540890 (16316'537871,16543'540890] local-lis/les=16227/16227 n=1233 ec=6474/6474 lis/c 16226/16226 les/c/f 16227/16240/0 16225/16226/16171) [1,32,8] r=0 lpr=0 crt=16543'540890 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 9 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.718206 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.1f6( v 16543'3412534 (16461'3409471,16543'3412534] local-lis/les=16381/16381 n=3079 ec=104/104 lis/c 16375/16375 les/c/f 16381/16469/0 16374/16375/16375) [22,16,1] r=2 lpr=0 crt=16543'3412534 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.778510 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.f3( v 16543'2376997 (16344'2373963,16543'2376997] local-lis/les=16245/16245 n=3326 ec=107/107 lis/c 16244/16244 les/c/f 16245/16261/0 16243/16244/16244) [39,10,1] r=2 lpr=0 crt=16543'2376997 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.808795 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.6f( v 16543'414018 (16120'410939,16543'414018] local-lis/les=16248/16248 n=1258 ec=6474/6474 lis/c 16247/16247 les/c/f 16248/16261/0 16246/16247/16171) [1,34,12] r=0 lpr=0 crt=16543'414018 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 9 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.828054 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.177( v 16543'8459029 (16499'8455945,16543'8459029] local-lis/les=16254/16254 n=3009 ec=104/104 lis/c 16253/16253 les/c/f 16254/16261/0 16252/16253/16253) [35,1,9] r=1 lpr=0 crt=16543'8459029 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.848340 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.170( v 16543'5509783 (16487'5506748,16543'5509783] local-lis/les=16417/16417 n=3070 ec=104/104 lis/c 16415/16415 les/c/f 16417/16471/0 16410/16415/16415) [18,1,17] r=1 lpr=0 crt=16543'5509783 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.865051 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.14c( v 16543'11226052 (16518'11222996,16543'11226052] local-lis/les=16214/16214 n=3028 ec=104/104 lis/c 16213/16213 les/c/f 16214/16219/0 16212/16213/16180) [11,1,16] r=1 lpr=0 crt=16543'11226052 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.910091 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.1a4( v 16543'10743701 (16495'10740678,16543'10743701] local-lis/les=16211/16211 n=2972 ec=104/104 lis/c 16210/16210 les/c/f 16211/16219/0 16209/16210/16210) [15,9,1] r=2 lpr=0 crt=16543'10743701 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:15 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:15.967771 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.df( v 16543'667503 (16483'664437,16543'667503] local-lis/les=16251/16251 n=1156 ec=6474/6474 lis/c 16250/16250 les/c/f 16251/16251/0 16249/16250/16171) [1,32,38] r=0 lpr=0 crt=16543'667503 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 9 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.011916 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.e3( v 16543'4547906 (16461'4544843,16543'4547906] local-lis/les=16245/16245 n=3094 ec=104/104 lis/c 16244/16244 les/c/f 16245/16261/0 16243/16244/16244) [39,17,1] r=2 lpr=0 crt=16543'4547906 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.039558 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.10a( v 16543'8348087 (16514'8345048,16543'8348087] local-lis/les=16428/16428 n=2998 ec=104/104 lis/c 16427/16427 les/c/f 16428/16469/0 16422/16427/16217) [17,1,25] r=1 lpr=0 crt=16543'8348087 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.071308 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.a1( v 16543'8189202 (16479'8186133,16543'8189202] local-lis/les=16245/16245 n=3043 ec=104/104 lis/c 16244/16244 les/c/f 16245/16261/0 16243/16244/16244) [39,1,6] r=1 lpr=0 crt=16543'8189202 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.121354 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.e9( v 16543'502979 (16316'499942,16543'502979] local-lis/les=16427/16427 n=1177 ec=6474/6474 lis/c 16423/16423 les/c/f 16427/16469/0 16422/16423/16171) [1,25,27] r=0 lpr=0 crt=16543'502979 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 9 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.160944 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.99( v 16543'8359470 (16514'8356457,16543'8359470] local-lis/les=16416/16416 n=3077 ec=104/104 lis/c 16413/16413 les/c/f 16416/16463/0 16410/16413/16413) [18,1,29] r=1 lpr=0 crt=16543'8359470 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.184741 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.4a( v 16543'7562018 (16487'7558968,16543'7562018] local-lis/les=16370/16370 n=2987 ec=104/104 lis/c 16366/16366 les/c/f 16370/16463/0 16365/16366/16366) [24,16,1] r=2 lpr=0 crt=16543'7562018 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.200872 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.12e( v 16543'9993584 (16528'9990567,16543'9993584] local-lis/les=16245/16245 n=3080 ec=104/104 lis/c 16244/16244 les/c/f 16245/16261/0 16243/16244/16244) [39,9,1] r=2 lpr=0 crt=16543'9993584 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.222529 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.0( v 16543'4404734 (16461'4401655,16543'4404734] local-lis/les=16230/16230 n=3021 ec=104/104 lis/c 16229/16229 les/c/f 16230/16240/0 16228/16229/16229) [30,1,11] r=1 lpr=0 crt=16543'4404734 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.240363 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.11( v 16543'657944 (16316'654911,16543'657944] local-lis/les=16382/16382 n=1226 ec=6474/6474 lis/c 16375/16375 les/c/f 16382/16467/0 16374/16375/16171) [1,22,8] r=0 lpr=0 crt=16543'657944 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 9 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.262919 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.14( v 16543'540818 (16316'537762,16543'540818] local-lis/les=16376/16376 n=1213 ec=6474/6474 lis/c 16375/16375 les/c/f 16376/16465/0 16374/16375/16171) [1,33,22] r=0 lpr=0 crt=16543'540818 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 9 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.315962 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.1c( v 16543'8750573 (16522'8747497,16543'8750573] local-lis/les=16410/16410 n=1223 ec=6474/6474 lis/c 16405/16405 les/c/f 16410/16467/0 16404/16405/16171) [1,7,26] r=0 lpr=0 crt=16543'8750573 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 9 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.364412 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.8d( v 16543'2527907 (16481'2524862,16543'2527907] local-lis/les=16466/16466 n=1232 ec=6474/6474 lis/c 16465/16465 les/c/f 16466/16469/0 16464/16465/16171) [1,31,36] r=0 lpr=0 crt=16543'2527907 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 9 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.387109 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.11c( v 16543'8059789 (16514'8056765,16543'8059789] local-lis/les=16208/16208 n=3048 ec=104/104 lis/c 16207/16207 les/c/f 16208/16219/0 16206/16207/16186) [10,12,1] r=2 lpr=0 crt=16543'8059789 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.412275 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.f4( v 16543'5247851 (16461'5244751,16543'5247851] local-lis/les=16260/16260 n=2975 ec=104/104 lis/c 16259/16259 les/c/f 16260/16261/0 16258/16259/16259) [33,1,30] r=1 lpr=0 crt=16543'5247851 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.446126 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.7e( v 16543'10011284 (16518'10008186,16543'10011284] local-lis/les=16437/16437 n=3047 ec=104/104 lis/c 16436/16436 les/c/f 16437/16474/0 16436/16436/16194) [6,1,22] r=1 lpr=0 crt=16543'10011284 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.499575 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.fd( v 16543'1768557 (16461'1765555,16543'1768557] local-lis/les=16257/16257 n=1198 ec=6474/6474 lis/c 16256/16256 les/c/f 16257/16257/0 16255/16256/16171) [1,37,30] r=0 lpr=0 crt=16543'1768557 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 9 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.567841 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.173( v 16543'2161312 (16333'2158263,16543'2161312] local-lis/les=16410/16410 n=3288 ec=107/107 lis/c 16405/16405 les/c/f 16410/16469/0 16404/16405/16232) [31,26,1] r=2 lpr=0 crt=16543'2161312 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.604112 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.2c3( v 16543'4203637 (16461'4200552,16543'4203637] local-lis/les=16260/16260 n=3039 ec=2543/2543 lis/c 16259/16259 les/c/f 16260/16261/0 16258/16259/16259) [33,1,8] r=1 lpr=0 crt=16543'4203637 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.653738 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.94( v 16543'504497 (16321'501397,16543'504497] local-lis/les=16224/16224 n=1181 ec=6474/6474 lis/c 16223/16223 les/c/f 16224/16240/0 16222/16223/16171) [1,15,27] r=0 lpr=0 crt=16543'504497 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 9 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.697982 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.108( v 16543'348957 (16120'345876,16543'348957] local-lis/les=16227/16227 n=1208 ec=6474/6474 lis/c 16226/16226 les/c/f 16227/16227/0 16225/16226/16171) [1,32,12] r=0 lpr=0 crt=16543'348957 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 9 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.726487 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.182( v 16543'4887118 (16461'4884043,16543'4887118] local-lis/les=16211/16211 n=3030 ec=104/104 lis/c 16210/16210 les/c/f 16211/16219/0 16209/16210/16210) [15,1,11] r=1 lpr=0 crt=16543'4887118 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.821296 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.1b0( v 16543'17440147 (16514'17437048,16543'17440147] local-lis/les=16417/16417 n=2966 ec=104/104 lis/c 16415/16415 les/c/f 16417/16473/0 16410/16415/16415) [18,1,27] r=1 lpr=0 crt=16543'17440147 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.865354 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.28( v 16543'582242 (16120'579222,16543'582242] local-lis/les=16360/16360 n=1222 ec=6474/6474 lis/c 16358/16358 les/c/f 16360/16417/0 16355/16358/16171) [1,12,19] r=0 lpr=0 crt=16543'582242 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 9 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.889337 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.16d( v 16543'5397005 (16503'5393952,16543'5397005] local-lis/les=16373/16373 n=3222 ec=104/104 lis/c 16372/16372 les/c/f 16373/16469/0 16371/16372/16187) [9,1,23] r=1 lpr=0 crt=16543'5397005 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:16 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:16.948138 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.8f( v 16543'5680441 (16441'5677387,16543'5680441] local-lis/les=16230/16230 n=3036 ec=104/104 lis/c 16229/16229 les/c/f 16230/16240/0 16228/16229/16229) [30,9,1] r=2 lpr=0 crt=16543'5680441 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:17 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:17.005971 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.b( v 16543'2312226 (16447'2309159,16543'2312226] local-lis/les=16428/16428 n=3444 ec=107/107 lis/c 16427/16427 les/c/f 16428/16469/0 16422/16427/16256) [37,25,1] r=2 lpr=0 crt=16543'2312226 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:17 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:17.049094 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.145( v 16543'1689763 (16463'1686693,16543'1689763] local-lis/les=16407/16407 n=1228 ec=6474/6474 lis/c 16406/16406 les/c/f 16407/16467/0 16403/16406/16171) [1,21,31] r=0 lpr=0 crt=16543'1689763 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 9 Sep 12 22:29:17 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:17.082408 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.14f( v 16543'64626396 (16541'64623375,16543'64626396] local-lis/les=16214/16214 n=2932 ec=104/104 lis/c 16213/16213 les/c/f 16214/16219/0 16212/16213/16187) [9,1,16] r=1 lpr=0 crt=16543'64626396 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:17 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:17.113718 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.5f( v 16543'14193466 (16516'14190459,16543'14193466] local-lis/les=16230/16230 n=3175 ec=104/104 lis/c 16229/16229 les/c/f 16230/16240/0 16228/16229/16229) [30,11,1] r=2 lpr=0 crt=16543'14193466 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:17 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:17.178436 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.bd( v 16543'6934421 (16417'6924402,16543'6934421] local-lis/les=16467/16467 n=2959 ec=104/104 lis/c 16465/16346 les/c/f 16467/16346/0 16464/16465/16465) [36,1,20]/[36,1,13] r=1 lpr=0 pi=[16322,16465)/12 crt=16543'6934421 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:17 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:17.202631 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.16b( v 16543'1150052 (16120'1147046,16543'1150052] local-lis/les=16260/16260 n=1220 ec=6474/6474 lis/c 16259/16259 les/c/f 16260/16261/0 16258/16259/16171) [1,32,33] r=0 lpr=0 crt=16543'1150052 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 9 Sep 12 22:29:17 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:17.246416 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.25( v 16543'2448444 (16430'2445379,16543'2448444] local-lis/les=16245/16245 n=3360 ec=107/107 lis/c 16244/16244 les/c/f 16245/16261/0 16243/16244/16171) [1,31,39] r=0 lpr=0 crt=16543'2448444 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:17 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:17.275830 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.182( v 16543'511993 (16120'508962,16543'511993] local-lis/les=16416/16416 n=1259 ec=6474/6474 lis/c 16415/16415 les/c/f 16416/16469/0 16410/16415/16171) [1,18,32] r=0 lpr=0 crt=16543'511993 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 9 Sep 12 22:29:17 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:17.329938 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.197( v 16543'617891 (16328'614846,16543'617891] local-lis/les=16260/16260 n=1203 ec=6474/6474 lis/c 16259/16259 les/c/f 16260/16260/0 16258/16259/16171) [1,6,33] r=0 lpr=0 crt=16543'617891 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 9 Sep 12 22:29:17 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:17.378551 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.156( v 16543'655865 (16120'652820,16543'655865] local-lis/les=16230/16230 n=1239 ec=6474/6474 lis/c 16229/16229 les/c/f 16230/16240/0 16228/16229/16229) [30,1,11] r=1 lpr=0 crt=16543'655865 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:17 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:17.423373 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.110( v 16543'5273859 (16497'5270841,16543'5273859] local-lis/les=16257/16257 n=3047 ec=104/104 lis/c 16256/16256 les/c/f 16257/16261/0 16255/16256/16187) [9,37,1] r=2 lpr=0 crt=16543'5273859 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:17 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:17.468950 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.6f( v 16543'4222863 (16461'4219771,16543'4222863] local-lis/les=16218/16218 n=3341 ec=107/107 lis/c 16217/16217 les/c/f 16218/16219/0 16216/16217/16217) [17,7,1] r=2 lpr=0 crt=16543'4222863 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:17 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:17.530513 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.4( v 16543'485777 (16120'482759,16543'485777] local-lis/les=16245/16245 n=1245 ec=6474/6474 lis/c 16244/16244 les/c/f 16245/16261/0 16243/16244/16223) [27,1,39] r=1 lpr=0 crt=16543'485777 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:17 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:17.609095 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.20( v 16543'3467825 (16455'3457730,16543'3467825] local-lis/les=16438/16438 n=3431 ec=107/107 lis/c 16437/16388 les/c/f 16438/16388/0 16437/16437/16330) [20,37,15]/[37,15,1] r=2 lpr=0 pi=[16330,16437)/6 crt=16543'3467825 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:17 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:17.654144 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.af( v 16543'1832130 (16316'1829100,16543'1832130] local-lis/les=16466/16466 n=3421 ec=107/107 lis/c 16465/16465 les/c/f 16466/16467/0 16464/16465/16171) [1,36,8] r=0 lpr=0 crt=16543'1832130 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:17 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:17.709418 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.af( v 16543'636748 (16316'633723,16543'636748] local-lis/les=16376/16376 n=1257 ec=6474/6474 lis/c 16375/16375 les/c/f 16376/16463/0 16374/16375/16229) [30,1,22] r=1 lpr=0 crt=16543'636748 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:17 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:17.759956 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.1fe( v 16543'699303 (16316'696296,16543'699303] local-lis/les=16211/16211 n=1230 ec=6474/6474 lis/c 16210/16210 les/c/f 16211/16219/0 16209/16210/16210) [15,8,1] r=2 lpr=0 crt=16543'699303 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:17 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:17.800054 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.a5( v 16543'677829 (16477'674812,16543'677829] local-lis/les=16211/16211 n=1172 ec=6474/6474 lis/c 16210/16210 les/c/f 16211/16219/0 16209/16210/16210) [15,1,7] r=1 lpr=0 crt=16543'677829 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:17 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:17.900614 7f922c909d00 -1 osd.1 pg_epoch: 16541 pg[18.150( v 16541'361673 (16120'358661,16541'361673] local-lis/les=16382/16382 n=1258 ec=6474/6474 lis/c 16375/16375 les/c/f 16382/16463/0 16374/16375/16191) [8,1,22] r=1 lpr=0 crt=16541'361673 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:17 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:17.955946 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.1ec( v 16543'2883547 (16120'2880508,16543'2883547] local-lis/les=16466/16466 n=1167 ec=6474/6474 lis/c 16465/16465 les/c/f 16466/16473/0 16464/16465/16232) [31,1,36] r=1 lpr=0 crt=16543'2883547 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:17 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:17.994376 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.84( v 16543'9443735 (16507'9440635,16543'9443735] local-lis/les=16412/16412 n=2982 ec=104/104 lis/c 16408/16408 les/c/f 16412/16471/0 16404/16408/16408) [26,35,1] r=2 lpr=0 crt=16543'9443735 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.030006 7f922c909d00 -1 osd.1 pg_epoch: 16541 pg[8.119( v 16541'2243499 (16316'2240425,16541'2243499] local-lis/les=16410/16410 n=3422 ec=107/107 lis/c 16407/16407 les/c/f 16410/16469/0 16404/16407/16171) [1,8,26] r=0 lpr=0 crt=16541'2243499 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.067826 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.11d( v 16543'3051675 (16451'3048595,16543'3051675] local-lis/les=16245/16245 n=3296 ec=107/107 lis/c 16244/16244 les/c/f 16245/16261/0 16243/16244/16244) [39,13,1] r=2 lpr=0 crt=16543'3051675 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.109360 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.128( v 16543'2203509 (16457'2200426,16543'2203509] local-lis/les=16376/16376 n=3284 ec=107/107 lis/c 16375/16375 les/c/f 16376/16463/0 16374/16375/16171) [1,22,9] r=0 lpr=0 crt=16543'2203509 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.147971 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.62( v 16543'1940549 (16445'1937508,16543'1940549] local-lis/les=16208/16208 n=1240 ec=6474/6474 lis/c 16207/16207 les/c/f 16208/16219/0 16206/16207/16194) [6,1,12] r=1 lpr=0 crt=16543'1940549 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.190113 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.12c( v 16543'2721299 (16328'2718204,16543'2721299] local-lis/les=16438/16438 n=3432 ec=107/107 lis/c 16437/16437 les/c/f 16438/16469/0 16436/16437/16171) [1,26,10] r=0 lpr=0 crt=16543'2721299 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.216778 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.14a( v 16543'7952626 (16497'7949530,16543'7952626] local-lis/les=16233/16233 n=3458 ec=107/107 lis/c 16232/16232 les/c/f 16233/16240/0 16231/16232/16204) [14,31,1] r=2 lpr=0 crt=16543'7952626 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.277767 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.14e( v 16543'4300481 (16461'4297457,16543'4300481] local-lis/les=16267/16267 n=3398 ec=107/107 lis/c 16266/16266 les/c/f 16267/16267/0 16265/16266/16171) [1,40,29] r=0 lpr=0 crt=16543'4300481 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.311158 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.15b( v 16543'2465686 (16440'2462631,16543'2465686] local-lis/les=16236/16236 n=3368 ec=107/107 lis/c 16235/16235 les/c/f 16236/16240/0 16234/16235/16171) [1,28,9] r=0 lpr=0 crt=16543'2465686 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.377630 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.170( v 16543'2367031 (16328'2363993,16543'2367031] local-lis/les=16254/16254 n=3329 ec=107/107 lis/c 16253/16253 les/c/f 16254/16261/0 16252/16253/16171) [1,35,8] r=0 lpr=0 crt=16543'2367031 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.427234 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.23e( v 16543'1634487 (16321'1631388,16543'1634487] local-lis/les=16466/16466 n=3359 ec=2548/2548 lis/c 16465/16465 les/c/f 16466/16471/0 16464/16465/16366) [24,36,1] r=2 lpr=0 crt=16543'1634487 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.472719 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.18c( v 16543'7822271 (16499'7819211,16543'7822271] local-lis/les=16245/16245 n=2974 ec=104/104 lis/c 16244/16244 les/c/f 16245/16261/0 16243/16244/16204) [14,39,1] r=2 lpr=0 crt=16543'7822271 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.529404 7f922c909d00 -1 osd.1 pg_epoch: 16541 pg[18.d9( v 16541'456520 (16267'453480,16541'456520] local-lis/les=16376/16376 n=1166 ec=6474/6474 lis/c 16375/16375 les/c/f 16376/16463/0 16374/16375/16213) [16,1,22] r=1 lpr=0 crt=16541'456520 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.604876 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.299( v 16543'5182813 (16459'5179717,16543'5182813] local-lis/les=16260/16260 n=3003 ec=2543/2543 lis/c 16259/16259 les/c/f 16260/16261/0 16258/16259/16186) [10,1,33] r=1 lpr=0 crt=16543'5182813 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.660967 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.1d3( v 16543'2236956 (16461'2233883,16543'2236956] local-lis/les=16236/16236 n=3287 ec=107/107 lis/c 16235/16235 les/c/f 16236/16240/0 16234/16235/16171) [1,9,28] r=0 lpr=0 crt=16543'2236956 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.717341 7f922c909d00 -1 osd.1 pg_epoch: 16437 pg[7.3c6( v 16430'5582726 (16328'5578842,16430'5582726] lb MIN (bitwise) local-lis/les=16335/16335 n=0 ec=2543/2543 lis/c 16432/16331 les/c/f 16432/16331/0 16437/16437/16247) [34,12,20]/[34,12] r=-1 lpr=0 pi=[16330,16437)/4 crt=16430'5582726 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.747250 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.1f5( v 16543'3040835 (16328'3037819,16543'3040835] local-lis/les=16248/16248 n=3362 ec=107/107 lis/c 16247/16247 les/c/f 16248/16261/0 16246/16247/16171) [1,34,29] r=0 lpr=0 crt=16543'3040835 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.798413 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.1df( v 16543'2178846 (16321'2175754,16543'2178846] local-lis/les=16373/16373 n=3455 ec=107/107 lis/c 16372/16372 les/c/f 16373/16469/0 16371/16372/16194) [6,1,23] r=1 lpr=0 crt=16543'2178846 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.842400 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.131( v 16543'1130587 (16316'1127584,16543'1130587] local-lis/les=16233/16233 n=1205 ec=6474/6474 lis/c 16232/16232 les/c/f 16233/16240/0 16231/16232/16171) [1,11,31] r=0 lpr=0 crt=16543'1130587 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 9 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.892625 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.19a( v 16543'580026 (16328'576931,16543'580026] local-lis/les=16466/16466 n=1190 ec=6474/6474 lis/c 16465/16465 les/c/f 16466/16467/0 16464/16465/16171) [1,36,30] r=0 lpr=0 crt=16543'580026 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 9 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.931607 7f922c909d00 -1 osd.1 pg_epoch: 16437 pg[7.3d0( v 16430'3913381 (16321'3909893,16430'3913381] lb MIN (bitwise) local-lis/les=16335/16335 n=0 ec=2543/2543 lis/c 16432/16331 les/c/f 16432/16331/0 16437/16437/16330) [20,12,30]/[12,30] r=-1 lpr=0 pi=[16330,16437)/4 crt=16430'3913381 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.970801 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.1b4( v 16543'7420444 (16501'7417403,16543'7420444] local-lis/les=16437/16437 n=3379 ec=107/107 lis/c 16436/16436 les/c/f 16437/16469/0 16436/16436/16210) [15,1,23] r=1 lpr=0 crt=16543'7420444 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:18 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:18.997245 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.2f0( v 16543'1956680 (16439'1953581,16543'1956680] local-lis/les=16415/16415 n=3434 ec=2548/2548 lis/c 16413/16413 les/c/f 16415/16471/0 16410/16413/16413) [18,38,1] r=2 lpr=0 crt=16543'1956680 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:19 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:19.036462 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.1b8( v 16543'304923 (16316'301859,16543'304923] local-lis/les=16364/16364 n=1213 ec=6474/6474 lis/c 16360/16360 les/c/f 16364/16463/0 16355/16360/16360) [19,11,1] r=2 lpr=0 crt=16543'304923 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:19 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:19.075308 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.a1( v 16543'408646 (16120'405554,16543'408646] local-lis/les=16414/16414 n=1230 ec=6474/6474 lis/c 16413/16413 les/c/f 16414/16463/0 16410/16413/16266) [40,18,1] r=2 lpr=0 crt=16543'408646 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:19 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:19.110842 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.1ae( v 16543'398985 (16120'395937,16543'398985] local-lis/les=16251/16251 n=1187 ec=6474/6474 lis/c 16250/16250 les/c/f 16251/16251/0 16249/16250/16171) [1,27,38] r=0 lpr=0 crt=16543'398985 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 9 Sep 12 22:29:19 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:19.151854 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.1c3( v 16543'648978 (16120'645973,16543'648978] local-lis/les=16233/16233 n=1177 ec=6474/6474 lis/c 16232/16232 les/c/f 16233/16240/0 16231/16232/16207) [12,31,1] r=2 lpr=0 crt=16543'648978 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:19 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:19.208375 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.da( v 16543'2410507 (16328'2407453,16543'2410507] local-lis/les=16233/16233 n=3356 ec=107/107 lis/c 16232/16232 les/c/f 16233/16240/0 16231/16232/16232) [31,16,1] r=2 lpr=0 crt=16543'2410507 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:19 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:19.255101 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.f3( v 16543'559622 (16121'556556,16543'559622] local-lis/les=16380/16380 n=1167 ec=6474/6474 lis/c 16375/16375 les/c/f 16380/16417/0 16374/16375/16375) [22,27,1] r=2 lpr=0 crt=16543'559622 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:19 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:19.301457 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.1da( v 16543'2156442 (16321'2153418,16543'2156442] local-lis/les=16370/16370 n=3337 ec=107/107 lis/c 16366/16366 les/c/f 16370/16430/0 16365/16366/16366) [24,1,6] r=1 lpr=0 crt=16543'2156442 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:19 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:19.374302 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.12b( v 16543'5163035 (16461'5159956,16543'5163035] local-lis/les=16382/16382 n=3434 ec=107/107 lis/c 16375/16375 les/c/f 16382/16473/0 16374/16375/16375) [22,1,8] r=1 lpr=0 crt=16543'5163035 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:19 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:19.409856 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.f( v 16543'646538 (16120'643457,16543'646538] local-lis/les=16373/16373 n=1216 ec=6474/6474 lis/c 16372/16372 les/c/f 16373/16469/0 16371/16372/16372) [23,1,39] r=1 lpr=0 crt=16543'646538 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:19 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:19.467564 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.1f8( v 16543'478312 (16316'475247,16543'478312] local-lis/les=16205/16205 n=1223 ec=6474/6474 lis/c 16204/16204 les/c/f 16205/16219/0 16203/16204/16204) [14,1,6] r=1 lpr=0 crt=16543'478312 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:19 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:19.546025 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.18c( v 16543'10871074 (16507'10868057,16543'10871074] local-lis/les=16236/16236 n=3365 ec=107/107 lis/c 16235/16235 les/c/f 16236/16240/0 16234/16235/16235) [28,14,1] r=2 lpr=0 crt=16543'10871074 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:19 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:19.586959 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.68( v 16543'367737 (16316'364648,16543'367737] local-lis/les=16260/16260 n=1224 ec=6474/6474 lis/c 16259/16259 les/c/f 16260/16261/0 16258/16259/16186) [10,33,1] r=2 lpr=0 crt=16543'367737 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:19 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:19.653313 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.6a( v 16543'7549583 (16461'7546500,16543'7549583] local-lis/les=16260/16260 n=3502 ec=107/107 lis/c 16259/16259 les/c/f 16260/16261/0 16258/16259/16259) [33,1,11] r=1 lpr=0 crt=16543'7549583 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:19 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:19.706323 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.159( v 16543'2078806 (16461'2075794,16543'2078806] local-lis/les=16361/16361 n=1201 ec=6474/6474 lis/c 16358/16358 les/c/f 16361/16417/0 16355/16358/16250) [38,1,19] r=1 lpr=0 crt=16543'2078806 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:19 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:19.794498 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.52( v 16543'6419328 (16328'6409302,16543'6419328] local-lis/les=16438/16438 n=3399 ec=107/107 lis/c 16437/16331 les/c/f 16438/16331/0 16437/16437/16244) [39,1,20]/[39,1] r=1 lpr=0 pi=[16241,16437)/12 crt=16543'6419328 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:19 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:19.834718 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.a9( v 16543'2678441 (16316'2675366,16543'2678441] local-lis/les=16236/16236 n=3364 ec=107/107 lis/c 16235/16235 les/c/f 16236/16240/0 16234/16235/16235) [28,1,8] r=1 lpr=0 crt=16543'2678441 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:19 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:19.891418 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.1c7( v 16543'7894059 (16499'7891055,16543'7894059] local-lis/les=16260/16260 n=2991 ec=104/104 lis/c 16259/16259 les/c/f 16260/16261/0 16258/16259/16204) [14,1,33] r=1 lpr=0 crt=16543'7894059 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:19 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:19.942178 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.365( v 16543'6496695 (16485'6493640,16543'6496695] local-lis/les=16370/16370 n=3314 ec=2548/2548 lis/c 16366/16366 les/c/f 16370/16469/0 16365/16366/16366) [24,1,15] r=1 lpr=0 crt=16543'6496695 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:20 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:20.016856 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.1ee( v 16543'6778805 (16485'6775727,16543'6778805] local-lis/les=16248/16248 n=3093 ec=104/104 lis/c 16247/16247 les/c/f 16248/16261/0 16246/16247/16226) [32,34,1] r=2 lpr=0 crt=16543'6778805 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:20 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:20.100035 7f922c909d00 -1 osd.1 pg_epoch: 16536 pg[18.1ea( v 16536'429791 (16120'426714,16536'429791] local-lis/les=16257/16257 n=1222 ec=6474/6474 lis/c 16256/16256 les/c/f 16257/16257/0 16255/16256/16223) [27,1,37] r=1 lpr=0 crt=16536'429791 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:20 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:20.159711 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.49( v 16543'682766 (16461'679710,16543'682766] local-lis/les=16370/16370 n=1203 ec=6474/6474 lis/c 16366/16366 les/c/f 16370/16430/0 16365/16366/16366) [24,1,28] r=1 lpr=0 crt=16543'682766 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:20 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:20.203873 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.1b9( v 16543'759912 (16421'756689,16543'759912] local-lis/les=16466/16466 n=1270 ec=6474/6474 lis/c 16465/16463 les/c/f 16466/16463/0 16464/16465/16465) [36,7,1] r=2 lpr=0 pi=[10595,16465)/135 crt=16543'759912 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:20 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:20.259108 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.290( v 16543'5735045 (16518'5731972,16543'5735045] local-lis/les=16230/16230 n=3113 ec=2543/2543 lis/c 16229/16229 les/c/f 16230/16240/0 16228/16229/16229) [30,13,1] r=2 lpr=0 crt=16543'5735045 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:20 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:20.325273 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.17b( v 16543'1767734 (16417'1764716,16543'1767734] local-lis/les=16409/16409 n=3258 ec=107/107 lis/c 16407/16407 les/c/f 16409/16477/0 16403/16407/16407) [21,1,17] r=1 lpr=0 crt=16543'1767734 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:20 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:20.388897 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.151( v 16543'503996 (16328'500944,16543'503996] local-lis/les=16251/16251 n=1212 ec=6474/6474 lis/c 16250/16250 les/c/f 16251/16251/0 16249/16250/16226) [32,38,1] r=2 lpr=0 crt=16543'503996 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:20 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:20.433489 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.169( v 16543'609181 (16149'606141,16543'609181] local-lis/les=16260/16260 n=1216 ec=6474/6474 lis/c 16259/16259 les/c/f 16260/16261/0 16258/16259/16259) [33,11,1] r=2 lpr=0 crt=16543'609181 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:20 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:20.495139 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.1( v 16543'10264777 (16516'10261729,16543'10264777] local-lis/les=16427/16427 n=3024 ec=104/104 lis/c 16425/16425 les/c/f 16427/16469/0 16422/16425/16425) [25,1,14] r=1 lpr=0 crt=16543'10264777 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:20 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:20.544986 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.4c( v 16543'2547636 (16441'2544536,16543'2547636] local-lis/les=16369/16369 n=3421 ec=107/107 lis/c 16366/16366 les/c/f 16369/16417/0 16365/16366/16366) [24,33,1] r=2 lpr=0 crt=16543'2547636 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:20 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:20.580210 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.15b( v 16543'5888218 (16461'5885141,16543'5888218] local-lis/les=16466/16466 n=2962 ec=104/104 lis/c 16465/16465 les/c/f 16466/16469/0 16464/16465/16207) [12,36,1] r=2 lpr=0 crt=16543'5888218 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:20 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:20.609788 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.31( v 16543'5465130 (16461'5462069,16543'5465130] local-lis/les=16380/16380 n=3039 ec=104/104 lis/c 16375/16375 les/c/f 16380/16469/0 16374/16375/16244) [39,1,22] r=1 lpr=0 crt=16543'5465130 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:20 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:20.658896 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.f4( v 16543'2505663 (16443'2502623,16543'2505663] local-lis/les=16437/16437 n=3347 ec=107/107 lis/c 16436/16436 les/c/f 16437/16437/0 16436/16436/16213) [16,1,24] r=1 lpr=0 crt=16543'2505663 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:20 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:20.775406 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.d8( v 16543'6642400 (16459'6635403,16543'6642400] local-lis/les=16466/16466 n=3050 ec=104/104 lis/c 16465/16463 les/c/f 16466/16463/0 16464/16465/16465) [36,30,1] r=2 lpr=0 pi=[186,16465)/196 crt=16543'6642400 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:20 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:20.827612 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.8e( v 16543'7291200 (16505'7288186,16543'7291200] local-lis/les=16267/16267 n=3045 ec=104/104 lis/c 16266/16266 les/c/f 16267/16267/0 16265/16266/16201) [13,40,1] r=2 lpr=0 crt=16543'7291200 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:20 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:20.891825 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.11e( v 16543'7071587 (16518'7068490,16543'7071587] local-lis/les=16245/16245 n=3066 ec=104/104 lis/c 16244/16244 les/c/f 16245/16261/0 16243/16244/16201) [13,1,39] r=1 lpr=0 crt=16543'7071587 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:20 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:20.972701 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.147( v 16543'9291035 (16507'9288008,16543'9291035] local-lis/les=16261/16261 n=3072 ec=104/104 lis/c 16260/16260 les/c/f 16261/16261/0 16258/16260/16260) [33,9,1] r=2 lpr=0 crt=16543'9291035 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.028664 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.318( v 16543'11224982 (16524'11221981,16543'11224982] local-lis/les=16260/16260 n=3022 ec=2543/2543 lis/c 16259/16259 les/c/f 16260/16261/0 16258/16259/16235) [28,33,1] r=2 lpr=0 crt=16543'11224982 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.056280 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.319( v 16543'7644028 (16461'7640977,16543'7644028] local-lis/les=16240/16240 n=3069 ec=2543/2543 lis/c 16239/16239 les/c/f 16240/16240/0 16238/16239/16239) [29,11,1] r=2 lpr=0 crt=16543'7644028 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.091869 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.1bf( v 16543'4812282 (16477'4809214,16543'4812282] local-lis/les=16373/16373 n=2953 ec=104/104 lis/c 16372/16372 les/c/f 16373/16463/0 16371/16372/16226) [32,23,1] r=2 lpr=0 crt=16543'4812282 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.117430 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.3ba( v 16543'3924663 (16483'3921642,16543'3924663] local-lis/les=16248/16248 n=3325 ec=2548/2548 lis/c 16247/16247 les/c/f 16248/16261/0 16246/16247/16229) [30,1,34] r=1 lpr=0 crt=16543'3924663 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.127664 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.13d( v 16543'1878317 (16316'1875258,16543'1878317] local-lis/les=16370/16370 n=3194 ec=107/107 lis/c 16366/16366 les/c/f 16370/16463/0 16365/16366/16210) [15,24,1] r=2 lpr=0 crt=16543'1878317 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.160246 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.1d6( v 16543'3894390 (16514'3891356,16543'3894390] local-lis/les=16202/16202 n=3400 ec=107/107 lis/c 16201/16201 les/c/f 16202/16211/0 16200/16201/16191) [8,13,1] r=2 lpr=0 crt=16543'3894390 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.209173 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.118( v 16543'5325060 (16514'5322015,16543'5325060] local-lis/les=16466/16466 n=3317 ec=107/107 lis/c 16465/16465 les/c/f 16466/16469/0 16464/16465/16213) [16,36,1] r=2 lpr=0 crt=16543'5325060 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.270149 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.386( v 16543'5133118 (16461'5130028,16543'5133118] local-lis/les=16254/16254 n=3074 ec=2543/2543 lis/c 16253/16253 les/c/f 16254/16261/0 16252/16253/16223) [27,35,1] r=2 lpr=0 crt=16543'5133118 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.303946 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.d8( v 16543'891641 (16321'888580,16543'891641] local-lis/les=16257/16257 n=1212 ec=6474/6474 lis/c 16256/16256 les/c/f 16257/16261/0 16255/16256/16180) [11,37,1] r=2 lpr=0 crt=16543'891641 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.356362 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.86( v 16543'883493 (16445'880426,16543'883493] local-lis/les=16202/16202 n=1237 ec=6474/6474 lis/c 16201/16201 les/c/f 16202/16219/0 16200/16201/16180) [11,1,13] r=1 lpr=0 crt=16543'883493 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.395564 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.32( v 16543'886684 (16333'883635,16543'886684] local-lis/les=16248/16248 n=1168 ec=6474/6474 lis/c 16247/16247 les/c/f 16248/16261/0 16246/16247/16247) [34,1,13] r=1 lpr=0 crt=16543'886684 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.455334 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.89( v 16543'651452 (16483'648409,16543'651452] local-lis/les=16233/16233 n=1272 ec=6474/6474 lis/c 16232/16232 les/c/f 16233/16240/0 16231/16232/16204) [14,31,1] r=2 lpr=0 crt=16543'651452 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.504700 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.1aa( v 16543'853804 (16120'850711,16543'853804] local-lis/les=16224/16224 n=1216 ec=6474/6474 lis/c 16223/16223 les/c/f 16224/16240/0 16222/16223/16204) [14,1,27] r=1 lpr=0 crt=16543'853804 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.536008 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.43( v 16543'1098863 (16430'1095838,16543'1098863] local-lis/les=16380/16380 n=1219 ec=6474/6474 lis/c 16375/16375 les/c/f 16380/16469/0 16374/16375/16187) [9,1,22] r=1 lpr=0 crt=16543'1098863 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.587404 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.59( v 16543'852571 (16120'849517,16543'852571] local-lis/les=16236/16236 n=1276 ec=6474/6474 lis/c 16235/16235 les/c/f 16236/16240/0 16234/16235/16235) [28,15,1] r=2 lpr=0 crt=16543'852571 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.641756 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.a8( v 16543'1670556 (16461'1667533,16543'1670556] local-lis/les=16211/16211 n=1250 ec=6474/6474 lis/c 16210/16210 les/c/f 16211/16219/0 16209/16210/16187) [9,15,1] r=2 lpr=0 crt=16543'1670556 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.694992 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.166( v 16543'523340 (16321'520321,16543'523340] local-lis/les=16233/16233 n=1232 ec=6474/6474 lis/c 16232/16232 les/c/f 16233/16240/0 16231/16232/16232) [31,10,1] r=2 lpr=0 crt=16543'523340 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.736448 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.276( v 16543'3378542 (16328'3375537,16543'3378542] local-lis/les=16227/16227 n=3379 ec=2548/2548 lis/c 16226/16226 les/c/f 16227/16240/0 16225/16226/16194) [6,32,1] r=2 lpr=0 crt=16543'3378542 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.801599 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[18.2d( v 16543'580105 (16120'577011,16543'580105] local-lis/les=16245/16245 n=1195 ec=6474/6474 lis/c 16244/16244 les/c/f 16245/16245/0 16243/16244/16244) [39,32,1] r=2 lpr=0 crt=16543'580105 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 9 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.844975 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.31f( v 16543'7160178 (16495'7157116,16543'7160178] local-lis/les=16227/16227 n=3108 ec=2543/2543 lis/c 16226/16226 les/c/f 16227/16240/0 16225/16226/16194) [6,1,32] r=1 lpr=0 crt=16543'7160178 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.894222 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.275( v 16543'1929002 (16328'1925928,16543'1929002] local-lis/les=16233/16233 n=3410 ec=2548/2548 lis/c 16232/16232 les/c/f 16233/16240/0 16231/16232/16194) [6,31,1] r=2 lpr=0 crt=16543'1929002 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.926478 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.3e1( v 16543'4501298 (16469'4498275,16543'4501298] local-lis/les=16364/16364 n=3017 ec=2543/2543 lis/c 16358/16358 les/c/f 16364/16430/0 16355/16358/16171) [1,8,19] r=0 lpr=0 crt=16543'4501298 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:21 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:21.997164 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.286( v 16543'3911272 (16439'3908173,16543'3911272] local-lis/les=16211/16211 n=3420 ec=2548/2548 lis/c 16210/16210 les/c/f 16211/16219/0 16209/16210/16210) [15,1,8] r=1 lpr=0 crt=16543'3911272 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:22 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:22.046001 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.29d( v 16543'2814281 (16419'2811263,16543'2814281] local-lis/les=16438/16438 n=3270 ec=2548/2548 lis/c 16437/16437 les/c/f 16438/16438/0 16436/16437/16171) [1,19,32] r=0 lpr=0 crt=16543'2814281 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:22 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:22.147023 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.25c( v 16543'1784143 (16328'1781099,16543'1784143] local-lis/les=16427/16427 n=3400 ec=2548/2548 lis/c 16423/16423 les/c/f 16427/16469/0 16422/16423/16171) [1,12,25] r=0 lpr=0 crt=16543'1784143 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:22 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:22.211542 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.217( v 16543'3267402 (16514'3264330,16543'3267402] local-lis/les=16407/16407 n=3412 ec=2548/2548 lis/c 16404/16404 les/c/f 16407/16463/0 16403/16404/16404) [21,30,1] r=2 lpr=0 crt=16543'3267402 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:22 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:22.274093 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.254( v 16543'2071997 (16451'2068982,16543'2071997] local-lis/les=16257/16257 n=3422 ec=2548/2548 lis/c 16256/16256 les/c/f 16257/16261/0 16255/16256/16171) [1,11,37] r=0 lpr=0 crt=16543'2071997 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:22 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:22.317086 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.2af( v 16543'2052332 (16316'2049294,16543'2052332] local-lis/les=16240/16240 n=3286 ec=2548/2548 lis/c 16239/16239 les/c/f 16240/16240/0 16238/16239/16239) [29,17,1] r=2 lpr=0 crt=16543'2052332 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:22 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:22.371783 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.3d2( v 16543'2797144 (16461'2794082,16543'2797144] local-lis/les=16427/16427 n=3412 ec=2548/2548 lis/c 16423/16423 les/c/f 16427/16469/0 16422/16423/16171) [1,33,25] r=0 lpr=0 crt=16543'2797144 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:22 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:22.433381 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.3b4( v 16543'3509220 (16316'3506164,16543'3509220] local-lis/les=16233/16233 n=3246 ec=2548/2548 lis/c 16232/16232 les/c/f 16233/16240/0 16231/16232/16186) [10,1,31] r=1 lpr=0 crt=16543'3509220 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:22 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:22.493214 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.2d9( v 16543'3376270 (16453'3373213,16543'3376270] local-lis/les=16245/16245 n=3377 ec=2548/2548 lis/c 16244/16244 les/c/f 16245/16261/0 16243/16244/16171) [1,39,32] r=0 lpr=0 crt=16543'3376270 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:22 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:22.551270 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.2ff( v 16543'3204426 (16434'3201365,16543'3204426] local-lis/les=16205/16205 n=3395 ec=2548/2548 lis/c 16204/16204 les/c/f 16205/16219/0 16203/16204/16171) [1,14,10] r=0 lpr=0 crt=16543'3204426 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:22 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:22.597732 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.26f( v 16543'2734931 (16430'2731896,16543'2734931] local-lis/les=16466/16466 n=3352 ec=2548/2548 lis/c 16465/16465 les/c/f 16466/16469/0 16464/16465/16171) [1,10,36] r=0 lpr=0 crt=16543'2734931 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:22 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:22.667205 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.2c8( v 16543'2166764 (16328'2163724,16543'2166764] local-lis/les=16377/16377 n=3408 ec=2548/2548 lis/c 16375/16375 les/c/f 16377/16467/0 16374/16375/16171) [1,31,22] r=0 lpr=0 crt=16543'2166764 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:22 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:22.725871 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.352( v 16543'12067678 (16507'12064600,16543'12067678] local-lis/les=16466/16466 n=3068 ec=2543/2543 lis/c 16465/16465 les/c/f 16466/16469/0 16464/16465/16171) [1,36,8] r=0 lpr=0 crt=16543'12067678 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:22 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:22.787467 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.30f( v 16543'6054793 (16540'6051733,16543'6054793] local-lis/les=16466/16466 n=3149 ec=2543/2543 lis/c 16465/16465 les/c/f 16466/16469/0 16464/16465/16171) [1,36,12] r=0 lpr=0 crt=16543'6054793 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:22 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:22.835682 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.3d3( v 16543'4222881 (16461'4219800,16543'4222881] local-lis/les=16214/16214 n=3122 ec=2543/2543 lis/c 16213/16213 les/c/f 16214/16219/0 16212/16213/16171) [1,10,16] r=0 lpr=0 crt=16543'4222881 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:22 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:22.907100 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.3c2( v 16543'7318549 (16461'7315495,16543'7318549] local-lis/les=16218/16218 n=3103 ec=2543/2543 lis/c 16217/16217 les/c/f 16218/16219/0 16216/16217/16171) [1,17,11] r=0 lpr=0 crt=16543'7318549 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:22 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:22.975396 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.2ac( v 16543'9746061 (16541'9743023,16543'9746061] local-lis/les=16410/16410 n=2977 ec=2543/2543 lis/c 16408/16408 les/c/f 16410/16469/0 16404/16408/16171) [1,38,26] r=0 lpr=0 crt=16543'9746061 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:23 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:23.018292 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.3ce( v 16543'4930183 (16461'4927106,16543'4930183] local-lis/les=16373/16373 n=3031 ec=2543/2543 lis/c 16372/16372 les/c/f 16373/16430/0 16371/16372/16171) [1,15,23] r=0 lpr=0 crt=16543'4930183 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:23 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:23.168994 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.374( v 16543'6697212 (16485'6694137,16543'6697212] local-lis/les=16377/16377 n=3010 ec=2543/2543 lis/c 16375/16375 les/c/f 16377/16467/0 16374/16375/16171) [1,22,29] r=0 lpr=0 crt=16543'6697212 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:23 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:23.300812 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.334( v 16543'60430055 (16540'60426957,16543'60430055] local-lis/les=16251/16251 n=3010 ec=2543/2543 lis/c 16250/16250 les/c/f 16251/16261/0 16249/16250/16171) [1,30,38] r=0 lpr=0 crt=16543'60430055 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:23 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:23.487510 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.3ed( v 16543'2485739 (16430'2482724,16543'2485739] local-lis/les=16245/16245 n=3408 ec=2548/2548 lis/c 16244/16244 les/c/f 16245/16261/0 16243/16244/16171) [1,39,13] r=0 lpr=0 crt=16543'2485739 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:23 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:23.558188 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.3ca( v 16543'10479199 (16518'10476151,16543'10479199] local-lis/les=16410/16410 n=3034 ec=2543/2543 lis/c 16405/16405 les/c/f 16410/16469/0 16404/16405/16171) [1,28,26] r=0 lpr=0 crt=16543'10479199 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:23 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:23.628214 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.293( v 16543'2631632 (16328'2628550,16543'2631632] local-lis/les=16240/16240 n=3481 ec=2548/2548 lis/c 16239/16239 les/c/f 16240/16240/0 16238/16239/16239) [29,9,1] r=2 lpr=0 crt=16543'2631632 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:23 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:23.681450 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.3a5( v 16543'2147188 (16321'2144157,16543'2147188] local-lis/les=16233/16233 n=3370 ec=2548/2548 lis/c 16232/16232 les/c/f 16233/16240/0 16231/16232/16171) [1,16,31] r=0 lpr=0 crt=16543'2147188 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:23 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:23.718734 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.3b9( v 16543'8640666 (16512'8637623,16543'8640666] local-lis/les=16205/16205 n=3134 ec=2543/2543 lis/c 16204/16204 les/c/f 16205/16219/0 16203/16204/16171) [1,8,14] r=0 lpr=0 crt=16543'8640666 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:23 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:23.780092 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.332( v 16543'2392562 (16445'2389499,16543'2392562] local-lis/les=16224/16224 n=3341 ec=2548/2548 lis/c 16223/16223 les/c/f 16224/16240/0 16222/16223/16171) [1,9,27] r=0 lpr=0 crt=16543'2392562 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:23 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:23.866627 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.203( v 16543'3891789 (16461'3888703,16543'3891789] local-lis/les=16233/16233 n=3332 ec=2548/2548 lis/c 16232/16232 les/c/f 16233/16240/0 16231/16232/16171) [1,31,14] r=0 lpr=0 crt=16543'3891789 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:23 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:23.930735 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.227( v 16543'4443089 (16501'4440075,16543'4443089] local-lis/les=16427/16427 n=3115 ec=2543/2543 lis/c 16423/16423 les/c/f 16427/16469/0 16422/16423/16171) [1,25,31] r=0 lpr=0 crt=16543'4443089 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:24 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:24.005587 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.27e( v 16543'3329723 (16461'3326669,16543'3329723] local-lis/les=16245/16245 n=3235 ec=2548/2548 lis/c 16244/16244 les/c/f 16245/16261/0 16243/16244/16171) [1,39,13] r=0 lpr=0 crt=16543'3329723 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:24 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:24.065538 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.322( v 16543'1620278 (16316'1617193,16543'1620278] local-lis/les=16373/16373 n=3494 ec=2548/2548 lis/c 16372/16372 les/c/f 16373/16430/0 16371/16372/16171) [1,34,23] r=0 lpr=0 crt=16543'1620278 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:24 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:24.149934 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.384( v 16543'4153758 (16479'4150721,16543'4153758] local-lis/les=16410/16410 n=3119 ec=2543/2543 lis/c 16407/16407 les/c/f 16410/16469/0 16404/16407/16171) [1,9,26] r=0 lpr=0 crt=16543'4153758 lcod 0'0 mlcod 0'0 unknown] update_store_on_load setting bit width to 10 Sep 12 22:29:24 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:24.239397 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.3c1( v 16543'3039456 (16316'3033750,16543'3039456] local-lis/les=16438/16438 n=3393 ec=2548/2548 lis/c 16437/16331 les/c/f 16438/16331/0 16437/16437/16226) [32,20,1]/[32,1] r=1 lpr=0 pi=[7622,16437)/133 crt=16543'3039456 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:24 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:24.377552 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.2a1( v 16543'2442256 (16316'2434715,16543'2442256] local-lis/les=16438/16438 n=3334 ec=2548/2548 lis/c 16437/16331 les/c/f 16438/16331/0 16437/16437/16244) [39,1,20]/[39,1] r=1 lpr=0 pi=[16241,16437)/13 crt=16543'2442256 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:24 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:24.430361 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.2cb( v 16543'4696859 (16461'4693768,16543'4696859] local-lis/les=16373/16373 n=3481 ec=2548/2548 lis/c 16372/16372 les/c/f 16373/16473/0 16371/16372/16372) [23,34,1] r=2 lpr=0 crt=16543'4696859 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:24 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:24.505982 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.311( v 16543'7748062 (16512'7745026,16543'7748062] local-lis/les=16373/16373 n=3029 ec=2543/2543 lis/c 16372/16372 les/c/f 16373/16463/0 16371/16372/16247) [34,23,1] r=2 lpr=0 crt=16543'7748062 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:24 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:24.649031 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.396( v 16543'4115676 (16439'4112620,16543'4115676] local-lis/les=16260/16260 n=3373 ec=2548/2548 lis/c 16259/16259 les/c/f 16260/16261/0 16258/16259/16226) [32,33,1] r=2 lpr=0 crt=16543'4115676 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:24 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:24.700994 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.2a4( v 16543'2199348 (16333'2196346,16543'2199348] local-lis/les=16437/16437 n=3324 ec=2548/2548 lis/c 16436/16436 les/c/f 16437/16437/0 16436/16436/16223) [27,1,24] r=1 lpr=0 crt=16543'2199348 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:24 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:24.769227 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.21c( v 16543'4693627 (16505'4690529,16543'4693627] local-lis/les=16233/16233 n=2967 ec=2543/2543 lis/c 16232/16232 les/c/f 16233/16240/0 16231/16232/16232) [31,1,9] r=1 lpr=0 crt=16543'4693627 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:24 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:24.842658 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.3fe( v 16543'2796663 (16417'2793658,16543'2796663] local-lis/les=16202/16202 n=3361 ec=2548/2548 lis/c 16201/16201 les/c/f 16202/16219/0 16200/16201/16201) [13,10,1] r=2 lpr=0 crt=16543'2796663 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:24 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:24.887799 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.2c0( v 16543'11934729 (16497'11931685,16543'11934729] local-lis/les=16245/16245 n=2970 ec=2543/2543 lis/c 16244/16244 les/c/f 16245/16261/0 16243/16244/16207) [12,1,39] r=1 lpr=0 crt=16543'11934729 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:24 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:24.932088 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.2dd( v 16543'2618213 (16348'2615205,16543'2618213] local-lis/les=16370/16370 n=3460 ec=2548/2548 lis/c 16366/16366 les/c/f 16370/16463/0 16365/16366/16366) [24,31,1] r=2 lpr=0 crt=16543'2618213 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:24 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:24.974419 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.269( v 16543'3344144 (16445'3341086,16543'3344144] local-lis/les=16251/16251 n=3289 ec=2548/2548 lis/c 16250/16250 les/c/f 16251/16261/0 16249/16250/16250) [38,1,30] r=1 lpr=0 crt=16543'3344144 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:25 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:25.022287 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.20b( v 16543'6325107 (16417'6322085,16543'6325107] local-lis/les=16427/16427 n=3033 ec=2543/2543 lis/c 16423/16423 les/c/f 16427/16469/0 16422/16423/16213) [16,1,25] r=1 lpr=0 crt=16543'6325107 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:25 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:25.113998 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.397( v 16543'5553446 (16328'5543366,16543'5553446] local-lis/les=16465/16465 n=3124 ec=2543/2543 lis/c 16464/16331 les/c/f 16465/16331/0 16464/16464/16464) [36,1,20]/[36,1] r=1 lpr=0 pi=[16322,16464)/10 crt=16543'5553446 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:25 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:25.193868 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.302( v 16543'11187323 (16524'11184251,16543'11187323] local-lis/les=16233/16233 n=3007 ec=2543/2543 lis/c 16232/16232 les/c/f 16233/16240/0 16231/16232/16232) [31,1,15] r=1 lpr=0 crt=16543'11187323 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:25 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:25.263511 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.39b( v 16543'7450147 (16493'7447055,16543'7450147] local-lis/les=16254/16254 n=2962 ec=2543/2543 lis/c 16253/16253 les/c/f 16254/16261/0 16252/16253/16253) [35,1,28] r=1 lpr=0 crt=16543'7450147 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:25 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:25.301422 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.396( v 16543'6450602 (16507'6447539,16543'6450602] local-lis/les=16251/16251 n=2959 ec=2543/2543 lis/c 16250/16250 les/c/f 16251/16261/0 16249/16250/16250) [38,7,1] r=2 lpr=0 crt=16543'6450602 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:25 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:25.353199 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.397( v 16543'1807642 (16316'1804573,16543'1807642] local-lis/les=16230/16230 n=3236 ec=2548/2548 lis/c 16229/16229 les/c/f 16230/16240/0 16228/16229/16204) [14,1,30] r=1 lpr=0 crt=16543'1807642 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:25 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:25.383136 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.289( v 16543'2506291 (16328'2503237,16543'2506291] local-lis/les=16202/16202 n=3270 ec=2548/2548 lis/c 16201/16201 les/c/f 16202/16219/0 16200/16201/16201) [13,1,9] r=1 lpr=0 crt=16543'2506291 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:25 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:25.499155 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.295( v 16543'4466972 (16483'4463915,16543'4466972] local-lis/les=16368/16368 n=3003 ec=2543/2543 lis/c 16366/16366 les/c/f 16368/16417/0 16365/16366/16366) [24,1,6] r=1 lpr=0 crt=16543'4466972 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:25 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:25.612564 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.20c( v 16543'65613893 (16541'65610857,16543'65613893] local-lis/les=16227/16227 n=2945 ec=2543/2543 lis/c 16226/16226 les/c/f 16227/16240/0 16225/16226/16226) [32,8,1] r=2 lpr=0 crt=16543'65613893 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:25 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:25.677602 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.330( v 16543'2856348 (16461'2853337,16543'2856348] local-lis/les=16370/16370 n=3284 ec=2548/2548 lis/c 16366/16366 les/c/f 16370/16463/0 16365/16366/16366) [24,8,1] r=2 lpr=0 crt=16543'2856348 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:25 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:25.706270 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.3b7( v 16543'4795959 (16461'4792884,16543'4795959] local-lis/les=16230/16230 n=2964 ec=2543/2543 lis/c 16229/16229 les/c/f 16230/16240/0 16228/16229/16229) [30,1,15] r=1 lpr=0 crt=16543'4795959 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:25 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:25.785520 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.3c2( v 16543'2121014 (16321'2117937,16543'2121014] local-lis/les=16409/16409 n=3307 ec=2548/2548 lis/c 16407/16407 les/c/f 16409/16476/0 16403/16407/16407) [21,40,1] r=2 lpr=0 crt=16543'2121014 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:25 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:25.839093 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.255( v 16543'2957006 (16316'2953999,16543'2957006] local-lis/les=16245/16245 n=3392 ec=2548/2548 lis/c 16244/16244 les/c/f 16245/16251/0 16243/16244/16186) [10,1,39] r=1 lpr=0 crt=16543'2957006 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:26 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:26.038816 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.3e0( v 16543'10722636 (16503'10719546,16543'10722636] local-lis/les=16466/16466 n=2998 ec=2543/2543 lis/c 16465/16465 les/c/f 16466/16478/0 16464/16465/16465) [36,1,8] r=1 lpr=0 crt=16543'10722636 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:26 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:26.181816 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.37a( v 16543'259126992 (16543'259123944,16543'259126992] local-lis/les=16536/16536 n=3091 ec=2543/2543 lis/c 16535/16535 les/c/f 16536/16536/0 16410/16535/16217) [17,18,1] r=2 lpr=0 crt=16543'259126992 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:26 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:26.209251 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.33e( v 16543'15973590 (16526'15970573,16543'15973590] local-lis/les=16479/16479 n=3042 ec=2543/2543 lis/c 16478/16478 les/c/f 16479/16479/0 16464/16478/16464) [36,1,20] r=1 lpr=0 crt=16543'15973590 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:26 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:26.250825 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.30a( v 16543'2314246 (16316'2311240,16543'2314246] local-lis/les=16227/16227 n=3298 ec=2548/2548 lis/c 16226/16226 les/c/f 16227/16240/0 16225/16226/16186) [10,32,1] r=2 lpr=0 crt=16543'2314246 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:26 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:26.282234 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.20d( v 16543'3312181 (16340'3309160,16543'3312181] local-lis/les=16236/16236 n=3289 ec=2548/2548 lis/c 16235/16235 les/c/f 16236/16240/0 16234/16235/16204) [14,1,28] r=1 lpr=0 crt=16543'3312181 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:26 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:26.303010 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.3b3( v 16543'3408758 (16449'3405752,16543'3408758] local-lis/les=16251/16251 n=3466 ec=2548/2548 lis/c 16250/16250 les/c/f 16251/16261/0 16249/16250/16183) [7,38,1] r=2 lpr=0 crt=16543'3408758 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:26 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:26.321057 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[8.259( v 16543'3179220 (16421'3176189,16543'3179220] local-lis/les=16415/16415 n=3401 ec=2548/2548 lis/c 16411/16411 les/c/f 16415/16469/0 16410/16411/16411) [18,1,31] r=1 lpr=0 crt=16543'3179220 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:26 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:26.358082 7f922c909d00 -1 osd.1 pg_epoch: 16543 pg[7.391( v 16543'3224465 (16461'3221385,16543'3224465] local-lis/les=16233/16233 n=3063 ec=2543/2543 lis/c 16232/16232 les/c/f 16233/16240/0 16231/16232/16232) [31,11,1] r=2 lpr=0 crt=16543'3224465 lcod 0'0 unknown NOTIFY] update_store_on_load setting bit width to 10 Sep 12 22:29:26 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:26.392305 7f922c909d00 -1 osd.1 16543 log_to_monitors {default=true} Sep 12 22:29:26 node1.ceph ceph-osd[1686]: 2017-09-12 22:29:26.398890 7f922c909d00 -1 osd.1 16543 mon_cmd_maybe_osd_create fail: 'you must complete the upgrade and 'ceph osd require-osd-release luminous' before using crush device classes': (1) Operation not permitted Sep 12 22:29:33 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:29:33 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:29:33 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:29:54 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:29:54 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:29:54 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:29:54 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:29:54 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:29:54 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:30:14 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:30:15 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:30:15 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:30:15 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:30:15 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:30:15 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:30:15 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:30:15 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:30:15 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:30:15 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:30:15 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:30:15 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:30:16 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:30:16 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:30:16 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:31:23 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:31:23 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 12 22:43:25 node1.ceph ceph-osd[1686]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7f920b3cd700 time 2017-09-12 22:43:25.412926 Sep 12 22:43:25 node1.ceph ceph-osd[1686]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 12 22:43:25 node1.ceph ceph-osd[1686]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x55b57fccc510] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55b57f8719d7] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55b57f871b19] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55b57f740908] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55b57f76c121] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x55b57f76cb4c] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x55b57f76ce87] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 8: (DispatchQueue::entry()+0x792) [0x55b57ff42cb2] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x55b57fd5775d] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 10: (()+0x7dc5) [0x7f9229d19dc5] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 11: (clone()+0x6d) [0x7f9228e0d76d] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 2017-09-12 22:43:25.416144 7f920b3cd700 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7f920b3cd700 time 2017-09-12 22:43:25.412926 Sep 12 22:43:25 node1.ceph ceph-osd[1686]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 12 22:43:25 node1.ceph ceph-osd[1686]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x55b57fccc510] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55b57f8719d7] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55b57f871b19] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55b57f740908] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55b57f76c121] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x55b57f76cb4c] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x55b57f76ce87] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 8: (DispatchQueue::entry()+0x792) [0x55b57ff42cb2] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x55b57fd5775d] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 10: (()+0x7dc5) [0x7f9229d19dc5] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 11: (clone()+0x6d) [0x7f9228e0d76d] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 0> 2017-09-12 22:43:25.416144 7f920b3cd700 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7f920b3cd700 time 2017-09-12 22:43:25.412926 Sep 12 22:43:25 node1.ceph ceph-osd[1686]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 12 22:43:25 node1.ceph ceph-osd[1686]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x55b57fccc510] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55b57f8719d7] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55b57f871b19] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55b57f740908] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55b57f76c121] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x55b57f76cb4c] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x55b57f76ce87] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 8: (DispatchQueue::entry()+0x792) [0x55b57ff42cb2] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x55b57fd5775d] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 10: (()+0x7dc5) [0x7f9229d19dc5] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 11: (clone()+0x6d) [0x7f9228e0d76d] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 22:43:25 node1.ceph ceph-osd[1686]: *** Caught signal (Aborted) ** Sep 12 22:43:25 node1.ceph ceph-osd[1686]: in thread 7f920b3cd700 thread_name:ms_dispatch Sep 12 22:43:25 node1.ceph ceph-osd[1686]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 1: (()+0xa23b21) [0x55b57fc8db21] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 2: (()+0xf370) [0x7f9229d21370] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 3: (gsignal()+0x37) [0x7f9228d4b1d7] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 4: (abort()+0x148) [0x7f9228d4c8c8] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x55b57fccc684] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55b57f8719d7] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55b57f871b19] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55b57f740908] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55b57f76c121] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x55b57f76cb4c] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x55b57f76ce87] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 12: (DispatchQueue::entry()+0x792) [0x55b57ff42cb2] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x55b57fd5775d] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 14: (()+0x7dc5) [0x7f9229d19dc5] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 15: (clone()+0x6d) [0x7f9228e0d76d] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 2017-09-12 22:43:25.441817 7f920b3cd700 -1 *** Caught signal (Aborted) ** Sep 12 22:43:25 node1.ceph ceph-osd[1686]: in thread 7f920b3cd700 thread_name:ms_dispatch Sep 12 22:43:25 node1.ceph ceph-osd[1686]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 1: (()+0xa23b21) [0x55b57fc8db21] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 2: (()+0xf370) [0x7f9229d21370] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 3: (gsignal()+0x37) [0x7f9228d4b1d7] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 4: (abort()+0x148) [0x7f9228d4c8c8] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x55b57fccc684] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55b57f8719d7] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55b57f871b19] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55b57f740908] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55b57f76c121] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x55b57f76cb4c] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x55b57f76ce87] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 12: (DispatchQueue::entry()+0x792) [0x55b57ff42cb2] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x55b57fd5775d] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 14: (()+0x7dc5) [0x7f9229d19dc5] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 15: (clone()+0x6d) [0x7f9228e0d76d] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 0> 2017-09-12 22:43:25.441817 7f920b3cd700 -1 *** Caught signal (Aborted) ** Sep 12 22:43:25 node1.ceph ceph-osd[1686]: in thread 7f920b3cd700 thread_name:ms_dispatch Sep 12 22:43:25 node1.ceph ceph-osd[1686]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 1: (()+0xa23b21) [0x55b57fc8db21] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 2: (()+0xf370) [0x7f9229d21370] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 3: (gsignal()+0x37) [0x7f9228d4b1d7] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 4: (abort()+0x148) [0x7f9228d4c8c8] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x55b57fccc684] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55b57f8719d7] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55b57f871b19] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55b57f740908] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55b57f76c121] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x55b57f76cb4c] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x55b57f76ce87] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 12: (DispatchQueue::entry()+0x792) [0x55b57ff42cb2] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x55b57fd5775d] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 14: (()+0x7dc5) [0x7f9229d19dc5] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: 15: (clone()+0x6d) [0x7f9228e0d76d] Sep 12 22:43:25 node1.ceph ceph-osd[1686]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 22:43:25 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=6/ABRT Sep 12 22:43:25 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 12 22:43:25 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 12 22:43:45 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 12 22:43:45 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 12 22:43:45 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 12 22:43:45 node1.ceph ceph-osd[8356]: 2017-09-12 22:43:45.784281 7f976fd2cd00 -1 Public network was set, but cluster network was not set Sep 12 22:43:45 node1.ceph ceph-osd[8356]: 2017-09-12 22:43:45.784290 7f976fd2cd00 -1 Using public network also for cluster network Sep 12 22:43:45 node1.ceph ceph-osd[8356]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 12 22:43:56 node1.ceph ceph-osd[8356]: 2017-09-12 22:43:56.501360 7f976fd2cd00 -1 osd.1 16570 log_to_monitors {default=true} Sep 12 22:43:56 node1.ceph ceph-osd[8356]: 2017-09-12 22:43:56.505500 7f976fd2cd00 -1 osd.1 16570 mon_cmd_maybe_osd_create fail: 'you must complete the upgrade and 'ceph osd require-osd-release luminous' before using crush device classes': (1) Operation not permitted Sep 12 22:59:15 node1.ceph ceph-osd[8356]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7f974c3fd700 time 2017-09-12 22:59:15.844395 Sep 12 22:59:15 node1.ceph ceph-osd[8356]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 12 22:59:15 node1.ceph ceph-osd[8356]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x55f9f5aed510] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55f9f56929d7] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55f9f5692b19] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55f9f5561908] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55f9f558d121] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x55f9f558db4c] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x55f9f558de87] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 8: (DispatchQueue::entry()+0x792) [0x55f9f5d63cb2] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x55f9f5b7875d] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 10: (()+0x7dc5) [0x7f976d13cdc5] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 11: (clone()+0x6d) [0x7f976c23076d] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 2017-09-12 22:59:15.850532 7f974c3fd700 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7f974c3fd700 time 2017-09-12 22:59:15.844395 Sep 12 22:59:15 node1.ceph ceph-osd[8356]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 12 22:59:15 node1.ceph ceph-osd[8356]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x55f9f5aed510] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55f9f56929d7] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55f9f5692b19] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55f9f5561908] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55f9f558d121] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x55f9f558db4c] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x55f9f558de87] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 8: (DispatchQueue::entry()+0x792) [0x55f9f5d63cb2] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x55f9f5b7875d] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 10: (()+0x7dc5) [0x7f976d13cdc5] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 11: (clone()+0x6d) [0x7f976c23076d] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 0> 2017-09-12 22:59:15.850532 7f974c3fd700 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7f974c3fd700 time 2017-09-12 22:59:15.844395 Sep 12 22:59:15 node1.ceph ceph-osd[8356]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 12 22:59:15 node1.ceph ceph-osd[8356]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x55f9f5aed510] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55f9f56929d7] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55f9f5692b19] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55f9f5561908] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55f9f558d121] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x55f9f558db4c] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x55f9f558de87] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 8: (DispatchQueue::entry()+0x792) [0x55f9f5d63cb2] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x55f9f5b7875d] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 10: (()+0x7dc5) [0x7f976d13cdc5] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 11: (clone()+0x6d) [0x7f976c23076d] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 22:59:15 node1.ceph ceph-osd[8356]: *** Caught signal (Aborted) ** Sep 12 22:59:15 node1.ceph ceph-osd[8356]: in thread 7f974c3fd700 thread_name:ms_dispatch Sep 12 22:59:15 node1.ceph ceph-osd[8356]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 1: (()+0xa23b21) [0x55f9f5aaeb21] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 2: (()+0xf370) [0x7f976d144370] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 3: (gsignal()+0x37) [0x7f976c16e1d7] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 4: (abort()+0x148) [0x7f976c16f8c8] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x55f9f5aed684] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55f9f56929d7] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55f9f5692b19] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55f9f5561908] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55f9f558d121] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x55f9f558db4c] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x55f9f558de87] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 12: (DispatchQueue::entry()+0x792) [0x55f9f5d63cb2] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x55f9f5b7875d] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 14: (()+0x7dc5) [0x7f976d13cdc5] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 15: (clone()+0x6d) [0x7f976c23076d] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 2017-09-12 22:59:15.888867 7f974c3fd700 -1 *** Caught signal (Aborted) ** Sep 12 22:59:15 node1.ceph ceph-osd[8356]: in thread 7f974c3fd700 thread_name:ms_dispatch Sep 12 22:59:15 node1.ceph ceph-osd[8356]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 1: (()+0xa23b21) [0x55f9f5aaeb21] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 2: (()+0xf370) [0x7f976d144370] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 3: (gsignal()+0x37) [0x7f976c16e1d7] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 4: (abort()+0x148) [0x7f976c16f8c8] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x55f9f5aed684] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55f9f56929d7] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55f9f5692b19] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55f9f5561908] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55f9f558d121] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x55f9f558db4c] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x55f9f558de87] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 12: (DispatchQueue::entry()+0x792) [0x55f9f5d63cb2] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x55f9f5b7875d] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 14: (()+0x7dc5) [0x7f976d13cdc5] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 15: (clone()+0x6d) [0x7f976c23076d] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 0> 2017-09-12 22:59:15.888867 7f974c3fd700 -1 *** Caught signal (Aborted) ** Sep 12 22:59:15 node1.ceph ceph-osd[8356]: in thread 7f974c3fd700 thread_name:ms_dispatch Sep 12 22:59:15 node1.ceph ceph-osd[8356]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 1: (()+0xa23b21) [0x55f9f5aaeb21] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 2: (()+0xf370) [0x7f976d144370] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 3: (gsignal()+0x37) [0x7f976c16e1d7] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 4: (abort()+0x148) [0x7f976c16f8c8] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x55f9f5aed684] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55f9f56929d7] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55f9f5692b19] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55f9f5561908] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55f9f558d121] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x55f9f558db4c] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x55f9f558de87] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 12: (DispatchQueue::entry()+0x792) [0x55f9f5d63cb2] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x55f9f5b7875d] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 14: (()+0x7dc5) [0x7f976d13cdc5] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: 15: (clone()+0x6d) [0x7f976c23076d] Sep 12 22:59:15 node1.ceph ceph-osd[8356]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 22:59:15 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=6/ABRT Sep 12 22:59:15 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 12 22:59:15 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 12 22:59:36 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 12 22:59:36 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 12 22:59:36 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 12 22:59:36 node1.ceph ceph-osd[11805]: 2017-09-12 22:59:36.263192 7f2e72334d00 -1 Public network was set, but cluster network was not set Sep 12 22:59:36 node1.ceph ceph-osd[11805]: 2017-09-12 22:59:36.263198 7f2e72334d00 -1 Using public network also for cluster network Sep 12 22:59:36 node1.ceph ceph-osd[11805]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 12 22:59:43 node1.ceph ceph-osd[11805]: 2017-09-12 22:59:43.345549 7f2e72334d00 -1 osd.1 16581 log_to_monitors {default=true} Sep 12 22:59:43 node1.ceph ceph-osd[11805]: 2017-09-12 22:59:43.350830 7f2e72334d00 -1 osd.1 16581 mon_cmd_maybe_osd_create fail: 'you must complete the upgrade and 'ceph osd require-osd-release luminous' before using crush device classes': (1) Operation not permitted Sep 12 23:15:31 node1.ceph ceph-osd[11805]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7f2e50e69700 time 2017-09-12 23:15:31.448519 Sep 12 23:15:31 node1.ceph ceph-osd[11805]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 12 23:15:31 node1.ceph ceph-osd[11805]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x55e921ac0510] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55e9216659d7] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55e921665b19] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55e921534908] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55e921560121] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x55e921560b4c] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x55e921560e87] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 8: (DispatchQueue::entry()+0x792) [0x55e921d36cb2] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x55e921b4b75d] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 10: (()+0x7dc5) [0x7f2e6f744dc5] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 11: (clone()+0x6d) [0x7f2e6e83876d] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 2017-09-12 23:15:31.451941 7f2e50e69700 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7f2e50e69700 time 2017-09-12 23:15:31.448519 Sep 12 23:15:31 node1.ceph ceph-osd[11805]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 12 23:15:31 node1.ceph ceph-osd[11805]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x55e921ac0510] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55e9216659d7] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55e921665b19] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55e921534908] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55e921560121] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x55e921560b4c] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x55e921560e87] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 8: (DispatchQueue::entry()+0x792) [0x55e921d36cb2] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x55e921b4b75d] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 10: (()+0x7dc5) [0x7f2e6f744dc5] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 11: (clone()+0x6d) [0x7f2e6e83876d] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 0> 2017-09-12 23:15:31.451941 7f2e50e69700 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7f2e50e69700 time 2017-09-12 23:15:31.448519 Sep 12 23:15:31 node1.ceph ceph-osd[11805]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 12 23:15:31 node1.ceph ceph-osd[11805]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x55e921ac0510] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55e9216659d7] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55e921665b19] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55e921534908] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55e921560121] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x55e921560b4c] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x55e921560e87] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 8: (DispatchQueue::entry()+0x792) [0x55e921d36cb2] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x55e921b4b75d] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 10: (()+0x7dc5) [0x7f2e6f744dc5] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 11: (clone()+0x6d) [0x7f2e6e83876d] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 23:15:31 node1.ceph ceph-osd[11805]: *** Caught signal (Aborted) ** Sep 12 23:15:31 node1.ceph ceph-osd[11805]: in thread 7f2e50e69700 thread_name:ms_dispatch Sep 12 23:15:31 node1.ceph ceph-osd[11805]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 1: (()+0xa23b21) [0x55e921a81b21] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 2: (()+0xf370) [0x7f2e6f74c370] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 3: (gsignal()+0x37) [0x7f2e6e7761d7] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 4: (abort()+0x148) [0x7f2e6e7778c8] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x55e921ac0684] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55e9216659d7] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55e921665b19] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55e921534908] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55e921560121] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x55e921560b4c] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x55e921560e87] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 12: (DispatchQueue::entry()+0x792) [0x55e921d36cb2] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x55e921b4b75d] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 14: (()+0x7dc5) [0x7f2e6f744dc5] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 15: (clone()+0x6d) [0x7f2e6e83876d] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 2017-09-12 23:15:31.478897 7f2e50e69700 -1 *** Caught signal (Aborted) ** Sep 12 23:15:31 node1.ceph ceph-osd[11805]: in thread 7f2e50e69700 thread_name:ms_dispatch Sep 12 23:15:31 node1.ceph ceph-osd[11805]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 1: (()+0xa23b21) [0x55e921a81b21] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 2: (()+0xf370) [0x7f2e6f74c370] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 3: (gsignal()+0x37) [0x7f2e6e7761d7] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 4: (abort()+0x148) [0x7f2e6e7778c8] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x55e921ac0684] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55e9216659d7] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55e921665b19] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55e921534908] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55e921560121] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x55e921560b4c] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x55e921560e87] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 12: (DispatchQueue::entry()+0x792) [0x55e921d36cb2] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x55e921b4b75d] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 14: (()+0x7dc5) [0x7f2e6f744dc5] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 15: (clone()+0x6d) [0x7f2e6e83876d] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 0> 2017-09-12 23:15:31.478897 7f2e50e69700 -1 *** Caught signal (Aborted) ** Sep 12 23:15:31 node1.ceph ceph-osd[11805]: in thread 7f2e50e69700 thread_name:ms_dispatch Sep 12 23:15:31 node1.ceph ceph-osd[11805]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 1: (()+0xa23b21) [0x55e921a81b21] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 2: (()+0xf370) [0x7f2e6f74c370] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 3: (gsignal()+0x37) [0x7f2e6e7761d7] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 4: (abort()+0x148) [0x7f2e6e7778c8] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x55e921ac0684] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55e9216659d7] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55e921665b19] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55e921534908] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55e921560121] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x55e921560b4c] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x55e921560e87] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 12: (DispatchQueue::entry()+0x792) [0x55e921d36cb2] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x55e921b4b75d] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 14: (()+0x7dc5) [0x7f2e6f744dc5] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: 15: (clone()+0x6d) [0x7f2e6e83876d] Sep 12 23:15:31 node1.ceph ceph-osd[11805]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 23:15:31 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=6/ABRT Sep 12 23:15:31 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 12 23:15:31 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 12 23:15:51 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 12 23:15:51 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 12 23:15:51 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 12 23:15:51 node1.ceph ceph-osd[15330]: 2017-09-12 23:15:51.750050 7fde28c7cd00 -1 Public network was set, but cluster network was not set Sep 12 23:15:51 node1.ceph ceph-osd[15330]: 2017-09-12 23:15:51.750054 7fde28c7cd00 -1 Using public network also for cluster network Sep 12 23:15:51 node1.ceph ceph-osd[15330]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 12 23:16:00 node1.ceph ceph-osd[15330]: 2017-09-12 23:16:00.261963 7fde28c7cd00 -1 osd.1 16591 log_to_monitors {default=true} Sep 12 23:16:00 node1.ceph ceph-osd[15330]: 2017-09-12 23:16:00.267500 7fde28c7cd00 -1 osd.1 16591 mon_cmd_maybe_osd_create fail: 'you must complete the upgrade and 'ceph osd require-osd-release luminous' before using crush device classes': (1) Operation not permitted Sep 12 23:31:33 node1.ceph ceph-osd[15330]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7fde06c7e700 time 2017-09-12 23:31:33.231749 Sep 12 23:31:33 node1.ceph ceph-osd[15330]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 12 23:31:33 node1.ceph ceph-osd[15330]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x558456ddd510] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x5584569829d7] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x558456982b19] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x558456851908] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55845687d121] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x55845687db4c] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x55845687de87] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 8: (DispatchQueue::entry()+0x792) [0x558457053cb2] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x558456e6875d] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 10: (()+0x7dc5) [0x7fde2608cdc5] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 11: (clone()+0x6d) [0x7fde2518076d] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 2017-09-12 23:31:33.236831 7fde06c7e700 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7fde06c7e700 time 2017-09-12 23:31:33.231749 Sep 12 23:31:33 node1.ceph ceph-osd[15330]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 12 23:31:33 node1.ceph ceph-osd[15330]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x558456ddd510] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x5584569829d7] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x558456982b19] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x558456851908] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55845687d121] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x55845687db4c] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x55845687de87] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 8: (DispatchQueue::entry()+0x792) [0x558457053cb2] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x558456e6875d] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 10: (()+0x7dc5) [0x7fde2608cdc5] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 11: (clone()+0x6d) [0x7fde2518076d] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 0> 2017-09-12 23:31:33.236831 7fde06c7e700 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7fde06c7e700 time 2017-09-12 23:31:33.231749 Sep 12 23:31:33 node1.ceph ceph-osd[15330]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 12 23:31:33 node1.ceph ceph-osd[15330]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x558456ddd510] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x5584569829d7] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x558456982b19] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x558456851908] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55845687d121] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x55845687db4c] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x55845687de87] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 8: (DispatchQueue::entry()+0x792) [0x558457053cb2] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x558456e6875d] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 10: (()+0x7dc5) [0x7fde2608cdc5] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 11: (clone()+0x6d) [0x7fde2518076d] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 23:31:33 node1.ceph ceph-osd[15330]: *** Caught signal (Aborted) ** Sep 12 23:31:33 node1.ceph ceph-osd[15330]: in thread 7fde06c7e700 thread_name:ms_dispatch Sep 12 23:31:33 node1.ceph ceph-osd[15330]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 1: (()+0xa23b21) [0x558456d9eb21] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 2: (()+0xf370) [0x7fde26094370] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 3: (gsignal()+0x37) [0x7fde250be1d7] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 4: (abort()+0x148) [0x7fde250bf8c8] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x558456ddd684] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x5584569829d7] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x558456982b19] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x558456851908] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55845687d121] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x55845687db4c] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x55845687de87] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 12: (DispatchQueue::entry()+0x792) [0x558457053cb2] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x558456e6875d] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 14: (()+0x7dc5) [0x7fde2608cdc5] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 15: (clone()+0x6d) [0x7fde2518076d] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 2017-09-12 23:31:33.272945 7fde06c7e700 -1 *** Caught signal (Aborted) ** Sep 12 23:31:33 node1.ceph ceph-osd[15330]: in thread 7fde06c7e700 thread_name:ms_dispatch Sep 12 23:31:33 node1.ceph ceph-osd[15330]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 1: (()+0xa23b21) [0x558456d9eb21] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 2: (()+0xf370) [0x7fde26094370] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 3: (gsignal()+0x37) [0x7fde250be1d7] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 4: (abort()+0x148) [0x7fde250bf8c8] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x558456ddd684] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x5584569829d7] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x558456982b19] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x558456851908] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55845687d121] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x55845687db4c] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x55845687de87] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 12: (DispatchQueue::entry()+0x792) [0x558457053cb2] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x558456e6875d] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 14: (()+0x7dc5) [0x7fde2608cdc5] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 15: (clone()+0x6d) [0x7fde2518076d] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 0> 2017-09-12 23:31:33.272945 7fde06c7e700 -1 *** Caught signal (Aborted) ** Sep 12 23:31:33 node1.ceph ceph-osd[15330]: in thread 7fde06c7e700 thread_name:ms_dispatch Sep 12 23:31:33 node1.ceph ceph-osd[15330]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 1: (()+0xa23b21) [0x558456d9eb21] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 2: (()+0xf370) [0x7fde26094370] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 3: (gsignal()+0x37) [0x7fde250be1d7] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 4: (abort()+0x148) [0x7fde250bf8c8] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x558456ddd684] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x5584569829d7] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x558456982b19] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x558456851908] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55845687d121] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x55845687db4c] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x55845687de87] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 12: (DispatchQueue::entry()+0x792) [0x558457053cb2] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x558456e6875d] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 14: (()+0x7dc5) [0x7fde2608cdc5] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: 15: (clone()+0x6d) [0x7fde2518076d] Sep 12 23:31:33 node1.ceph ceph-osd[15330]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 23:31:33 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=6/ABRT Sep 12 23:31:33 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 12 23:31:33 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 12 23:31:53 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 12 23:31:53 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 12 23:31:53 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 12 23:31:53 node1.ceph ceph-osd[19150]: 2017-09-12 23:31:53.530188 7f580cc65d00 -1 Public network was set, but cluster network was not set Sep 12 23:31:53 node1.ceph ceph-osd[19150]: 2017-09-12 23:31:53.530198 7f580cc65d00 -1 Using public network also for cluster network Sep 12 23:31:53 node1.ceph ceph-osd[19150]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 12 23:32:02 node1.ceph ceph-osd[19150]: 2017-09-12 23:32:02.132948 7f580cc65d00 -1 osd.1 16602 log_to_monitors {default=true} Sep 12 23:32:02 node1.ceph ceph-osd[19150]: 2017-09-12 23:32:02.137727 7f580cc65d00 -1 osd.1 16602 mon_cmd_maybe_osd_create fail: 'you must complete the upgrade and 'ceph osd require-osd-release luminous' before using crush device classes': (1) Operation not permitted Sep 12 23:47:20 node1.ceph ceph-osd[19150]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7f57eaa75700 time 2017-09-12 23:47:20.431447 Sep 12 23:47:20 node1.ceph ceph-osd[19150]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 12 23:47:20 node1.ceph ceph-osd[19150]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x5577887bf510] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x5577883649d7] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x557788364b19] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x557788233908] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55778825f121] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x55778825fb4c] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x55778825fe87] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 8: (DispatchQueue::entry()+0x792) [0x557788a35cb2] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x55778884a75d] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 10: (()+0x7dc5) [0x7f580a075dc5] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 11: (clone()+0x6d) [0x7f580916976d] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 2017-09-12 23:47:20.435796 7f57eaa75700 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7f57eaa75700 time 2017-09-12 23:47:20.431447 Sep 12 23:47:20 node1.ceph ceph-osd[19150]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 12 23:47:20 node1.ceph ceph-osd[19150]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x5577887bf510] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x5577883649d7] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x557788364b19] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x557788233908] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55778825f121] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x55778825fb4c] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x55778825fe87] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 8: (DispatchQueue::entry()+0x792) [0x557788a35cb2] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x55778884a75d] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 10: (()+0x7dc5) [0x7f580a075dc5] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 11: (clone()+0x6d) [0x7f580916976d] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 0> 2017-09-12 23:47:20.435796 7f57eaa75700 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7f57eaa75700 time 2017-09-12 23:47:20.431447 Sep 12 23:47:20 node1.ceph ceph-osd[19150]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 12 23:47:20 node1.ceph ceph-osd[19150]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x5577887bf510] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x5577883649d7] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x557788364b19] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x557788233908] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55778825f121] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x55778825fb4c] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x55778825fe87] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 8: (DispatchQueue::entry()+0x792) [0x557788a35cb2] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x55778884a75d] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 10: (()+0x7dc5) [0x7f580a075dc5] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 11: (clone()+0x6d) [0x7f580916976d] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 23:47:20 node1.ceph ceph-osd[19150]: *** Caught signal (Aborted) ** Sep 12 23:47:20 node1.ceph ceph-osd[19150]: in thread 7f57eaa75700 thread_name:ms_dispatch Sep 12 23:47:20 node1.ceph ceph-osd[19150]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 1: (()+0xa23b21) [0x557788780b21] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 2: (()+0xf370) [0x7f580a07d370] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 3: (gsignal()+0x37) [0x7f58090a71d7] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 4: (abort()+0x148) [0x7f58090a88c8] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x5577887bf684] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x5577883649d7] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x557788364b19] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x557788233908] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55778825f121] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x55778825fb4c] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x55778825fe87] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 12: (DispatchQueue::entry()+0x792) [0x557788a35cb2] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x55778884a75d] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 14: (()+0x7dc5) [0x7f580a075dc5] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 15: (clone()+0x6d) [0x7f580916976d] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 2017-09-12 23:47:20.470895 7f57eaa75700 -1 *** Caught signal (Aborted) ** Sep 12 23:47:20 node1.ceph ceph-osd[19150]: in thread 7f57eaa75700 thread_name:ms_dispatch Sep 12 23:47:20 node1.ceph ceph-osd[19150]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 1: (()+0xa23b21) [0x557788780b21] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 2: (()+0xf370) [0x7f580a07d370] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 3: (gsignal()+0x37) [0x7f58090a71d7] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 4: (abort()+0x148) [0x7f58090a88c8] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x5577887bf684] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x5577883649d7] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x557788364b19] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x557788233908] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55778825f121] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x55778825fb4c] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x55778825fe87] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 12: (DispatchQueue::entry()+0x792) [0x557788a35cb2] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x55778884a75d] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 14: (()+0x7dc5) [0x7f580a075dc5] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 15: (clone()+0x6d) [0x7f580916976d] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 0> 2017-09-12 23:47:20.470895 7f57eaa75700 -1 *** Caught signal (Aborted) ** Sep 12 23:47:20 node1.ceph ceph-osd[19150]: in thread 7f57eaa75700 thread_name:ms_dispatch Sep 12 23:47:20 node1.ceph ceph-osd[19150]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 1: (()+0xa23b21) [0x557788780b21] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 2: (()+0xf370) [0x7f580a07d370] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 3: (gsignal()+0x37) [0x7f58090a71d7] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 4: (abort()+0x148) [0x7f58090a88c8] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x5577887bf684] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x5577883649d7] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x557788364b19] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x557788233908] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55778825f121] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x55778825fb4c] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x55778825fe87] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 12: (DispatchQueue::entry()+0x792) [0x557788a35cb2] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x55778884a75d] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 14: (()+0x7dc5) [0x7f580a075dc5] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: 15: (clone()+0x6d) [0x7f580916976d] Sep 12 23:47:20 node1.ceph ceph-osd[19150]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 12 23:47:20 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=6/ABRT Sep 12 23:47:20 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 12 23:47:20 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 12 23:47:40 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 12 23:47:40 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 12 23:47:40 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 12 23:47:40 node1.ceph ceph-osd[22453]: 2017-09-12 23:47:40.778731 7fed6e3ffd00 -1 Public network was set, but cluster network was not set Sep 12 23:47:40 node1.ceph ceph-osd[22453]: 2017-09-12 23:47:40.778738 7fed6e3ffd00 -1 Using public network also for cluster network Sep 12 23:47:40 node1.ceph ceph-osd[22453]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 12 23:47:49 node1.ceph ceph-osd[22453]: 2017-09-12 23:47:49.874677 7fed6e3ffd00 -1 osd.1 16612 log_to_monitors {default=true} Sep 12 23:47:49 node1.ceph ceph-osd[22453]: 2017-09-12 23:47:49.880273 7fed6e3ffd00 -1 osd.1 16612 mon_cmd_maybe_osd_create fail: 'you must complete the upgrade and 'ceph osd require-osd-release luminous' before using crush device classes': (1) Operation not permitted Sep 13 00:03:15 node1.ceph ceph-osd[22453]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7fed4b3fd700 time 2017-09-13 00:03:15.840733 Sep 13 00:03:15 node1.ceph ceph-osd[22453]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 13 00:03:15 node1.ceph ceph-osd[22453]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x56460511a510] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x564604cbf9d7] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x564604cbfb19] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x564604b8e908] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x564604bba121] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x564604bbab4c] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x564604bbae87] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 8: (DispatchQueue::entry()+0x792) [0x564605390cb2] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x5646051a575d] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 10: (()+0x7dc5) [0x7fed6b80fdc5] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 11: (clone()+0x6d) [0x7fed6a90376d] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 2017-09-13 00:03:15.844052 7fed4b3fd700 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7fed4b3fd700 time 2017-09-13 00:03:15.840733 Sep 13 00:03:15 node1.ceph ceph-osd[22453]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 13 00:03:15 node1.ceph ceph-osd[22453]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x56460511a510] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x564604cbf9d7] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x564604cbfb19] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x564604b8e908] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x564604bba121] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x564604bbab4c] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x564604bbae87] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 8: (DispatchQueue::entry()+0x792) [0x564605390cb2] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x5646051a575d] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 10: (()+0x7dc5) [0x7fed6b80fdc5] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 11: (clone()+0x6d) [0x7fed6a90376d] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 0> 2017-09-13 00:03:15.844052 7fed4b3fd700 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7fed4b3fd700 time 2017-09-13 00:03:15.840733 Sep 13 00:03:15 node1.ceph ceph-osd[22453]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 13 00:03:15 node1.ceph ceph-osd[22453]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x56460511a510] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x564604cbf9d7] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x564604cbfb19] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x564604b8e908] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x564604bba121] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x564604bbab4c] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x564604bbae87] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 8: (DispatchQueue::entry()+0x792) [0x564605390cb2] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x5646051a575d] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 10: (()+0x7dc5) [0x7fed6b80fdc5] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 11: (clone()+0x6d) [0x7fed6a90376d] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 13 00:03:15 node1.ceph ceph-osd[22453]: *** Caught signal (Aborted) ** Sep 13 00:03:15 node1.ceph ceph-osd[22453]: in thread 7fed4b3fd700 thread_name:ms_dispatch Sep 13 00:03:15 node1.ceph ceph-osd[22453]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 1: (()+0xa23b21) [0x5646050dbb21] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 2: (()+0xf370) [0x7fed6b817370] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 3: (gsignal()+0x37) [0x7fed6a8411d7] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 4: (abort()+0x148) [0x7fed6a8428c8] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x56460511a684] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x564604cbf9d7] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x564604cbfb19] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x564604b8e908] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x564604bba121] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x564604bbab4c] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x564604bbae87] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 12: (DispatchQueue::entry()+0x792) [0x564605390cb2] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x5646051a575d] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 14: (()+0x7dc5) [0x7fed6b80fdc5] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 15: (clone()+0x6d) [0x7fed6a90376d] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 2017-09-13 00:03:15.873206 7fed4b3fd700 -1 *** Caught signal (Aborted) ** Sep 13 00:03:15 node1.ceph ceph-osd[22453]: in thread 7fed4b3fd700 thread_name:ms_dispatch Sep 13 00:03:15 node1.ceph ceph-osd[22453]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 1: (()+0xa23b21) [0x5646050dbb21] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 2: (()+0xf370) [0x7fed6b817370] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 3: (gsignal()+0x37) [0x7fed6a8411d7] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 4: (abort()+0x148) [0x7fed6a8428c8] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x56460511a684] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x564604cbf9d7] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x564604cbfb19] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x564604b8e908] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x564604bba121] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x564604bbab4c] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x564604bbae87] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 12: (DispatchQueue::entry()+0x792) [0x564605390cb2] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x5646051a575d] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 14: (()+0x7dc5) [0x7fed6b80fdc5] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 15: (clone()+0x6d) [0x7fed6a90376d] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 0> 2017-09-13 00:03:15.873206 7fed4b3fd700 -1 *** Caught signal (Aborted) ** Sep 13 00:03:15 node1.ceph ceph-osd[22453]: in thread 7fed4b3fd700 thread_name:ms_dispatch Sep 13 00:03:15 node1.ceph ceph-osd[22453]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 1: (()+0xa23b21) [0x5646050dbb21] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 2: (()+0xf370) [0x7fed6b817370] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 3: (gsignal()+0x37) [0x7fed6a8411d7] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 4: (abort()+0x148) [0x7fed6a8428c8] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x56460511a684] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x564604cbf9d7] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x564604cbfb19] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x564604b8e908] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x564604bba121] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x564604bbab4c] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x564604bbae87] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 12: (DispatchQueue::entry()+0x792) [0x564605390cb2] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x5646051a575d] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 14: (()+0x7dc5) [0x7fed6b80fdc5] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: 15: (clone()+0x6d) [0x7fed6a90376d] Sep 13 00:03:15 node1.ceph ceph-osd[22453]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 13 00:03:15 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=6/ABRT Sep 13 00:03:15 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 13 00:03:15 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 13 00:03:36 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 13 00:03:36 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 13 00:03:36 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 13 00:03:36 node1.ceph ceph-osd[25936]: 2017-09-13 00:03:36.287910 7f3509432d00 -1 Public network was set, but cluster network was not set Sep 13 00:03:36 node1.ceph ceph-osd[25936]: 2017-09-13 00:03:36.287916 7f3509432d00 -1 Using public network also for cluster network Sep 13 00:03:36 node1.ceph ceph-osd[25936]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 13 00:03:45 node1.ceph ceph-osd[25936]: 2017-09-13 00:03:45.456291 7f3509432d00 -1 osd.1 16623 log_to_monitors {default=true} Sep 13 00:03:45 node1.ceph ceph-osd[25936]: 2017-09-13 00:03:45.460666 7f3509432d00 -1 osd.1 16623 mon_cmd_maybe_osd_create fail: 'you must complete the upgrade and 'ceph osd require-osd-release luminous' before using crush device classes': (1) Operation not permitted Sep 13 00:14:45 node1.ceph ceph-osd[25936]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7f34e67fd700 time 2017-09-13 00:14:45.292917 Sep 13 00:14:45 node1.ceph ceph-osd[25936]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 13 00:14:45 node1.ceph ceph-osd[25936]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x5653fc95a510] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x5653fc4ff9d7] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x5653fc4ffb19] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x5653fc3ce908] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x5653fc3fa121] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x5653fc3fab4c] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x5653fc3fae87] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 8: (DispatchQueue::entry()+0x792) [0x5653fcbd0cb2] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x5653fc9e575d] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 10: (()+0x7dc5) [0x7f3506842dc5] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 11: (clone()+0x6d) [0x7f350593676d] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 2017-09-13 00:14:45.296749 7f34e67fd700 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7f34e67fd700 time 2017-09-13 00:14:45.292917 Sep 13 00:14:45 node1.ceph ceph-osd[25936]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 13 00:14:45 node1.ceph ceph-osd[25936]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x5653fc95a510] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x5653fc4ff9d7] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x5653fc4ffb19] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x5653fc3ce908] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x5653fc3fa121] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x5653fc3fab4c] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x5653fc3fae87] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 8: (DispatchQueue::entry()+0x792) [0x5653fcbd0cb2] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x5653fc9e575d] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 10: (()+0x7dc5) [0x7f3506842dc5] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 11: (clone()+0x6d) [0x7f350593676d] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 0> 2017-09-13 00:14:45.296749 7f34e67fd700 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7f34e67fd700 time 2017-09-13 00:14:45.292917 Sep 13 00:14:45 node1.ceph ceph-osd[25936]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 13 00:14:45 node1.ceph ceph-osd[25936]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x5653fc95a510] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x5653fc4ff9d7] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x5653fc4ffb19] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x5653fc3ce908] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x5653fc3fa121] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x5653fc3fab4c] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x5653fc3fae87] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 8: (DispatchQueue::entry()+0x792) [0x5653fcbd0cb2] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x5653fc9e575d] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 10: (()+0x7dc5) [0x7f3506842dc5] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 11: (clone()+0x6d) [0x7f350593676d] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 13 00:14:45 node1.ceph ceph-osd[25936]: *** Caught signal (Aborted) ** Sep 13 00:14:45 node1.ceph ceph-osd[25936]: in thread 7f34e67fd700 thread_name:ms_dispatch Sep 13 00:14:45 node1.ceph ceph-osd[25936]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 1: (()+0xa23b21) [0x5653fc91bb21] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 2: (()+0xf370) [0x7f350684a370] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 3: (gsignal()+0x37) [0x7f35058741d7] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 4: (abort()+0x148) [0x7f35058758c8] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x5653fc95a684] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x5653fc4ff9d7] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x5653fc4ffb19] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x5653fc3ce908] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x5653fc3fa121] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x5653fc3fab4c] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x5653fc3fae87] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 12: (DispatchQueue::entry()+0x792) [0x5653fcbd0cb2] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x5653fc9e575d] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 14: (()+0x7dc5) [0x7f3506842dc5] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 15: (clone()+0x6d) [0x7f350593676d] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 2017-09-13 00:14:45.328267 7f34e67fd700 -1 *** Caught signal (Aborted) ** Sep 13 00:14:45 node1.ceph ceph-osd[25936]: in thread 7f34e67fd700 thread_name:ms_dispatch Sep 13 00:14:45 node1.ceph ceph-osd[25936]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 1: (()+0xa23b21) [0x5653fc91bb21] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 2: (()+0xf370) [0x7f350684a370] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 3: (gsignal()+0x37) [0x7f35058741d7] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 4: (abort()+0x148) [0x7f35058758c8] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x5653fc95a684] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x5653fc4ff9d7] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x5653fc4ffb19] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x5653fc3ce908] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x5653fc3fa121] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x5653fc3fab4c] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x5653fc3fae87] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 12: (DispatchQueue::entry()+0x792) [0x5653fcbd0cb2] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x5653fc9e575d] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 14: (()+0x7dc5) [0x7f3506842dc5] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 15: (clone()+0x6d) [0x7f350593676d] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 0> 2017-09-13 00:14:45.328267 7f34e67fd700 -1 *** Caught signal (Aborted) ** Sep 13 00:14:45 node1.ceph ceph-osd[25936]: in thread 7f34e67fd700 thread_name:ms_dispatch Sep 13 00:14:45 node1.ceph ceph-osd[25936]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 1: (()+0xa23b21) [0x5653fc91bb21] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 2: (()+0xf370) [0x7f350684a370] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 3: (gsignal()+0x37) [0x7f35058741d7] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 4: (abort()+0x148) [0x7f35058758c8] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x5653fc95a684] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x5653fc4ff9d7] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x5653fc4ffb19] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x5653fc3ce908] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x5653fc3fa121] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x5653fc3fab4c] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x5653fc3fae87] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 12: (DispatchQueue::entry()+0x792) [0x5653fcbd0cb2] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x5653fc9e575d] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 14: (()+0x7dc5) [0x7f3506842dc5] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: 15: (clone()+0x6d) [0x7f350593676d] Sep 13 00:14:45 node1.ceph ceph-osd[25936]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 13 00:14:45 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=6/ABRT Sep 13 00:14:45 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 13 00:14:45 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 13 00:15:05 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 13 00:15:05 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 13 00:15:05 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 13 00:15:05 node1.ceph ceph-osd[28593]: 2017-09-13 00:15:05.536359 7f7b5119ad00 -1 Public network was set, but cluster network was not set Sep 13 00:15:05 node1.ceph ceph-osd[28593]: 2017-09-13 00:15:05.536366 7f7b5119ad00 -1 Using public network also for cluster network Sep 13 00:15:05 node1.ceph ceph-osd[28593]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 13 00:15:14 node1.ceph ceph-osd[28593]: 2017-09-13 00:15:14.356402 7f7b5119ad00 -1 osd.1 16633 log_to_monitors {default=true} Sep 13 00:15:14 node1.ceph ceph-osd[28593]: 2017-09-13 00:15:14.361917 7f7b5119ad00 -1 osd.1 16633 mon_cmd_maybe_osd_create fail: 'you must complete the upgrade and 'ceph osd require-osd-release luminous' before using crush device classes': (1) Operation not permitted Sep 13 01:19:22 node1.ceph ceph-osd[28593]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7f7b2ee86700 time 2017-09-13 01:19:22.619711 Sep 13 01:19:22 node1.ceph ceph-osd[28593]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 13 01:19:22 node1.ceph ceph-osd[28593]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x55f05bca9510] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55f05b84e9d7] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55f05b84eb19] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55f05b71d908] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55f05b749121] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x55f05b749b4c] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x55f05b749e87] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 8: (DispatchQueue::entry()+0x792) [0x55f05bf1fcb2] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x55f05bd3475d] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 10: (()+0x7dc5) [0x7f7b4e5aadc5] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 11: (clone()+0x6d) [0x7f7b4d69e76d] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 2017-09-13 01:19:22.623928 7f7b2ee86700 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7f7b2ee86700 time 2017-09-13 01:19:22.619711 Sep 13 01:19:22 node1.ceph ceph-osd[28593]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 13 01:19:22 node1.ceph ceph-osd[28593]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x55f05bca9510] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55f05b84e9d7] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55f05b84eb19] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55f05b71d908] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55f05b749121] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x55f05b749b4c] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x55f05b749e87] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 8: (DispatchQueue::entry()+0x792) [0x55f05bf1fcb2] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x55f05bd3475d] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 10: (()+0x7dc5) [0x7f7b4e5aadc5] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 11: (clone()+0x6d) [0x7f7b4d69e76d] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 0> 2017-09-13 01:19:22.623928 7f7b2ee86700 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7f7b2ee86700 time 2017-09-13 01:19:22.619711 Sep 13 01:19:22 node1.ceph ceph-osd[28593]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 13 01:19:22 node1.ceph ceph-osd[28593]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x55f05bca9510] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55f05b84e9d7] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55f05b84eb19] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55f05b71d908] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55f05b749121] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x55f05b749b4c] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x55f05b749e87] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 8: (DispatchQueue::entry()+0x792) [0x55f05bf1fcb2] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x55f05bd3475d] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 10: (()+0x7dc5) [0x7f7b4e5aadc5] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 11: (clone()+0x6d) [0x7f7b4d69e76d] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 13 01:19:22 node1.ceph ceph-osd[28593]: *** Caught signal (Aborted) ** Sep 13 01:19:22 node1.ceph ceph-osd[28593]: in thread 7f7b2ee86700 thread_name:ms_dispatch Sep 13 01:19:22 node1.ceph ceph-osd[28593]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 1: (()+0xa23b21) [0x55f05bc6ab21] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 2: (()+0xf370) [0x7f7b4e5b2370] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 3: (gsignal()+0x37) [0x7f7b4d5dc1d7] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 4: (abort()+0x148) [0x7f7b4d5dd8c8] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x55f05bca9684] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55f05b84e9d7] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55f05b84eb19] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55f05b71d908] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55f05b749121] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x55f05b749b4c] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x55f05b749e87] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 12: (DispatchQueue::entry()+0x792) [0x55f05bf1fcb2] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x55f05bd3475d] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 14: (()+0x7dc5) [0x7f7b4e5aadc5] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 15: (clone()+0x6d) [0x7f7b4d69e76d] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 2017-09-13 01:19:22.657713 7f7b2ee86700 -1 *** Caught signal (Aborted) ** Sep 13 01:19:22 node1.ceph ceph-osd[28593]: in thread 7f7b2ee86700 thread_name:ms_dispatch Sep 13 01:19:22 node1.ceph ceph-osd[28593]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 1: (()+0xa23b21) [0x55f05bc6ab21] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 2: (()+0xf370) [0x7f7b4e5b2370] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 3: (gsignal()+0x37) [0x7f7b4d5dc1d7] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 4: (abort()+0x148) [0x7f7b4d5dd8c8] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x55f05bca9684] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55f05b84e9d7] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55f05b84eb19] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55f05b71d908] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55f05b749121] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x55f05b749b4c] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x55f05b749e87] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 12: (DispatchQueue::entry()+0x792) [0x55f05bf1fcb2] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x55f05bd3475d] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 14: (()+0x7dc5) [0x7f7b4e5aadc5] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 15: (clone()+0x6d) [0x7f7b4d69e76d] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 0> 2017-09-13 01:19:22.657713 7f7b2ee86700 -1 *** Caught signal (Aborted) ** Sep 13 01:19:22 node1.ceph ceph-osd[28593]: in thread 7f7b2ee86700 thread_name:ms_dispatch Sep 13 01:19:22 node1.ceph ceph-osd[28593]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 1: (()+0xa23b21) [0x55f05bc6ab21] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 2: (()+0xf370) [0x7f7b4e5b2370] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 3: (gsignal()+0x37) [0x7f7b4d5dc1d7] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 4: (abort()+0x148) [0x7f7b4d5dd8c8] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x55f05bca9684] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55f05b84e9d7] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55f05b84eb19] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55f05b71d908] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55f05b749121] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x55f05b749b4c] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x55f05b749e87] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 12: (DispatchQueue::entry()+0x792) [0x55f05bf1fcb2] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x55f05bd3475d] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 14: (()+0x7dc5) [0x7f7b4e5aadc5] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: 15: (clone()+0x6d) [0x7f7b4d69e76d] Sep 13 01:19:22 node1.ceph ceph-osd[28593]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 13 01:19:22 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=6/ABRT Sep 13 01:19:22 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 13 01:19:22 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 13 01:19:42 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 13 01:19:42 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 13 01:19:43 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 13 01:19:43 node1.ceph ceph-osd[11188]: 2017-09-13 01:19:43.100212 7f5237035d00 -1 Public network was set, but cluster network was not set Sep 13 01:19:43 node1.ceph ceph-osd[11188]: 2017-09-13 01:19:43.100222 7f5237035d00 -1 Using public network also for cluster network Sep 13 01:19:43 node1.ceph ceph-osd[11188]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 13 01:20:12 node1.ceph ceph-osd[11188]: 2017-09-13 01:20:12.897538 7f5237035d00 -1 osd.1 16656 log_to_monitors {default=true} Sep 13 01:20:12 node1.ceph ceph-osd[11188]: 2017-09-13 01:20:12.902570 7f5237035d00 -1 osd.1 16656 mon_cmd_maybe_osd_create fail: 'you must complete the upgrade and 'ceph osd require-osd-release luminous' before using crush device classes': (1) Operation not permitted Sep 13 04:27:32 node1.ceph ceph-osd[11188]: 2017-09-13 04:27:32.184942 7f52047ff700 -1 received signal: Hangup from PID: 20241 task name: killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw UID: 0 Sep 13 05:08:59 node1.ceph ceph-osd[11188]: 2017-09-13 05:08:59.148935 7f520c7e2700 -1 osd.1 pg_epoch: 16727 pg[8.322( v 16727'1622494 (16461'1619417,16727'1622494] local-lis/les=16661/16663 n=3501 ec=2548/2548 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,34,23] r=0 lpr=16661 crt=16727'1622494 lcod 16727'1622493 mlcod 16727'1622493 active+clean+scrubbing+deep] _scan_snaps no head for 8:44d70d26:::rbd_data.9aca26238e1f29.0000000000001670:65 (have MIN) Sep 13 05:20:14 node1.ceph ceph-osd[11188]: 2017-09-13 05:20:14.869104 7f520d7e4700 -1 osd.1 pg_epoch: 16731 pg[7.311( v 16731'7759871 (16703'7756867,16731'7759871] local-lis/les=16661/16662 n=3031 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16679/0 16661/16661/16247) [34,23,1] r=2 lpr=16661 luod=0'0 crt=16731'7759866 lcod 16731'7759870 active] _scan_snaps no head for 7:88df11c1:::rbd_data.32bc79238e1f29.000000000000076c:2d (have MIN) Sep 13 05:20:55 node1.ceph ceph-osd[11188]: 2017-09-13 05:20:55.957371 7f520d7e4700 -1 osd.1 pg_epoch: 16731 pg[7.311( v 16731'7759889 (16703'7756867,16731'7759889] local-lis/les=16661/16662 n=3031 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16679/0 16661/16661/16247) [34,23,1] r=2 lpr=16661 luod=0'0 lua=16731'7759887 crt=16731'7759885 lcod 16731'7759888 active] _scan_snaps no head for 7:88e3d887:::rbd_data.a6351b238e1f29.000000000001d93f:9e (have MIN) Sep 13 05:21:46 node1.ceph ceph-osd[11188]: 2017-09-13 05:21:46.821120 7f520d7e4700 -1 osd.1 pg_epoch: 16731 pg[7.311( v 16731'7759937 (16703'7756867,16731'7759937] local-lis/les=16661/16662 n=3031 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16679/0 16661/16661/16247) [34,23,1] r=2 lpr=16661 luod=0'0 crt=16731'7759931 lcod 16731'7759936 active] _scan_snaps no head for 7:88e9215b:::rbd_data.a6351b238e1f29.0000000000026d82:9e (have MIN) Sep 13 05:23:55 node1.ceph ceph-osd[11188]: 2017-09-13 05:23:55.253125 7f520d7e4700 -1 osd.1 pg_epoch: 16731 pg[7.311( v 16731'7760055 (16703'7756967,16731'7760055] local-lis/les=16661/16662 n=3031 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16679/0 16661/16661/16247) [34,23,1] r=2 lpr=16661 luod=0'0 crt=16731'7760052 lcod 16731'7760054 active] _scan_snaps no head for 7:88f549c1:::rbd_data.a6351b238e1f29.0000000000023d80:9e (have MIN) Sep 13 05:24:39 node1.ceph ceph-osd[11188]: 2017-09-13 05:24:39.329448 7f520d7e4700 -1 osd.1 pg_epoch: 16733 pg[7.311( v 16733'7760077 (16705'7757067,16733'7760077] local-lis/les=16661/16662 n=3031 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16679/0 16661/16661/16247) [34,23,1] r=2 lpr=16661 luod=0'0 crt=16731'7760071 lcod 16733'7760076 active] _scan_snaps no head for 7:88f9b30c:::rbd_data.a6351b238e1f29.0000000000026d89:9e (have MIN) Sep 13 05:30:01 node1.ceph ceph-osd[11188]: 2017-09-13 05:30:01.102636 7f520c7e2700 -1 osd.1 pg_epoch: 16735 pg[7.8e( v 16735'7305549 (16707'7302494,16735'7305549] local-lis/les=16661/16663 n=3048 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16201) [13,40,1] r=2 lpr=16661 luod=0'0 crt=16735'7305547 lcod 16735'7305548 active] _scan_snaps no head for 7:710cf42a:::rbd_data.bd1c92ae8944a.0000000000002aad:d2 (have MIN) Sep 13 05:30:07 node1.ceph ceph-osd[11188]: 2017-09-13 05:30:07.196975 7f520c7e2700 -1 osd.1 pg_epoch: 16735 pg[7.8e( v 16735'7305549 (16707'7302494,16735'7305549] local-lis/les=16661/16663 n=3048 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16201) [13,40,1] r=2 lpr=16661 luod=0'0 crt=16735'7305547 lcod 16735'7305548 active] _scan_snaps no head for 7:711283ae:::rbd_data.a70641238e1f29.00000000000066cc:ce (have MIN) Sep 13 05:30:08 node1.ceph ceph-osd[11188]: 2017-09-13 05:30:08.844248 7f520c7e2700 -1 osd.1 pg_epoch: 16735 pg[7.8e( v 16735'7305549 (16707'7302494,16735'7305549] local-lis/les=16661/16663 n=3048 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16201) [13,40,1] r=2 lpr=16661 luod=0'0 crt=16735'7305547 lcod 16735'7305548 active] _scan_snaps no head for 7:7115bd03:::rbd_data.a70641238e1f29.0000000000005cd9:ce (have MIN) Sep 13 05:30:15 node1.ceph ceph-osd[11188]: 2017-09-13 05:30:15.618268 7f520c7e2700 -1 osd.1 pg_epoch: 16735 pg[7.8e( v 16735'7305550 (16707'7302494,16735'7305550] local-lis/les=16661/16663 n=3048 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16201) [13,40,1] r=2 lpr=16661 luod=0'0 crt=16735'7305548 lcod 16735'7305549 active] _scan_snaps no head for 7:711f6e7e:::rbd_data.bd1c92ae8944a.000000000000195c:d4 (have MIN) Sep 13 05:30:15 node1.ceph ceph-osd[11188]: 2017-09-13 05:30:15.618324 7f520c7e2700 -1 osd.1 pg_epoch: 16735 pg[7.8e( v 16735'7305550 (16707'7302494,16735'7305550] local-lis/les=16661/16663 n=3048 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16201) [13,40,1] r=2 lpr=16661 luod=0'0 crt=16735'7305548 lcod 16735'7305549 active] _scan_snaps no head for 7:711f6e7e:::rbd_data.bd1c92ae8944a.000000000000195c:d2 (have MIN) Sep 13 05:30:16 node1.ceph ceph-osd[11188]: 2017-09-13 05:30:16.841583 7f520c7e2700 -1 osd.1 pg_epoch: 16735 pg[7.8e( v 16735'7305550 (16707'7302494,16735'7305550] local-lis/les=16661/16663 n=3048 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16201) [13,40,1] r=2 lpr=16661 luod=0'0 crt=16735'7305548 lcod 16735'7305549 active] _scan_snaps no head for 7:71217eec:::rbd_data.32bc79238e1f29.0000000000002329:2d (have MIN) Sep 13 05:30:17 node1.ceph ceph-osd[11188]: 2017-09-13 05:30:17.460091 7f520c7e2700 -1 osd.1 pg_epoch: 16735 pg[7.8e( v 16735'7305550 (16707'7302494,16735'7305550] local-lis/les=16661/16663 n=3048 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16201) [13,40,1] r=2 lpr=16661 luod=0'0 crt=16735'7305548 lcod 16735'7305549 active] _scan_snaps no head for 7:712280d8:::rbd_data.a6351b238e1f29.000000000001fbc1:9e (have MIN) Sep 13 05:30:26 node1.ceph ceph-osd[11188]: 2017-09-13 05:30:26.029584 7f520c7e2700 -1 osd.1 pg_epoch: 16735 pg[7.8e( v 16735'7305551 (16707'7302494,16735'7305551] local-lis/les=16661/16663 n=3048 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16201) [13,40,1] r=2 lpr=16661 luod=0'0 crt=16735'7305549 lcod 16735'7305550 active] _scan_snaps no head for 7:712d145f:::rbd_data.a6351b238e1f29.000000000002b0cf:9e (have MIN) Sep 13 05:30:29 node1.ceph ceph-osd[11188]: 2017-09-13 05:30:29.664721 7f520c7e2700 -1 osd.1 pg_epoch: 16735 pg[7.8e( v 16735'7305551 (16707'7302494,16735'7305551] local-lis/les=16661/16663 n=3048 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16201) [13,40,1] r=2 lpr=16661 luod=0'0 crt=16735'7305549 lcod 16735'7305550 active] _scan_snaps no head for 7:71325af8:::rbd_data.a74f60238e1f29.0000000000000fdf:9c (have MIN) Sep 13 05:30:30 node1.ceph ceph-osd[11188]: 2017-09-13 05:30:30.422006 7f520c7e2700 -1 osd.1 pg_epoch: 16735 pg[7.8e( v 16735'7305551 (16707'7302494,16735'7305551] local-lis/les=16661/16663 n=3048 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16201) [13,40,1] r=2 lpr=16661 luod=0'0 crt=16735'7305549 lcod 16735'7305550 active] _scan_snaps no head for 7:7134e87d:::rbd_data.bd1c92ae8944a.000000000000113b:d2 (have MIN) Sep 13 05:44:20 node1.ceph ceph-osd[11188]: 2017-09-13 05:44:20.401721 7f520c7e2700 -1 osd.1 pg_epoch: 16737 pg[7.84( v 16737'9461672 (16715'9458614,16737'9461672] local-lis/les=16661/16662 n=2988 ec=104/104 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16408) [26,35,1] r=2 lpr=16661 luod=0'0 crt=16737'9461670 lcod 16737'9461671 active] _scan_snaps no head for 7:21046fa5:::rbd_data.a6351b238e1f29.000000000001f0dd:9e (have MIN) Sep 13 05:44:23 node1.ceph ceph-osd[11188]: 2017-09-13 05:44:23.434697 7f520c7e2700 -1 osd.1 pg_epoch: 16737 pg[7.84( v 16737'9461673 (16715'9458614,16737'9461673] local-lis/les=16661/16662 n=2988 ec=104/104 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16408) [26,35,1] r=2 lpr=16661 luod=0'0 crt=16737'9461671 lcod 16737'9461672 active] _scan_snaps no head for 7:210b8503:::rbd_data.a6351b238e1f29.000000000002badf:9e (have MIN) Sep 13 05:44:30 node1.ceph ceph-osd[11188]: 2017-09-13 05:44:30.499072 7f520c7e2700 -1 osd.1 pg_epoch: 16737 pg[7.84( v 16737'9461673 (16715'9458614,16737'9461673] local-lis/les=16661/16662 n=2988 ec=104/104 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16408) [26,35,1] r=2 lpr=16661 luod=0'0 crt=16737'9461671 lcod 16737'9461672 active] _scan_snaps no head for 7:21226950:::rbd_data.bd1c92ae8944a.00000000000029ba:d4 (have MIN) Sep 13 05:44:30 node1.ceph ceph-osd[11188]: 2017-09-13 05:44:30.499102 7f520c7e2700 -1 osd.1 pg_epoch: 16737 pg[7.84( v 16737'9461673 (16715'9458614,16737'9461673] local-lis/les=16661/16662 n=2988 ec=104/104 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16408) [26,35,1] r=2 lpr=16661 luod=0'0 crt=16737'9461671 lcod 16737'9461672 active] _scan_snaps no head for 7:21226950:::rbd_data.bd1c92ae8944a.00000000000029ba:d2 (have MIN) Sep 13 05:44:36 node1.ceph ceph-osd[11188]: 2017-09-13 05:44:36.809697 7f520c7e2700 -1 osd.1 pg_epoch: 16737 pg[7.84( v 16737'9461673 (16715'9458614,16737'9461673] local-lis/les=16661/16662 n=2988 ec=104/104 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16408) [26,35,1] r=2 lpr=16661 luod=0'0 crt=16737'9461671 lcod 16737'9461672 active] _scan_snaps no head for 7:213d1811:::rbd_data.bd1c92ae8944a.000000000000580e:d2 (have MIN) Sep 13 05:44:36 node1.ceph ceph-osd[11188]: 2017-09-13 05:44:36.884809 7f520c7e2700 -1 osd.1 pg_epoch: 16737 pg[7.84( v 16737'9461673 (16715'9458614,16737'9461673] local-lis/les=16661/16662 n=2988 ec=104/104 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16408) [26,35,1] r=2 lpr=16661 luod=0'0 crt=16737'9461671 lcod 16737'9461672 active] _scan_snaps no head for 7:213dc23b:::rbd_data.b07e94238e1f29.000000000000056b:80 (have MIN) Sep 13 05:45:01 node1.ceph ceph-osd[11188]: 2017-09-13 05:45:01.651827 7f520b7e0700 -1 osd.1 pg_epoch: 16737 pg[7.2c0( v 16737'11945923 (16707'11942823,16737'11945923] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16670/0 16661/16661/16207) [12,1,39] r=1 lpr=16661 luod=0'0 crt=16737'11945921 lcod 16737'11945922 active] _scan_snaps no head for 7:034239fb:::rbd_data.bd1c92ae8944a.0000000000004bea:d2 (have MIN) Sep 13 05:45:08 node1.ceph ceph-osd[11188]: 2017-09-13 05:45:08.040499 7f520b7e0700 -1 osd.1 pg_epoch: 16737 pg[7.2c0( v 16737'11945931 (16709'11942923,16737'11945931] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16670/0 16661/16661/16207) [12,1,39] r=1 lpr=16661 luod=0'0 crt=16737'11945929 lcod 16737'11945930 active] _scan_snaps no head for 7:035389cc:::rbd_data.bd1c92ae8944a.0000000000003bca:d4 (have MIN) Sep 13 05:45:08 node1.ceph ceph-osd[11188]: 2017-09-13 05:45:08.040537 7f520b7e0700 -1 osd.1 pg_epoch: 16737 pg[7.2c0( v 16737'11945931 (16709'11942923,16737'11945931] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16670/0 16661/16661/16207) [12,1,39] r=1 lpr=16661 luod=0'0 crt=16737'11945929 lcod 16737'11945930 active] _scan_snaps no head for 7:035389cc:::rbd_data.bd1c92ae8944a.0000000000003bca:d2 (have MIN) Sep 13 05:45:10 node1.ceph ceph-osd[11188]: 2017-09-13 05:45:10.502251 7f520b7e0700 -1 osd.1 pg_epoch: 16737 pg[7.2c0( v 16737'11945933 (16709'11942923,16737'11945933] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16670/0 16661/16661/16207) [12,1,39] r=1 lpr=16661 luod=0'0 crt=16737'11945930 lcod 16737'11945932 active] _scan_snaps no head for 7:035b1439:::rbd_data.bd1c92ae8944a.000000000000204f:d4 (have MIN) Sep 13 05:45:10 node1.ceph ceph-osd[11188]: 2017-09-13 05:45:10.502281 7f520b7e0700 -1 osd.1 pg_epoch: 16737 pg[7.2c0( v 16737'11945933 (16709'11942923,16737'11945933] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16670/0 16661/16661/16207) [12,1,39] r=1 lpr=16661 luod=0'0 crt=16737'11945930 lcod 16737'11945932 active] _scan_snaps no head for 7:035b1439:::rbd_data.bd1c92ae8944a.000000000000204f:d2 (have MIN) Sep 13 05:45:11 node1.ceph ceph-osd[11188]: 2017-09-13 05:45:11.196172 7f520b7e0700 -1 osd.1 pg_epoch: 16737 pg[7.2c0( v 16737'11945934 (16709'11942923,16737'11945934] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16670/0 16661/16661/16207) [12,1,39] r=1 lpr=16661 luod=0'0 crt=16737'11945932 lcod 16737'11945933 active] _scan_snaps no head for 7:035e5a24:::rbd_data.a6351b238e1f29.000000000002b028:9e (have MIN) Sep 13 05:45:20 node1.ceph ceph-osd[11188]: 2017-09-13 05:45:20.707365 7f520b7e0700 -1 osd.1 pg_epoch: 16737 pg[7.2c0( v 16737'11945938 (16709'11942923,16737'11945938] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16670/0 16661/16661/16207) [12,1,39] r=1 lpr=16661 luod=0'0 crt=16737'11945936 lcod 16737'11945937 active] _scan_snaps no head for 7:037a3d34:::rbd_data.bd1c92ae8944a.0000000000002d26:d4 (have MIN) Sep 13 05:45:20 node1.ceph ceph-osd[11188]: 2017-09-13 05:45:20.707399 7f520b7e0700 -1 osd.1 pg_epoch: 16737 pg[7.2c0( v 16737'11945938 (16709'11942923,16737'11945938] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16670/0 16661/16661/16207) [12,1,39] r=1 lpr=16661 luod=0'0 crt=16737'11945936 lcod 16737'11945937 active] _scan_snaps no head for 7:037a3d34:::rbd_data.bd1c92ae8944a.0000000000002d26:d2 (have MIN) Sep 13 05:45:22 node1.ceph ceph-osd[11188]: 2017-09-13 05:45:22.786147 7f520b7e0700 -1 osd.1 pg_epoch: 16737 pg[7.2c0( v 16737'11945938 (16709'11942923,16737'11945938] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16670/0 16661/16661/16207) [12,1,39] r=1 lpr=16661 luod=0'0 crt=16737'11945936 lcod 16737'11945937 active] _scan_snaps no head for 7:037fe752:::rbd_data.a6351b238e1f29.000000000001c736:9e (have MIN) Sep 13 05:50:22 node1.ceph ceph-osd[11188]: 2017-09-13 05:50:22.406134 7f520d7e4700 -1 osd.1 pg_epoch: 16741 pg[7.21c( v 16741'4707739 (16703'4704705,16741'4707739] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16232) [31,1,9] r=1 lpr=16661 luod=0'0 crt=16741'4707737 lcod 16741'4707738 active] _scan_snaps no head for 7:38409b60:::rbd_data.a6351b238e1f29.000000000001baed:9e (have MIN) Sep 13 05:51:14 node1.ceph ceph-osd[11188]: 2017-09-13 05:51:14.845021 7f520d7e4700 -1 osd.1 pg_epoch: 16741 pg[7.21c( v 16741'4707782 (16703'4704705,16741'4707782] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16232) [31,1,9] r=1 lpr=16661 luod=0'0 crt=16741'4707780 lcod 16741'4707781 active] _scan_snaps no head for 7:384aed19:::rbd_data.b0d052238e1f29.0000000000000688:b5 (have MIN) Sep 13 05:51:14 node1.ceph ceph-osd[11188]: 2017-09-13 05:51:14.845056 7f520d7e4700 -1 osd.1 pg_epoch: 16741 pg[7.21c( v 16741'4707782 (16703'4704705,16741'4707782] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16232) [31,1,9] r=1 lpr=16661 luod=0'0 crt=16741'4707780 lcod 16741'4707781 active] _scan_snaps no head for 7:384aed19:::rbd_data.b0d052238e1f29.0000000000000688:b4 (have MIN) Sep 13 05:51:14 node1.ceph ceph-osd[11188]: 2017-09-13 05:51:14.845068 7f520d7e4700 -1 osd.1 pg_epoch: 16741 pg[7.21c( v 16741'4707782 (16703'4704705,16741'4707782] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16232) [31,1,9] r=1 lpr=16661 luod=0'0 crt=16741'4707780 lcod 16741'4707781 active] _scan_snaps no head for 7:384aed19:::rbd_data.b0d052238e1f29.0000000000000688:b3 (have MIN) Sep 13 05:51:14 node1.ceph ceph-osd[11188]: 2017-09-13 05:51:14.845078 7f520d7e4700 -1 osd.1 pg_epoch: 16741 pg[7.21c( v 16741'4707782 (16703'4704705,16741'4707782] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16232) [31,1,9] r=1 lpr=16661 luod=0'0 crt=16741'4707780 lcod 16741'4707781 active] _scan_snaps no head for 7:384aed19:::rbd_data.b0d052238e1f29.0000000000000688:b2 (have MIN) Sep 13 05:51:14 node1.ceph ceph-osd[11188]: 2017-09-13 05:51:14.845088 7f520d7e4700 -1 osd.1 pg_epoch: 16741 pg[7.21c( v 16741'4707782 (16703'4704705,16741'4707782] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16232) [31,1,9] r=1 lpr=16661 luod=0'0 crt=16741'4707780 lcod 16741'4707781 active] _scan_snaps no head for 7:384aed19:::rbd_data.b0d052238e1f29.0000000000000688:b1 (have MIN) Sep 13 05:51:14 node1.ceph ceph-osd[11188]: 2017-09-13 05:51:14.845097 7f520d7e4700 -1 osd.1 pg_epoch: 16741 pg[7.21c( v 16741'4707782 (16703'4704705,16741'4707782] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16232) [31,1,9] r=1 lpr=16661 luod=0'0 crt=16741'4707780 lcod 16741'4707781 active] _scan_snaps no head for 7:384aed19:::rbd_data.b0d052238e1f29.0000000000000688:b0 (have MIN) Sep 13 05:51:14 node1.ceph ceph-osd[11188]: 2017-09-13 05:51:14.845106 7f520d7e4700 -1 osd.1 pg_epoch: 16741 pg[7.21c( v 16741'4707782 (16703'4704705,16741'4707782] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16232) [31,1,9] r=1 lpr=16661 luod=0'0 crt=16741'4707780 lcod 16741'4707781 active] _scan_snaps no head for 7:384aed19:::rbd_data.b0d052238e1f29.0000000000000688:ae (have MIN) Sep 13 05:53:26 node1.ceph ceph-osd[11188]: 2017-09-13 05:53:26.552627 7f520d7e4700 -1 osd.1 pg_epoch: 16743 pg[7.21c( v 16743'4707880 (16703'4704805,16743'4707880] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16232) [31,1,9] r=1 lpr=16661 luod=0'0 crt=16743'4707875 lcod 16743'4707879 active] _scan_snaps no head for 7:386ad14e:::rbd_data.b0d052238e1f29.0000000000000023:b2 (have MIN) Sep 13 05:53:26 node1.ceph ceph-osd[11188]: 2017-09-13 05:53:26.552666 7f520d7e4700 -1 osd.1 pg_epoch: 16743 pg[7.21c( v 16743'4707880 (16703'4704805,16743'4707880] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16232) [31,1,9] r=1 lpr=16661 luod=0'0 crt=16743'4707875 lcod 16743'4707879 active] _scan_snaps no head for 7:386ad14e:::rbd_data.b0d052238e1f29.0000000000000023:b1 (have MIN) Sep 13 05:53:26 node1.ceph ceph-osd[11188]: 2017-09-13 05:53:26.552679 7f520d7e4700 -1 osd.1 pg_epoch: 16743 pg[7.21c( v 16743'4707880 (16703'4704805,16743'4707880] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16232) [31,1,9] r=1 lpr=16661 luod=0'0 crt=16743'4707875 lcod 16743'4707879 active] _scan_snaps no head for 7:386ad14e:::rbd_data.b0d052238e1f29.0000000000000023:b0 (have MIN) Sep 13 05:53:26 node1.ceph ceph-osd[11188]: 2017-09-13 05:53:26.552690 7f520d7e4700 -1 osd.1 pg_epoch: 16743 pg[7.21c( v 16743'4707880 (16703'4704805,16743'4707880] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16232) [31,1,9] r=1 lpr=16661 luod=0'0 crt=16743'4707875 lcod 16743'4707879 active] _scan_snaps no head for 7:386ad14e:::rbd_data.b0d052238e1f29.0000000000000023:ae (have MIN) Sep 13 05:53:32 node1.ceph ceph-osd[11188]: 2017-09-13 05:53:32.021579 7f520d7e4700 -1 osd.1 pg_epoch: 16743 pg[7.21c( v 16743'4707886 (16703'4704805,16743'4707886] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16232) [31,1,9] r=1 lpr=16661 luod=0'0 crt=16743'4707882 lcod 16743'4707885 active] _scan_snaps no head for 7:386c4900:::rbd_data.a6351b238e1f29.00000000000199bb:d1 (have MIN) Sep 13 05:53:32 node1.ceph ceph-osd[11188]: 2017-09-13 05:53:32.021621 7f520d7e4700 -1 osd.1 pg_epoch: 16743 pg[7.21c( v 16743'4707886 (16703'4704805,16743'4707886] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16232) [31,1,9] r=1 lpr=16661 luod=0'0 crt=16743'4707882 lcod 16743'4707885 active] _scan_snaps no head for 7:386c4900:::rbd_data.a6351b238e1f29.00000000000199bb:9e (have MIN) Sep 13 05:53:40 node1.ceph ceph-osd[11188]: 2017-09-13 05:53:40.610543 7f520d7e4700 -1 osd.1 pg_epoch: 16743 pg[7.21c( v 16743'4707892 (16703'4704805,16743'4707892] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16232) [31,1,9] r=1 lpr=16661 luod=0'0 crt=16743'4707890 lcod 16743'4707891 active] _scan_snaps no head for 7:386e279b:::rbd_data.a6351b238e1f29.0000000000028396:9e (have MIN) Sep 13 05:53:43 node1.ceph ceph-osd[11188]: 2017-09-13 05:53:43.011067 7f520d7e4700 -1 osd.1 pg_epoch: 16743 pg[7.21c( v 16743'4707892 (16703'4704805,16743'4707892] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16232) [31,1,9] r=1 lpr=16661 luod=0'0 crt=16743'4707890 lcod 16743'4707891 active] _scan_snaps no head for 7:386ed603:::rbd_data.bd1c92ae8944a.00000000000035f8:d4 (have MIN) Sep 13 05:53:43 node1.ceph ceph-osd[11188]: 2017-09-13 05:53:43.011117 7f520d7e4700 -1 osd.1 pg_epoch: 16743 pg[7.21c( v 16743'4707892 (16703'4704805,16743'4707892] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16232) [31,1,9] r=1 lpr=16661 luod=0'0 crt=16743'4707890 lcod 16743'4707891 active] _scan_snaps no head for 7:386ed603:::rbd_data.bd1c92ae8944a.00000000000035f8:d2 (have MIN) Sep 13 05:54:44 node1.ceph ceph-osd[11188]: 2017-09-13 05:54:44.193400 7f520d7e4700 -1 osd.1 pg_epoch: 16743 pg[7.21c( v 16743'4707940 (16705'4704906,16743'4707940] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16232) [31,1,9] r=1 lpr=16661 luod=0'0 crt=16743'4707937 lcod 16743'4707939 active] _scan_snaps no head for 7:387c0c38:::rbd_data.a70641238e1f29.000000000000035b:9d (have MIN) Sep 13 05:54:53 node1.ceph ceph-osd[11188]: 2017-09-13 05:54:53.343508 7f520d7e4700 -1 osd.1 pg_epoch: 16743 pg[7.21c( v 16743'4707949 (16705'4704906,16743'4707949] local-lis/les=16661/16662 n=2970 ec=2543/2543 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16232) [31,1,9] r=1 lpr=16661 luod=0'0 crt=16743'4707947 lcod 16743'4707948 active] _scan_snaps no head for 7:387da4a0:::rbd_data.a6351b238e1f29.0000000000025622:9e (have MIN) Sep 13 05:56:18 node1.ceph ceph-osd[11188]: 2017-09-13 05:56:18.901180 7f520d7e4700 -1 osd.1 pg_epoch: 16743 pg[7.334( v 16743'60528832 (16735'60525769,16743'60528832] local-lis/les=16661/16663 n=3008 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,30,38] r=0 lpr=16661 crt=16743'60528832 lcod 16743'60528831 mlcod 16743'60528831 active+clean+scrubbing] _scan_snaps no head for 7:2cc38089:::rbd_data.c1ebe8238e1f29.0000000000002b05:df (have MIN) Sep 13 05:56:22 node1.ceph ceph-osd[11188]: 2017-09-13 05:56:22.097590 7f520d7e4700 -1 osd.1 pg_epoch: 16743 pg[7.334( v 16743'60528832 (16735'60525769,16743'60528832] local-lis/les=16661/16663 n=3008 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,30,38] r=0 lpr=16661 crt=16743'60528832 lcod 16743'60528831 mlcod 16743'60528831 active+clean+scrubbing] _scan_snaps no head for 7:2cce3787:::rbd_data.a74f60238e1f29.0000000000000215:cf (have MIN) Sep 13 05:56:22 node1.ceph ceph-osd[11188]: 2017-09-13 05:56:22.097623 7f520d7e4700 -1 osd.1 pg_epoch: 16743 pg[7.334( v 16743'60528832 (16735'60525769,16743'60528832] local-lis/les=16661/16663 n=3008 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,30,38] r=0 lpr=16661 crt=16743'60528832 lcod 16743'60528831 mlcod 16743'60528831 active+clean+scrubbing] _scan_snaps no head for 7:2cce3787:::rbd_data.a74f60238e1f29.0000000000000215:9c (have MIN) Sep 13 05:56:23 node1.ceph ceph-osd[11188]: 2017-09-13 05:56:23.355312 7f520d7e4700 -1 osd.1 pg_epoch: 16743 pg[7.334( v 16743'60528832 (16735'60525769,16743'60528832] local-lis/les=16661/16663 n=3008 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,30,38] r=0 lpr=16661 crt=16743'60528832 lcod 16743'60528831 mlcod 16743'60528831 active+clean+scrubbing] _scan_snaps no head for 7:2cd095ba:::rbd_data.a6351b238e1f29.0000000000027d91:9e (have MIN) Sep 13 05:56:23 node1.ceph ceph-osd[11188]: 2017-09-13 05:56:23.525915 7f520d7e4700 -1 osd.1 pg_epoch: 16743 pg[7.334( v 16743'60528832 (16735'60525769,16743'60528832] local-lis/les=16661/16663 n=3008 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,30,38] r=0 lpr=16661 crt=16743'60528832 lcod 16743'60528831 mlcod 16743'60528831 active+clean+scrubbing] _scan_snaps no head for 7:2cd10766:::rbd_data.bd1c92ae8944a.0000000000000535:d4 (have MIN) Sep 13 05:56:23 node1.ceph ceph-osd[11188]: 2017-09-13 05:56:23.525952 7f520d7e4700 -1 osd.1 pg_epoch: 16743 pg[7.334( v 16743'60528832 (16735'60525769,16743'60528832] local-lis/les=16661/16663 n=3008 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,30,38] r=0 lpr=16661 crt=16743'60528832 lcod 16743'60528831 mlcod 16743'60528831 active+clean+scrubbing] _scan_snaps no head for 7:2cd10766:::rbd_data.bd1c92ae8944a.0000000000000535:d2 (have MIN) Sep 13 05:56:32 node1.ceph ceph-osd[11188]: 2017-09-13 05:56:32.784606 7f520d7e4700 -1 osd.1 pg_epoch: 16743 pg[7.334( v 16743'60528833 (16735'60525769,16743'60528833] local-lis/les=16661/16663 n=3008 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,30,38] r=0 lpr=16661 crt=16743'60528833 lcod 16743'60528832 mlcod 16743'60528832 active+clean+scrubbing] _scan_snaps no head for 7:2cefd9ca:::rbd_data.bd1c92ae8944a.00000000000077f6:d2 (have MIN) Sep 13 05:56:40 node1.ceph ceph-osd[11188]: 2017-09-13 05:56:40.721013 7f520d7e4700 -1 osd.1 pg_epoch: 16743 pg[7.334( v 16743'60528833 (16735'60525769,16743'60528833] local-lis/les=16661/16663 n=3008 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,30,38] r=0 lpr=16661 crt=16743'60528833 lcod 16743'60528832 mlcod 16743'60528832 active+clean+scrubbing] _scan_snaps no head for 7:2cfad1c5:::rbd_data.bd1c92ae8944a.00000000000002e6:d4 (have MIN) Sep 13 05:56:40 node1.ceph ceph-osd[11188]: 2017-09-13 05:56:40.721055 7f520d7e4700 -1 osd.1 pg_epoch: 16743 pg[7.334( v 16743'60528833 (16735'60525769,16743'60528833] local-lis/les=16661/16663 n=3008 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,30,38] r=0 lpr=16661 crt=16743'60528833 lcod 16743'60528832 mlcod 16743'60528832 active+clean+scrubbing] _scan_snaps no head for 7:2cfad1c5:::rbd_data.bd1c92ae8944a.00000000000002e6:d2 (have MIN) Sep 13 05:56:42 node1.ceph ceph-osd[11188]: 2017-09-13 05:56:42.060179 7f520bfe1700 -1 osd.1 pg_epoch: 16743 pg[7.3b9( v 16743'8647030 (16667'8643942,16743'8647030] local-lis/les=16661/16663 n=3124 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,8,14] r=0 lpr=16661 crt=16743'8647030 lcod 16743'8647029 mlcod 16743'8647029 active+clean+scrubbing] _scan_snaps no head for 7:9dc0996f:::rbd_data.4044a9238e1f29.0000000000004a88:19 (have MIN) Sep 13 05:56:44 node1.ceph ceph-osd[11188]: 2017-09-13 05:56:44.407967 7f520bfe1700 -1 osd.1 pg_epoch: 16743 pg[7.3b9( v 16743'8647041 (16667'8643942,16743'8647041] local-lis/les=16661/16663 n=3124 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,8,14] r=0 lpr=16661 crt=16743'8647041 lcod 16743'8647040 mlcod 16743'8647040 active+clean+scrubbing] _scan_snaps no head for 7:9dc5ccee:::rbd_data.bd1c92ae8944a.0000000000004599:d4 (have MIN) Sep 13 05:56:44 node1.ceph ceph-osd[11188]: 2017-09-13 05:56:44.407999 7f520bfe1700 -1 osd.1 pg_epoch: 16743 pg[7.3b9( v 16743'8647041 (16667'8643942,16743'8647041] local-lis/les=16661/16663 n=3124 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,8,14] r=0 lpr=16661 crt=16743'8647041 lcod 16743'8647040 mlcod 16743'8647040 active+clean+scrubbing] _scan_snaps no head for 7:9dc5ccee:::rbd_data.bd1c92ae8944a.0000000000004599:d2 (have MIN) Sep 13 05:56:44 node1.ceph ceph-osd[11188]: 2017-09-13 05:56:44.793849 7f520bfe1700 -1 osd.1 pg_epoch: 16743 pg[7.3b9( v 16743'8647043 (16667'8644042,16743'8647043] local-lis/les=16661/16663 n=3124 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,8,14] r=0 lpr=16661 luod=16743'8647042 crt=16743'8647043 lcod 16743'8647041 mlcod 16743'8647041 active+clean+scrubbing] _scan_snaps no head for 7:9dc68edc:::rbd_data.bd1c92ae8944a.0000000000001b72:d4 (have MIN) Sep 13 05:56:44 node1.ceph ceph-osd[11188]: 2017-09-13 05:56:44.793873 7f520bfe1700 -1 osd.1 pg_epoch: 16743 pg[7.3b9( v 16743'8647043 (16667'8644042,16743'8647043] local-lis/les=16661/16663 n=3124 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,8,14] r=0 lpr=16661 luod=16743'8647042 crt=16743'8647043 lcod 16743'8647041 mlcod 16743'8647041 active+clean+scrubbing] _scan_snaps no head for 7:9dc68edc:::rbd_data.bd1c92ae8944a.0000000000001b72:d2 (have MIN) Sep 13 05:56:53 node1.ceph ceph-osd[11188]: 2017-09-13 05:56:53.443557 7f520bfe1700 -1 osd.1 pg_epoch: 16743 pg[7.3b9( v 16743'8647067 (16667'8644042,16743'8647067] local-lis/les=16661/16663 n=3124 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,8,14] r=0 lpr=16661 crt=16743'8647067 lcod 16743'8647066 mlcod 16743'8647066 active+clean+scrubbing] _scan_snaps no head for 7:9dd2f1b5:::rbd_data.a4f318238e1f29.00000000000002fa:8d (have MIN) Sep 13 05:56:53 node1.ceph ceph-osd[11188]: 2017-09-13 05:56:53.703321 7f520bfe1700 -1 osd.1 pg_epoch: 16743 pg[7.3b9( v 16743'8647068 (16667'8644042,16743'8647068] local-lis/les=16661/16663 n=3124 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,8,14] r=0 lpr=16661 crt=16743'8647068 lcod 16743'8647067 mlcod 16743'8647067 active+clean+scrubbing] _scan_snaps no head for 7:9dd3d73b:::rbd_data.a6351b238e1f29.0000000000024573:9e (have MIN) Sep 13 05:56:55 node1.ceph ceph-osd[11188]: 2017-09-13 05:56:55.022089 7f520bfe1700 -1 osd.1 pg_epoch: 16743 pg[7.3b9( v 16743'8647068 (16667'8644042,16743'8647068] local-lis/les=16661/16663 n=3124 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,8,14] r=0 lpr=16661 crt=16743'8647068 lcod 16743'8647067 mlcod 16743'8647067 active+clean+scrubbing] _scan_snaps no head for 7:9dd62ede:::rbd_data.8f8aad238e1f29.0000000000000391:54 (have MIN) Sep 13 05:57:04 node1.ceph ceph-osd[11188]: 2017-09-13 05:57:04.338833 7f520bfe1700 -1 osd.1 pg_epoch: 16743 pg[7.3b9( v 16743'8647070 (16667'8644042,16743'8647070] local-lis/les=16661/16663 n=3124 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,8,14] r=0 lpr=16661 crt=16743'8647070 lcod 16743'8647069 mlcod 16743'8647069 active+clean+scrubbing] _scan_snaps no head for 7:9de62fd3:::rbd_data.32bc79238e1f29.00000000000002ec:d (have MIN) Sep 13 05:57:17 node1.ceph ceph-osd[11188]: 2017-09-13 05:57:17.915136 7f520bfe1700 -1 osd.1 pg_epoch: 16743 pg[7.3b9( v 16743'8647071 (16667'8644042,16743'8647071] local-lis/les=16661/16663 n=3124 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,8,14] r=0 lpr=16661 crt=16743'8647071 lcod 16743'8647070 mlcod 16743'8647070 active+clean+scrubbing] _scan_snaps no head for 7:9dfdfea1:::rbd_data.a6351b238e1f29.000000000001cb2c:9e (have MIN) Sep 13 06:05:42 node1.ceph ceph-osd[11188]: 2017-09-13 06:05:42.248271 7f520c7e2700 -1 osd.1 pg_epoch: 16745 pg[7.3c2( v 16745'7327532 (16711'7324522,16745'7327532] local-lis/les=16661/16663 n=3100 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,17,11] r=0 lpr=16661 crt=16745'7327532 lcod 16745'7327531 mlcod 16745'7327531 active+clean+scrubbing+deep] _scan_snaps no head for 7:43c05684:::rbd_data.b0d052238e1f29.00000000000001fb:b4 (have MIN) Sep 13 06:05:42 node1.ceph ceph-osd[11188]: 2017-09-13 06:05:42.248326 7f520c7e2700 -1 osd.1 pg_epoch: 16745 pg[7.3c2( v 16745'7327532 (16711'7324522,16745'7327532] local-lis/les=16661/16663 n=3100 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,17,11] r=0 lpr=16661 crt=16745'7327532 lcod 16745'7327531 mlcod 16745'7327531 active+clean+scrubbing+deep] _scan_snaps no head for 7:43c05684:::rbd_data.b0d052238e1f29.00000000000001fb:b3 (have MIN) Sep 13 06:05:42 node1.ceph ceph-osd[11188]: 2017-09-13 06:05:42.248355 7f520c7e2700 -1 osd.1 pg_epoch: 16745 pg[7.3c2( v 16745'7327532 (16711'7324522,16745'7327532] local-lis/les=16661/16663 n=3100 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,17,11] r=0 lpr=16661 crt=16745'7327532 lcod 16745'7327531 mlcod 16745'7327531 active+clean+scrubbing+deep] _scan_snaps no head for 7:43c05684:::rbd_data.b0d052238e1f29.00000000000001fb:b2 (have MIN) Sep 13 06:05:42 node1.ceph ceph-osd[11188]: 2017-09-13 06:05:42.248379 7f520c7e2700 -1 osd.1 pg_epoch: 16745 pg[7.3c2( v 16745'7327532 (16711'7324522,16745'7327532] local-lis/les=16661/16663 n=3100 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,17,11] r=0 lpr=16661 crt=16745'7327532 lcod 16745'7327531 mlcod 16745'7327531 active+clean+scrubbing+deep] _scan_snaps no head for 7:43c05684:::rbd_data.b0d052238e1f29.00000000000001fb:b1 (have MIN) Sep 13 06:05:42 node1.ceph ceph-osd[11188]: 2017-09-13 06:05:42.248401 7f520c7e2700 -1 osd.1 pg_epoch: 16745 pg[7.3c2( v 16745'7327532 (16711'7324522,16745'7327532] local-lis/les=16661/16663 n=3100 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,17,11] r=0 lpr=16661 crt=16745'7327532 lcod 16745'7327531 mlcod 16745'7327531 active+clean+scrubbing+deep] _scan_snaps no head for 7:43c05684:::rbd_data.b0d052238e1f29.00000000000001fb:b0 (have MIN) Sep 13 06:05:42 node1.ceph ceph-osd[11188]: 2017-09-13 06:05:42.248435 7f520c7e2700 -1 osd.1 pg_epoch: 16745 pg[7.3c2( v 16745'7327532 (16711'7324522,16745'7327532] local-lis/les=16661/16663 n=3100 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,17,11] r=0 lpr=16661 crt=16745'7327532 lcod 16745'7327531 mlcod 16745'7327531 active+clean+scrubbing+deep] _scan_snaps no head for 7:43c05684:::rbd_data.b0d052238e1f29.00000000000001fb:ae (have MIN) Sep 13 06:07:05 node1.ceph ceph-osd[11188]: 2017-09-13 06:07:05.375147 7f520c7e2700 -1 osd.1 pg_epoch: 16745 pg[7.3c2( v 16745'7327612 (16711'7324522,16745'7327612] local-lis/les=16661/16663 n=3100 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,17,11] r=0 lpr=16661 crt=16745'7327612 lcod 16745'7327611 mlcod 16745'7327611 active+clean+scrubbing+deep] _scan_snaps no head for 7:43cfc87a:::rbd_data.bd1c92ae8944a.00000000000039e4:d4 (have MIN) Sep 13 06:07:05 node1.ceph ceph-osd[11188]: 2017-09-13 06:07:05.375185 7f520c7e2700 -1 osd.1 pg_epoch: 16745 pg[7.3c2( v 16745'7327612 (16711'7324522,16745'7327612] local-lis/les=16661/16663 n=3100 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,17,11] r=0 lpr=16661 crt=16745'7327612 lcod 16745'7327611 mlcod 16745'7327611 active+clean+scrubbing+deep] _scan_snaps no head for 7:43cfc87a:::rbd_data.bd1c92ae8944a.00000000000039e4:d2 (have MIN) Sep 13 06:07:30 node1.ceph ceph-osd[11188]: 2017-09-13 06:07:30.597358 7f520c7e2700 -1 osd.1 pg_epoch: 16745 pg[7.3c2( v 16745'7327638 (16711'7324623,16745'7327638] local-lis/les=16661/16663 n=3100 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,17,11] r=0 lpr=16661 crt=16745'7327638 lcod 16745'7327637 mlcod 16745'7327637 active+clean+scrubbing+deep] _scan_snaps no head for 7:43d5121d:::rbd_data.bd1c92ae8944a.0000000000000730:d4 (have MIN) Sep 13 06:07:30 node1.ceph ceph-osd[11188]: 2017-09-13 06:07:30.597397 7f520c7e2700 -1 osd.1 pg_epoch: 16745 pg[7.3c2( v 16745'7327638 (16711'7324623,16745'7327638] local-lis/les=16661/16663 n=3100 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,17,11] r=0 lpr=16661 crt=16745'7327638 lcod 16745'7327637 mlcod 16745'7327637 active+clean+scrubbing+deep] _scan_snaps no head for 7:43d5121d:::rbd_data.bd1c92ae8944a.0000000000000730:d2 (have MIN) Sep 13 06:07:45 node1.ceph ceph-osd[11188]: 2017-09-13 06:07:45.157996 7f520c7e2700 -1 osd.1 pg_epoch: 16745 pg[7.3c2( v 16745'7327653 (16711'7324623,16745'7327653] local-lis/les=16661/16663 n=3100 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,17,11] r=0 lpr=16661 crt=16745'7327653 lcod 16745'7327652 mlcod 16745'7327652 active+clean+scrubbing+deep] _scan_snaps no head for 7:43d857ef:::rbd_data.b07e94238e1f29.00000000000004e9:80 (have MIN) Sep 13 06:10:36 node1.ceph ceph-osd[11188]: 2017-09-13 06:10:36.873515 7f520c7e2700 -1 osd.1 pg_epoch: 16747 pg[7.3c2( v 16747'7327909 (16713'7324823,16747'7327909] local-lis/les=16661/16663 n=3100 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,17,11] r=0 lpr=16661 crt=16747'7327909 lcod 16747'7327908 mlcod 16747'7327908 active+clean+scrubbing+deep] _scan_snaps no head for 7:43fddb01:::rbd_data.a6351b238e1f29.0000000000020870:9e (have MIN) Sep 13 06:10:57 node1.ceph ceph-osd[11188]: 2017-09-13 06:10:57.874968 7f520d7e4700 -1 osd.1 pg_epoch: 16747 pg[8.14a( v 16747'7962589 (16677'7959511,16747'7962589] local-lis/les=16661/16662 n=3461 ec=107/107 lis/c 16661/16661 les/c/f 16662/16663/0 16661/16661/16204) [14,31,1] r=2 lpr=16661 luod=0'0 crt=16747'7962587 lcod 16747'7962588 active] _scan_snaps no head for 8:5294e9e2:::rbd_data.d393db238e1f29.0000000000000b04:67 (have MIN) Sep 13 06:17:00 node1.ceph ceph-osd[11188]: 2017-09-13 06:17:00.773920 7f520cfe3700 -1 osd.1 pg_epoch: 16747 pg[7.2e( v 16747'20494470 (16739'20491416,16747'20494470] local-lis/les=16661/16663 n=3065 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16201) [13,11,1] r=2 lpr=16661 luod=0'0 crt=16747'20494468 lcod 16747'20494469 active] _scan_snaps no head for 7:74019300:::rbd_data.bd1c92ae8944a.0000000000000df8:d4 (have MIN) Sep 13 06:17:00 node1.ceph ceph-osd[11188]: 2017-09-13 06:17:00.773950 7f520cfe3700 -1 osd.1 pg_epoch: 16747 pg[7.2e( v 16747'20494470 (16739'20491416,16747'20494470] local-lis/les=16661/16663 n=3065 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16201) [13,11,1] r=2 lpr=16661 luod=0'0 crt=16747'20494468 lcod 16747'20494469 active] _scan_snaps no head for 7:74019300:::rbd_data.bd1c92ae8944a.0000000000000df8:d2 (have MIN) Sep 13 06:17:33 node1.ceph ceph-osd[11188]: 2017-09-13 06:17:33.846409 7f520cfe3700 -1 osd.1 pg_epoch: 16747 pg[7.2e( v 16747'20494534 (16741'20491521,16747'20494534] local-lis/les=16661/16663 n=3065 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16201) [13,11,1] r=2 lpr=16661 luod=0'0 crt=16747'20494528 lcod 16747'20494533 active] _scan_snaps no head for 7:74090f8a:::rbd_data.a6351b238e1f29.0000000000028316:9e (have MIN) Sep 13 06:17:58 node1.ceph ceph-osd[11188]: 2017-09-13 06:17:58.555648 7f520cfe3700 -1 osd.1 pg_epoch: 16747 pg[7.2e( v 16747'20494593 (16741'20491521,16747'20494593] local-lis/les=16661/16663 n=3065 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16201) [13,11,1] r=2 lpr=16661 luod=0'0 crt=16747'20494583 lcod 16747'20494592 active] _scan_snaps no head for 7:740f0382:::rbd_data.bd1c92ae8944a.0000000000001e44:d2 (have MIN) Sep 13 06:19:34 node1.ceph ceph-osd[11188]: 2017-09-13 06:19:34.711402 7f520cfe3700 -1 osd.1 pg_epoch: 16747 pg[7.2e( v 16747'20494753 (16741'20491730,16747'20494753] local-lis/les=16661/16663 n=3065 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16201) [13,11,1] r=2 lpr=16661 luod=0'0 crt=16747'20494747 lcod 16747'20494752 active] _scan_snaps no head for 7:742113ca:::rbd_data.a6351b238e1f29.0000000000020ab1:9e (have MIN) Sep 13 06:19:46 node1.ceph ceph-osd[11188]: 2017-09-13 06:19:46.053171 7f520cfe3700 -1 osd.1 pg_epoch: 16747 pg[7.2e( v 16747'20494774 (16741'20491730,16747'20494774] local-lis/les=16661/16663 n=3065 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16201) [13,11,1] r=2 lpr=16661 luod=0'0 crt=16747'20494762 lcod 16747'20494773 active] _scan_snaps no head for 7:742306e4:::rbd_data.bd1c92ae8944a.0000000000007406:d2 (have MIN) Sep 13 06:21:19 node1.ceph ceph-osd[11188]: 2017-09-13 06:21:19.123518 7f520cfe3700 -1 osd.1 pg_epoch: 16747 pg[7.2e( v 16747'20495033 (16741'20491932,16747'20495033] local-lis/les=16661/16663 n=3065 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16201) [13,11,1] r=2 lpr=16661 luod=0'0 crt=16747'20495028 lcod 16747'20495032 active] _scan_snaps no head for 7:74374d12:::rbd_data.bd1c92ae8944a.0000000000000e0b:d4 (have MIN) Sep 13 06:21:19 node1.ceph ceph-osd[11188]: 2017-09-13 06:21:19.123548 7f520cfe3700 -1 osd.1 pg_epoch: 16747 pg[7.2e( v 16747'20495033 (16741'20491932,16747'20495033] local-lis/les=16661/16663 n=3065 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16201) [13,11,1] r=2 lpr=16661 luod=0'0 crt=16747'20495028 lcod 16747'20495032 active] _scan_snaps no head for 7:74374d12:::rbd_data.bd1c92ae8944a.0000000000000e0b:d2 (have MIN) Sep 13 06:21:50 node1.ceph ceph-osd[11188]: 2017-09-13 06:21:50.348263 7f520cfe3700 -1 osd.1 pg_epoch: 16747 pg[7.2e( v 16747'20495247 (16743'20492233,16747'20495247] local-lis/les=16661/16663 n=3065 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16201) [13,11,1] r=2 lpr=16661 luod=0'0 crt=16747'20495242 lcod 16747'20495246 active] _scan_snaps no head for 7:743ebd5e:::rbd_data.b737b238e1f29.0000000000000342:8 (have MIN) Sep 13 06:22:31 node1.ceph ceph-osd[11188]: 2017-09-13 06:22:31.503910 7f520c7e2700 -1 osd.1 pg_epoch: 16749 pg[8.1d3( v 16747'2239863 (16536'2236783,16747'2239863] local-lis/les=16661/16663 n=3291 ec=107/107 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,9,28] r=0 lpr=16661 crt=16747'2239863 lcod 16747'2239862 mlcod 16747'2239862 active+clean+scrubbing] _scan_snaps no head for 8:cbacf8b5:::rbd_data.9aca26238e1f29.00000000000061c9:65 (have MIN) Sep 13 06:28:04 node1.ceph ceph-osd[11188]: 2017-09-13 06:28:04.417700 7f520c7e2700 -1 osd.1 pg_epoch: 16749 pg[7.1c4( v 16749'6591104 (16695'6588019,16749'6591104] local-lis/les=16661/16663 n=3056 ec=104/104 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,26,10] r=0 lpr=16661 crt=16749'6591104 lcod 16749'6591103 mlcod 16749'6591103 active+clean+scrubbing] _scan_snaps no head for 7:238f6c3c:::rbd_data.bd1c92ae8944a.0000000000002c83:d4 (have MIN) Sep 13 06:28:04 node1.ceph ceph-osd[11188]: 2017-09-13 06:28:04.417734 7f520c7e2700 -1 osd.1 pg_epoch: 16749 pg[7.1c4( v 16749'6591104 (16695'6588019,16749'6591104] local-lis/les=16661/16663 n=3056 ec=104/104 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,26,10] r=0 lpr=16661 crt=16749'6591104 lcod 16749'6591103 mlcod 16749'6591103 active+clean+scrubbing] _scan_snaps no head for 7:238f6c3c:::rbd_data.bd1c92ae8944a.0000000000002c83:d2 (have MIN) Sep 13 06:28:05 node1.ceph ceph-osd[11188]: 2017-09-13 06:28:05.548659 7f520c7e2700 -1 osd.1 pg_epoch: 16749 pg[7.1c4( v 16749'6591104 (16695'6588019,16749'6591104] local-lis/les=16661/16663 n=3056 ec=104/104 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,26,10] r=0 lpr=16661 crt=16749'6591104 lcod 16749'6591103 mlcod 16749'6591103 active+clean+scrubbing] _scan_snaps no head for 7:23911b25:::rbd_data.bd1c92ae8944a.000000000000730e:d2 (have MIN) Sep 13 06:28:12 node1.ceph ceph-osd[11188]: 2017-09-13 06:28:12.356562 7f520c7e2700 -1 osd.1 pg_epoch: 16749 pg[7.1c4( v 16749'6591107 (16695'6588019,16749'6591107] local-lis/les=16661/16663 n=3056 ec=104/104 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,26,10] r=0 lpr=16661 crt=16749'6591107 lcod 16749'6591106 mlcod 16749'6591106 active+clean+scrubbing] _scan_snaps no head for 7:239b2675:::rbd_data.a6351b238e1f29.000000000002b4e9:9e (have MIN) Sep 13 06:28:12 node1.ceph ceph-osd[11188]: 2017-09-13 06:28:12.651332 7f520c7e2700 -1 osd.1 pg_epoch: 16749 pg[7.1c4( v 16749'6591107 (16695'6588019,16749'6591107] local-lis/les=16661/16663 n=3056 ec=104/104 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,26,10] r=0 lpr=16661 crt=16749'6591107 lcod 16749'6591106 mlcod 16749'6591106 active+clean+scrubbing] _scan_snaps no head for 7:239b83b0:::rbd_data.bd1c92ae8944a.000000000000333e:d2 (have MIN) Sep 13 06:28:14 node1.ceph ceph-osd[11188]: 2017-09-13 06:28:14.955270 7f520c7e2700 -1 osd.1 pg_epoch: 16749 pg[7.1c4( v 16749'6591112 (16695'6588019,16749'6591112] local-lis/les=16661/16663 n=3056 ec=104/104 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,26,10] r=0 lpr=16661 crt=16749'6591112 lcod 16749'6591111 mlcod 16749'6591111 active+clean+scrubbing] _scan_snaps no head for 7:239e9983:::rbd_data.c1ebe8238e1f29.000000000000050b:df (have MIN) Sep 13 06:28:21 node1.ceph ceph-osd[11188]: 2017-09-13 06:28:21.068490 7f520c7e2700 -1 osd.1 pg_epoch: 16749 pg[7.1c4( v 16749'6591122 (16699'6588119,16749'6591122] local-lis/les=16661/16663 n=3056 ec=104/104 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,26,10] r=0 lpr=16661 crt=16749'6591122 lcod 16749'6591121 mlcod 16749'6591121 active+clean+scrubbing] _scan_snaps no head for 7:23a58875:::rbd_data.a70641238e1f29.0000000000007360:9d (have MIN) Sep 13 06:28:33 node1.ceph ceph-osd[11188]: 2017-09-13 06:28:33.134045 7f520c7e2700 -1 osd.1 pg_epoch: 16749 pg[7.1c4( v 16749'6591130 (16699'6588119,16749'6591130] local-lis/les=16661/16663 n=3056 ec=104/104 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,26,10] r=0 lpr=16661 crt=16749'6591130 lcod 16749'6591129 mlcod 16749'6591129 active+clean+scrubbing] _scan_snaps no head for 7:23b3d4aa:::rbd_data.a74f60238e1f29.0000000000001072:9c (have MIN) Sep 13 06:28:37 node1.ceph ceph-osd[11188]: 2017-09-13 06:28:37.518817 7f520c7e2700 -1 osd.1 pg_epoch: 16749 pg[7.1c4( v 16749'6591132 (16699'6588119,16749'6591132] local-lis/les=16661/16663 n=3056 ec=104/104 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,26,10] r=0 lpr=16661 crt=16749'6591132 lcod 16749'6591131 mlcod 16749'6591131 active+clean+scrubbing] _scan_snaps no head for 7:23b9f27c:::rbd_data.c1ebe8238e1f29.00000000000009d6:df (have MIN) Sep 13 06:30:28 node1.ceph ceph-osd[11188]: 2017-09-13 06:30:28.236112 7f520cfe3700 -1 osd.1 pg_epoch: 16749 pg[8.119( v 16749'2247572 (16650'2244523,16749'2247572] local-lis/les=16661/16663 n=3424 ec=107/107 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,8,26] r=0 lpr=16661 crt=16749'2247572 lcod 16749'2247571 mlcod 16749'2247571 active+clean+scrubbing+deep] _scan_snaps no head for 8:989176d6:::rbd_data.9aca26238e1f29.00000000000042fc:65 (have MIN) Sep 13 06:38:11 node1.ceph ceph-osd[11188]: 2017-09-13 06:38:11.347811 7f520cfe3700 -1 osd.1 pg_epoch: 16753 pg[7.1a5( v 16753'9308319 (16735'9305295,16753'9308319] local-lis/les=16661/16663 n=3017 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,14,30] r=0 lpr=16661 crt=16753'9308319 lcod 16753'9308318 mlcod 16753'9308318 active+clean+scrubbing] _scan_snaps no head for 7:a58888da:::rbd_data.bd1c92ae8944a.0000000000003ada:d4 (have MIN) Sep 13 06:38:11 node1.ceph ceph-osd[11188]: 2017-09-13 06:38:11.347854 7f520cfe3700 -1 osd.1 pg_epoch: 16753 pg[7.1a5( v 16753'9308319 (16735'9305295,16753'9308319] local-lis/les=16661/16663 n=3017 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,14,30] r=0 lpr=16661 crt=16753'9308319 lcod 16753'9308318 mlcod 16753'9308318 active+clean+scrubbing] _scan_snaps no head for 7:a58888da:::rbd_data.bd1c92ae8944a.0000000000003ada:d2 (have MIN) Sep 13 06:38:19 node1.ceph ceph-osd[11188]: 2017-09-13 06:38:19.053656 7f520cfe3700 -1 osd.1 pg_epoch: 16753 pg[7.1a5( v 16753'9308329 (16735'9305295,16753'9308329] local-lis/les=16661/16663 n=3017 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,14,30] r=0 lpr=16661 crt=16753'9308329 lcod 16753'9308328 mlcod 16753'9308328 active+clean+scrubbing] _scan_snaps no head for 7:a59b89d7:::rbd_data.bd1c92ae8944a.0000000000003d2b:d4 (have MIN) Sep 13 06:38:21 node1.ceph ceph-osd[11188]: 2017-09-13 06:38:21.446455 7f520cfe3700 -1 osd.1 pg_epoch: 16753 pg[7.1a5( v 16753'9308329 (16735'9305295,16753'9308329] local-lis/les=16661/16663 n=3017 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,14,30] r=0 lpr=16661 crt=16753'9308329 lcod 16753'9308328 mlcod 16753'9308328 active+clean+scrubbing] _scan_snaps no head for 7:a5a1928e:::rbd_data.32bc79238e1f29.0000000000001511:2d (have MIN) Sep 13 06:38:23 node1.ceph ceph-osd[11188]: 2017-09-13 06:38:23.875115 7f520cfe3700 -1 osd.1 pg_epoch: 16753 pg[7.1a5( v 16753'9308329 (16735'9305295,16753'9308329] local-lis/les=16661/16663 n=3017 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,14,30] r=0 lpr=16661 crt=16753'9308329 lcod 16753'9308328 mlcod 16753'9308328 active+clean+scrubbing] _scan_snaps no head for 7:a5a76eae:::rbd_data.bd1c92ae8944a.00000000000034a1:d4 (have MIN) Sep 13 06:38:23 node1.ceph ceph-osd[11188]: 2017-09-13 06:38:23.875148 7f520cfe3700 -1 osd.1 pg_epoch: 16753 pg[7.1a5( v 16753'9308329 (16735'9305295,16753'9308329] local-lis/les=16661/16663 n=3017 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,14,30] r=0 lpr=16661 crt=16753'9308329 lcod 16753'9308328 mlcod 16753'9308328 active+clean+scrubbing] _scan_snaps no head for 7:a5a76eae:::rbd_data.bd1c92ae8944a.00000000000034a1:d2 (have MIN) Sep 13 06:38:26 node1.ceph ceph-osd[11188]: 2017-09-13 06:38:26.807964 7f520cfe3700 -1 osd.1 pg_epoch: 16753 pg[7.1a5( v 16753'9308332 (16735'9305295,16753'9308332] local-lis/les=16661/16663 n=3017 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,14,30] r=0 lpr=16661 crt=16753'9308332 lcod 16753'9308331 mlcod 16753'9308331 active+clean+scrubbing] _scan_snaps no head for 7:a5ae89c1:::rbd_data.bd1c92ae8944a.0000000000000514:d4 (have MIN) Sep 13 06:38:26 node1.ceph ceph-osd[11188]: 2017-09-13 06:38:26.807999 7f520cfe3700 -1 osd.1 pg_epoch: 16753 pg[7.1a5( v 16753'9308332 (16735'9305295,16753'9308332] local-lis/les=16661/16663 n=3017 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,14,30] r=0 lpr=16661 crt=16753'9308332 lcod 16753'9308331 mlcod 16753'9308331 active+clean+scrubbing] _scan_snaps no head for 7:a5ae89c1:::rbd_data.bd1c92ae8944a.0000000000000514:d2 (have MIN) Sep 13 06:38:28 node1.ceph ceph-osd[11188]: 2017-09-13 06:38:28.753046 7f520cfe3700 -1 osd.1 pg_epoch: 16753 pg[7.1a5( v 16753'9308333 (16735'9305295,16753'9308333] local-lis/les=16661/16663 n=3017 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,14,30] r=0 lpr=16661 crt=16753'9308333 lcod 16753'9308332 mlcod 16753'9308332 active+clean+scrubbing] _scan_snaps no head for 7:a5b3541d:::rbd_data.a6351b238e1f29.0000000000019c01:9e (have MIN) Sep 13 06:38:36 node1.ceph ceph-osd[11188]: 2017-09-13 06:38:36.901190 7f520cfe3700 -1 osd.1 pg_epoch: 16753 pg[7.1a5( v 16753'9308336 (16735'9305295,16753'9308336] local-lis/les=16661/16663 n=3017 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,14,30] r=0 lpr=16661 crt=16753'9308336 lcod 16753'9308335 mlcod 16753'9308335 active+clean+scrubbing] _scan_snaps no head for 7:a5bfd1c6:::rbd_data.a70641238e1f29.00000000000053a9:ce (have MIN) Sep 13 06:38:36 node1.ceph ceph-osd[11188]: 2017-09-13 06:38:36.901225 7f520cfe3700 -1 osd.1 pg_epoch: 16753 pg[7.1a5( v 16753'9308336 (16735'9305295,16753'9308336] local-lis/les=16661/16663 n=3017 ec=104/104 lis/c 16661/16661 les/c/f 16663/16663/0 16661/16661/16661) [1,14,30] r=0 lpr=16661 crt=16753'9308336 lcod 16753'9308335 mlcod 16753'9308335 active+clean+scrubbing] _scan_snaps no head for 7:a5bfd1c6:::rbd_data.a70641238e1f29.00000000000053a9:9d (have MIN) Sep 13 06:53:13 node1.ceph ceph-osd[11188]: 2017-09-13 06:53:13.942051 7f520cfe3700 -1 osd.1 pg_epoch: 16757 pg[8.6f( v 16757'4227627 (16652'4224603,16757'4227627] local-lis/les=16661/16662 n=3349 ec=107/107 lis/c 16661/16661 les/c/f 16662/16693/0 16661/16661/16217) [17,7,1] r=2 lpr=16661 luod=0'0 crt=16757'4227622 lcod 16757'4227626 active] _scan_snaps no head for 8:f60f8554:::rbd_data.9aca26238e1f29.0000000000003e9e:65 (have MIN) Sep 13 06:57:15 node1.ceph ceph-osd[11188]: 2017-09-13 06:57:15.009649 7f520b7e0700 -1 osd.1 pg_epoch: 16759 pg[7.11c( v 16759'8079883 (16737'8076864,16759'8079883] local-lis/les=16661/16662 n=3051 ec=104/104 lis/c 16661/16661 les/c/f 16662/16689/0 16661/16661/16186) [10,12,1] r=2 lpr=16661 luod=0'0 crt=16759'8079881 lcod 16759'8079882 active] _scan_snaps no head for 7:3884483e:::rbd_data.a6351b238e1f29.00000000000272ba:9e (have MIN) Sep 13 06:57:22 node1.ceph ceph-osd[11188]: 2017-09-13 06:57:22.081852 7f520b7e0700 -1 osd.1 pg_epoch: 16759 pg[7.11c( v 16759'8079883 (16737'8076864,16759'8079883] local-lis/les=16661/16662 n=3051 ec=104/104 lis/c 16661/16661 les/c/f 16662/16689/0 16661/16661/16186) [10,12,1] r=2 lpr=16661 luod=0'0 crt=16759'8079881 lcod 16759'8079882 active] _scan_snaps no head for 7:3891f651:::rbd_data.a6351b238e1f29.000000000001ff61:9e (have MIN) Sep 13 06:57:23 node1.ceph ceph-osd[11188]: 2017-09-13 06:57:23.030862 7f520b7e0700 -1 osd.1 pg_epoch: 16759 pg[7.11c( v 16759'8079883 (16737'8076864,16759'8079883] local-lis/les=16661/16662 n=3051 ec=104/104 lis/c 16661/16661 les/c/f 16662/16689/0 16661/16661/16186) [10,12,1] r=2 lpr=16661 luod=0'0 crt=16759'8079881 lcod 16759'8079882 active] _scan_snaps no head for 7:3892dd66:::rbd_data.bd1c92ae8944a.00000000000003c0:d2 (have MIN) Sep 13 06:57:23 node1.ceph ceph-osd[11188]: 2017-09-13 06:57:23.879587 7f520b7e0700 -1 osd.1 pg_epoch: 16759 pg[7.11c( v 16759'8079883 (16737'8076864,16759'8079883] local-lis/les=16661/16662 n=3051 ec=104/104 lis/c 16661/16661 les/c/f 16662/16689/0 16661/16661/16186) [10,12,1] r=2 lpr=16661 luod=0'0 crt=16759'8079881 lcod 16759'8079882 active] _scan_snaps no head for 7:389464fc:::rbd_data.bd1c92ae8944a.0000000000002a72:d4 (have MIN) Sep 13 06:57:23 node1.ceph ceph-osd[11188]: 2017-09-13 06:57:23.879625 7f520b7e0700 -1 osd.1 pg_epoch: 16759 pg[7.11c( v 16759'8079883 (16737'8076864,16759'8079883] local-lis/les=16661/16662 n=3051 ec=104/104 lis/c 16661/16661 les/c/f 16662/16689/0 16661/16661/16186) [10,12,1] r=2 lpr=16661 luod=0'0 crt=16759'8079881 lcod 16759'8079882 active] _scan_snaps no head for 7:389464fc:::rbd_data.bd1c92ae8944a.0000000000002a72:d2 (have MIN) Sep 13 06:57:34 node1.ceph ceph-osd[11188]: 2017-09-13 06:57:34.610596 7f520b7e0700 -1 osd.1 pg_epoch: 16759 pg[7.11c( v 16759'8079885 (16737'8076864,16759'8079885] local-lis/les=16661/16662 n=3051 ec=104/104 lis/c 16661/16661 les/c/f 16662/16689/0 16661/16661/16186) [10,12,1] r=2 lpr=16661 luod=0'0 crt=16759'8079883 lcod 16759'8079884 active] _scan_snaps no head for 7:38a89eed:::rbd_data.a6351b238e1f29.000000000001da1b:9e (have MIN) Sep 13 06:57:41 node1.ceph ceph-osd[11188]: 2017-09-13 06:57:41.626624 7f520b7e0700 -1 osd.1 pg_epoch: 16759 pg[7.11c( v 16759'8079886 (16737'8076864,16759'8079886] local-lis/les=16661/16662 n=3051 ec=104/104 lis/c 16661/16661 les/c/f 16662/16689/0 16661/16661/16186) [10,12,1] r=2 lpr=16661 luod=0'0 crt=16759'8079884 lcod 16759'8079885 active] _scan_snaps no head for 7:38b54766:::rbd_data.a6351b238e1f29.0000000000020f1c:9e (have MIN) Sep 13 06:57:47 node1.ceph ceph-osd[11188]: 2017-09-13 06:57:47.248680 7f520b7e0700 -1 osd.1 pg_epoch: 16759 pg[7.11c( v 16759'8079886 (16737'8076864,16759'8079886] local-lis/les=16661/16662 n=3051 ec=104/104 lis/c 16661/16661 les/c/f 16662/16689/0 16661/16661/16186) [10,12,1] r=2 lpr=16661 luod=0'0 crt=16759'8079884 lcod 16759'8079885 active] _scan_snaps no head for 7:38bdbf30:::rbd_data.a6351b238e1f29.0000000000020cb0:9e (have MIN) Sep 13 06:58:33 node1.ceph ceph-osd[11188]: 2017-09-13 06:58:33.419468 7f520cfe3700 -1 osd.1 pg_epoch: 16759 pg[7.227( v 16759'4455710 (16725'4452644,16759'4455710] local-lis/les=16661/16663 n=3119 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,25,31] r=0 lpr=16661 crt=16759'4455710 lcod 16759'4455709 mlcod 16759'4455709 active+clean+scrubbing] _scan_snaps no head for 7:e449ad42:::rbd_data.c1ebe8238e1f29.0000000000002c38:df (have MIN) Sep 13 06:58:35 node1.ceph ceph-osd[11188]: 2017-09-13 06:58:35.642467 7f520cfe3700 -1 osd.1 pg_epoch: 16759 pg[7.227( v 16759'4455711 (16725'4452644,16759'4455711] local-lis/les=16661/16663 n=3119 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,25,31] r=0 lpr=16661 crt=16759'4455711 lcod 16759'4455710 mlcod 16759'4455710 active+clean+scrubbing] _scan_snaps no head for 7:e44ce83d:::rbd_data.b07e94238e1f29.00000000000009c9:80 (have MIN) Sep 13 06:58:36 node1.ceph ceph-osd[11188]: 2017-09-13 06:58:36.719128 7f520cfe3700 -1 osd.1 pg_epoch: 16759 pg[7.227( v 16759'4455713 (16725'4452644,16759'4455713] local-lis/les=16661/16663 n=3119 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,25,31] r=0 lpr=16661 crt=16759'4455713 lcod 16759'4455712 mlcod 16759'4455712 active+clean+scrubbing] _scan_snaps no head for 7:e44f8f91:::rbd_data.bd1c92ae8944a.0000000000000360:d4 (have MIN) Sep 13 06:58:36 node1.ceph ceph-osd[11188]: 2017-09-13 06:58:36.719161 7f520cfe3700 -1 osd.1 pg_epoch: 16759 pg[7.227( v 16759'4455713 (16725'4452644,16759'4455713] local-lis/les=16661/16663 n=3119 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,25,31] r=0 lpr=16661 crt=16759'4455713 lcod 16759'4455712 mlcod 16759'4455712 active+clean+scrubbing] _scan_snaps no head for 7:e44f8f91:::rbd_data.bd1c92ae8944a.0000000000000360:d2 (have MIN) Sep 13 06:58:41 node1.ceph ceph-osd[11188]: 2017-09-13 06:58:41.533399 7f520cfe3700 -1 osd.1 pg_epoch: 16759 pg[7.227( v 16759'4455714 (16725'4452644,16759'4455714] local-lis/les=16661/16663 n=3119 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,25,31] r=0 lpr=16661 crt=16759'4455714 lcod 16759'4455713 mlcod 16759'4455713 active+clean+scrubbing] _scan_snaps no head for 7:e457f27f:::rbd_data.bd1c92ae8944a.00000000000018ea:d4 (have MIN) Sep 13 06:58:41 node1.ceph ceph-osd[11188]: 2017-09-13 06:58:41.533438 7f520cfe3700 -1 osd.1 pg_epoch: 16759 pg[7.227( v 16759'4455714 (16725'4452644,16759'4455714] local-lis/les=16661/16663 n=3119 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,25,31] r=0 lpr=16661 crt=16759'4455714 lcod 16759'4455713 mlcod 16759'4455713 active+clean+scrubbing] _scan_snaps no head for 7:e457f27f:::rbd_data.bd1c92ae8944a.00000000000018ea:d2 (have MIN) Sep 13 06:58:58 node1.ceph ceph-osd[11188]: 2017-09-13 06:58:58.148966 7f520cfe3700 -1 osd.1 pg_epoch: 16759 pg[7.227( v 16759'4455721 (16725'4452644,16759'4455721] local-lis/les=16661/16663 n=3119 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,25,31] r=0 lpr=16661 crt=16759'4455721 lcod 16759'4455720 mlcod 16759'4455720 active+clean+scrubbing] _scan_snaps no head for 7:e47a940e:::rbd_data.bd1c92ae8944a.0000000000001ab8:d4 (have MIN) Sep 13 06:58:58 node1.ceph ceph-osd[11188]: 2017-09-13 06:58:58.149007 7f520cfe3700 -1 osd.1 pg_epoch: 16759 pg[7.227( v 16759'4455721 (16725'4452644,16759'4455721] local-lis/les=16661/16663 n=3119 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,25,31] r=0 lpr=16661 crt=16759'4455721 lcod 16759'4455720 mlcod 16759'4455720 active+clean+scrubbing] _scan_snaps no head for 7:e47a940e:::rbd_data.bd1c92ae8944a.0000000000001ab8:d2 (have MIN) Sep 13 06:59:01 node1.ceph ceph-osd[11188]: 2017-09-13 06:59:01.115398 7f520cfe3700 -1 osd.1 pg_epoch: 16759 pg[7.227( v 16759'4455724 (16725'4452644,16759'4455724] local-lis/les=16661/16663 n=3119 ec=2543/2543 lis/c 16661/16661 les/c/f 16663/16665/0 16661/16661/16661) [1,25,31] r=0 lpr=16661 crt=16759'4455724 lcod 16759'4455723 mlcod 16759'4455723 active+clean+scrubbing] _scan_snaps no head for 7:e47e3e39:::rbd_data.a6351b238e1f29.000000000001ed37:9e (have MIN) Sep 13 07:01:59 node1.ceph ceph-osd[11188]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7f5215ff5700 time 2017-09-13 07:01:59.180762 Sep 13 07:01:59 node1.ceph ceph-osd[11188]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 13 07:01:59 node1.ceph ceph-osd[11188]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x55cd020ea510] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55cd01c8f9d7] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55cd01c8fb19] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55cd01b5e908] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55cd01b8a121] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x55cd01b8ab4c] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x55cd01b8ae87] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 8: (DispatchQueue::entry()+0x792) [0x55cd02360cb2] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x55cd0217575d] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 10: (()+0x7dc5) [0x7f5234445dc5] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 11: (clone()+0x6d) [0x7f523353976d] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 2017-09-13 07:01:59.198556 7f5215ff5700 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7f5215ff5700 time 2017-09-13 07:01:59.180762 Sep 13 07:01:59 node1.ceph ceph-osd[11188]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 13 07:01:59 node1.ceph ceph-osd[11188]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x55cd020ea510] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55cd01c8f9d7] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55cd01c8fb19] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55cd01b5e908] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55cd01b8a121] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x55cd01b8ab4c] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x55cd01b8ae87] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 8: (DispatchQueue::entry()+0x792) [0x55cd02360cb2] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x55cd0217575d] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 10: (()+0x7dc5) [0x7f5234445dc5] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 11: (clone()+0x6d) [0x7f523353976d] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 0> 2017-09-13 07:01:59.198556 7f5215ff5700 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: In function 'void PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set*, std::set >*, bool*)' thread 7f5215ff5700 time 2017-09-13 07:01:59.180762 Sep 13 07:01:59 node1.ceph ceph-osd[11188]: /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/12.2.0/rpm/el7/BUILD/ceph-12.2.0/src/osd/PGLog.cc: 60: FAILED assert(s <= can_rollback_to) Sep 13 07:01:59 node1.ceph ceph-osd[11188]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x110) [0x55cd020ea510] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 2: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55cd01c8f9d7] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 3: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55cd01c8fb19] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 4: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55cd01b5e908] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 5: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55cd01b8a121] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 6: (OSD::_dispatch(Message*)+0x3bc) [0x55cd01b8ab4c] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 7: (OSD::ms_dispatch(Message*)+0x87) [0x55cd01b8ae87] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 8: (DispatchQueue::entry()+0x792) [0x55cd02360cb2] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 9: (DispatchQueue::DispatchThread::entry()+0xd) [0x55cd0217575d] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 10: (()+0x7dc5) [0x7f5234445dc5] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 11: (clone()+0x6d) [0x7f523353976d] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 13 07:01:59 node1.ceph ceph-osd[11188]: *** Caught signal (Aborted) ** Sep 13 07:01:59 node1.ceph ceph-osd[11188]: in thread 7f5215ff5700 thread_name:ms_dispatch Sep 13 07:01:59 node1.ceph ceph-osd[11188]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 1: (()+0xa23b21) [0x55cd020abb21] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 2: (()+0xf370) [0x7f523444d370] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 3: (gsignal()+0x37) [0x7f52334771d7] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 4: (abort()+0x148) [0x7f52334788c8] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x55cd020ea684] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55cd01c8f9d7] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55cd01c8fb19] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55cd01b5e908] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55cd01b8a121] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x55cd01b8ab4c] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x55cd01b8ae87] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 12: (DispatchQueue::entry()+0x792) [0x55cd02360cb2] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x55cd0217575d] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 14: (()+0x7dc5) [0x7f5234445dc5] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 15: (clone()+0x6d) [0x7f523353976d] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 2017-09-13 07:01:59.242648 7f5215ff5700 -1 *** Caught signal (Aborted) ** Sep 13 07:01:59 node1.ceph ceph-osd[11188]: in thread 7f5215ff5700 thread_name:ms_dispatch Sep 13 07:01:59 node1.ceph ceph-osd[11188]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 1: (()+0xa23b21) [0x55cd020abb21] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 2: (()+0xf370) [0x7f523444d370] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 3: (gsignal()+0x37) [0x7f52334771d7] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 4: (abort()+0x148) [0x7f52334788c8] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x55cd020ea684] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55cd01c8f9d7] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55cd01c8fb19] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55cd01b5e908] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55cd01b8a121] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x55cd01b8ab4c] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x55cd01b8ae87] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 12: (DispatchQueue::entry()+0x792) [0x55cd02360cb2] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x55cd0217575d] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 14: (()+0x7dc5) [0x7f5234445dc5] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 15: (clone()+0x6d) [0x7f523353976d] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 0> 2017-09-13 07:01:59.242648 7f5215ff5700 -1 *** Caught signal (Aborted) ** Sep 13 07:01:59 node1.ceph ceph-osd[11188]: in thread 7f5215ff5700 thread_name:ms_dispatch Sep 13 07:01:59 node1.ceph ceph-osd[11188]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 1: (()+0xa23b21) [0x55cd020abb21] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 2: (()+0xf370) [0x7f523444d370] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 3: (gsignal()+0x37) [0x7f52334771d7] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 4: (abort()+0x148) [0x7f52334788c8] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x284) [0x55cd020ea684] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 6: (PGLog::IndexedLog::trim(CephContext*, eversion_t, std::set, std::allocator >*, std::set, std::allocator >*, bool*)+0xbd7) [0x55cd01c8f9d7] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 7: (PGLog::trim(eversion_t, pg_info_t&)+0xd9) [0x55cd01c8fb19] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 8: (OSD::handle_pg_trim(boost::intrusive_ptr)+0x3a8) [0x55cd01b5e908] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 9: (OSD::dispatch_op(boost::intrusive_ptr)+0x1b1) [0x55cd01b8a121] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 10: (OSD::_dispatch(Message*)+0x3bc) [0x55cd01b8ab4c] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 11: (OSD::ms_dispatch(Message*)+0x87) [0x55cd01b8ae87] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 12: (DispatchQueue::entry()+0x792) [0x55cd02360cb2] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 13: (DispatchQueue::DispatchThread::entry()+0xd) [0x55cd0217575d] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 14: (()+0x7dc5) [0x7f5234445dc5] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: 15: (clone()+0x6d) [0x7f523353976d] Sep 13 07:01:59 node1.ceph ceph-osd[11188]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 13 07:01:59 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=6/ABRT Sep 13 07:01:59 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 13 07:01:59 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 13 07:02:19 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 13 07:02:19 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 13 07:02:19 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 13 07:02:19 node1.ceph ceph-osd[22280]: 2017-09-13 07:02:19.626548 7f59a081ad00 -1 Public network was set, but cluster network was not set Sep 13 07:02:19 node1.ceph ceph-osd[22280]: 2017-09-13 07:02:19.626556 7f59a081ad00 -1 Using public network also for cluster network Sep 13 07:02:19 node1.ceph ceph-osd[22280]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 13 07:02:42 node1.ceph ceph-osd[22280]: 2017-09-13 07:02:42.607492 7f59a081ad00 -1 osd.1 16759 log_to_monitors {default=true} Sep 13 07:02:42 node1.ceph ceph-osd[22280]: 2017-09-13 07:02:42.613044 7f59a081ad00 -1 osd.1 16759 mon_cmd_maybe_osd_create fail: 'you must complete the upgrade and 'ceph osd require-osd-release luminous' before using crush device classes': (1) Operation not permitted Sep 13 07:22:36 node1.ceph ceph-osd[22280]: 2017-09-13 07:22:36.983070 7f5974be9700 -1 osd.1 pg_epoch: 16773 pg[8.27e( v 16773'3333163 (16610'3330074,16773'3333163] local-lis/les=16763/16765 n=3236 ec=2548/2548 lis/c 16763/16763 les/c/f 16765/16765/0 16763/16763/16763) [1,39,13] r=0 lpr=16763 crt=16773'3333163 lcod 16773'3333162 mlcod 16773'3333162 active+clean+scrubbing] _scan_snaps no head for 8:7e7f2ccd:::rbd_data.9aca26238e1f29.0000000000004146:65 (have MIN) Sep 13 07:22:47 node1.ceph ceph-osd[22280]: 2017-09-13 07:22:47.312032 7f5975beb700 -1 osd.1 pg_epoch: 16773 pg[8.128( v 16773'2207863 (16646'2204842,16773'2207863] local-lis/les=16763/16764 n=3286 ec=107/107 lis/c 16763/16763 les/c/f 16764/16764/0 16763/16763/16763) [1,22,9] r=0 lpr=16763 crt=16773'2207863 lcod 16773'2207862 mlcod 16773'2207862 active+clean+scrubbing] _scan_snaps no head for 8:148d1f51:::rbd_data.1443bb238e1f29.00000000000038a8:31 (have MIN) Sep 13 07:23:25 node1.ceph ceph-osd[22280]: 2017-09-13 07:23:25.545837 7f5975beb700 -1 osd.1 pg_epoch: 16773 pg[8.128( v 16773'2207870 (16646'2204842,16773'2207870] local-lis/les=16763/16764 n=3286 ec=107/107 lis/c 16763/16763 les/c/f 16764/16764/0 16763/16763/16763) [1,22,9] r=0 lpr=16763 crt=16773'2207870 lcod 16773'2207869 mlcod 16773'2207869 active+clean+scrubbing] _scan_snaps no head for 8:14b8632d:::rbd_data.1443bb238e1f29.0000000000000a1e:31 (have MIN) Sep 13 07:24:24 node1.ceph ceph-osd[22280]: 2017-09-13 07:24:24.799125 7f5974be9700 -1 osd.1 pg_epoch: 16773 pg[8.26f( v 16773'2737637 (16522'2734629,16773'2737637] local-lis/les=16763/16765 n=3355 ec=2548/2548 lis/c 16763/16763 les/c/f 16765/16773/0 16763/16763/16763) [1,10,36] r=0 lpr=16763 crt=16773'2737637 lcod 16773'2737636 mlcod 16773'2737636 active+clean+scrubbing] _scan_snaps no head for 8:f67c9370:::rbd_data.1443bb238e1f29.0000000000000d22:31 (have MIN) Sep 13 07:24:32 node1.ceph ceph-osd[22280]: 2017-09-13 07:24:32.027743 7f59743e8700 -1 osd.1 pg_epoch: 16773 pg[7.185( v 16773'7900880 (16737'7897813,16773'7900880] local-lis/les=16763/16764 n=3006 ec=104/104 lis/c 16763/16763 les/c/f 16764/16770/0 16763/16763/16763) [1,35,27] r=0 lpr=16763 crt=16773'7900880 lcod 16773'7900879 mlcod 16773'7900879 active+clean+scrubbing] _scan_snaps no head for 7:a183d589:::rbd_data.a6351b238e1f29.0000000000021810:9e (have MIN) Sep 13 07:24:50 node1.ceph ceph-osd[22280]: 2017-09-13 07:24:50.381520 7f59743e8700 -1 osd.1 pg_epoch: 16773 pg[7.185( v 16773'7900883 (16737'7897813,16773'7900883] local-lis/les=16763/16764 n=3006 ec=104/104 lis/c 16763/16763 les/c/f 16764/16770/0 16763/16763/16763) [1,35,27] r=0 lpr=16763 crt=16773'7900883 lcod 16773'7900882 mlcod 16773'7900882 active+clean+scrubbing] _scan_snaps no head for 7:a19dcc92:::rbd_data.bd1c92ae8944a.00000000000068ed:d2 (have MIN) Sep 13 07:24:55 node1.ceph ceph-osd[22280]: 2017-09-13 07:24:55.141467 7f59743e8700 -1 osd.1 pg_epoch: 16773 pg[7.185( v 16773'7900886 (16737'7897813,16773'7900886] local-lis/les=16763/16764 n=3006 ec=104/104 lis/c 16763/16763 les/c/f 16764/16770/0 16763/16763/16763) [1,35,27] r=0 lpr=16763 crt=16773'7900886 lcod 16773'7900885 mlcod 16773'7900885 active+clean+scrubbing] _scan_snaps no head for 7:a1a3df72:::rbd_data.a6351b238e1f29.000000000001ed7a:9e (have MIN) Sep 13 07:24:57 node1.ceph ceph-osd[22280]: 2017-09-13 07:24:57.349089 7f59743e8700 -1 osd.1 pg_epoch: 16773 pg[7.185( v 16773'7900886 (16737'7897813,16773'7900886] local-lis/les=16763/16764 n=3006 ec=104/104 lis/c 16763/16763 les/c/f 16764/16770/0 16763/16763/16763) [1,35,27] r=0 lpr=16763 crt=16773'7900886 lcod 16773'7900885 mlcod 16773'7900885 active+clean+scrubbing] _scan_snaps no head for 7:a1a788ed:::rbd_data.a4f318238e1f29.00000000000010f0:65 (have MIN) Sep 13 07:25:00 node1.ceph ceph-osd[22280]: 2017-09-13 07:25:00.164549 7f59743e8700 -1 osd.1 pg_epoch: 16773 pg[7.185( v 16773'7900886 (16737'7897813,16773'7900886] local-lis/les=16763/16764 n=3006 ec=104/104 lis/c 16763/16763 les/c/f 16764/16770/0 16763/16763/16763) [1,35,27] r=0 lpr=16763 crt=16773'7900886 lcod 16773'7900885 mlcod 16773'7900885 active+clean+scrubbing] _scan_snaps no head for 7:a1abd072:::rbd_data.8f8aad238e1f29.0000000000000819:54 (have MIN) Sep 13 07:25:02 node1.ceph ceph-osd[22280]: 2017-09-13 07:25:02.110899 7f59743e8700 -1 osd.1 pg_epoch: 16773 pg[7.185( v 16773'7900886 (16737'7897813,16773'7900886] local-lis/les=16763/16764 n=3006 ec=104/104 lis/c 16763/16763 les/c/f 16764/16770/0 16763/16763/16763) [1,35,27] r=0 lpr=16763 crt=16773'7900886 lcod 16773'7900885 mlcod 16773'7900885 active+clean+scrubbing] _scan_snaps no head for 7:a1af2b07:::rbd_data.a6351b238e1f29.000000000001ffa6:9e (have MIN) Sep 13 07:25:02 node1.ceph ceph-osd[22280]: 2017-09-13 07:25:02.918253 7f59743e8700 -1 osd.1 pg_epoch: 16773 pg[7.185( v 16773'7900886 (16737'7897813,16773'7900886] local-lis/les=16763/16764 n=3006 ec=104/104 lis/c 16763/16763 les/c/f 16764/16770/0 16763/16763/16763) [1,35,27] r=0 lpr=16763 crt=16773'7900886 lcod 16773'7900885 mlcod 16773'7900885 active+clean+scrubbing] _scan_snaps no head for 7:a1afffb2:::rbd_data.a74f60238e1f29.0000000000000c40:9c (have MIN) Sep 13 07:25:09 node1.ceph ceph-osd[22280]: 2017-09-13 07:25:09.538531 7f59743e8700 -1 osd.1 pg_epoch: 16773 pg[7.185( v 16773'7900886 (16737'7897813,16773'7900886] local-lis/les=16763/16764 n=3006 ec=104/104 lis/c 16763/16763 les/c/f 16764/16770/0 16763/16763/16763) [1,35,27] r=0 lpr=16763 crt=16773'7900886 lcod 16773'7900885 mlcod 16773'7900885 active+clean+scrubbing] _scan_snaps no head for 7:a1bcddeb:::rbd_data.b0d052238e1f29.0000000000000168:b1 (have MIN) Sep 13 07:25:09 node1.ceph ceph-osd[22280]: 2017-09-13 07:25:09.538565 7f59743e8700 -1 osd.1 pg_epoch: 16773 pg[7.185( v 16773'7900886 (16737'7897813,16773'7900886] local-lis/les=16763/16764 n=3006 ec=104/104 lis/c 16763/16763 les/c/f 16764/16770/0 16763/16763/16763) [1,35,27] r=0 lpr=16763 crt=16773'7900886 lcod 16773'7900885 mlcod 16773'7900885 active+clean+scrubbing] _scan_snaps no head for 7:a1bcddeb:::rbd_data.b0d052238e1f29.0000000000000168:b0 (have MIN) Sep 13 07:25:09 node1.ceph ceph-osd[22280]: 2017-09-13 07:25:09.538583 7f59743e8700 -1 osd.1 pg_epoch: 16773 pg[7.185( v 16773'7900886 (16737'7897813,16773'7900886] local-lis/les=16763/16764 n=3006 ec=104/104 lis/c 16763/16763 les/c/f 16764/16770/0 16763/16763/16763) [1,35,27] r=0 lpr=16763 crt=16773'7900886 lcod 16773'7900885 mlcod 16773'7900885 active+clean+scrubbing] _scan_snaps no head for 7:a1bcddeb:::rbd_data.b0d052238e1f29.0000000000000168:ae (have MIN) Sep 13 07:28:55 node1.ceph ceph-osd[22280]: 2017-09-13 07:28:55.793899 7f59753ea700 -1 osd.1 pg_epoch: 16773 pg[8.15b( v 16773'2470172 (16650'2467119,16773'2470172] local-lis/les=16763/16764 n=3369 ec=107/107 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,28,9] r=0 lpr=16763 crt=16773'2470172 lcod 16773'2470171 mlcod 16773'2470171 active+clean+scrubbing+deep] _scan_snaps no head for 8:daa29ccc:::rbd_data.9aca26238e1f29.0000000000004d6a:65 (have MIN) Sep 13 07:41:35 node1.ceph ceph-osd[22280]: 2017-09-13 07:41:35.897101 7f5974be9700 -1 osd.1 pg_epoch: 16777 pg[7.20b( v 16777'6332337 (16719'6329328,16777'6332337] local-lis/les=16763/16764 n=3031 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16213) [16,1,25] r=1 lpr=16763 luod=0'0 crt=16777'6332334 lcod 16777'6332336 active] _scan_snaps no head for 7:d045846e:::rbd_data.a6351b238e1f29.0000000000021030:9e (have MIN) Sep 13 07:41:36 node1.ceph ceph-osd[22280]: 2017-09-13 07:41:36.930748 7f5974be9700 -1 osd.1 pg_epoch: 16777 pg[7.20b( v 16777'6332337 (16719'6329328,16777'6332337] local-lis/les=16763/16764 n=3031 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16213) [16,1,25] r=1 lpr=16763 luod=0'0 crt=16777'6332334 lcod 16777'6332336 active] _scan_snaps no head for 7:d047f8c0:::rbd_data.a6351b238e1f29.0000000000000227:9e (have MIN) Sep 13 07:41:39 node1.ceph ceph-osd[22280]: 2017-09-13 07:41:39.634261 7f5974be9700 -1 osd.1 pg_epoch: 16777 pg[7.20b( v 16777'6332338 (16719'6329328,16777'6332338] local-lis/les=16763/16764 n=3031 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16213) [16,1,25] r=1 lpr=16763 luod=0'0 crt=16777'6332336 lcod 16777'6332337 active] _scan_snaps no head for 7:d04cf14d:::rbd_data.a74f60238e1f29.000000000000116c:9c (have MIN) Sep 13 07:41:42 node1.ceph ceph-osd[22280]: 2017-09-13 07:41:42.279438 7f5974be9700 -1 osd.1 pg_epoch: 16777 pg[7.20b( v 16777'6332338 (16719'6329328,16777'6332338] local-lis/les=16763/16764 n=3031 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16213) [16,1,25] r=1 lpr=16763 luod=0'0 crt=16777'6332336 lcod 16777'6332337 active] _scan_snaps no head for 7:d050358b:::rbd_data.a6351b238e1f29.0000000000008480:d1 (have MIN) Sep 13 07:41:42 node1.ceph ceph-osd[22280]: 2017-09-13 07:41:42.279468 7f5974be9700 -1 osd.1 pg_epoch: 16777 pg[7.20b( v 16777'6332338 (16719'6329328,16777'6332338] local-lis/les=16763/16764 n=3031 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16213) [16,1,25] r=1 lpr=16763 luod=0'0 crt=16777'6332336 lcod 16777'6332337 active] _scan_snaps no head for 7:d050358b:::rbd_data.a6351b238e1f29.0000000000008480:9e (have MIN) Sep 13 07:41:52 node1.ceph ceph-osd[22280]: 2017-09-13 07:41:52.418053 7f5974be9700 -1 osd.1 pg_epoch: 16777 pg[7.20b( v 16777'6332351 (16719'6329328,16777'6332351] local-lis/les=16763/16764 n=3031 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16213) [16,1,25] r=1 lpr=16763 luod=0'0 crt=16777'6332346 lcod 16777'6332350 active] _scan_snaps no head for 7:d06103ca:::rbd_data.bd1c92ae8944a.000000000000583f:d2 (have MIN) Sep 13 07:41:55 node1.ceph ceph-osd[22280]: 2017-09-13 07:41:55.838704 7f5974be9700 -1 osd.1 pg_epoch: 16777 pg[7.20b( v 16777'6332353 (16719'6329328,16777'6332353] local-lis/les=16763/16764 n=3031 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16213) [16,1,25] r=1 lpr=16763 luod=0'0 crt=16777'6332350 lcod 16777'6332352 active] _scan_snaps no head for 7:d067ab27:::rbd_data.a6351b238e1f29.000000000001b032:9e (have MIN) Sep 13 07:41:58 node1.ceph ceph-osd[22280]: 2017-09-13 07:41:58.185365 7f5974be9700 -1 osd.1 pg_epoch: 16777 pg[7.20b( v 16777'6332353 (16719'6329328,16777'6332353] local-lis/les=16763/16764 n=3031 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16213) [16,1,25] r=1 lpr=16763 luod=0'0 crt=16777'6332350 lcod 16777'6332352 active] _scan_snaps no head for 7:d06cb005:::rbd_data.bd1c92ae8944a.0000000000000171:d2 (have MIN) Sep 13 07:42:02 node1.ceph ceph-osd[22280]: 2017-09-13 07:42:02.119433 7f5974be9700 -1 osd.1 pg_epoch: 16777 pg[7.20b( v 16777'6332353 (16719'6329328,16777'6332353] local-lis/les=16763/16764 n=3031 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16213) [16,1,25] r=1 lpr=16763 luod=0'0 crt=16777'6332350 lcod 16777'6332352 active] _scan_snaps no head for 7:d0739fd8:::rbd_data.b0d052238e1f29.00000000000002c9:ae (have MIN) Sep 13 07:42:09 node1.ceph ceph-osd[22280]: 2017-09-13 07:42:09.188206 7f5974be9700 -1 osd.1 pg_epoch: 16777 pg[7.20b( v 16777'6332354 (16719'6329328,16777'6332354] local-lis/les=16763/16764 n=3031 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16213) [16,1,25] r=1 lpr=16763 luod=0'0 crt=16777'6332352 lcod 16777'6332353 active] _scan_snaps no head for 7:d07bd1e1:::rbd_data.bd1c92ae8944a.0000000000005812:d2 (have MIN) Sep 13 07:44:24 node1.ceph ceph-osd[22280]: 2017-09-13 07:44:24.187283 7f59743e8700 -1 osd.1 pg_epoch: 16777 pg[7.20c( v 16777'65734316 (16773'65731232,16777'65734316] local-lis/les=16763/16764 n=2949 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16226) [32,8,1] r=2 lpr=16763 luod=0'0 crt=16777'65734313 lcod 16777'65734315 active] _scan_snaps no head for 7:30417ec7:::rbd_data.a6351b238e1f29.0000000000029d7e:9e (have MIN) Sep 13 07:45:26 node1.ceph ceph-osd[22280]: 2017-09-13 07:45:26.022581 7f59743e8700 -1 osd.1 pg_epoch: 16777 pg[7.20c( v 16777'65734390 (16773'65731332,16777'65734390] local-lis/les=16763/16764 n=2949 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16226) [32,8,1] r=2 lpr=16763 luod=0'0 crt=16777'65734385 lcod 16777'65734389 active] _scan_snaps no head for 7:304dd58c:::rbd_data.32bc79238e1f29.0000000000002eb1:2d (have MIN) Sep 13 07:46:18 node1.ceph ceph-osd[22280]: 2017-09-13 07:46:18.778661 7f59743e8700 -1 osd.1 pg_epoch: 16777 pg[7.20c( v 16777'65734459 (16773'65731433,16777'65734459] local-lis/les=16763/16764 n=2949 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16226) [32,8,1] r=2 lpr=16763 luod=0'0 crt=16777'65734455 lcod 16777'65734458 active] _scan_snaps no head for 7:305828ad:::rbd_data.a6351b238e1f29.0000000000019d87:9e (have MIN) Sep 13 07:48:12 node1.ceph ceph-osd[22280]: 2017-09-13 07:48:12.675696 7f59743e8700 -1 osd.1 pg_epoch: 16777 pg[7.20c( v 16777'65734628 (16773'65731534,16777'65734628] local-lis/les=16763/16764 n=2949 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16226) [32,8,1] r=2 lpr=16763 luod=0'0 lua=16777'65734626 crt=16777'65734625 lcod 16777'65734627 active] _scan_snaps no head for 7:3071b586:::rbd_data.bd1c92ae8944a.0000000000001251:d4 (have MIN) Sep 13 07:48:12 node1.ceph ceph-osd[22280]: 2017-09-13 07:48:12.675739 7f59743e8700 -1 osd.1 pg_epoch: 16777 pg[7.20c( v 16777'65734628 (16773'65731534,16777'65734628] local-lis/les=16763/16764 n=2949 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16226) [32,8,1] r=2 lpr=16763 luod=0'0 lua=16777'65734626 crt=16777'65734625 lcod 16777'65734627 active] _scan_snaps no head for 7:3071b586:::rbd_data.bd1c92ae8944a.0000000000001251:d2 (have MIN) Sep 13 07:48:58 node1.ceph ceph-osd[22280]: 2017-09-13 07:48:58.496024 7f59743e8700 -1 osd.1 pg_epoch: 16778 pg[7.20c( v 16778'65734676 (16773'65731634,16778'65734676] local-lis/les=16763/16764 n=2949 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16226) [32,8,1] r=2 lpr=16763 luod=0'0 crt=16777'65734673 lcod 16778'65734675 active] _scan_snaps no head for 7:307c2870:::rbd_data.a4f318238e1f29.0000000000000ac1:8d (have MIN) Sep 13 07:49:53 node1.ceph ceph-osd[22280]: 2017-09-13 07:49:53.183506 7f59763ec700 -1 osd.1 pg_epoch: 16779 pg[7.384( v 16779'4162711 (16725'4159672,16779'4162711] local-lis/les=16763/16764 n=3122 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,9,26] r=0 lpr=16763 crt=16779'4162711 lcod 16779'4162710 mlcod 16779'4162710 active+clean+scrubbing] _scan_snaps no head for 7:21d8ae6c:::rbd_data.bd1c92ae8944a.0000000000003ca6:d2 (have MIN) Sep 13 07:49:54 node1.ceph ceph-osd[22280]: 2017-09-13 07:49:54.815503 7f59763ec700 -1 osd.1 pg_epoch: 16779 pg[7.384( v 16779'4162711 (16725'4159672,16779'4162711] local-lis/les=16763/16764 n=3122 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,9,26] r=0 lpr=16763 crt=16779'4162711 lcod 16779'4162710 mlcod 16779'4162710 active+clean+scrubbing] _scan_snaps no head for 7:21d9ce93:::rbd_data.bd1c92ae8944a.0000000000001f23:d4 (have MIN) Sep 13 07:49:54 node1.ceph ceph-osd[22280]: 2017-09-13 07:49:54.815539 7f59763ec700 -1 osd.1 pg_epoch: 16779 pg[7.384( v 16779'4162711 (16725'4159672,16779'4162711] local-lis/les=16763/16764 n=3122 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,9,26] r=0 lpr=16763 crt=16779'4162711 lcod 16779'4162710 mlcod 16779'4162710 active+clean+scrubbing] _scan_snaps no head for 7:21d9ce93:::rbd_data.bd1c92ae8944a.0000000000001f23:d2 (have MIN) Sep 13 07:50:01 node1.ceph ceph-osd[22280]: 2017-09-13 07:50:01.719101 7f59763ec700 -1 osd.1 pg_epoch: 16779 pg[7.384( v 16779'4162711 (16725'4159672,16779'4162711] local-lis/les=16763/16764 n=3122 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,9,26] r=0 lpr=16763 crt=16779'4162711 lcod 16779'4162710 mlcod 16779'4162710 active+clean+scrubbing] _scan_snaps no head for 7:21e162f9:::rbd_data.b07e94238e1f29.0000000000000b68:80 (have MIN) Sep 13 07:50:03 node1.ceph ceph-osd[22280]: 2017-09-13 07:50:03.503356 7f59763ec700 -1 osd.1 pg_epoch: 16779 pg[7.384( v 16779'4162711 (16725'4159672,16779'4162711] local-lis/les=16763/16764 n=3122 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,9,26] r=0 lpr=16763 crt=16779'4162711 lcod 16779'4162710 mlcod 16779'4162710 active+clean+scrubbing] _scan_snaps no head for 7:21e2d13c:::rbd_data.bd1c92ae8944a.00000000000035bc:d2 (have MIN) Sep 13 07:50:19 node1.ceph ceph-osd[22280]: 2017-09-13 07:50:19.319823 7f59763ec700 -1 osd.1 pg_epoch: 16779 pg[7.384( v 16779'4162718 (16725'4159672,16779'4162718] local-lis/les=16763/16764 n=3122 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,9,26] r=0 lpr=16763 crt=16779'4162718 lcod 16779'4162717 mlcod 16779'4162717 active+clean+scrubbing] _scan_snaps no head for 7:21f71021:::rbd_data.b07e94238e1f29.000000000000099a:80 (have MIN) Sep 13 07:56:28 node1.ceph ceph-osd[22280]: 2017-09-13 07:56:28.445199 7f59743e8700 -1 osd.1 pg_epoch: 16779 pg[8.14e( v 16779'4308340 (16719'4305292,16779'4308340] local-lis/les=16763/16764 n=3403 ec=107/107 lis/c 16763/16763 les/c/f 16764/16773/0 16763/16763/16763) [1,40,29] r=0 lpr=16763 crt=16779'4308340 lcod 16779'4308339 mlcod 16779'4308339 active+clean+scrubbing+deep] _scan_snaps no head for 8:72afb2e8:::rbd_data.9aca26238e1f29.0000000000000d98:65 (have MIN) Sep 13 07:56:52 node1.ceph ceph-osd[22280]: 2017-09-13 07:56:52.816420 7f59743e8700 -1 osd.1 pg_epoch: 16781 pg[8.14e( v 16781'4308371 (16719'4305292,16781'4308371] local-lis/les=16763/16764 n=3403 ec=107/107 lis/c 16763/16763 les/c/f 16764/16773/0 16763/16763/16763) [1,40,29] r=0 lpr=16763 crt=16781'4308371 lcod 16781'4308370 mlcod 16781'4308370 active+clean+scrubbing+deep] _scan_snaps no head for 8:72b393ea:::rbd_data.9aca26238e1f29.00000000000061a6:65 (have MIN) Sep 13 07:59:40 node1.ceph ceph-osd[22280]: 2017-09-13 07:59:40.238235 7f5974be9700 -1 osd.1 pg_epoch: 16781 pg[8.da( v 16781'2414493 (16610'2411484,16781'2414493] local-lis/les=16763/16764 n=3362 ec=107/107 lis/c 16763/16763 les/c/f 16764/16764/0 16763/16763/16232) [31,16,1] r=2 lpr=16763 luod=0'0 crt=16781'2414491 lcod 16781'2414492 active] _scan_snaps no head for 8:5b19bc62:::rbd_data.1443bb238e1f29.0000000000001db4:31 (have MIN) Sep 13 08:01:08 node1.ceph ceph-osd[22280]: 2017-09-13 08:01:08.765968 7f59743e8700 -1 osd.1 pg_epoch: 16781 pg[8.2d9( v 16781'3381856 (16675'3378774,16781'3381856] local-lis/les=16763/16765 n=3379 ec=2548/2548 lis/c 16763/16763 les/c/f 16765/16772/0 16763/16763/16763) [1,39,32] r=0 lpr=16763 crt=16781'3381856 lcod 16781'3381855 mlcod 16781'3381855 active+clean+scrubbing] _scan_snaps no head for 8:9b64d8e2:::rbd_data.d393db238e1f29.00000000000000a4:68 (have MIN) Sep 13 08:01:08 node1.ceph ceph-osd[22280]: 2017-09-13 08:01:08.766001 7f59743e8700 -1 osd.1 pg_epoch: 16781 pg[8.2d9( v 16781'3381856 (16675'3378774,16781'3381856] local-lis/les=16763/16765 n=3379 ec=2548/2548 lis/c 16763/16763 les/c/f 16765/16772/0 16763/16763/16763) [1,39,32] r=0 lpr=16763 crt=16781'3381856 lcod 16781'3381855 mlcod 16781'3381855 active+clean+scrubbing] _scan_snaps no head for 8:9b64d8e2:::rbd_data.d393db238e1f29.00000000000000a4:67 (have MIN) Sep 13 08:05:42 node1.ceph ceph-osd[22280]: 2017-09-13 08:05:42.210197 7f59743e8700 -1 osd.1 pg_epoch: 16783 pg[7.2ac( v 16783'9763945 (16745'9760924,16783'9763945] local-lis/les=16763/16764 n=2972 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,38,26] r=0 lpr=16763 luod=16783'9763944 lua=16783'9763944 crt=16783'9763945 lcod 16783'9763943 mlcod 16783'9763943 active+clean+scrubbing] _scan_snaps no head for 7:35535b74:::rbd_data.bd1c92ae8944a.000000000000572c:d2 (have MIN) Sep 13 08:05:50 node1.ceph ceph-osd[22280]: 2017-09-13 08:05:50.744473 7f59743e8700 -1 osd.1 pg_epoch: 16783 pg[7.2ac( v 16783'9763954 (16745'9760924,16783'9763954] local-lis/les=16763/16764 n=2972 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,38,26] r=0 lpr=16763 crt=16783'9763954 lcod 16783'9763953 mlcod 16783'9763953 active+clean+scrubbing] _scan_snaps no head for 7:3568a1f0:::rbd_data.bd1c92ae8944a.00000000000013ab:d2 (have MIN) Sep 13 08:05:51 node1.ceph ceph-osd[22280]: 2017-09-13 08:05:51.689813 7f59743e8700 -1 osd.1 pg_epoch: 16783 pg[7.2ac( v 16783'9763954 (16745'9760924,16783'9763954] local-lis/les=16763/16764 n=2972 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,38,26] r=0 lpr=16763 crt=16783'9763954 lcod 16783'9763953 mlcod 16783'9763953 active+clean+scrubbing] _scan_snaps no head for 7:356ab2c6:::rbd_data.bd1c92ae8944a.00000000000009a1:d4 (have MIN) Sep 13 08:05:51 node1.ceph ceph-osd[22280]: 2017-09-13 08:05:51.689850 7f59743e8700 -1 osd.1 pg_epoch: 16783 pg[7.2ac( v 16783'9763954 (16745'9760924,16783'9763954] local-lis/les=16763/16764 n=2972 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,38,26] r=0 lpr=16763 crt=16783'9763954 lcod 16783'9763953 mlcod 16783'9763953 active+clean+scrubbing] _scan_snaps no head for 7:356ab2c6:::rbd_data.bd1c92ae8944a.00000000000009a1:d2 (have MIN) Sep 13 08:05:54 node1.ceph ceph-osd[22280]: 2017-09-13 08:05:54.376024 7f59743e8700 -1 osd.1 pg_epoch: 16783 pg[7.2ac( v 16783'9763954 (16745'9760924,16783'9763954] local-lis/les=16763/16764 n=2972 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,38,26] r=0 lpr=16763 crt=16783'9763954 lcod 16783'9763953 mlcod 16783'9763953 active+clean+scrubbing] _scan_snaps no head for 7:356ecd7d:::rbd_data.a70641238e1f29.0000000000006fec:9d (have MIN) Sep 13 08:05:58 node1.ceph ceph-osd[22280]: 2017-09-13 08:05:58.739524 7f59743e8700 -1 osd.1 pg_epoch: 16783 pg[7.2ac( v 16783'9763955 (16745'9760924,16783'9763955] local-lis/les=16763/16764 n=2972 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,38,26] r=0 lpr=16763 crt=16783'9763955 lcod 16783'9763954 mlcod 16783'9763954 active+clean+scrubbing] _scan_snaps no head for 7:35767e50:::rbd_data.a70641238e1f29.0000000000006e7e:9d (have MIN) Sep 13 08:06:00 node1.ceph ceph-osd[22280]: 2017-09-13 08:06:00.403636 7f59743e8700 -1 osd.1 pg_epoch: 16783 pg[7.2ac( v 16783'9763955 (16745'9760924,16783'9763955] local-lis/les=16763/16764 n=2972 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,38,26] r=0 lpr=16763 crt=16783'9763955 lcod 16783'9763954 mlcod 16783'9763954 active+clean+scrubbing] _scan_snaps no head for 7:3579d64e:::rbd_data.bd1c92ae8944a.0000000000004f9a:d2 (have MIN) Sep 13 08:11:28 node1.ceph ceph-osd[22280]: 2017-09-13 08:11:28.772780 7f59743e8700 -1 osd.1 pg_epoch: 16785 pg[8.29d( v 16785'2820321 (16693'2817303,16785'2820321] local-lis/les=16763/16764 n=3276 ec=2548/2548 lis/c 16763/16763 les/c/f 16764/16768/0 16763/16763/16763) [1,19,32] r=0 lpr=16763 crt=16785'2820321 lcod 16785'2820320 mlcod 16785'2820320 active+clean+scrubbing+deep] _scan_snaps no head for 8:b94b9c7a:::rbd_data.9aca26238e1f29.0000000000003c7f:65 (have MIN) Sep 13 08:16:58 node1.ceph ceph-osd[22280]: 2017-09-13 08:16:58.139053 7f59743e8700 -1 osd.1 pg_epoch: 16787 pg[8.289( v 16787'2510884 (16642'2507787,16787'2510884] local-lis/les=16763/16764 n=3274 ec=2548/2548 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16201) [13,1,9] r=1 lpr=16763 luod=0'0 crt=16787'2510881 lcod 16787'2510883 active] _scan_snaps no head for 8:9148f867:::rbd_data.1443bb238e1f29.0000000000001d5b:31 (have MIN) Sep 13 08:17:01 node1.ceph ceph-osd[22280]: 2017-09-13 08:17:01.207224 7f59743e8700 -1 osd.1 pg_epoch: 16787 pg[8.289( v 16787'2510884 (16642'2507787,16787'2510884] local-lis/les=16763/16764 n=3274 ec=2548/2548 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16201) [13,1,9] r=1 lpr=16763 luod=0'0 crt=16787'2510881 lcod 16787'2510883 active] _scan_snaps no head for 8:91517613:::rbd_data.1443bb238e1f29.000000000000220f:31 (have MIN) Sep 13 08:17:18 node1.ceph ceph-osd[22280]: 2017-09-13 08:17:18.703718 7f59743e8700 -1 osd.1 pg_epoch: 16787 pg[8.289( v 16787'2510884 (16642'2507787,16787'2510884] local-lis/les=16763/16764 n=3274 ec=2548/2548 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16201) [13,1,9] r=1 lpr=16763 luod=0'0 crt=16787'2510881 lcod 16787'2510883 active] _scan_snaps no head for 8:91775019:::rbd_data.9aca26238e1f29.0000000000003302:65 (have MIN) Sep 13 08:17:52 node1.ceph ceph-osd[22280]: 2017-09-13 08:17:52.817899 7f5975beb700 -1 osd.1 pg_epoch: 16787 pg[7.37b( v 16787'13107534 (16775'13104515,16787'13107534] local-lis/les=16763/16764 n=2986 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16253) [35,17,1] r=2 lpr=16763 luod=0'0 crt=16787'13107529 lcod 16787'13107533 active] _scan_snaps no head for 7:dec0f335:::rbd_data.b0d052238e1f29.0000000000000883:b5 (have MIN) Sep 13 08:17:52 node1.ceph ceph-osd[22280]: 2017-09-13 08:17:52.817931 7f5975beb700 -1 osd.1 pg_epoch: 16787 pg[7.37b( v 16787'13107534 (16775'13104515,16787'13107534] local-lis/les=16763/16764 n=2986 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16253) [35,17,1] r=2 lpr=16763 luod=0'0 crt=16787'13107529 lcod 16787'13107533 active] _scan_snaps no head for 7:dec0f335:::rbd_data.b0d052238e1f29.0000000000000883:b4 (have MIN) Sep 13 08:17:52 node1.ceph ceph-osd[22280]: 2017-09-13 08:17:52.817942 7f5975beb700 -1 osd.1 pg_epoch: 16787 pg[7.37b( v 16787'13107534 (16775'13104515,16787'13107534] local-lis/les=16763/16764 n=2986 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16253) [35,17,1] r=2 lpr=16763 luod=0'0 crt=16787'13107529 lcod 16787'13107533 active] _scan_snaps no head for 7:dec0f335:::rbd_data.b0d052238e1f29.0000000000000883:b3 (have MIN) Sep 13 08:17:52 node1.ceph ceph-osd[22280]: 2017-09-13 08:17:52.817952 7f5975beb700 -1 osd.1 pg_epoch: 16787 pg[7.37b( v 16787'13107534 (16775'13104515,16787'13107534] local-lis/les=16763/16764 n=2986 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16253) [35,17,1] r=2 lpr=16763 luod=0'0 crt=16787'13107529 lcod 16787'13107533 active] _scan_snaps no head for 7:dec0f335:::rbd_data.b0d052238e1f29.0000000000000883:b2 (have MIN) Sep 13 08:17:52 node1.ceph ceph-osd[22280]: 2017-09-13 08:17:52.817962 7f5975beb700 -1 osd.1 pg_epoch: 16787 pg[7.37b( v 16787'13107534 (16775'13104515,16787'13107534] local-lis/les=16763/16764 n=2986 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16253) [35,17,1] r=2 lpr=16763 luod=0'0 crt=16787'13107529 lcod 16787'13107533 active] _scan_snaps no head for 7:dec0f335:::rbd_data.b0d052238e1f29.0000000000000883:b1 (have MIN) Sep 13 08:17:52 node1.ceph ceph-osd[22280]: 2017-09-13 08:17:52.817970 7f5975beb700 -1 osd.1 pg_epoch: 16787 pg[7.37b( v 16787'13107534 (16775'13104515,16787'13107534] local-lis/les=16763/16764 n=2986 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16253) [35,17,1] r=2 lpr=16763 luod=0'0 crt=16787'13107529 lcod 16787'13107533 active] _scan_snaps no head for 7:dec0f335:::rbd_data.b0d052238e1f29.0000000000000883:b0 (have MIN) Sep 13 08:17:52 node1.ceph ceph-osd[22280]: 2017-09-13 08:17:52.817979 7f5975beb700 -1 osd.1 pg_epoch: 16787 pg[7.37b( v 16787'13107534 (16775'13104515,16787'13107534] local-lis/les=16763/16764 n=2986 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16253) [35,17,1] r=2 lpr=16763 luod=0'0 crt=16787'13107529 lcod 16787'13107533 active] _scan_snaps no head for 7:dec0f335:::rbd_data.b0d052238e1f29.0000000000000883:ae (have MIN) Sep 13 08:18:09 node1.ceph ceph-osd[22280]: 2017-09-13 08:18:09.075964 7f5975beb700 -1 osd.1 pg_epoch: 16787 pg[7.37b( v 16787'13107553 (16775'13104515,16787'13107553] local-lis/les=16763/16764 n=2986 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16253) [35,17,1] r=2 lpr=16763 luod=0'0 crt=16787'13107549 lcod 16787'13107552 active] _scan_snaps no head for 7:dec499d1:::rbd_data.bd1c92ae8944a.000000000000531b:d2 (have MIN) Sep 13 08:20:01 node1.ceph ceph-osd[22280]: 2017-09-13 08:20:01.934771 7f5975beb700 -1 osd.1 pg_epoch: 16787 pg[7.37b( v 16787'13107779 (16775'13104727,16787'13107779] local-lis/les=16763/16764 n=2986 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16253) [35,17,1] r=2 lpr=16763 luod=0'0 crt=16787'13107775 lcod 16787'13107778 active] _scan_snaps no head for 7:dedcce04:::rbd_data.a74f60238e1f29.0000000000000cb8:cf (have MIN) Sep 13 08:20:01 node1.ceph ceph-osd[22280]: 2017-09-13 08:20:01.934805 7f5975beb700 -1 osd.1 pg_epoch: 16787 pg[7.37b( v 16787'13107779 (16775'13104727,16787'13107779] local-lis/les=16763/16764 n=2986 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16253) [35,17,1] r=2 lpr=16763 luod=0'0 crt=16787'13107775 lcod 16787'13107778 active] _scan_snaps no head for 7:dedcce04:::rbd_data.a74f60238e1f29.0000000000000cb8:9c (have MIN) Sep 13 08:21:10 node1.ceph ceph-osd[22280]: 2017-09-13 08:21:10.060652 7f5975beb700 -1 osd.1 pg_epoch: 16787 pg[7.37b( v 16787'13107983 (16775'13104930,16787'13107983] local-lis/les=16763/16764 n=2986 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16253) [35,17,1] r=2 lpr=16763 luod=0'0 crt=16787'13107980 lcod 16787'13107982 active] _scan_snaps no head for 7:deea204f:::rbd_data.a6351b238e1f29.00000000000191d3:9e (have MIN) Sep 13 08:21:16 node1.ceph ceph-osd[22280]: 2017-09-13 08:21:16.187556 7f5975beb700 -1 osd.1 pg_epoch: 16787 pg[7.37b( v 16787'13107989 (16775'13104930,16787'13107989] local-lis/les=16763/16764 n=2986 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16253) [35,17,1] r=2 lpr=16763 luod=0'0 crt=16787'13107986 lcod 16787'13107988 active] _scan_snaps no head for 7:deeae048:::rbd_data.8f8aad238e1f29.0000000000000964:54 (have MIN) Sep 13 08:22:24 node1.ceph ceph-osd[22280]: 2017-09-13 08:22:24.869024 7f5975beb700 -1 osd.1 pg_epoch: 16787 pg[7.37b( v 16787'13108083 (16775'13105031,16787'13108083] local-lis/les=16763/16764 n=2986 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16253) [35,17,1] r=2 lpr=16763 luod=0'0 crt=16787'13108077 lcod 16787'13108082 active] _scan_snaps no head for 7:def801aa:::rbd_data.bd1c92ae8944a.0000000000004e28:d2 (have MIN) Sep 13 08:24:04 node1.ceph ceph-osd[22280]: 2017-09-13 08:24:04.956624 7f59763ec700 -1 osd.1 pg_epoch: 16787 pg[7.15e( v 16787'5606808 (16731'5603737,16787'5606808] local-lis/les=16763/16764 n=2989 ec=104/104 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16763) [1,30,12] r=0 lpr=16763 crt=16787'5606808 lcod 16787'5606807 mlcod 16787'5606807 active+clean+scrubbing+deep] _scan_snaps no head for 7:7a8ef673:::rbd_data.68c683238e1f29.00000000000012a2:3d (have MIN) Sep 13 08:25:39 node1.ceph ceph-osd[22280]: 2017-09-13 08:25:39.511846 7f59763ec700 -1 osd.1 pg_epoch: 16787 pg[7.15e( v 16787'5606932 (16735'5603837,16787'5606932] local-lis/les=16763/16764 n=2989 ec=104/104 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16763) [1,30,12] r=0 lpr=16763 crt=16787'5606932 lcod 16787'5606931 mlcod 16787'5606931 active+clean+scrubbing+deep] _scan_snaps no head for 7:7aa434b0:::rbd_data.bd1c92ae8944a.000000000000217e:d4 (have MIN) Sep 13 08:25:39 node1.ceph ceph-osd[22280]: 2017-09-13 08:25:39.511899 7f59763ec700 -1 osd.1 pg_epoch: 16787 pg[7.15e( v 16787'5606932 (16735'5603837,16787'5606932] local-lis/les=16763/16764 n=2989 ec=104/104 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16763) [1,30,12] r=0 lpr=16763 crt=16787'5606932 lcod 16787'5606931 mlcod 16787'5606931 active+clean+scrubbing+deep] _scan_snaps no head for 7:7aa434b0:::rbd_data.bd1c92ae8944a.000000000000217e:d2 (have MIN) Sep 13 08:26:11 node1.ceph ceph-osd[22280]: 2017-09-13 08:26:11.352211 7f59763ec700 -1 osd.1 pg_epoch: 16787 pg[7.15e( v 16787'5606963 (16737'5603937,16787'5606963] local-lis/les=16763/16764 n=2989 ec=104/104 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16763) [1,30,12] r=0 lpr=16763 crt=16787'5606963 lcod 16787'5606962 mlcod 16787'5606962 active+clean+scrubbing+deep] _scan_snaps no head for 7:7aaa6b37:::rbd_data.32bc79238e1f29.000000000000064b:d (have MIN) Sep 13 08:26:35 node1.ceph ceph-osd[22280]: 2017-09-13 08:26:35.226147 7f59763ec700 -1 osd.1 pg_epoch: 16789 pg[7.15e( v 16789'5606990 (16737'5603937,16789'5606990] local-lis/les=16763/16764 n=2989 ec=104/104 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16763) [1,30,12] r=0 lpr=16763 crt=16789'5606990 lcod 16789'5606989 mlcod 16789'5606989 active+clean+scrubbing+deep] _scan_snaps no head for 7:7aaf8825:::rbd_data.bd1c92ae8944a.00000000000013c5:d2 (have MIN) Sep 13 08:29:46 node1.ceph ceph-osd[22280]: 2017-09-13 08:29:46.859043 7f5974be9700 -1 osd.1 pg_epoch: 16789 pg[8.332( v 16789'2397474 (16669'2394444,16789'2397474] local-lis/les=16763/16764 n=3346 ec=2548/2548 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16763) [1,9,27] r=0 lpr=16763 crt=16789'2397474 lcod 16789'2397473 mlcod 16789'2397473 active+clean+scrubbing] _scan_snaps no head for 8:4cd7329f:::rbd_data.9aca26238e1f29.0000000000003a0e:65 (have MIN) Sep 13 08:29:47 node1.ceph ceph-osd[22280]: 2017-09-13 08:29:47.983586 7f5974be9700 -1 osd.1 pg_epoch: 16789 pg[8.332( v 16789'2397474 (16669'2394444,16789'2397474] local-lis/les=16763/16764 n=3346 ec=2548/2548 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16763) [1,9,27] r=0 lpr=16763 crt=16789'2397474 lcod 16789'2397473 mlcod 16789'2397473 active+clean+scrubbing] _scan_snaps no head for 8:4cd8e0b9:::rbd_data.1443bb238e1f29.00000000000025c3:31 (have MIN) Sep 13 08:30:34 node1.ceph ceph-osd[22280]: 2017-09-13 08:30:34.779819 7f59743e8700 -1 osd.1 pg_epoch: 16789 pg[7.3d3( v 16789'4231588 (16741'4228556,16789'4231588] local-lis/les=16763/16765 n=3134 ec=2543/2543 lis/c 16763/16763 les/c/f 16765/16773/0 16763/16763/16763) [1,10,16] r=0 lpr=16763 crt=16789'4231588 lcod 16789'4231587 mlcod 16789'4231587 active+clean+scrubbing] _scan_snaps no head for 7:cbc19aea:::rbd_data.32bc79238e1f29.0000000000000221:2d (have MIN) Sep 13 08:30:37 node1.ceph ceph-osd[22280]: 2017-09-13 08:30:37.953940 7f59743e8700 -1 osd.1 pg_epoch: 16789 pg[7.3d3( v 16789'4231588 (16741'4228556,16789'4231588] local-lis/les=16763/16765 n=3134 ec=2543/2543 lis/c 16763/16763 les/c/f 16765/16773/0 16763/16763/16763) [1,10,16] r=0 lpr=16763 crt=16789'4231588 lcod 16789'4231587 mlcod 16789'4231587 active+clean+scrubbing] _scan_snaps no head for 7:cbc7ad48:::rbd_data.a6351b238e1f29.000000000001db8a:9e (have MIN) Sep 13 08:30:47 node1.ceph ceph-osd[22280]: 2017-09-13 08:30:47.863095 7f59743e8700 -1 osd.1 pg_epoch: 16789 pg[7.3d3( v 16789'4231590 (16741'4228556,16789'4231590] local-lis/les=16763/16765 n=3134 ec=2543/2543 lis/c 16763/16763 les/c/f 16765/16773/0 16763/16763/16763) [1,10,16] r=0 lpr=16763 crt=16789'4231590 lcod 16789'4231589 mlcod 16789'4231589 active+clean+scrubbing] _scan_snaps no head for 7:cbd50155:::rbd_data.bd1c92ae8944a.0000000000000b72:d2 (have MIN) Sep 13 08:30:54 node1.ceph ceph-osd[22280]: 2017-09-13 08:30:54.532042 7f59743e8700 -1 osd.1 pg_epoch: 16789 pg[7.3d3( v 16789'4231590 (16741'4228556,16789'4231590] local-lis/les=16763/16765 n=3134 ec=2543/2543 lis/c 16763/16763 les/c/f 16765/16773/0 16763/16763/16763) [1,10,16] r=0 lpr=16763 crt=16789'4231590 lcod 16789'4231589 mlcod 16789'4231589 active+clean+scrubbing] _scan_snaps no head for 7:cbde9470:::rbd_data.bd1c92ae8944a.0000000000000bf4:d4 (have MIN) Sep 13 08:30:54 node1.ceph ceph-osd[22280]: 2017-09-13 08:30:54.532074 7f59743e8700 -1 osd.1 pg_epoch: 16789 pg[7.3d3( v 16789'4231590 (16741'4228556,16789'4231590] local-lis/les=16763/16765 n=3134 ec=2543/2543 lis/c 16763/16763 les/c/f 16765/16773/0 16763/16763/16763) [1,10,16] r=0 lpr=16763 crt=16789'4231590 lcod 16789'4231589 mlcod 16789'4231589 active+clean+scrubbing] _scan_snaps no head for 7:cbde9470:::rbd_data.bd1c92ae8944a.0000000000000bf4:d2 (have MIN) Sep 13 08:31:01 node1.ceph ceph-osd[22280]: 2017-09-13 08:31:01.931321 7f59743e8700 -1 osd.1 pg_epoch: 16790 pg[7.3d3( v 16789'4231590 (16741'4228556,16789'4231590] local-lis/les=16763/16765 n=3134 ec=2543/2543 lis/c 16763/16763 les/c/f 16765/16773/0 16763/16763/16763) [1,10,16] r=0 lpr=16763 crt=16789'4231590 lcod 16789'4231589 mlcod 16789'4231589 active+clean+scrubbing] _scan_snaps no head for 7:cbeb7f4a:::rbd_data.bd1c92ae8944a.0000000000003db7:d4 (have MIN) Sep 13 08:31:04 node1.ceph ceph-osd[22280]: 2017-09-13 08:31:04.732225 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.3d3( v 16791'4231591 (16741'4228556,16791'4231591] local-lis/les=16763/16765 n=3134 ec=2543/2543 lis/c 16763/16763 les/c/f 16765/16773/0 16763/16763/16763) [1,10,16] r=0 lpr=16763 crt=16791'4231591 lcod 16789'4231590 mlcod 16789'4231590 active+clean+scrubbing] _scan_snaps no head for 7:cbef65b6:::rbd_data.a6351b238e1f29.000000000002a029:9e (have MIN) Sep 13 08:31:28 node1.ceph ceph-osd[22280]: 2017-09-13 08:31:28.971061 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.374( v 16791'6708284 (16743'6705199,16791'6708284] local-lis/les=16763/16764 n=3010 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16773/0 16763/16763/16763) [1,22,29] r=0 lpr=16763 crt=16791'6708284 lcod 16791'6708283 mlcod 16791'6708283 active+clean+scrubbing] _scan_snaps no head for 7:2ed4ee4e:::rbd_data.b0d052238e1f29.0000000000000158:b1 (have MIN) Sep 13 08:31:28 node1.ceph ceph-osd[22280]: 2017-09-13 08:31:28.971086 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.374( v 16791'6708284 (16743'6705199,16791'6708284] local-lis/les=16763/16764 n=3010 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16773/0 16763/16763/16763) [1,22,29] r=0 lpr=16763 crt=16791'6708284 lcod 16791'6708283 mlcod 16791'6708283 active+clean+scrubbing] _scan_snaps no head for 7:2ed4ee4e:::rbd_data.b0d052238e1f29.0000000000000158:b0 (have MIN) Sep 13 08:31:28 node1.ceph ceph-osd[22280]: 2017-09-13 08:31:28.971094 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.374( v 16791'6708284 (16743'6705199,16791'6708284] local-lis/les=16763/16764 n=3010 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16773/0 16763/16763/16763) [1,22,29] r=0 lpr=16763 crt=16791'6708284 lcod 16791'6708283 mlcod 16791'6708283 active+clean+scrubbing] _scan_snaps no head for 7:2ed4ee4e:::rbd_data.b0d052238e1f29.0000000000000158:ae (have MIN) Sep 13 08:31:36 node1.ceph ceph-osd[22280]: 2017-09-13 08:31:36.868790 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.374( v 16791'6708285 (16743'6705199,16791'6708285] local-lis/les=16763/16764 n=3010 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16773/0 16763/16763/16763) [1,22,29] r=0 lpr=16763 crt=16791'6708285 lcod 16791'6708284 mlcod 16791'6708284 active+clean+scrubbing] _scan_snaps no head for 7:2ee81536:::rbd_data.bd1c92ae8944a.0000000000000934:d2 (have MIN) Sep 13 08:31:37 node1.ceph ceph-osd[22280]: 2017-09-13 08:31:37.613167 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.374( v 16791'6708285 (16743'6705199,16791'6708285] local-lis/les=16763/16764 n=3010 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16773/0 16763/16763/16763) [1,22,29] r=0 lpr=16763 crt=16791'6708285 lcod 16791'6708284 mlcod 16791'6708284 active+clean+scrubbing] _scan_snaps no head for 7:2eea07b3:::rbd_data.bd1c92ae8944a.0000000000005577:d2 (have MIN) Sep 13 08:31:43 node1.ceph ceph-osd[22280]: 2017-09-13 08:31:43.049707 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.374( v 16791'6708286 (16743'6705199,16791'6708286] local-lis/les=16763/16764 n=3010 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16773/0 16763/16763/16763) [1,22,29] r=0 lpr=16763 crt=16791'6708286 lcod 16791'6708285 mlcod 16791'6708285 active+clean+scrubbing] _scan_snaps no head for 7:2ef4c808:::rbd_data.a74f60238e1f29.0000000000000e60:cf (have MIN) Sep 13 08:31:43 node1.ceph ceph-osd[22280]: 2017-09-13 08:31:43.049744 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.374( v 16791'6708286 (16743'6705199,16791'6708286] local-lis/les=16763/16764 n=3010 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16773/0 16763/16763/16763) [1,22,29] r=0 lpr=16763 crt=16791'6708286 lcod 16791'6708285 mlcod 16791'6708285 active+clean+scrubbing] _scan_snaps no head for 7:2ef4c808:::rbd_data.a74f60238e1f29.0000000000000e60:9c (have MIN) Sep 13 08:31:45 node1.ceph ceph-osd[22280]: 2017-09-13 08:31:45.193447 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.374( v 16791'6708287 (16743'6705199,16791'6708287] local-lis/les=16763/16764 n=3010 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16773/0 16763/16763/16763) [1,22,29] r=0 lpr=16763 crt=16791'6708287 lcod 16791'6708286 mlcod 16791'6708286 active+clean+scrubbing] _scan_snaps no head for 7:2ef8b1fc:::rbd_data.a6351b238e1f29.000000000001c84a:9e (have MIN) Sep 13 08:31:45 node1.ceph ceph-osd[22280]: 2017-09-13 08:31:45.489315 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.374( v 16791'6708287 (16743'6705199,16791'6708287] local-lis/les=16763/16764 n=3010 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16773/0 16763/16763/16763) [1,22,29] r=0 lpr=16763 crt=16791'6708287 lcod 16791'6708286 mlcod 16791'6708286 active+clean+scrubbing] _scan_snaps no head for 7:2ef96e92:::rbd_data.bd1c92ae8944a.0000000000000906:d2 (have MIN) Sep 13 08:31:46 node1.ceph ceph-osd[22280]: 2017-09-13 08:31:46.448673 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.374( v 16791'6708287 (16743'6705199,16791'6708287] local-lis/les=16763/16764 n=3010 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16773/0 16763/16763/16763) [1,22,29] r=0 lpr=16763 crt=16791'6708287 lcod 16791'6708286 mlcod 16791'6708286 active+clean+scrubbing] _scan_snaps no head for 7:2efbb499:::rbd_data.a6351b238e1f29.000000000001a27f:d1 (have MIN) Sep 13 08:31:46 node1.ceph ceph-osd[22280]: 2017-09-13 08:31:46.448708 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.374( v 16791'6708287 (16743'6705199,16791'6708287] local-lis/les=16763/16764 n=3010 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16773/0 16763/16763/16763) [1,22,29] r=0 lpr=16763 crt=16791'6708287 lcod 16791'6708286 mlcod 16791'6708286 active+clean+scrubbing] _scan_snaps no head for 7:2efbb499:::rbd_data.a6351b238e1f29.000000000001a27f:9e (have MIN) Sep 13 08:31:53 node1.ceph ceph-osd[22280]: 2017-09-13 08:31:53.195974 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.18c( v 16791'7838814 (16769'7835785,16791'7838814] local-lis/les=16763/16764 n=2972 ec=104/104 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16204) [14,39,1] r=2 lpr=16763 luod=0'0 crt=16791'7838812 lcod 16791'7838813 active] _scan_snaps no head for 7:31843e59:::rbd_data.a6351b238e1f29.0000000000025413:9e (have MIN) Sep 13 08:32:01 node1.ceph ceph-osd[22280]: 2017-09-13 08:32:01.397011 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.18c( v 16791'7838817 (16769'7835785,16791'7838817] local-lis/les=16763/16764 n=2972 ec=104/104 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16204) [14,39,1] r=2 lpr=16763 luod=0'0 crt=16791'7838815 lcod 16791'7838816 active] _scan_snaps no head for 7:3192045f:::rbd_data.bd1c92ae8944a.0000000000004939:d2 (have MIN) Sep 13 08:32:12 node1.ceph ceph-osd[22280]: 2017-09-13 08:32:12.888040 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.18c( v 16791'7838821 (16769'7835785,16791'7838821] local-lis/les=16763/16764 n=2972 ec=104/104 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16204) [14,39,1] r=2 lpr=16763 luod=0'0 crt=16791'7838819 lcod 16791'7838820 active] _scan_snaps no head for 7:31a1d41f:::rbd_data.a6351b238e1f29.0000000000020b71:9e (have MIN) Sep 13 08:32:17 node1.ceph ceph-osd[22280]: 2017-09-13 08:32:17.405489 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.18c( v 16791'7838823 (16769'7835785,16791'7838823] local-lis/les=16763/16764 n=2972 ec=104/104 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16204) [14,39,1] r=2 lpr=16763 luod=0'0 crt=16791'7838821 lcod 16791'7838822 active] _scan_snaps no head for 7:31a983ba:::rbd_data.bd1c92ae8944a.000000000000335e:d2 (have MIN) Sep 13 08:32:19 node1.ceph ceph-osd[22280]: 2017-09-13 08:32:19.387542 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.18c( v 16791'7838854 (16769'7835785,16791'7838854] local-lis/les=16763/16764 n=2972 ec=104/104 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16204) [14,39,1] r=2 lpr=16763 luod=0'0 crt=16791'7838822 lcod 16791'7838853 active] _scan_snaps no head for 7:31ac6645:::rbd_data.bd1c92ae8944a.0000000000001c3f:d4 (have MIN) Sep 13 08:37:23 node1.ceph ceph-osd[22280]: 2017-09-13 08:37:23.320735 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.30f( v 16791'6062983 (16715'6059946,16791'6062983] local-lis/les=16763/16764 n=3149 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,36,12] r=0 lpr=16763 crt=16791'6062983 lcod 16791'6062982 mlcod 16791'6062982 active+clean+scrubbing] _scan_snaps no head for 7:f0c20b02:::rbd_data.a6351b238e1f29.00000000000217bb:9e (have MIN) Sep 13 08:37:25 node1.ceph ceph-osd[22280]: 2017-09-13 08:37:25.306133 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.30f( v 16791'6062983 (16715'6059946,16791'6062983] local-lis/les=16763/16764 n=3149 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,36,12] r=0 lpr=16763 crt=16791'6062983 lcod 16791'6062982 mlcod 16791'6062982 active+clean+scrubbing] _scan_snaps no head for 7:f0c82432:::rbd_data.445028238e1f29.0000000000000e80:1f (have MIN) Sep 13 08:37:28 node1.ceph ceph-osd[22280]: 2017-09-13 08:37:28.134864 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.30f( v 16791'6062984 (16715'6059946,16791'6062984] local-lis/les=16763/16764 n=3149 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,36,12] r=0 lpr=16763 luod=16791'6062983 crt=16791'6062984 lcod 16791'6062982 mlcod 16791'6062982 active+clean+scrubbing] _scan_snaps no head for 7:f0cecf50:::rbd_data.a70641238e1f29.0000000000005e88:9d (have MIN) Sep 13 08:37:28 node1.ceph ceph-osd[22280]: 2017-09-13 08:37:28.296182 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.30f( v 16791'6062984 (16715'6059946,16791'6062984] local-lis/les=16763/16764 n=3149 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,36,12] r=0 lpr=16763 crt=16791'6062984 lcod 16791'6062983 mlcod 16791'6062983 active+clean+scrubbing] _scan_snaps no head for 7:f0cf3eda:::rbd_data.a6351b238e1f29.0000000000019913:9e (have MIN) Sep 13 08:37:30 node1.ceph ceph-osd[22280]: 2017-09-13 08:37:30.083467 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.30f( v 16791'6062984 (16715'6059946,16791'6062984] local-lis/les=16763/16764 n=3149 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,36,12] r=0 lpr=16763 crt=16791'6062984 lcod 16791'6062983 mlcod 16791'6062983 active+clean+scrubbing] _scan_snaps no head for 7:f0d50a17:::rbd_data.bd1c92ae8944a.00000000000036a1:d2 (have MIN) Sep 13 08:37:30 node1.ceph ceph-osd[22280]: 2017-09-13 08:37:30.509058 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.30f( v 16791'6062984 (16715'6059946,16791'6062984] local-lis/les=16763/16764 n=3149 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,36,12] r=0 lpr=16763 crt=16791'6062984 lcod 16791'6062983 mlcod 16791'6062983 active+clean+scrubbing] _scan_snaps no head for 7:f0d56cb9:::rbd_data.a70641238e1f29.000000000000723c:9d (have MIN) Sep 13 08:37:34 node1.ceph ceph-osd[22280]: 2017-09-13 08:37:34.617387 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.30f( v 16791'6062984 (16715'6059946,16791'6062984] local-lis/les=16763/16764 n=3149 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,36,12] r=0 lpr=16763 crt=16791'6062984 lcod 16791'6062983 mlcod 16791'6062983 active+clean+scrubbing] _scan_snaps no head for 7:f0dae811:::rbd_data.bd1c92ae8944a.0000000000000e5d:d4 (have MIN) Sep 13 08:37:34 node1.ceph ceph-osd[22280]: 2017-09-13 08:37:34.617422 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.30f( v 16791'6062984 (16715'6059946,16791'6062984] local-lis/les=16763/16764 n=3149 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,36,12] r=0 lpr=16763 crt=16791'6062984 lcod 16791'6062983 mlcod 16791'6062983 active+clean+scrubbing] _scan_snaps no head for 7:f0dae811:::rbd_data.bd1c92ae8944a.0000000000000e5d:d2 (have MIN) Sep 13 08:37:35 node1.ceph ceph-osd[22280]: 2017-09-13 08:37:35.208046 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.30f( v 16791'6062984 (16715'6059946,16791'6062984] local-lis/les=16763/16764 n=3149 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,36,12] r=0 lpr=16763 crt=16791'6062984 lcod 16791'6062983 mlcod 16791'6062983 active+clean+scrubbing] _scan_snaps no head for 7:f0dbacb1:::rbd_data.a6351b238e1f29.0000000000019155:9e (have MIN) Sep 13 08:37:44 node1.ceph ceph-osd[22280]: 2017-09-13 08:37:44.181295 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.30f( v 16791'6062984 (16715'6059946,16791'6062984] local-lis/les=16763/16764 n=3149 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,36,12] r=0 lpr=16763 crt=16791'6062984 lcod 16791'6062983 mlcod 16791'6062983 active+clean+scrubbing] _scan_snaps no head for 7:f0ede124:::rbd_data.a70641238e1f29.00000000000072f7:ce (have MIN) Sep 13 08:37:44 node1.ceph ceph-osd[22280]: 2017-09-13 08:37:44.181352 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.30f( v 16791'6062984 (16715'6059946,16791'6062984] local-lis/les=16763/16764 n=3149 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,36,12] r=0 lpr=16763 crt=16791'6062984 lcod 16791'6062983 mlcod 16791'6062983 active+clean+scrubbing] _scan_snaps no head for 7:f0ede124:::rbd_data.a70641238e1f29.00000000000072f7:9d (have MIN) Sep 13 08:43:24 node1.ceph ceph-osd[22280]: 2017-09-13 08:43:24.267353 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.3e1( v 16791'4506265 (16663'4503209,16791'4506265] local-lis/les=16763/16764 n=3019 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,8,19] r=0 lpr=16763 crt=16791'4506265 lcod 16791'4506264 mlcod 16791'4506264 active+clean+scrubbing] _scan_snaps no head for 7:87d812dc:::rbd_data.b07e94238e1f29.0000000000000d5f:80 (have MIN) Sep 13 08:43:30 node1.ceph ceph-osd[22280]: 2017-09-13 08:43:30.363663 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.3e1( v 16791'4506267 (16663'4503209,16791'4506267] local-lis/les=16763/16764 n=3019 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,8,19] r=0 lpr=16763 crt=16791'4506267 lcod 16791'4506266 mlcod 16791'4506266 active+clean+scrubbing] _scan_snaps no head for 7:87e0e1d0:::rbd_data.8f8aad238e1f29.000000000000054c:54 (have MIN) Sep 13 08:43:31 node1.ceph ceph-osd[22280]: 2017-09-13 08:43:31.045388 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.3e1( v 16791'4506270 (16663'4503209,16791'4506270] local-lis/les=16763/16764 n=3019 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,8,19] r=0 lpr=16763 luod=16791'4506268 crt=16791'4506270 lcod 16791'4506267 mlcod 16791'4506267 active+clean+scrubbing] _scan_snaps no head for 7:87e1cf52:::rbd_data.a70641238e1f29.000000000000713d:9d (have MIN) Sep 13 08:43:32 node1.ceph ceph-osd[22280]: 2017-09-13 08:43:32.477267 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.3e1( v 16791'4506276 (16663'4503209,16791'4506276] local-lis/les=16763/16764 n=3019 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,8,19] r=0 lpr=16763 crt=16791'4506276 lcod 16791'4506275 mlcod 16791'4506275 active+clean+scrubbing] _scan_snaps no head for 7:87e4d815:::rbd_data.b0d052238e1f29.000000000000011b:b2 (have MIN) Sep 13 08:43:32 node1.ceph ceph-osd[22280]: 2017-09-13 08:43:32.477296 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.3e1( v 16791'4506276 (16663'4503209,16791'4506276] local-lis/les=16763/16764 n=3019 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,8,19] r=0 lpr=16763 crt=16791'4506276 lcod 16791'4506275 mlcod 16791'4506275 active+clean+scrubbing] _scan_snaps no head for 7:87e4d815:::rbd_data.b0d052238e1f29.000000000000011b:b1 (have MIN) Sep 13 08:43:32 node1.ceph ceph-osd[22280]: 2017-09-13 08:43:32.477306 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.3e1( v 16791'4506276 (16663'4503209,16791'4506276] local-lis/les=16763/16764 n=3019 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,8,19] r=0 lpr=16763 crt=16791'4506276 lcod 16791'4506275 mlcod 16791'4506275 active+clean+scrubbing] _scan_snaps no head for 7:87e4d815:::rbd_data.b0d052238e1f29.000000000000011b:b0 (have MIN) Sep 13 08:43:32 node1.ceph ceph-osd[22280]: 2017-09-13 08:43:32.477315 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.3e1( v 16791'4506276 (16663'4503209,16791'4506276] local-lis/les=16763/16764 n=3019 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,8,19] r=0 lpr=16763 crt=16791'4506276 lcod 16791'4506275 mlcod 16791'4506275 active+clean+scrubbing] _scan_snaps no head for 7:87e4d815:::rbd_data.b0d052238e1f29.000000000000011b:ae (have MIN) Sep 13 08:43:45 node1.ceph ceph-osd[22280]: 2017-09-13 08:43:45.144675 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.3e1( v 16791'4506280 (16663'4503209,16791'4506280] local-lis/les=16763/16764 n=3019 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,8,19] r=0 lpr=16763 crt=16791'4506280 lcod 16791'4506279 mlcod 16791'4506279 active+clean+scrubbing] _scan_snaps no head for 7:87f6c1d3:::rbd_data.8f8aad238e1f29.000000000000002d:54 (have MIN) Sep 13 08:43:58 node1.ceph ceph-osd[22280]: 2017-09-13 08:43:58.331258 7f59753ea700 -1 osd.1 pg_epoch: 16791 pg[7.156( v 16791'14526044 (16781'14523038,16791'14526044] local-lis/les=16763/16764 n=3058 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16763) [1,22,27] r=0 lpr=16763 crt=16791'14526044 lcod 16791'14526043 mlcod 16791'14526043 active+clean+scrubbing] _scan_snaps no head for 7:6a824209:::rbd_data.a6351b238e1f29.0000000000000221:9e (have MIN) Sep 13 08:44:03 node1.ceph ceph-osd[22280]: 2017-09-13 08:44:03.072958 7f59753ea700 -1 osd.1 pg_epoch: 16791 pg[7.156( v 16791'14526047 (16781'14523038,16791'14526047] local-lis/les=16763/16764 n=3058 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16763) [1,22,27] r=0 lpr=16763 luod=16791'14526045 lua=16791'14526045 crt=16791'14526047 lcod 16791'14526044 mlcod 16791'14526044 active+clean+scrubbing] _scan_snaps no head for 7:6a8eef58:::rbd_data.c1ebe8238e1f29.0000000000002ed8:df (have MIN) Sep 13 08:44:07 node1.ceph ceph-osd[22280]: 2017-09-13 08:44:07.154219 7f59753ea700 -1 osd.1 pg_epoch: 16791 pg[7.156( v 16791'14526056 (16781'14523038,16791'14526056] local-lis/les=16763/16764 n=3058 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16763) [1,22,27] r=0 lpr=16763 crt=16791'14526056 lcod 16791'14526055 mlcod 16791'14526055 active+clean+scrubbing] _scan_snaps no head for 7:6a97acf7:::rbd_data.a6351b238e1f29.00000000000192c5:d1 (have MIN) Sep 13 08:44:07 node1.ceph ceph-osd[22280]: 2017-09-13 08:44:07.154250 7f59753ea700 -1 osd.1 pg_epoch: 16791 pg[7.156( v 16791'14526056 (16781'14523038,16791'14526056] local-lis/les=16763/16764 n=3058 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16763) [1,22,27] r=0 lpr=16763 crt=16791'14526056 lcod 16791'14526055 mlcod 16791'14526055 active+clean+scrubbing] _scan_snaps no head for 7:6a97acf7:::rbd_data.a6351b238e1f29.00000000000192c5:9e (have MIN) Sep 13 08:44:12 node1.ceph ceph-osd[22280]: 2017-09-13 08:44:12.250366 7f59753ea700 -1 osd.1 pg_epoch: 16791 pg[7.156( v 16791'14526060 (16781'14523038,16791'14526060] local-lis/les=16763/16764 n=3058 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16763) [1,22,27] r=0 lpr=16763 crt=16791'14526060 lcod 16791'14526059 mlcod 16791'14526059 active+clean+scrubbing] _scan_snaps no head for 7:6aa2e7ed:::rbd_data.32bc79238e1f29.00000000000005ae:2d (have MIN) Sep 13 08:44:12 node1.ceph ceph-osd[22280]: 2017-09-13 08:44:12.250395 7f59753ea700 -1 osd.1 pg_epoch: 16791 pg[7.156( v 16791'14526060 (16781'14523038,16791'14526060] local-lis/les=16763/16764 n=3058 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16763) [1,22,27] r=0 lpr=16763 crt=16791'14526060 lcod 16791'14526059 mlcod 16791'14526059 active+clean+scrubbing] _scan_snaps no head for 7:6aa2e7ed:::rbd_data.32bc79238e1f29.00000000000005ae:d (have MIN) Sep 13 08:44:16 node1.ceph ceph-osd[22280]: 2017-09-13 08:44:16.713502 7f59753ea700 -1 osd.1 pg_epoch: 16791 pg[7.156( v 16791'14526060 (16781'14523038,16791'14526060] local-lis/les=16763/16764 n=3058 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16763) [1,22,27] r=0 lpr=16763 crt=16791'14526060 lcod 16791'14526059 mlcod 16791'14526059 active+clean+scrubbing] _scan_snaps no head for 7:6aa73018:::rbd_data.bd1c92ae8944a.00000000000002f9:d4 (have MIN) Sep 13 08:44:16 node1.ceph ceph-osd[22280]: 2017-09-13 08:44:16.713529 7f59753ea700 -1 osd.1 pg_epoch: 16791 pg[7.156( v 16791'14526060 (16781'14523038,16791'14526060] local-lis/les=16763/16764 n=3058 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16763) [1,22,27] r=0 lpr=16763 crt=16791'14526060 lcod 16791'14526059 mlcod 16791'14526059 active+clean+scrubbing] _scan_snaps no head for 7:6aa73018:::rbd_data.bd1c92ae8944a.00000000000002f9:d2 (have MIN) Sep 13 08:44:20 node1.ceph ceph-osd[22280]: 2017-09-13 08:44:20.444141 7f59753ea700 -1 osd.1 pg_epoch: 16791 pg[7.156( v 16791'14526060 (16781'14523038,16791'14526060] local-lis/les=16763/16764 n=3058 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16763) [1,22,27] r=0 lpr=16763 crt=16791'14526060 lcod 16791'14526059 mlcod 16791'14526059 active+clean+scrubbing] _scan_snaps no head for 7:6aafe33b:::rbd_data.a6351b238e1f29.000000000002964b:9e (have MIN) Sep 13 08:44:21 node1.ceph ceph-osd[22280]: 2017-09-13 08:44:21.151752 7f59753ea700 -1 osd.1 pg_epoch: 16791 pg[7.156( v 16791'14526060 (16781'14523038,16791'14526060] local-lis/les=16763/16764 n=3058 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16763) [1,22,27] r=0 lpr=16763 crt=16791'14526060 lcod 16791'14526059 mlcod 16791'14526059 active+clean+scrubbing] _scan_snaps no head for 7:6ab18373:::rbd_data.bd1c92ae8944a.00000000000022bd:d2 (have MIN) Sep 13 08:44:22 node1.ceph ceph-osd[22280]: 2017-09-13 08:44:22.507119 7f59753ea700 -1 osd.1 pg_epoch: 16791 pg[7.156( v 16791'14526060 (16781'14523038,16791'14526060] local-lis/les=16763/16764 n=3058 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16763) [1,22,27] r=0 lpr=16763 crt=16791'14526060 lcod 16791'14526059 mlcod 16791'14526059 active+clean+scrubbing] _scan_snaps no head for 7:6ab3e267:::rbd_data.a70641238e1f29.000000000000672f:ce (have MIN) Sep 13 08:45:34 node1.ceph ceph-osd[22280]: 2017-09-13 08:45:34.030749 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.13a( v 16791'7213742 (16727'7210691,16791'7213742] local-lis/les=16763/16765 n=3045 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16239) [29,21,1] r=2 lpr=16763 luod=0'0 crt=16791'7213740 lcod 16791'7213741 active] _scan_snaps no head for 7:5c8078a4:::rbd_data.bd1c92ae8944a.00000000000018e0:d4 (have MIN) Sep 13 08:45:34 node1.ceph ceph-osd[22280]: 2017-09-13 08:45:34.030786 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.13a( v 16791'7213742 (16727'7210691,16791'7213742] local-lis/les=16763/16765 n=3045 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16239) [29,21,1] r=2 lpr=16763 luod=0'0 crt=16791'7213740 lcod 16791'7213741 active] _scan_snaps no head for 7:5c8078a4:::rbd_data.bd1c92ae8944a.00000000000018e0:d2 (have MIN) Sep 13 08:45:36 node1.ceph ceph-osd[22280]: 2017-09-13 08:45:36.838360 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.13a( v 16791'7213742 (16727'7210691,16791'7213742] local-lis/les=16763/16765 n=3045 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16239) [29,21,1] r=2 lpr=16763 luod=0'0 crt=16791'7213740 lcod 16791'7213741 active] _scan_snaps no head for 7:5c866acf:::rbd_data.32bc79238e1f29.0000000000000b89:d (have MIN) Sep 13 08:45:45 node1.ceph ceph-osd[22280]: 2017-09-13 08:45:45.419450 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.13a( v 16791'7213744 (16727'7210691,16791'7213744] local-lis/les=16763/16765 n=3045 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16239) [29,21,1] r=2 lpr=16763 luod=0'0 crt=16791'7213742 lcod 16791'7213743 active] _scan_snaps no head for 7:5c9985bf:::rbd_data.bd1c92ae8944a.0000000000000d93:d4 (have MIN) Sep 13 08:45:45 node1.ceph ceph-osd[22280]: 2017-09-13 08:45:45.419475 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.13a( v 16791'7213744 (16727'7210691,16791'7213744] local-lis/les=16763/16765 n=3045 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16239) [29,21,1] r=2 lpr=16763 luod=0'0 crt=16791'7213742 lcod 16791'7213743 active] _scan_snaps no head for 7:5c9985bf:::rbd_data.bd1c92ae8944a.0000000000000d93:d2 (have MIN) Sep 13 08:45:52 node1.ceph ceph-osd[22280]: 2017-09-13 08:45:52.588907 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.13a( v 16791'7213747 (16727'7210691,16791'7213747] local-lis/les=16763/16765 n=3045 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16239) [29,21,1] r=2 lpr=16763 luod=0'0 crt=16791'7213745 lcod 16791'7213746 active] _scan_snaps no head for 7:5ca3b93d:::rbd_data.a70641238e1f29.00000000000066f1:ce (have MIN) Sep 13 08:45:58 node1.ceph ceph-osd[22280]: 2017-09-13 08:45:58.735252 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.13a( v 16791'7213749 (16727'7210691,16791'7213749] local-lis/les=16763/16765 n=3045 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16239) [29,21,1] r=2 lpr=16763 luod=0'0 crt=16791'7213747 lcod 16791'7213748 active] _scan_snaps no head for 7:5caf2dc3:::rbd_data.b0d052238e1f29.0000000000000784:ae (have MIN) Sep 13 08:46:01 node1.ceph ceph-osd[22280]: 2017-09-13 08:46:01.688069 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.13a( v 16791'7213749 (16727'7210691,16791'7213749] local-lis/les=16763/16765 n=3045 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16239) [29,21,1] r=2 lpr=16763 luod=0'0 crt=16791'7213747 lcod 16791'7213748 active] _scan_snaps no head for 7:5cb43df8:::rbd_data.a6351b238e1f29.0000000000024a50:9e (have MIN) Sep 13 08:46:07 node1.ceph ceph-osd[22280]: 2017-09-13 08:46:07.063255 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.13a( v 16791'7213749 (16727'7210691,16791'7213749] local-lis/les=16763/16765 n=3045 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16239) [29,21,1] r=2 lpr=16763 luod=0'0 crt=16791'7213747 lcod 16791'7213748 active] _scan_snaps no head for 7:5cbf4d5b:::rbd_data.b0d052238e1f29.00000000000010ad:ae (have MIN) Sep 13 08:46:07 node1.ceph ceph-osd[22280]: 2017-09-13 08:46:07.280579 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.13a( v 16791'7213750 (16727'7210691,16791'7213750] local-lis/les=16763/16765 n=3045 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16239) [29,21,1] r=2 lpr=16763 luod=0'0 crt=16791'7213748 lcod 16791'7213749 active] _scan_snaps no head for 7:5cbfc4b7:::rbd_data.32bc79238e1f29.0000000000000b14:2d (have MIN) Sep 13 08:54:12 node1.ceph ceph-osd[22280]: 2017-09-13 08:54:12.644649 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[8.3a5( v 16791'2150495 (16601'2147436,16791'2150495] local-lis/les=16763/16764 n=3371 ec=2548/2548 lis/c 16763/16763 les/c/f 16764/16764/0 16763/16763/16763) [1,16,31] r=0 lpr=16763 crt=16791'2150495 lcod 16791'2150494 mlcod 16791'2150494 active+clean+scrubbing] _scan_snaps no head for 8:a5c496c0:::rbd_data.9aca26238e1f29.0000000000004d6d:65 (have MIN) Sep 13 09:09:09 node1.ceph ceph-osd[22280]: 2017-09-13 09:09:09.089243 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[8.254( v 16791'2076225 (16650'2073136,16791'2076225] local-lis/les=16763/16764 n=3425 ec=2548/2548 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,11,37] r=0 lpr=16763 crt=16791'2076225 lcod 16791'2076224 mlcod 16791'2076224 active+clean+scrubbing+deep] _scan_snaps no head for 8:2a439484:::rbd_data.9aca26238e1f29.0000000000001219:65 (have MIN) Sep 13 09:11:14 node1.ceph ceph-osd[22280]: 2017-09-13 09:11:14.246755 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[8.254( v 16791'2076413 (16675'2073336,16791'2076413] local-lis/les=16763/16764 n=3425 ec=2548/2548 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,11,37] r=0 lpr=16763 crt=16791'2076413 lcod 16791'2076412 mlcod 16791'2076412 active+clean+scrubbing+deep] _scan_snaps no head for 8:2a561d35:::rbd_data.9aca26238e1f29.000000000000619d:65 (have MIN) Sep 13 09:15:01 node1.ceph ceph-osd[22280]: 2017-09-13 09:15:01.379266 7f59753ea700 -1 osd.1 pg_epoch: 16791 pg[7.1bf( v 16791'4820677 (16737'4817643,16791'4820677] local-lis/les=16763/16764 n=2956 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16226) [32,23,1] r=2 lpr=16763 luod=0'0 crt=16791'4820675 lcod 16791'4820676 active] _scan_snaps no head for 7:fd85eb2f:::rbd_data.a6351b238e1f29.0000000000025275:9e (have MIN) Sep 13 09:15:12 node1.ceph ceph-osd[22280]: 2017-09-13 09:15:12.612710 7f59753ea700 -1 osd.1 pg_epoch: 16791 pg[7.1bf( v 16791'4820677 (16737'4817643,16791'4820677] local-lis/les=16763/16764 n=2956 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16226) [32,23,1] r=2 lpr=16763 luod=0'0 crt=16791'4820675 lcod 16791'4820676 active] _scan_snaps no head for 7:fda0cb01:::rbd_data.a6351b238e1f29.00000000000252e4:9e (have MIN) Sep 13 09:15:19 node1.ceph ceph-osd[22280]: 2017-09-13 09:15:19.617474 7f59753ea700 -1 osd.1 pg_epoch: 16791 pg[7.1bf( v 16791'4820679 (16737'4817643,16791'4820679] local-lis/les=16763/16764 n=2956 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16226) [32,23,1] r=2 lpr=16763 luod=0'0 crt=16791'4820676 lcod 16791'4820678 active] _scan_snaps no head for 7:fdaea0e2:::rbd_data.bd1c92ae8944a.0000000000001416:d2 (have MIN) Sep 13 09:19:36 node1.ceph ceph-osd[22280]: 2017-09-13 09:19:36.385840 7f59763ec700 -1 osd.1 pg_epoch: 16791 pg[8.af( v 16791'1834727 (16497'1831685,16791'1834727] local-lis/les=16763/16764 n=3428 ec=107/107 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,36,8] r=0 lpr=16763 crt=16791'1834727 lcod 16791'1834726 mlcod 16791'1834726 active+clean+scrubbing] _scan_snaps no head for 8:f52ae795:::rbd_data.1443bb238e1f29.0000000000001ce8:31 (have MIN) Sep 13 09:26:33 node1.ceph ceph-osd[22280]: 2017-09-13 09:26:33.483226 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.3ce( v 16791'4937141 (16741'4934045,16791'4937141] local-lis/les=16763/16764 n=3028 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,15,23] r=0 lpr=16763 crt=16791'4937141 lcod 16791'4937140 mlcod 16791'4937140 active+clean+scrubbing] _scan_snaps no head for 7:73d33fff:::rbd_data.a6351b238e1f29.000000000001962e:9e (have MIN) Sep 13 09:26:45 node1.ceph ceph-osd[22280]: 2017-09-13 09:26:45.123375 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.3ce( v 16791'4937141 (16741'4934045,16791'4937141] local-lis/les=16763/16764 n=3028 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,15,23] r=0 lpr=16763 crt=16791'4937141 lcod 16791'4937140 mlcod 16791'4937140 active+clean+scrubbing] _scan_snaps no head for 7:73e6e8c5:::rbd_data.a70641238e1f29.00000000000055e6:ce (have MIN) Sep 13 09:26:47 node1.ceph ceph-osd[22280]: 2017-09-13 09:26:47.935323 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.3ce( v 16791'4937141 (16741'4934045,16791'4937141] local-lis/les=16763/16764 n=3028 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,15,23] r=0 lpr=16763 crt=16791'4937141 lcod 16791'4937140 mlcod 16791'4937140 active+clean+scrubbing] _scan_snaps no head for 7:73eef84a:::rbd_data.bd1c92ae8944a.00000000000035f1:d4 (have MIN) Sep 13 09:26:47 node1.ceph ceph-osd[22280]: 2017-09-13 09:26:47.935360 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.3ce( v 16791'4937141 (16741'4934045,16791'4937141] local-lis/les=16763/16764 n=3028 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,15,23] r=0 lpr=16763 crt=16791'4937141 lcod 16791'4937140 mlcod 16791'4937140 active+clean+scrubbing] _scan_snaps no head for 7:73eef84a:::rbd_data.bd1c92ae8944a.00000000000035f1:d2 (have MIN) Sep 13 09:26:52 node1.ceph ceph-osd[22280]: 2017-09-13 09:26:52.761997 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.3ce( v 16791'4937141 (16741'4934045,16791'4937141] local-lis/les=16763/16764 n=3028 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,15,23] r=0 lpr=16763 crt=16791'4937141 lcod 16791'4937140 mlcod 16791'4937140 active+clean+scrubbing] _scan_snaps no head for 7:73f9999b:::rbd_data.a6351b238e1f29.000000000001d7ce:9e (have MIN) Sep 13 09:28:41 node1.ceph ceph-osd[22280]: 2017-09-13 09:28:41.320603 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.1( v 16791'10284555 (16791'10281520,16791'10284555] local-lis/les=16763/16764 n=3025 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16425) [25,1,14] r=1 lpr=16763 luod=0'0 crt=16791'10284552 lcod 16791'10284554 active] _scan_snaps no head for 7:80036b8e:::rbd_data.bd1c92ae8944a.000000000000619d:d2 (have MIN) Sep 13 09:28:43 node1.ceph ceph-osd[22280]: 2017-09-13 09:28:43.572615 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.1( v 16791'10284555 (16791'10281520,16791'10284555] local-lis/les=16763/16764 n=3025 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16425) [25,1,14] r=1 lpr=16763 luod=0'0 crt=16791'10284552 lcod 16791'10284554 active] _scan_snaps no head for 7:8007e8d6:::rbd_data.a6351b238e1f29.000000000001e7e1:9e (have MIN) Sep 13 09:28:46 node1.ceph ceph-osd[22280]: 2017-09-13 09:28:46.025651 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.1( v 16791'10284557 (16791'10281520,16791'10284557] local-lis/les=16763/16764 n=3025 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16425) [25,1,14] r=1 lpr=16763 luod=0'0 crt=16791'10284555 lcod 16791'10284556 active] _scan_snaps no head for 7:80102e16:::rbd_data.a6351b238e1f29.0000000000019c15:9e (have MIN) Sep 13 09:28:46 node1.ceph ceph-osd[22280]: 2017-09-13 09:28:46.808182 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.1( v 16791'10284557 (16791'10281520,16791'10284557] local-lis/les=16763/16764 n=3025 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16425) [25,1,14] r=1 lpr=16763 luod=0'0 crt=16791'10284555 lcod 16791'10284556 active] _scan_snaps no head for 7:80117272:::rbd_data.b0d052238e1f29.0000000000000a82:b5 (have MIN) Sep 13 09:28:46 node1.ceph ceph-osd[22280]: 2017-09-13 09:28:46.808217 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.1( v 16791'10284557 (16791'10281520,16791'10284557] local-lis/les=16763/16764 n=3025 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16425) [25,1,14] r=1 lpr=16763 luod=0'0 crt=16791'10284555 lcod 16791'10284556 active] _scan_snaps no head for 7:80117272:::rbd_data.b0d052238e1f29.0000000000000a82:b4 (have MIN) Sep 13 09:28:46 node1.ceph ceph-osd[22280]: 2017-09-13 09:28:46.808229 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.1( v 16791'10284557 (16791'10281520,16791'10284557] local-lis/les=16763/16764 n=3025 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16425) [25,1,14] r=1 lpr=16763 luod=0'0 crt=16791'10284555 lcod 16791'10284556 active] _scan_snaps no head for 7:80117272:::rbd_data.b0d052238e1f29.0000000000000a82:b3 (have MIN) Sep 13 09:28:46 node1.ceph ceph-osd[22280]: 2017-09-13 09:28:46.808239 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.1( v 16791'10284557 (16791'10281520,16791'10284557] local-lis/les=16763/16764 n=3025 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16425) [25,1,14] r=1 lpr=16763 luod=0'0 crt=16791'10284555 lcod 16791'10284556 active] _scan_snaps no head for 7:80117272:::rbd_data.b0d052238e1f29.0000000000000a82:b2 (have MIN) Sep 13 09:28:46 node1.ceph ceph-osd[22280]: 2017-09-13 09:28:46.808252 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.1( v 16791'10284557 (16791'10281520,16791'10284557] local-lis/les=16763/16764 n=3025 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16425) [25,1,14] r=1 lpr=16763 luod=0'0 crt=16791'10284555 lcod 16791'10284556 active] _scan_snaps no head for 7:80117272:::rbd_data.b0d052238e1f29.0000000000000a82:b1 (have MIN) Sep 13 09:28:46 node1.ceph ceph-osd[22280]: 2017-09-13 09:28:46.808261 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.1( v 16791'10284557 (16791'10281520,16791'10284557] local-lis/les=16763/16764 n=3025 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16425) [25,1,14] r=1 lpr=16763 luod=0'0 crt=16791'10284555 lcod 16791'10284556 active] _scan_snaps no head for 7:80117272:::rbd_data.b0d052238e1f29.0000000000000a82:b0 (have MIN) Sep 13 09:28:46 node1.ceph ceph-osd[22280]: 2017-09-13 09:28:46.808271 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.1( v 16791'10284557 (16791'10281520,16791'10284557] local-lis/les=16763/16764 n=3025 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16425) [25,1,14] r=1 lpr=16763 luod=0'0 crt=16791'10284555 lcod 16791'10284556 active] _scan_snaps no head for 7:80117272:::rbd_data.b0d052238e1f29.0000000000000a82:ae (have MIN) Sep 13 09:28:46 node1.ceph ceph-osd[22280]: 2017-09-13 09:28:46.808280 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.1( v 16791'10284557 (16791'10281520,16791'10284557] local-lis/les=16763/16764 n=3025 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16425) [25,1,14] r=1 lpr=16763 luod=0'0 crt=16791'10284555 lcod 16791'10284556 active] _scan_snaps no head for 7:80117272:::rbd_data.b0d052238e1f29.0000000000000a82:ad (have MIN) Sep 13 09:28:51 node1.ceph ceph-osd[22280]: 2017-09-13 09:28:51.280326 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.1( v 16791'10284559 (16791'10281520,16791'10284559] local-lis/les=16763/16764 n=3025 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16425) [25,1,14] r=1 lpr=16763 luod=0'0 crt=16791'10284557 lcod 16791'10284558 active] _scan_snaps no head for 7:801d1b9a:::rbd_data.bd1c92ae8944a.00000000000065e9:d2 (have MIN) Sep 13 09:28:59 node1.ceph ceph-osd[22280]: 2017-09-13 09:28:59.750463 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.1( v 16791'10284566 (16791'10281520,16791'10284566] local-lis/les=16763/16764 n=3025 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16425) [25,1,14] r=1 lpr=16763 luod=0'0 crt=16791'10284562 lcod 16791'10284565 active] _scan_snaps no head for 7:802e5049:::rbd_data.b07e94238e1f29.000000000000094f:80 (have MIN) Sep 13 09:29:01 node1.ceph ceph-osd[22280]: 2017-09-13 09:29:01.575053 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.1( v 16791'10284566 (16791'10281520,16791'10284566] local-lis/les=16763/16764 n=3025 ec=104/104 lis/c 16763/16763 les/c/f 16764/16767/0 16763/16763/16425) [25,1,14] r=1 lpr=16763 luod=0'0 crt=16791'10284562 lcod 16791'10284565 active] _scan_snaps no head for 7:80329dfb:::rbd_data.a6351b238e1f29.0000000000026792:9e (have MIN) Sep 13 09:32:22 node1.ceph ceph-osd[22280]: 2017-09-13 09:32:22.700223 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[8.2a1( v 16791'2447875 (16689'2444779,16791'2447875] local-lis/les=16772/16773 n=3336 ec=2548/2548 lis/c 16772/16772 les/c/f 16773/16773/0 16763/16772/16244) [39,1,20] r=1 lpr=16772 luod=0'0 crt=16791'2447867 lcod 16791'2447874 active] _scan_snaps no head for 8:8549df84:::rbd_data.1443bb238e1f29.00000000000021b2:31 (have MIN) Sep 13 09:47:19 node1.ceph ceph-osd[22280]: 2017-09-13 09:47:19.832912 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[8.2a4( v 16791'2203571 (16669'2200554,16791'2203571] local-lis/les=16763/16764 n=3328 ec=2548/2548 lis/c 16763/16763 les/c/f 16764/16765/0 16763/16763/16223) [27,1,24] r=1 lpr=16763 luod=0'0 crt=16791'2203561 lcod 16791'2203570 active] _scan_snaps no head for 8:2561959f:::rbd_data.1443bb238e1f29.0000000000001da1:31 (have MIN) Sep 13 09:47:59 node1.ceph ceph-osd[22280]: 2017-09-13 09:47:59.208298 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[8.2a4( v 16791'2203653 (16669'2200554,16791'2203653] local-lis/les=16763/16764 n=3328 ec=2548/2548 lis/c 16763/16763 les/c/f 16764/16765/0 16763/16763/16223) [27,1,24] r=1 lpr=16763 luod=0'0 crt=16791'2203647 lcod 16791'2203652 active] _scan_snaps no head for 8:256a31f1:::rbd_data.9aca26238e1f29.0000000000003b8e:65 (have MIN) Sep 13 09:54:31 node1.ceph ceph-osd[22280]: 2017-09-13 09:54:31.183338 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.c2( v 16791'12892983 (16791'12889919,16791'12892983] local-lis/les=16763/16764 n=3053 ec=104/104 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,17,36] r=0 lpr=16763 crt=16791'12892983 lcod 16791'12892982 mlcod 16791'12892982 active+clean+scrubbing+deep] _scan_snaps no head for 7:4309557b:::rbd_data.a6351b238e1f29.00000000000208b5:9e (have MIN) Sep 13 09:55:30 node1.ceph ceph-osd[22280]: 2017-09-13 09:55:30.577598 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.c2( v 16791'12893080 (16791'12890019,16791'12893080] local-lis/les=16763/16764 n=3053 ec=104/104 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,17,36] r=0 lpr=16763 crt=16791'12893080 lcod 16791'12893079 mlcod 16791'12893079 active+clean+scrubbing+deep] _scan_snaps no head for 7:4315fbef:::rbd_data.bd1c92ae8944a.000000000000110e:d2 (have MIN) Sep 13 09:56:39 node1.ceph ceph-osd[22280]: 2017-09-13 09:56:39.484224 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.c2( v 16791'12893223 (16791'12890219,16791'12893223] local-lis/les=16763/16764 n=3053 ec=104/104 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,17,36] r=0 lpr=16763 crt=16791'12893223 lcod 16791'12893222 mlcod 16791'12893222 active+clean+scrubbing+deep] _scan_snaps no head for 7:4324039a:::rbd_data.a6351b238e1f29.0000000000022252:9e (have MIN) Sep 13 09:56:43 node1.ceph ceph-osd[22280]: 2017-09-13 09:56:43.215301 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.c2( v 16791'12893228 (16791'12890219,16791'12893228] local-lis/les=16763/16764 n=3053 ec=104/104 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,17,36] r=0 lpr=16763 crt=16791'12893228 lcod 16791'12893227 mlcod 16791'12893227 active+clean+scrubbing+deep] _scan_snaps no head for 7:43250808:::rbd_data.bd1c92ae8944a.0000000000002f9a:d4 (have MIN) Sep 13 09:56:43 node1.ceph ceph-osd[22280]: 2017-09-13 09:56:43.215335 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.c2( v 16791'12893228 (16791'12890219,16791'12893228] local-lis/les=16763/16764 n=3053 ec=104/104 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,17,36] r=0 lpr=16763 crt=16791'12893228 lcod 16791'12893227 mlcod 16791'12893227 active+clean+scrubbing+deep] _scan_snaps no head for 7:43250808:::rbd_data.bd1c92ae8944a.0000000000002f9a:d2 (have MIN) Sep 13 09:58:06 node1.ceph ceph-osd[22280]: 2017-09-13 09:58:06.933982 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.c2( v 16791'12893475 (16791'12890419,16791'12893475] local-lis/les=16763/16764 n=3053 ec=104/104 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,17,36] r=0 lpr=16763 crt=16791'12893475 lcod 16791'12893474 mlcod 16791'12893474 active+clean+scrubbing+deep] _scan_snaps no head for 7:4338055d:::rbd_data.a6351b238e1f29.0000000000026372:9e (have MIN) Sep 13 09:58:29 node1.ceph ceph-osd[22280]: 2017-09-13 09:58:29.681592 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.c2( v 16791'12893519 (16791'12890419,16791'12893519] local-lis/les=16763/16764 n=3053 ec=104/104 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,17,36] r=0 lpr=16763 crt=16791'12893519 lcod 16791'12893518 mlcod 16791'12893518 active+clean+scrubbing+deep] _scan_snaps no head for 7:433dd5d4:::rbd_data.bd1c92ae8944a.0000000000003bed:d2 (have MIN) Sep 13 09:59:51 node1.ceph ceph-osd[22280]: 2017-09-13 09:59:51.630046 7f59763ec700 -1 osd.1 pg_epoch: 16791 pg[7.352( v 16791'12094197 (16791'12091120,16791'12094197] local-lis/les=16763/16764 n=3069 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,36,8] r=0 lpr=16763 crt=16791'12094197 lcod 16791'12094196 mlcod 16791'12094196 active+clean+scrubbing+deep] _scan_snaps no head for 7:4acfaef5:::rbd_data.bd1c92ae8944a.0000000000006ee6:d2 (have MIN) Sep 13 10:02:08 node1.ceph ceph-osd[22280]: 2017-09-13 10:02:08.159290 7f59763ec700 -1 osd.1 pg_epoch: 16791 pg[7.352( v 16791'12094435 (16791'12091420,16791'12094435] local-lis/les=16763/16764 n=3069 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,36,8] r=0 lpr=16763 crt=16791'12094435 lcod 16791'12094434 mlcod 16791'12094434 active+clean+scrubbing+deep] _scan_snaps no head for 7:4aea7506:::rbd_data.bd1c92ae8944a.0000000000006462:d2 (have MIN) Sep 13 10:04:10 node1.ceph ceph-osd[22280]: 2017-09-13 10:04:10.456323 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.1eb( v 16791'4314579 (16785'4311525,16791'4314579] local-lis/les=16763/16764 n=3030 ec=104/104 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16763) [1,20,40] r=0 lpr=16763 luod=16791'4314578 lua=16791'4314578 crt=16791'4314579 lcod 16791'4314577 mlcod 16791'4314577 active+clean+scrubbing] _scan_snaps no head for 7:d78c0750:::rbd_data.a6351b238e1f29.000000000001c62f:9e (have MIN) Sep 13 10:04:13 node1.ceph ceph-osd[22280]: 2017-09-13 10:04:13.253595 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.1eb( v 16791'4314579 (16785'4311525,16791'4314579] local-lis/les=16763/16764 n=3030 ec=104/104 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16763) [1,20,40] r=0 lpr=16763 crt=16791'4314579 lcod 16791'4314578 mlcod 16791'4314578 active+clean+scrubbing] _scan_snaps no head for 7:d793199f:::rbd_data.bd1c92ae8944a.0000000000005333:d2 (have MIN) Sep 13 10:04:26 node1.ceph ceph-osd[22280]: 2017-09-13 10:04:26.398377 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.1eb( v 16791'4314581 (16785'4311525,16791'4314581] local-lis/les=16763/16764 n=3030 ec=104/104 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16763) [1,20,40] r=0 lpr=16763 crt=16791'4314581 lcod 16791'4314580 mlcod 16791'4314580 active+clean+scrubbing] _scan_snaps no head for 7:d7b47d4b:::rbd_data.b07e94238e1f29.0000000000000328:80 (have MIN) Sep 13 10:04:31 node1.ceph ceph-osd[22280]: 2017-09-13 10:04:31.375527 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.1eb( v 16791'4314584 (16785'4311525,16791'4314584] local-lis/les=16763/16764 n=3030 ec=104/104 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16763) [1,20,40] r=0 lpr=16763 luod=16791'4314583 lua=16791'4314583 crt=16791'4314584 lcod 16791'4314582 mlcod 16791'4314582 active+clean+scrubbing] _scan_snaps no head for 7:d7bd01a2:::rbd_data.a6351b238e1f29.00000000000240ee:9e (have MIN) Sep 13 10:04:49 node1.ceph ceph-osd[22280]: 2017-09-13 10:04:49.922684 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.d6( v 16791'11096172 (16791'11093129,16791'11096172] local-lis/les=16763/16764 n=3024 ec=104/104 lis/c 16763/16763 les/c/f 16764/16772/0 16763/16763/16763) [1,39,23] r=0 lpr=16763 crt=16791'11096172 lcod 16791'11096171 mlcod 16791'11096171 active+clean+scrubbing+deep] _scan_snaps no head for 7:6b032f13:::rbd_data.a6351b238e1f29.00000000000232c2:9e (have MIN) Sep 13 10:05:17 node1.ceph ceph-osd[22280]: 2017-09-13 10:05:17.938289 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.d6( v 16791'11096442 (16791'11093429,16791'11096442] local-lis/les=16763/16764 n=3024 ec=104/104 lis/c 16763/16763 les/c/f 16764/16772/0 16763/16763/16763) [1,39,23] r=0 lpr=16763 crt=16791'11096442 lcod 16791'11096441 mlcod 16791'11096441 active+clean+scrubbing+deep] _scan_snaps no head for 7:6b096a57:::rbd_data.bd1c92ae8944a.00000000000063d0:d2 (have MIN) Sep 13 10:06:12 node1.ceph ceph-osd[22280]: 2017-09-13 10:06:12.755009 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.d6( v 16791'11096948 (16791'11093929,16791'11096948] local-lis/les=16763/16764 n=3024 ec=104/104 lis/c 16763/16763 les/c/f 16764/16772/0 16763/16763/16763) [1,39,23] r=0 lpr=16763 crt=16791'11096948 lcod 16791'11096947 mlcod 16791'11096947 active+clean+scrubbing+deep] _scan_snaps no head for 7:6b158531:::rbd_data.bd1c92ae8944a.0000000000002da1:d4 (have MIN) Sep 13 10:06:12 node1.ceph ceph-osd[22280]: 2017-09-13 10:06:12.755040 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.d6( v 16791'11096948 (16791'11093929,16791'11096948] local-lis/les=16763/16764 n=3024 ec=104/104 lis/c 16763/16763 les/c/f 16764/16772/0 16763/16763/16763) [1,39,23] r=0 lpr=16763 crt=16791'11096948 lcod 16791'11096947 mlcod 16791'11096947 active+clean+scrubbing+deep] _scan_snaps no head for 7:6b158531:::rbd_data.bd1c92ae8944a.0000000000002da1:d2 (have MIN) Sep 13 10:06:26 node1.ceph ceph-osd[22280]: 2017-09-13 10:06:26.706458 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.d6( v 16791'11097029 (16791'11093929,16791'11097029] local-lis/les=16763/16764 n=3024 ec=104/104 lis/c 16763/16763 les/c/f 16764/16772/0 16763/16763/16763) [1,39,23] r=0 lpr=16763 crt=16791'11097029 lcod 16791'11097028 mlcod 16791'11097028 active+clean+scrubbing+deep] _scan_snaps no head for 7:6b182772:::rbd_data.bd1c92ae8944a.0000000000004657:d2 (have MIN) Sep 13 10:06:30 node1.ceph ceph-osd[22280]: 2017-09-13 10:06:30.376410 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.d6( v 16791'11097052 (16791'11094029,16791'11097052] local-lis/les=16763/16764 n=3024 ec=104/104 lis/c 16763/16763 les/c/f 16764/16772/0 16763/16763/16763) [1,39,23] r=0 lpr=16763 crt=16791'11097052 lcod 16791'11097051 mlcod 16791'11097051 active+clean+scrubbing+deep] _scan_snaps no head for 7:6b1911d7:::rbd_data.c1ebe8238e1f29.0000000000002b2c:df (have MIN) Sep 13 10:07:09 node1.ceph ceph-osd[22280]: 2017-09-13 10:07:09.849844 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.d6( v 16791'11097293 (16791'11094229,16791'11097293] local-lis/les=16763/16764 n=3024 ec=104/104 lis/c 16763/16763 les/c/f 16764/16772/0 16763/16763/16763) [1,39,23] r=0 lpr=16763 crt=16791'11097293 lcod 16791'11097292 mlcod 16791'11097292 active+clean+scrubbing+deep] _scan_snaps no head for 7:6b225d75:::rbd_data.b07e94238e1f29.00000000000007b8:80 (have MIN) Sep 13 10:08:40 node1.ceph ceph-osd[22280]: 2017-09-13 10:08:40.008265 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.d6( v 16791'11097690 (16791'11094630,16791'11097690] local-lis/les=16763/16764 n=3024 ec=104/104 lis/c 16763/16763 les/c/f 16764/16772/0 16763/16763/16763) [1,39,23] r=0 lpr=16763 crt=16791'11097690 lcod 16791'11097689 mlcod 16791'11097689 active+clean+scrubbing+deep] _scan_snaps no head for 7:6b359532:::rbd_data.bd1c92ae8944a.0000000000002563:d4 (have MIN) Sep 13 10:08:40 node1.ceph ceph-osd[22280]: 2017-09-13 10:08:40.008331 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.d6( v 16791'11097690 (16791'11094630,16791'11097690] local-lis/les=16763/16764 n=3024 ec=104/104 lis/c 16763/16763 les/c/f 16764/16772/0 16763/16763/16763) [1,39,23] r=0 lpr=16763 crt=16791'11097690 lcod 16791'11097689 mlcod 16791'11097689 active+clean+scrubbing+deep] _scan_snaps no head for 7:6b359532:::rbd_data.bd1c92ae8944a.0000000000002563:d2 (have MIN) Sep 13 10:09:16 node1.ceph ceph-osd[22280]: 2017-09-13 10:09:16.507230 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[7.d6( v 16791'11097787 (16791'11094730,16791'11097787] local-lis/les=16763/16764 n=3024 ec=104/104 lis/c 16763/16763 les/c/f 16764/16772/0 16763/16763/16763) [1,39,23] r=0 lpr=16763 crt=16791'11097787 lcod 16791'11097786 mlcod 16791'11097786 active+clean+scrubbing+deep] _scan_snaps no head for 7:6b3eb953:::rbd_data.bd1c92ae8944a.0000000000001dad:d2 (have MIN) Sep 13 10:15:24 node1.ceph ceph-osd[22280]: 2017-09-13 10:15:24.460379 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.396( v 16791'6476244 (16791'6473210,16791'6476244] local-lis/les=16763/16764 n=2961 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16250) [38,7,1] r=2 lpr=16763 luod=0'0 crt=16791'6476241 lcod 16791'6476243 active] _scan_snaps no head for 7:69c54119:::rbd_data.a6351b238e1f29.0000000000025180:9e (have MIN) Sep 13 10:15:46 node1.ceph ceph-osd[22280]: 2017-09-13 10:15:46.913041 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.396( v 16791'6476284 (16791'6473210,16791'6476284] local-lis/les=16763/16764 n=2961 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16250) [38,7,1] r=2 lpr=16763 luod=0'0 crt=16791'6476282 lcod 16791'6476283 active] _scan_snaps no head for 7:69cb5fbf:::rbd_data.bd1c92ae8944a.00000000000037c7:d4 (have MIN) Sep 13 10:16:15 node1.ceph ceph-osd[22280]: 2017-09-13 10:16:15.697795 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.396( v 16791'6476336 (16791'6473312,16791'6476336] local-lis/les=16763/16764 n=2961 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16250) [38,7,1] r=2 lpr=16763 luod=0'0 crt=16791'6476333 lcod 16791'6476335 active] _scan_snaps no head for 7:69d1a17a:::rbd_data.bd1c92ae8944a.0000000000005296:d2 (have MIN) Sep 13 10:16:29 node1.ceph ceph-osd[22280]: 2017-09-13 10:16:29.060350 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.396( v 16791'6476360 (16791'6473312,16791'6476360] local-lis/les=16763/16764 n=2961 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16250) [38,7,1] r=2 lpr=16763 luod=0'0 crt=16791'6476358 lcod 16791'6476359 active] _scan_snaps no head for 7:69d50265:::rbd_data.a6351b238e1f29.0000000000022184:9e (have MIN) Sep 13 10:16:54 node1.ceph ceph-osd[22280]: 2017-09-13 10:16:54.839964 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.396( v 16791'6476389 (16791'6473312,16791'6476389] local-lis/les=16763/16764 n=2961 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16250) [38,7,1] r=2 lpr=16763 luod=0'0 crt=16791'6476383 lcod 16791'6476388 active] _scan_snaps no head for 7:69db2cf9:::rbd_data.8f8aad238e1f29.000000000000083a:54 (have MIN) Sep 13 10:17:03 node1.ceph ceph-osd[22280]: 2017-09-13 10:17:03.757979 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.396( v 16791'6476399 (16791'6473312,16791'6476399] local-lis/les=16763/16764 n=2961 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16250) [38,7,1] r=2 lpr=16763 luod=0'0 lua=16791'6476398 crt=16791'6476396 lcod 16791'6476397 active] _scan_snaps no head for 7:69dcc667:::rbd_data.bd1c92ae8944a.0000000000000ec0:d2 (have MIN) Sep 13 10:20:21 node1.ceph ceph-osd[22280]: 2017-09-13 10:20:21.936590 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[8.1f5( v 16791'3046672 (16715'3043624,16791'3046672] local-lis/les=16763/16764 n=3368 ec=107/107 lis/c 16763/16763 les/c/f 16764/16773/0 16763/16763/16763) [1,34,29] r=0 lpr=16763 crt=16791'3046672 lcod 16791'3046671 mlcod 16791'3046671 active+clean+scrubbing] _scan_snaps no head for 8:af991e81:::rbd_data.9aca26238e1f29.0000000000003b11:65 (have MIN) Sep 13 10:20:39 node1.ceph ceph-osd[22280]: 2017-09-13 10:20:39.822545 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.b5( v 16791'6345719 (16773'6342657,16791'6345719] local-lis/les=16763/16764 n=2984 ec=104/104 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,32,36] r=0 lpr=16763 crt=16791'6345719 lcod 16791'6345718 mlcod 16791'6345718 active+clean+scrubbing] _scan_snaps no head for 7:ad01ae81:::rbd_data.bd1c92ae8944a.000000000000104c:d4 (have MIN) Sep 13 10:20:39 node1.ceph ceph-osd[22280]: 2017-09-13 10:20:39.822584 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.b5( v 16791'6345719 (16773'6342657,16791'6345719] local-lis/les=16763/16764 n=2984 ec=104/104 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,32,36] r=0 lpr=16763 crt=16791'6345719 lcod 16791'6345718 mlcod 16791'6345718 active+clean+scrubbing] _scan_snaps no head for 7:ad01ae81:::rbd_data.bd1c92ae8944a.000000000000104c:d2 (have MIN) Sep 13 10:20:59 node1.ceph ceph-osd[22280]: 2017-09-13 10:20:59.260243 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.b5( v 16791'6345727 (16773'6342657,16791'6345727] local-lis/les=16763/16764 n=2984 ec=104/104 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,32,36] r=0 lpr=16763 crt=16791'6345727 lcod 16791'6345726 mlcod 16791'6345726 active+clean+scrubbing] _scan_snaps no head for 7:ad31669a:::rbd_data.a6351b238e1f29.00000000000193cf:d1 (have MIN) Sep 13 10:20:59 node1.ceph ceph-osd[22280]: 2017-09-13 10:20:59.260280 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.b5( v 16791'6345727 (16773'6342657,16791'6345727] local-lis/les=16763/16764 n=2984 ec=104/104 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,32,36] r=0 lpr=16763 crt=16791'6345727 lcod 16791'6345726 mlcod 16791'6345726 active+clean+scrubbing] _scan_snaps no head for 7:ad31669a:::rbd_data.a6351b238e1f29.00000000000193cf:9e (have MIN) Sep 13 10:21:00 node1.ceph ceph-osd[22280]: 2017-09-13 10:21:00.698304 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.b5( v 16791'6345728 (16773'6342657,16791'6345728] local-lis/les=16763/16764 n=2984 ec=104/104 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,32,36] r=0 lpr=16763 crt=16791'6345728 lcod 16791'6345727 mlcod 16791'6345727 active+clean+scrubbing] _scan_snaps no head for 7:ad35917e:::rbd_data.a70641238e1f29.000000000000733c:9d (have MIN) Sep 13 10:21:02 node1.ceph ceph-osd[22280]: 2017-09-13 10:21:02.540798 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.b5( v 16791'6345729 (16773'6342657,16791'6345729] local-lis/les=16763/16764 n=2984 ec=104/104 lis/c 16763/16763 les/c/f 16764/16771/0 16763/16763/16763) [1,32,36] r=0 lpr=16763 crt=16791'6345729 lcod 16791'6345728 mlcod 16791'6345728 active+clean+scrubbing] _scan_snaps no head for 7:ad3bd7e8:::rbd_data.a6351b238e1f29.000000000001b6b6:9e (have MIN) Sep 13 10:21:56 node1.ceph ceph-osd[22280]: 2017-09-13 10:21:56.428543 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.182( v 16791'4902852 (16777'4899765,16791'4902852] local-lis/les=16763/16765 n=3033 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16210) [15,1,11] r=1 lpr=16763 luod=0'0 crt=16791'4902850 lcod 16791'4902851 active] _scan_snaps no head for 7:4188618c:::rbd_data.a6351b238e1f29.000000000001d774:9e (have MIN) Sep 13 10:21:59 node1.ceph ceph-osd[22280]: 2017-09-13 10:21:59.641286 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.182( v 16791'4902852 (16777'4899765,16791'4902852] local-lis/les=16763/16765 n=3033 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16210) [15,1,11] r=1 lpr=16763 luod=0'0 crt=16791'4902850 lcod 16791'4902851 active] _scan_snaps no head for 7:418d7d3c:::rbd_data.a6351b238e1f29.000000000002a02f:9e (have MIN) Sep 13 10:22:00 node1.ceph ceph-osd[22280]: 2017-09-13 10:22:00.776941 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.182( v 16791'4902853 (16777'4899765,16791'4902853] local-lis/les=16763/16765 n=3033 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16210) [15,1,11] r=1 lpr=16763 luod=0'0 crt=16791'4902851 lcod 16791'4902852 active] _scan_snaps no head for 7:418f05aa:::rbd_data.bd1c92ae8944a.0000000000002cd0:d4 (have MIN) Sep 13 10:22:00 node1.ceph ceph-osd[22280]: 2017-09-13 10:22:00.776998 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.182( v 16791'4902853 (16777'4899765,16791'4902853] local-lis/les=16763/16765 n=3033 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16210) [15,1,11] r=1 lpr=16763 luod=0'0 crt=16791'4902851 lcod 16791'4902852 active] _scan_snaps no head for 7:418f05aa:::rbd_data.bd1c92ae8944a.0000000000002cd0:d2 (have MIN) Sep 13 10:22:08 node1.ceph ceph-osd[22280]: 2017-09-13 10:22:08.168269 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.182( v 16791'4902854 (16777'4899765,16791'4902854] local-lis/les=16763/16765 n=3033 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16210) [15,1,11] r=1 lpr=16763 luod=0'0 crt=16791'4902852 lcod 16791'4902853 active] _scan_snaps no head for 7:419c572a:::rbd_data.bd1c92ae8944a.0000000000005115:d2 (have MIN) Sep 13 10:22:09 node1.ceph ceph-osd[22280]: 2017-09-13 10:22:09.428846 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.182( v 16791'4902854 (16777'4899765,16791'4902854] local-lis/les=16763/16765 n=3033 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16210) [15,1,11] r=1 lpr=16763 luod=0'0 crt=16791'4902852 lcod 16791'4902853 active] _scan_snaps no head for 7:419f28d5:::rbd_data.a6351b238e1f29.000000000001b512:9e (have MIN) Sep 13 10:22:09 node1.ceph ceph-osd[22280]: 2017-09-13 10:22:09.672913 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.182( v 16791'4902854 (16777'4899765,16791'4902854] local-lis/les=16763/16765 n=3033 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16210) [15,1,11] r=1 lpr=16763 luod=0'0 crt=16791'4902852 lcod 16791'4902853 active] _scan_snaps no head for 7:419fc29e:::rbd_data.a6351b238e1f29.00000000000221e7:9e (have MIN) Sep 13 10:22:11 node1.ceph ceph-osd[22280]: 2017-09-13 10:22:11.923042 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.182( v 16791'4902854 (16777'4899765,16791'4902854] local-lis/les=16763/16765 n=3033 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16210) [15,1,11] r=1 lpr=16763 luod=0'0 crt=16791'4902852 lcod 16791'4902853 active] _scan_snaps no head for 7:41a3763d:::rbd_data.a6351b238e1f29.0000000000019f11:9e (have MIN) Sep 13 10:22:20 node1.ceph ceph-osd[22280]: 2017-09-13 10:22:20.153522 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.182( v 16791'4902855 (16777'4899765,16791'4902855] local-lis/les=16763/16765 n=3033 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16210) [15,1,11] r=1 lpr=16763 luod=0'0 crt=16791'4902853 lcod 16791'4902854 active] _scan_snaps no head for 7:41b1d67f:::rbd_data.bd1c92ae8944a.00000000000040ff:d4 (have MIN) Sep 13 10:22:20 node1.ceph ceph-osd[22280]: 2017-09-13 10:22:20.153560 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.182( v 16791'4902855 (16777'4899765,16791'4902855] local-lis/les=16763/16765 n=3033 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16210) [15,1,11] r=1 lpr=16763 luod=0'0 crt=16791'4902853 lcod 16791'4902854 active] _scan_snaps no head for 7:41b1d67f:::rbd_data.bd1c92ae8944a.00000000000040ff:d2 (have MIN) Sep 13 10:22:21 node1.ceph ceph-osd[22280]: 2017-09-13 10:22:21.634980 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.182( v 16791'4902855 (16777'4899765,16791'4902855] local-lis/les=16763/16765 n=3033 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16210) [15,1,11] r=1 lpr=16763 luod=0'0 crt=16791'4902853 lcod 16791'4902854 active] _scan_snaps no head for 7:41b57dd8:::rbd_data.a6351b238e1f29.0000000000028567:9e (have MIN) Sep 13 10:22:24 node1.ceph ceph-osd[22280]: 2017-09-13 10:22:24.228156 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.182( v 16791'4902856 (16777'4899765,16791'4902856] local-lis/les=16763/16765 n=3033 ec=104/104 lis/c 16763/16763 les/c/f 16765/16769/0 16763/16763/16210) [15,1,11] r=1 lpr=16763 luod=0'0 crt=16791'4902854 lcod 16791'4902855 active] _scan_snaps no head for 7:41ba4833:::rbd_data.bd1c92ae8944a.0000000000005018:d2 (have MIN) Sep 13 10:26:54 node1.ceph ceph-osd[22280]: 2017-09-13 10:26:54.153482 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.39b( v 16791'7472182 (16791'7469179,16791'7472182] local-lis/les=16763/16764 n=2966 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16768/0 16763/16763/16253) [35,1,28] r=1 lpr=16763 luod=0'0 crt=16791'7472175 lcod 16791'7472181 active] _scan_snaps no head for 7:d9cafc22:::rbd_data.bd1c92ae8944a.000000000000517d:d2 (have MIN) Sep 13 10:26:59 node1.ceph ceph-osd[22280]: 2017-09-13 10:26:59.542027 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.39b( v 16791'7472183 (16791'7469179,16791'7472183] local-lis/les=16763/16764 n=2966 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16768/0 16763/16763/16253) [35,1,28] r=1 lpr=16763 luod=0'0 crt=16791'7472181 lcod 16791'7472182 active] _scan_snaps no head for 7:d9d8d15e:::rbd_data.c1ebe8238e1f29.0000000000000ad5:df (have MIN) Sep 13 10:27:00 node1.ceph ceph-osd[22280]: 2017-09-13 10:27:00.845891 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.39b( v 16791'7472183 (16791'7469179,16791'7472183] local-lis/les=16763/16764 n=2966 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16768/0 16763/16763/16253) [35,1,28] r=1 lpr=16763 luod=0'0 crt=16791'7472181 lcod 16791'7472182 active] _scan_snaps no head for 7:d9dc472b:::rbd_data.bd1c92ae8944a.0000000000004b00:d2 (have MIN) Sep 13 10:27:04 node1.ceph ceph-osd[22280]: 2017-09-13 10:27:04.477707 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.39b( v 16791'7472183 (16791'7469179,16791'7472183] local-lis/les=16763/16764 n=2966 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16768/0 16763/16763/16253) [35,1,28] r=1 lpr=16763 luod=0'0 crt=16791'7472181 lcod 16791'7472182 active] _scan_snaps no head for 7:d9e2c567:::rbd_data.a6351b238e1f29.000000000002840e:9e (have MIN) Sep 13 10:27:05 node1.ceph ceph-osd[22280]: 2017-09-13 10:27:05.259467 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.39b( v 16791'7472184 (16791'7469179,16791'7472184] local-lis/les=16763/16764 n=2966 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16768/0 16763/16763/16253) [35,1,28] r=1 lpr=16763 luod=0'0 crt=16791'7472182 lcod 16791'7472183 active] _scan_snaps no head for 7:d9e4e7e2:::rbd_data.a6351b238e1f29.0000000000018fe3:9e (have MIN) Sep 13 10:27:05 node1.ceph ceph-osd[22280]: 2017-09-13 10:27:05.568952 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.39b( v 16791'7472184 (16791'7469179,16791'7472184] local-lis/les=16763/16764 n=2966 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16768/0 16763/16763/16253) [35,1,28] r=1 lpr=16763 luod=0'0 crt=16791'7472182 lcod 16791'7472183 active] _scan_snaps no head for 7:d9e5518c:::rbd_data.a6351b238e1f29.000000000001c6d4:9e (have MIN) Sep 13 10:27:10 node1.ceph ceph-osd[22280]: 2017-09-13 10:27:10.492930 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.39b( v 16791'7472190 (16791'7469179,16791'7472190] local-lis/les=16763/16764 n=2966 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16768/0 16763/16763/16253) [35,1,28] r=1 lpr=16763 luod=0'0 crt=16791'7472183 lcod 16791'7472189 active] _scan_snaps no head for 7:d9f1adf4:::rbd_data.a6351b238e1f29.0000000000018fe8:9e (have MIN) Sep 13 10:27:10 node1.ceph ceph-osd[22280]: 2017-09-13 10:27:10.956871 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.39b( v 16791'7472190 (16791'7469179,16791'7472190] local-lis/les=16763/16764 n=2966 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16768/0 16763/16763/16253) [35,1,28] r=1 lpr=16763 luod=0'0 crt=16791'7472183 lcod 16791'7472189 active] _scan_snaps no head for 7:d9f368e0:::rbd_data.bd1c92ae8944a.000000000000593c:d2 (have MIN) Sep 13 10:27:12 node1.ceph ceph-osd[22280]: 2017-09-13 10:27:12.196329 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.39b( v 16791'7472190 (16791'7469179,16791'7472190] local-lis/les=16763/16764 n=2966 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16768/0 16763/16763/16253) [35,1,28] r=1 lpr=16763 luod=0'0 crt=16791'7472183 lcod 16791'7472189 active] _scan_snaps no head for 7:d9f762e5:::rbd_data.a6351b238e1f29.000000000001e3db:9e (have MIN) Sep 13 10:27:14 node1.ceph ceph-osd[22280]: 2017-09-13 10:27:14.987732 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.39b( v 16791'7472190 (16791'7469179,16791'7472190] local-lis/les=16763/16764 n=2966 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16768/0 16763/16763/16253) [35,1,28] r=1 lpr=16763 luod=0'0 crt=16791'7472183 lcod 16791'7472189 active] _scan_snaps no head for 7:d9fe134b:::rbd_data.bd1c92ae8944a.0000000000006713:d2 (have MIN) Sep 13 10:27:15 node1.ceph ceph-osd[22280]: 2017-09-13 10:27:15.660651 7f5974be9700 -1 osd.1 pg_epoch: 16791 pg[7.39b( v 16791'7472190 (16791'7469179,16791'7472190] local-lis/les=16763/16764 n=2966 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16768/0 16763/16763/16253) [35,1,28] r=1 lpr=16763 luod=0'0 crt=16791'7472183 lcod 16791'7472189 active] _scan_snaps no head for 7:d9ffd917:::rbd_data.bd1c92ae8944a.00000000000063f7:d2 (have MIN) Sep 13 10:35:27 node1.ceph ceph-osd[22280]: 2017-09-13 10:35:27.432620 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.290( v 16791'5764623 (16791'5761603,16791'5764623] local-lis/les=16763/16764 n=3109 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16229) [30,13,1] r=2 lpr=16763 luod=0'0 crt=16791'5764621 lcod 16791'5764622 active] _scan_snaps no head for 7:09429d14:::rbd_data.bd1c92ae8944a.00000000000018bf:d4 (have MIN) Sep 13 10:35:27 node1.ceph ceph-osd[22280]: 2017-09-13 10:35:27.432657 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.290( v 16791'5764623 (16791'5761603,16791'5764623] local-lis/les=16763/16764 n=3109 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16229) [30,13,1] r=2 lpr=16763 luod=0'0 crt=16791'5764621 lcod 16791'5764622 active] _scan_snaps no head for 7:09429d14:::rbd_data.bd1c92ae8944a.00000000000018bf:d2 (have MIN) Sep 13 10:35:27 node1.ceph ceph-osd[22280]: 2017-09-13 10:35:27.544786 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.290( v 16791'5764623 (16791'5761603,16791'5764623] local-lis/les=16763/16764 n=3109 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16229) [30,13,1] r=2 lpr=16763 luod=0'0 crt=16791'5764621 lcod 16791'5764622 active] _scan_snaps no head for 7:09433c2e:::rbd_data.bd1c92ae8944a.0000000000002b38:d2 (have MIN) Sep 13 10:35:28 node1.ceph ceph-osd[22280]: 2017-09-13 10:35:28.188956 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.290( v 16791'5764623 (16791'5761603,16791'5764623] local-lis/les=16763/16764 n=3109 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16229) [30,13,1] r=2 lpr=16763 luod=0'0 crt=16791'5764621 lcod 16791'5764622 active] _scan_snaps no head for 7:094585ca:::rbd_data.a74f60238e1f29.00000000000012aa:9c (have MIN) Sep 13 10:35:28 node1.ceph ceph-osd[22280]: 2017-09-13 10:35:28.860121 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.290( v 16791'5764626 (16791'5761603,16791'5764626] local-lis/les=16763/16764 n=3109 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16229) [30,13,1] r=2 lpr=16763 luod=0'0 crt=16791'5764624 lcod 16791'5764625 active] _scan_snaps no head for 7:09475676:::rbd_data.a6351b238e1f29.000000000001dc33:9e (have MIN) Sep 13 10:35:44 node1.ceph ceph-osd[22280]: 2017-09-13 10:35:44.084864 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.290( v 16791'5764650 (16791'5761603,16791'5764650] local-lis/les=16763/16764 n=3109 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16229) [30,13,1] r=2 lpr=16763 luod=0'0 crt=16791'5764641 lcod 16791'5764649 active] _scan_snaps no head for 7:096d9823:::rbd_data.bd1c92ae8944a.0000000000000bcc:d4 (have MIN) Sep 13 10:35:44 node1.ceph ceph-osd[22280]: 2017-09-13 10:35:44.084922 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.290( v 16791'5764650 (16791'5761603,16791'5764650] local-lis/les=16763/16764 n=3109 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16229) [30,13,1] r=2 lpr=16763 luod=0'0 crt=16791'5764641 lcod 16791'5764649 active] _scan_snaps no head for 7:096d9823:::rbd_data.bd1c92ae8944a.0000000000000bcc:d2 (have MIN) Sep 13 10:35:45 node1.ceph ceph-osd[22280]: 2017-09-13 10:35:45.208066 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.290( v 16791'5764650 (16791'5761603,16791'5764650] local-lis/les=16763/16764 n=3109 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16229) [30,13,1] r=2 lpr=16763 luod=0'0 crt=16791'5764641 lcod 16791'5764649 active] _scan_snaps no head for 7:09712ddb:::rbd_data.a6351b238e1f29.000000000001a049:9e (have MIN) Sep 13 10:35:45 node1.ceph ceph-osd[22280]: 2017-09-13 10:35:45.435689 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.290( v 16791'5764650 (16791'5761603,16791'5764650] local-lis/les=16763/16764 n=3109 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16229) [30,13,1] r=2 lpr=16763 luod=0'0 crt=16791'5764641 lcod 16791'5764649 active] _scan_snaps no head for 7:0971b599:::rbd_data.bd1c92ae8944a.00000000000016f4:d4 (have MIN) Sep 13 10:35:45 node1.ceph ceph-osd[22280]: 2017-09-13 10:35:45.435733 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.290( v 16791'5764650 (16791'5761603,16791'5764650] local-lis/les=16763/16764 n=3109 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16229) [30,13,1] r=2 lpr=16763 luod=0'0 crt=16791'5764641 lcod 16791'5764649 active] _scan_snaps no head for 7:0971b599:::rbd_data.bd1c92ae8944a.00000000000016f4:d2 (have MIN) Sep 13 10:35:47 node1.ceph ceph-osd[22280]: 2017-09-13 10:35:47.330636 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.290( v 16791'5764650 (16791'5761603,16791'5764650] local-lis/les=16763/16764 n=3109 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16229) [30,13,1] r=2 lpr=16763 luod=0'0 crt=16791'5764641 lcod 16791'5764649 active] _scan_snaps no head for 7:0975cece:::rbd_data.bd1c92ae8944a.00000000000049ca:d2 (have MIN) Sep 13 10:35:50 node1.ceph ceph-osd[22280]: 2017-09-13 10:35:50.012549 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.290( v 16791'5764650 (16791'5761603,16791'5764650] local-lis/les=16763/16764 n=3109 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16229) [30,13,1] r=2 lpr=16763 luod=0'0 crt=16791'5764641 lcod 16791'5764649 active] _scan_snaps no head for 7:097ddde2:::rbd_data.bd1c92ae8944a.0000000000000a4f:d4 (have MIN) Sep 13 10:35:50 node1.ceph ceph-osd[22280]: 2017-09-13 10:35:50.012603 7f5975beb700 -1 osd.1 pg_epoch: 16791 pg[7.290( v 16791'5764650 (16791'5761603,16791'5764650] local-lis/les=16763/16764 n=3109 ec=2543/2543 lis/c 16763/16763 les/c/f 16764/16769/0 16763/16763/16229) [30,13,1] r=2 lpr=16763 luod=0'0 crt=16791'5764641 lcod 16791'5764649 active] _scan_snaps no head for 7:097ddde2:::rbd_data.bd1c92ae8944a.0000000000000a4f:d2 (have MIN) Sep 13 10:48:32 node1.ceph ceph-osd[22280]: 2017-09-13 10:48:32.103642 7f59743e8700 -1 osd.1 pg_epoch: 16791 pg[8.1df( v 16791'2184281 (16723'2181222,16791'2184281] local-lis/les=16763/16765 n=3460 ec=107/107 lis/c 16763/16763 les/c/f 16765/16767/0 16763/16763/16194) [6,1,23] r=1 lpr=16763 luod=0'0 crt=16791'2184279 lcod 16791'2184280 active] _scan_snaps no head for 8:fb98d636:::rbd_data.9aca26238e1f29.00000000000044f9:65 (have MIN) Sep 13 10:49:24 node1.ceph ceph-osd[22280]: 2017-09-13 10:49:24.853973 7f59763ec700 -1 osd.1 pg_epoch: 16791 pg[8.3ed( v 16791'2492543 (16719'2489460,16791'2492543] local-lis/les=16763/16764 n=3413 ec=2548/2548 lis/c 16763/16763 les/c/f 16764/16772/0 16763/16763/16763) [1,39,13] r=0 lpr=16763 crt=16791'2492543 lcod 16791'2492542 mlcod 16791'2492542 active+clean+scrubbing] _scan_snaps no head for 8:b7cb88f7:::rbd_data.9aca26238e1f29.0000000000003a50:65 (have MIN) Sep 13 10:55:59 node1.ceph ceph-osd[22280]: 2017-09-13 10:55:59.044323 7f59753ea700 -1 osd.1 pg_epoch: 16791 pg[7.14c( v 16791'11273719 (16791'11270622,16791'11273719] local-lis/les=16763/16764 n=3031 ec=104/104 lis/c 16763/16763 les/c/f 16764/16764/0 16763/16763/16180) [11,1,16] r=1 lpr=16763 luod=0'0 lua=16791'11273718 crt=16791'11273717 lcod 16791'11273718 active] _scan_snaps no head for 7:32872d05:::rbd_data.a74f60238e1f29.00000000000000ab:cf (have MIN) Sep 13 10:55:59 node1.ceph ceph-osd[22280]: 2017-09-13 10:55:59.044355 7f59753ea700 -1 osd.1 pg_epoch: 16791 pg[7.14c( v 16791'11273719 (16791'11270622,16791'11273719] local-lis/les=16763/16764 n=3031 ec=104/104 lis/c 16763/16763 les/c/f 16764/16764/0 16763/16763/16180) [11,1,16] r=1 lpr=16763 luod=0'0 lua=16791'11273718 crt=16791'11273717 lcod 16791'11273718 active] _scan_snaps no head for 7:32872d05:::rbd_data.a74f60238e1f29.00000000000000ab:9c (have MIN) Sep 13 10:56:09 node1.ceph ceph-osd[22280]: 2017-09-13 10:56:09.496265 7f59753ea700 -1 osd.1 pg_epoch: 16791 pg[7.14c( v 16791'11273730 (16791'11270723,16791'11273730] local-lis/les=16763/16764 n=3031 ec=104/104 lis/c 16763/16763 les/c/f 16764/16764/0 16763/16763/16180) [11,1,16] r=1 lpr=16763 luod=0'0 crt=16791'11273726 lcod 16791'11273729 active] _scan_snaps no head for 7:3289662e:::rbd_data.a6351b238e1f29.000000000001c9e1:9e (have MIN) Sep 13 10:59:03 node1.ceph ceph-osd[22280]: 2017-09-13 10:59:03.629686 7f59753ea700 -1 osd.1 pg_epoch: 16791 pg[7.14c( v 16791'11273914 (16791'11270825,16791'11273914] local-lis/les=16763/16764 n=3031 ec=104/104 lis/c 16763/16763 les/c/f 16764/16764/0 16763/16763/16180) [11,1,16] r=1 lpr=16763 luod=0'0 crt=16791'11273910 lcod 16791'11273913 active] _scan_snaps no head for 7:32b1013d:::rbd_data.a74f60238e1f29.0000000000001627:cf (have MIN) Sep 13 22:27:18 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 13 22:28:00 node1.ceph systemd[1]: [/usr/lib/systemd/system/ceph-osd@.service:18] Unknown lvalue 'TasksMax' in section 'Service' Sep 13 22:29:42 node1.ceph ceph-osd[22280]: 2017-09-13 22:29:42.155495 7f596d7ff700 -1 received signal: Terminated from PID: 1 task name: /usr/lib/systemd/systemd --system --deserialize 22 UID: 0 Sep 13 22:29:42 node1.ceph ceph-osd[22280]: 2017-09-13 22:29:42.155521 7f596d7ff700 -1 osd.1 16866 *** Got signal Terminated *** Sep 13 22:29:42 node1.ceph systemd[1]: Stopping Ceph object storage daemon osd.1... Sep 13 22:29:43 node1.ceph ceph-osd[22280]: 2017-09-13 22:29:43.304261 7f596d7ff700 -1 osd.1 16866 shutdown Sep 13 22:29:43 node1.ceph systemd[1]: Stopped Ceph object storage daemon osd.1. -- Reboot -- Sep 13 22:31:58 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 13 22:31:58 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 13 22:31:58 node1.ceph ceph-osd[1703]: 2017-09-13 22:31:58.402725 7fb969fb9d00 -1 Public network was set, but cluster network was not set Sep 13 22:31:58 node1.ceph ceph-osd[1703]: 2017-09-13 22:31:58.402880 7fb969fb9d00 -1 Using public network also for cluster network Sep 13 22:31:58 node1.ceph ceph-osd[1703]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 13 22:32:52 node1.ceph ceph-osd[1703]: 2017-09-13 22:32:52.631637 7fb969fb9d00 -1 osd.1 16866 log_to_monitors {default=true} Sep 13 22:32:52 node1.ceph ceph-osd[1703]: 2017-09-13 22:32:52.637727 7fb969fb9d00 -1 osd.1 16866 mon_cmd_maybe_osd_create fail: 'you must complete the upgrade and 'ceph osd require-osd-release luminous' before using crush device classes': (1) Operation not permitted Sep 14 05:04:08 node1.ceph ceph-osd[1703]: 2017-09-14 05:04:08.408802 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.a1( v 17029'8232022 (17029'8228961,17029'8232022] local-lis/les=16967/16968 n=3054 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16900/16967/16855) [39,1,6] r=1 lpr=16967 luod=0'0 crt=17029'8232022 lcod 17029'8232021 active] _scan_snaps no head for 7:8501235b:::rbd_data.a6351b238e1f29.0000000000019a59:d1 (have MIN) Sep 14 05:04:08 node1.ceph ceph-osd[1703]: 2017-09-14 05:04:08.408853 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.a1( v 17029'8232022 (17029'8228961,17029'8232022] local-lis/les=16967/16968 n=3054 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16900/16967/16855) [39,1,6] r=1 lpr=16967 luod=0'0 crt=17029'8232022 lcod 17029'8232021 active] _scan_snaps no head for 7:8501235b:::rbd_data.a6351b238e1f29.0000000000019a59:9e (have MIN) Sep 14 05:04:30 node1.ceph ceph-osd[1703]: 2017-09-14 05:04:30.905400 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.a1( v 17029'8232166 (17029'8229161,17029'8232166] local-lis/les=16967/16968 n=3069 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16900/16967/16855) [39,1,6] r=1 lpr=16967 luod=0'0 crt=17029'8232166 lcod 17029'8232165 active] _scan_snaps no head for 7:852211bd:::rbd_data.bd1c92ae8944a.00000000000024cd:d4 (have MIN) Sep 14 05:04:30 node1.ceph ceph-osd[1703]: 2017-09-14 05:04:30.905449 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.a1( v 17029'8232166 (17029'8229161,17029'8232166] local-lis/les=16967/16968 n=3069 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16900/16967/16855) [39,1,6] r=1 lpr=16967 luod=0'0 crt=17029'8232166 lcod 17029'8232165 active] _scan_snaps no head for 7:852211bd:::rbd_data.bd1c92ae8944a.00000000000024cd:d2 (have MIN) Sep 14 05:04:33 node1.ceph ceph-osd[1703]: 2017-09-14 05:04:33.841243 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.a1( v 17029'8232174 (17029'8229161,17029'8232174] local-lis/les=16967/16968 n=3070 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16900/16967/16855) [39,1,6] r=1 lpr=16967 luod=0'0 crt=17029'8232174 lcod 17029'8232173 active] _scan_snaps no head for 7:8523fba0:::rbd_data.bd1c92ae8944a.0000000000001a30:d4 (have MIN) Sep 14 05:04:33 node1.ceph ceph-osd[1703]: 2017-09-14 05:04:33.841269 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.a1( v 17029'8232174 (17029'8229161,17029'8232174] local-lis/les=16967/16968 n=3070 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16900/16967/16855) [39,1,6] r=1 lpr=16967 luod=0'0 crt=17029'8232174 lcod 17029'8232173 active] _scan_snaps no head for 7:8523fba0:::rbd_data.bd1c92ae8944a.0000000000001a30:d2 (have MIN) Sep 14 05:04:38 node1.ceph ceph-osd[1703]: 2017-09-14 05:04:38.959437 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.a1( v 17029'8232193 (17029'8229161,17029'8232193] local-lis/les=16967/16968 n=3073 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16900/16967/16855) [39,1,6] r=1 lpr=16967 luod=0'0 crt=17029'8232193 lcod 17029'8232192 active] _scan_snaps no head for 7:85294b41:::rbd_data.bd1c92ae8944a.0000000000001f54:d2 (have MIN) Sep 14 05:04:51 node1.ceph ceph-osd[1703]: 2017-09-14 05:04:51.254166 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.a1( v 17029'8232241 (17029'8229161,17029'8232241] local-lis/les=16967/16968 n=3073 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16900/16967/16855) [39,1,6] r=1 lpr=16967 luod=0'0 crt=17029'8232241 lcod 17029'8232240 active] _scan_snaps no head for 7:853625b6:::rbd_data.a6351b238e1f29.00000000000255b1:9e (have MIN) Sep 14 05:04:51 node1.ceph ceph-osd[1703]: 2017-09-14 05:04:51.591545 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.a1( v 17029'8232245 (17029'8229161,17029'8232245] local-lis/les=16967/16968 n=3074 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16900/16967/16855) [39,1,6] r=1 lpr=16967 luod=0'0 lua=17029'8232242 crt=17029'8232245 lcod 17029'8232244 active] _scan_snaps no head for 7:85367d14:::rbd_data.445028238e1f29.0000000000002130:1f (have MIN) Sep 14 05:04:55 node1.ceph ceph-osd[1703]: 2017-09-14 05:04:55.569592 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.a1( v 17029'8232268 (17029'8229261,17029'8232268] local-lis/les=16967/16968 n=3075 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16900/16967/16855) [39,1,6] r=1 lpr=16967 luod=0'0 crt=17029'8232268 lcod 17029'8232267 active] _scan_snaps no head for 7:853c50cb:::rbd_data.a70641238e1f29.00000000000075b4:ce (have MIN) Sep 14 05:04:56 node1.ceph ceph-osd[1703]: 2017-09-14 05:04:56.322961 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.a1( v 17029'8232271 (17029'8229261,17029'8232271] local-lis/les=16967/16968 n=3075 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16900/16967/16855) [39,1,6] r=1 lpr=16967 luod=0'0 crt=17029'8232271 lcod 17029'8232270 active] _scan_snaps no head for 7:853ddc6f:::rbd_data.a6351b238e1f29.0000000000021fe2:9e (have MIN) Sep 14 05:13:37 node1.ceph ceph-osd[1703]: 2017-09-14 05:13:37.167680 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.3a4( v 17029'6142589 (17029'6139552,17029'6142589] local-lis/les=17003/17004 n=3218 ec=2543/2543 lis/c 17003/17003 les/c/f 17004/17021/0 17003/17003/16848) [33,21,1] r=2 lpr=17003 luod=0'0 crt=17029'6142589 lcod 17029'6142588 active] _scan_snaps no head for 7:25c05b32:::rbd_data.68c683238e1f29.00000000000010a0:3d (have MIN) Sep 14 05:13:41 node1.ceph ceph-osd[1703]: 2017-09-14 05:13:41.265305 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.3a4( v 17029'6142615 (17029'6139552,17029'6142615] local-lis/les=17003/17004 n=3221 ec=2543/2543 lis/c 17003/17003 les/c/f 17004/17021/0 17003/17003/16848) [33,21,1] r=2 lpr=17003 luod=0'0 crt=17029'6142615 lcod 17029'6142614 active] _scan_snaps no head for 7:25c6c707:::rbd_data.a6351b238e1f29.000000000001fedf:9e (have MIN) Sep 14 05:13:42 node1.ceph ceph-osd[1703]: 2017-09-14 05:13:42.552392 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.3a4( v 17029'6142628 (17029'6139552,17029'6142628] local-lis/les=17003/17004 n=3222 ec=2543/2543 lis/c 17003/17003 les/c/f 17004/17021/0 17003/17003/16848) [33,21,1] r=2 lpr=17003 luod=0'0 lua=17029'6142626 crt=17029'6142628 lcod 17029'6142627 active] _scan_snaps no head for 7:25c9ecb4:::rbd_data.bd1c92ae8944a.0000000000006305:d2 (have MIN) Sep 14 05:13:42 node1.ceph ceph-osd[1703]: 2017-09-14 05:13:42.751051 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.3a4( v 17029'6142628 (17029'6139552,17029'6142628] local-lis/les=17003/17004 n=3222 ec=2543/2543 lis/c 17003/17003 les/c/f 17004/17021/0 17003/17003/16848) [33,21,1] r=2 lpr=17003 luod=0'0 crt=17029'6142628 lcod 17029'6142627 active] _scan_snaps no head for 7:25ca767a:::rbd_data.b07e94238e1f29.0000000000000727:80 (have MIN) Sep 14 05:13:47 node1.ceph ceph-osd[1703]: 2017-09-14 05:13:47.015464 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.3a4( v 17029'6142658 (17029'6139652,17029'6142658] local-lis/les=17003/17004 n=3224 ec=2543/2543 lis/c 17003/17003 les/c/f 17004/17021/0 17003/17003/16848) [33,21,1] r=2 lpr=17003 luod=0'0 crt=17029'6142658 lcod 17029'6142657 active] _scan_snaps no head for 7:25d18436:::rbd_data.32bc79238e1f29.00000000000016a5:2d (have MIN) Sep 14 05:13:48 node1.ceph ceph-osd[1703]: 2017-09-14 05:13:48.574407 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.3a4( v 17029'6142665 (17029'6139652,17029'6142665] local-lis/les=17003/17004 n=3224 ec=2543/2543 lis/c 17003/17003 les/c/f 17004/17021/0 17003/17003/16848) [33,21,1] r=2 lpr=17003 luod=0'0 crt=17029'6142665 lcod 17029'6142664 active] _scan_snaps no head for 7:25d412ec:::rbd_data.a6351b238e1f29.0000000000023f52:9e (have MIN) Sep 14 05:13:56 node1.ceph ceph-osd[1703]: 2017-09-14 05:13:56.031001 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.3a4( v 17029'6142699 (17029'6139652,17029'6142699] local-lis/les=17003/17004 n=3225 ec=2543/2543 lis/c 17003/17003 les/c/f 17004/17021/0 17003/17003/16848) [33,21,1] r=2 lpr=17003 luod=0'0 crt=17029'6142699 lcod 17029'6142698 active] _scan_snaps no head for 7:25dcfbf8:::rbd_data.a6351b238e1f29.000000000002203c:9e (have MIN) Sep 14 05:13:57 node1.ceph ceph-osd[1703]: 2017-09-14 05:13:57.841972 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.3a4( v 17029'6142708 (17029'6139652,17029'6142708] local-lis/les=17003/17004 n=3226 ec=2543/2543 lis/c 17003/17003 les/c/f 17004/17021/0 17003/17003/16848) [33,21,1] r=2 lpr=17003 luod=0'0 crt=17029'6142708 lcod 17029'6142707 active] _scan_snaps no head for 7:25df295c:::rbd_data.a6351b238e1f29.00000000000295fd:9e (have MIN) Sep 14 05:14:02 node1.ceph ceph-osd[1703]: 2017-09-14 05:14:02.669952 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.3a4( v 17029'6142754 (17029'6139752,17029'6142754] local-lis/les=17003/17004 n=3232 ec=2543/2543 lis/c 17003/17003 les/c/f 17004/17021/0 17003/17003/16848) [33,21,1] r=2 lpr=17003 luod=0'0 crt=17029'6142754 lcod 17029'6142753 active] _scan_snaps no head for 7:25e91eaa:::rbd_data.bd1c92ae8944a.0000000000003628:d4 (have MIN) Sep 14 05:14:02 node1.ceph ceph-osd[1703]: 2017-09-14 05:14:02.669990 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.3a4( v 17029'6142754 (17029'6139752,17029'6142754] local-lis/les=17003/17004 n=3232 ec=2543/2543 lis/c 17003/17003 les/c/f 17004/17021/0 17003/17003/16848) [33,21,1] r=2 lpr=17003 luod=0'0 crt=17029'6142754 lcod 17029'6142753 active] _scan_snaps no head for 7:25e91eaa:::rbd_data.bd1c92ae8944a.0000000000003628:d2 (have MIN) Sep 14 05:14:04 node1.ceph ceph-osd[1703]: 2017-09-14 05:14:04.773496 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.3a4( v 17029'6142768 (17029'6139752,17029'6142768] local-lis/les=17003/17004 n=3233 ec=2543/2543 lis/c 17003/17003 les/c/f 17004/17021/0 17003/17003/16848) [33,21,1] r=2 lpr=17003 luod=0'0 crt=17029'6142768 lcod 17029'6142766 active] _scan_snaps no head for 7:25ecdc9c:::rbd_data.a6351b238e1f29.0000000000020226:9e (have MIN) Sep 14 05:14:04 node1.ceph ceph-osd[1703]: 2017-09-14 05:14:04.958093 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.3a4( v 17029'6142770 (17029'6139752,17029'6142770] local-lis/les=17003/17004 n=3234 ec=2543/2543 lis/c 17003/17003 les/c/f 17004/17021/0 17003/17003/16848) [33,21,1] r=2 lpr=17003 luod=0'0 crt=17029'6142770 lcod 17029'6142768 active] _scan_snaps no head for 7:25ed62f3:::rbd_data.a6351b238e1f29.000000000001debb:9e (have MIN) Sep 14 05:14:09 node1.ceph ceph-osd[1703]: 2017-09-14 05:14:09.536141 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.3a4( v 17029'6142820 (17029'6139752,17029'6142820] local-lis/les=17003/17004 n=3239 ec=2543/2543 lis/c 17003/17003 les/c/f 17004/17021/0 17003/17003/16848) [33,21,1] r=2 lpr=17003 luod=0'0 crt=17029'6142820 lcod 17029'6142819 active] _scan_snaps no head for 7:25f56600:::rbd_data.bd1c92ae8944a.00000000000064a9:d2 (have MIN) Sep 14 05:14:10 node1.ceph ceph-osd[1703]: 2017-09-14 05:14:10.488203 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.3a4( v 17029'6142827 (17029'6139752,17029'6142827] local-lis/les=17003/17004 n=3240 ec=2543/2543 lis/c 17003/17003 les/c/f 17004/17021/0 17003/17003/16848) [33,21,1] r=2 lpr=17003 luod=0'0 crt=17029'6142827 lcod 17029'6142826 active] _scan_snaps no head for 7:25f72cd5:::rbd_data.c1ebe8238e1f29.0000000000002bf0:df (have MIN) Sep 14 05:14:11 node1.ceph ceph-osd[1703]: 2017-09-14 05:14:11.759888 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.3a4( v 17029'6142838 (17029'6139752,17029'6142838] local-lis/les=17003/17004 n=3241 ec=2543/2543 lis/c 17003/17003 les/c/f 17004/17021/0 17003/17003/16848) [33,21,1] r=2 lpr=17003 luod=0'0 crt=17029'6142838 lcod 17029'6142837 active] _scan_snaps no head for 7:25f9921e:::rbd_data.a70641238e1f29.000000000000525e:ce (have MIN) Sep 14 05:14:15 node1.ceph ceph-osd[1703]: 2017-09-14 05:14:15.031837 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.3a4( v 17029'6142861 (17029'6139853,17029'6142861] local-lis/les=17003/17004 n=3243 ec=2543/2543 lis/c 17003/17003 les/c/f 17004/17021/0 17003/17003/16848) [33,21,1] r=2 lpr=17003 luod=0'0 crt=17029'6142861 lcod 17029'6142859 active] _scan_snaps no head for 7:25fe7881:::rbd_data.a6351b238e1f29.00000000000203ea:9e (have MIN) Sep 14 05:18:27 node1.ceph ceph-osd[1703]: 2017-09-14 05:18:27.575864 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[8.396( v 17029'4133838 (17025'4130744,17029'4133838] local-lis/les=16967/16968 n=3375 ec=2548/2548 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16842) [32,33,1] r=2 lpr=16967 luod=0'0 crt=17029'4133838 lcod 17029'4133837 active] _scan_snaps no head for 8:69c56ab6:::rbd_data.1443bb238e1f29.000000000000166a:31 (have MIN) Sep 14 05:18:35 node1.ceph ceph-osd[1703]: 2017-09-14 05:18:35.941899 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[8.396( v 17029'4134013 (17028'4130944,17029'4134013] local-lis/les=16967/16968 n=3375 ec=2548/2548 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16842) [32,33,1] r=2 lpr=16967 luod=0'0 crt=17029'4134013 lcod 17029'4134012 active] _scan_snaps no head for 8:69da0784:::rbd_data.1443bb238e1f29.0000000000001e94:31 (have MIN) Sep 14 05:18:41 node1.ceph ceph-osd[1703]: 2017-09-14 05:18:41.410892 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[8.396( v 17029'4134092 (17029'4131044,17029'4134092] local-lis/les=16967/16968 n=3375 ec=2548/2548 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16842) [32,33,1] r=2 lpr=16967 luod=0'0 crt=17029'4134092 lcod 17029'4134091 active] _scan_snaps no head for 8:69e434c7:::rbd_data.9aca26238e1f29.0000000000004a15:65 (have MIN) Sep 14 05:18:54 node1.ceph ceph-osd[1703]: 2017-09-14 05:18:54.083642 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ee( v 17029'6817287 (17029'6814253,17029'6817287] local-lis/les=16967/16968 n=3123 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16842) [32,34,1] r=2 lpr=16967 luod=0'0 crt=17029'6817287 lcod 17029'6817286 active] _scan_snaps no head for 7:77862a63:::rbd_data.a6351b238e1f29.00000000000286ef:9e (have MIN) Sep 14 05:18:59 node1.ceph ceph-osd[1703]: 2017-09-14 05:18:59.381836 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ee( v 17029'6817330 (17029'6814253,17029'6817330] local-lis/les=16967/16968 n=3128 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16842) [32,34,1] r=2 lpr=16967 luod=0'0 crt=17029'6817330 lcod 17029'6817329 active] _scan_snaps no head for 7:778f5b62:::rbd_data.b0d052238e1f29.0000000000000584:b4 (have MIN) Sep 14 05:18:59 node1.ceph ceph-osd[1703]: 2017-09-14 05:18:59.381879 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ee( v 17029'6817330 (17029'6814253,17029'6817330] local-lis/les=16967/16968 n=3128 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16842) [32,34,1] r=2 lpr=16967 luod=0'0 crt=17029'6817330 lcod 17029'6817329 active] _scan_snaps no head for 7:778f5b62:::rbd_data.b0d052238e1f29.0000000000000584:b3 (have MIN) Sep 14 05:18:59 node1.ceph ceph-osd[1703]: 2017-09-14 05:18:59.381894 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ee( v 17029'6817330 (17029'6814253,17029'6817330] local-lis/les=16967/16968 n=3128 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16842) [32,34,1] r=2 lpr=16967 luod=0'0 crt=17029'6817330 lcod 17029'6817329 active] _scan_snaps no head for 7:778f5b62:::rbd_data.b0d052238e1f29.0000000000000584:b2 (have MIN) Sep 14 05:18:59 node1.ceph ceph-osd[1703]: 2017-09-14 05:18:59.381906 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ee( v 17029'6817330 (17029'6814253,17029'6817330] local-lis/les=16967/16968 n=3128 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16842) [32,34,1] r=2 lpr=16967 luod=0'0 crt=17029'6817330 lcod 17029'6817329 active] _scan_snaps no head for 7:778f5b62:::rbd_data.b0d052238e1f29.0000000000000584:b1 (have MIN) Sep 14 05:18:59 node1.ceph ceph-osd[1703]: 2017-09-14 05:18:59.381919 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ee( v 17029'6817330 (17029'6814253,17029'6817330] local-lis/les=16967/16968 n=3128 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16842) [32,34,1] r=2 lpr=16967 luod=0'0 crt=17029'6817330 lcod 17029'6817329 active] _scan_snaps no head for 7:778f5b62:::rbd_data.b0d052238e1f29.0000000000000584:b0 (have MIN) Sep 14 05:18:59 node1.ceph ceph-osd[1703]: 2017-09-14 05:18:59.381946 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ee( v 17029'6817330 (17029'6814253,17029'6817330] local-lis/les=16967/16968 n=3128 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16842) [32,34,1] r=2 lpr=16967 luod=0'0 crt=17029'6817330 lcod 17029'6817329 active] _scan_snaps no head for 7:778f5b62:::rbd_data.b0d052238e1f29.0000000000000584:ae (have MIN) Sep 14 05:19:09 node1.ceph ceph-osd[1703]: 2017-09-14 05:19:09.264001 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ee( v 17029'6817392 (17029'6814353,17029'6817392] local-lis/les=16967/16968 n=3132 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16842) [32,34,1] r=2 lpr=16967 luod=0'0 crt=17029'6817392 lcod 17029'6817391 active] _scan_snaps no head for 7:779f6166:::rbd_data.a6351b238e1f29.000000000000ba8b:9e (have MIN) Sep 14 05:19:11 node1.ceph ceph-osd[1703]: 2017-09-14 05:19:11.488903 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ee( v 17029'6817400 (17029'6814353,17029'6817400] local-lis/les=16967/16968 n=3132 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16842) [32,34,1] r=2 lpr=16967 luod=0'0 crt=17029'6817400 lcod 17029'6817399 active] _scan_snaps no head for 7:77a0e610:::rbd_data.a6351b238e1f29.00000000000212a8:9e (have MIN) Sep 14 05:19:12 node1.ceph ceph-osd[1703]: 2017-09-14 05:19:12.940632 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ee( v 17029'6817409 (17029'6814353,17029'6817409] local-lis/les=16967/16968 n=3132 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16842) [32,34,1] r=2 lpr=16967 luod=0'0 crt=17029'6817409 lcod 17029'6817408 active] _scan_snaps no head for 7:77a25122:::rbd_data.bd1c92ae8944a.00000000000016b7:d4 (have MIN) Sep 14 05:19:12 node1.ceph ceph-osd[1703]: 2017-09-14 05:19:12.940671 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ee( v 17029'6817409 (17029'6814353,17029'6817409] local-lis/les=16967/16968 n=3132 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16842) [32,34,1] r=2 lpr=16967 luod=0'0 crt=17029'6817409 lcod 17029'6817408 active] _scan_snaps no head for 7:77a25122:::rbd_data.bd1c92ae8944a.00000000000016b7:d2 (have MIN) Sep 14 05:19:25 node1.ceph ceph-osd[1703]: 2017-09-14 05:19:25.391600 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ee( v 17029'6817495 (17029'6814453,17029'6817495] local-lis/les=16967/16968 n=3138 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16842) [32,34,1] r=2 lpr=16967 luod=0'0 crt=17029'6817495 lcod 17029'6817494 active] _scan_snaps no head for 7:77b5c969:::rbd_data.a6351b238e1f29.00000000000202a9:9e (have MIN) Sep 14 05:19:25 node1.ceph ceph-osd[1703]: 2017-09-14 05:19:25.986319 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ee( v 17029'6817498 (17029'6814453,17029'6817498] local-lis/les=16967/16968 n=3138 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16842) [32,34,1] r=2 lpr=16967 luod=0'0 crt=17029'6817498 lcod 17029'6817497 active] _scan_snaps no head for 7:77b68d90:::rbd_data.bd1c92ae8944a.0000000000002e37:d4 (have MIN) Sep 14 05:19:25 node1.ceph ceph-osd[1703]: 2017-09-14 05:19:25.986348 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ee( v 17029'6817498 (17029'6814453,17029'6817498] local-lis/les=16967/16968 n=3138 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16842) [32,34,1] r=2 lpr=16967 luod=0'0 crt=17029'6817498 lcod 17029'6817497 active] _scan_snaps no head for 7:77b68d90:::rbd_data.bd1c92ae8944a.0000000000002e37:d2 (have MIN) Sep 14 05:19:28 node1.ceph ceph-osd[1703]: 2017-09-14 05:19:28.047774 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ee( v 17029'6817516 (17029'6814453,17029'6817516] local-lis/les=16967/16968 n=3139 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16842) [32,34,1] r=2 lpr=16967 luod=0'0 crt=17029'6817516 lcod 17029'6817515 active] _scan_snaps no head for 7:77bb12e3:::rbd_data.a74f60238e1f29.0000000000000e73:9c (have MIN) Sep 14 05:19:30 node1.ceph ceph-osd[1703]: 2017-09-14 05:19:30.574103 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ee( v 17029'6817536 (17029'6814453,17029'6817536] local-lis/les=16967/16968 n=3142 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16842) [32,34,1] r=2 lpr=16967 luod=0'0 crt=17029'6817536 lcod 17029'6817535 active] _scan_snaps no head for 7:77bff90f:::rbd_data.bd1c92ae8944a.00000000000030ff:d4 (have MIN) Sep 14 05:19:30 node1.ceph ceph-osd[1703]: 2017-09-14 05:19:30.574124 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ee( v 17029'6817536 (17029'6814453,17029'6817536] local-lis/les=16967/16968 n=3142 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16842) [32,34,1] r=2 lpr=16967 luod=0'0 crt=17029'6817536 lcod 17029'6817535 active] _scan_snaps no head for 7:77bff90f:::rbd_data.bd1c92ae8944a.00000000000030ff:d2 (have MIN) Sep 14 05:22:47 node1.ceph ceph-osd[1703]: 2017-09-14 05:22:47.230635 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.5a( v 17029'7752555 (17029'7749464,17029'7752555] local-lis/les=17009/17010 n=3015 ec=104/104 lis/c 17009/17009 les/c/f 17010/17019/0 17009/17009/16871) [1,32,20] r=0 lpr=17009 crt=17029'7752555 lcod 17029'7752554 mlcod 17029'7752554 active+clean+scrubbing] _scan_snaps no head for 7:5a04bf0c:::rbd_data.bd1c92ae8944a.0000000000002f50:d4 (have MIN) Sep 14 05:22:47 node1.ceph ceph-osd[1703]: 2017-09-14 05:22:47.230672 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.5a( v 17029'7752555 (17029'7749464,17029'7752555] local-lis/les=17009/17010 n=3015 ec=104/104 lis/c 17009/17009 les/c/f 17010/17019/0 17009/17009/16871) [1,32,20] r=0 lpr=17009 crt=17029'7752555 lcod 17029'7752554 mlcod 17029'7752554 active+clean+scrubbing] _scan_snaps no head for 7:5a04bf0c:::rbd_data.bd1c92ae8944a.0000000000002f50:d2 (have MIN) Sep 14 05:22:48 node1.ceph ceph-osd[1703]: 2017-09-14 05:22:48.732227 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.5a( v 17029'7752567 (17029'7749564,17029'7752567] local-lis/les=17009/17010 n=3016 ec=104/104 lis/c 17009/17009 les/c/f 17010/17019/0 17009/17009/16871) [1,32,20] r=0 lpr=17009 crt=17029'7752567 lcod 17029'7752566 mlcod 17029'7752566 active+clean+scrubbing] _scan_snaps no head for 7:5a07d42a:::rbd_data.bd1c92ae8944a.0000000000002159:d4 (have MIN) Sep 14 05:22:48 node1.ceph ceph-osd[1703]: 2017-09-14 05:22:48.732254 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.5a( v 17029'7752567 (17029'7749564,17029'7752567] local-lis/les=17009/17010 n=3016 ec=104/104 lis/c 17009/17009 les/c/f 17010/17019/0 17009/17009/16871) [1,32,20] r=0 lpr=17009 crt=17029'7752567 lcod 17029'7752566 mlcod 17029'7752566 active+clean+scrubbing] _scan_snaps no head for 7:5a07d42a:::rbd_data.bd1c92ae8944a.0000000000002159:d2 (have MIN) Sep 14 05:22:58 node1.ceph ceph-osd[1703]: 2017-09-14 05:22:58.680235 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.5a( v 17029'7752645 (17029'7749564,17029'7752645] local-lis/les=17009/17010 n=3022 ec=104/104 lis/c 17009/17009 les/c/f 17010/17019/0 17009/17009/16871) [1,32,20] r=0 lpr=17009 crt=17029'7752645 lcod 17029'7752644 mlcod 17029'7752644 active+clean+scrubbing] _scan_snaps no head for 7:5a191535:::rbd_data.a70641238e1f29.0000000000005280:ce (have MIN) Sep 14 05:22:58 node1.ceph ceph-osd[1703]: 2017-09-14 05:22:58.680268 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.5a( v 17029'7752645 (17029'7749564,17029'7752645] local-lis/les=17009/17010 n=3022 ec=104/104 lis/c 17009/17009 les/c/f 17010/17019/0 17009/17009/16871) [1,32,20] r=0 lpr=17009 crt=17029'7752645 lcod 17029'7752644 mlcod 17029'7752644 active+clean+scrubbing] _scan_snaps no head for 7:5a191535:::rbd_data.a70641238e1f29.0000000000005280:9d (have MIN) Sep 14 05:23:04 node1.ceph ceph-osd[1703]: 2017-09-14 05:23:04.146599 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.5a( v 17029'7752677 (17029'7749664,17029'7752677] local-lis/les=17009/17010 n=3022 ec=104/104 lis/c 17009/17009 les/c/f 17010/17019/0 17009/17009/16871) [1,32,20] r=0 lpr=17009 crt=17029'7752677 lcod 17029'7752676 mlcod 17029'7752676 active+clean+scrubbing] _scan_snaps no head for 7:5a2225f2:::rbd_data.a6351b238e1f29.0000000000022f75:9e (have MIN) Sep 14 05:23:04 node1.ceph ceph-osd[1703]: 2017-09-14 05:23:04.634559 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.5a( v 17029'7752681 (17029'7749664,17029'7752681] local-lis/les=17009/17010 n=3022 ec=104/104 lis/c 17009/17009 les/c/f 17010/17019/0 17009/17009/16871) [1,32,20] r=0 lpr=17009 crt=17029'7752681 lcod 17029'7752680 mlcod 17029'7752680 active+clean+scrubbing] _scan_snaps no head for 7:5a2323e9:::rbd_data.a6351b238e1f29.000000000002227e:9e (have MIN) Sep 14 05:23:09 node1.ceph ceph-osd[1703]: 2017-09-14 05:23:09.013906 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.5a( v 17029'7752712 (17029'7749664,17029'7752712] local-lis/les=17009/17010 n=3024 ec=104/104 lis/c 17009/17009 les/c/f 17010/17019/0 17009/17009/16871) [1,32,20] r=0 lpr=17009 crt=17029'7752712 lcod 17029'7752711 mlcod 17029'7752711 active+clean+scrubbing] _scan_snaps no head for 7:5a2aa008:::rbd_data.bd1c92ae8944a.0000000000001b3d:d2 (have MIN) Sep 14 05:37:43 node1.ceph ceph-osd[1703]: 2017-09-14 05:37:43.690830 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.11e( v 17029'7140866 (17029'7137803,17029'7140866] local-lis/les=16967/16968 n=3090 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16917/16967/16917) [13,1,39] r=1 lpr=16967 luod=0'0 crt=17029'7140866 lcod 17029'7140865 active] _scan_snaps no head for 7:78835b6a:::rbd_data.a4f318238e1f29.0000000000000ebc:8d (have MIN) Sep 14 05:37:49 node1.ceph ceph-osd[1703]: 2017-09-14 05:37:49.752365 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.11e( v 17029'7140905 (17029'7137904,17029'7140905] local-lis/les=16967/16968 n=3092 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16917/16967/16917) [13,1,39] r=1 lpr=16967 luod=0'0 crt=17029'7140905 lcod 17029'7140904 active] _scan_snaps no head for 7:788edb21:::rbd_data.a6351b238e1f29.000000000001d159:9e (have MIN) Sep 14 05:37:57 node1.ceph ceph-osd[1703]: 2017-09-14 05:37:57.139991 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.11e( v 17029'7140948 (17029'7137904,17029'7140948] local-lis/les=16967/16968 n=3093 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16917/16967/16917) [13,1,39] r=1 lpr=16967 luod=0'0 crt=17029'7140948 lcod 17029'7140947 active] _scan_snaps no head for 7:789c73f7:::rbd_data.a6351b238e1f29.000000000001e9ba:9e (have MIN) Sep 14 05:37:59 node1.ceph ceph-osd[1703]: 2017-09-14 05:37:59.595214 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.11e( v 17029'7140964 (17029'7137904,17029'7140964] local-lis/les=16967/16968 n=3094 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16917/16967/16917) [13,1,39] r=1 lpr=16967 luod=0'0 crt=17029'7140964 lcod 17029'7140963 active] _scan_snaps no head for 7:78a0b585:::rbd_data.bd1c92ae8944a.00000000000018ad:d4 (have MIN) Sep 14 05:37:59 node1.ceph ceph-osd[1703]: 2017-09-14 05:37:59.595246 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.11e( v 17029'7140964 (17029'7137904,17029'7140964] local-lis/les=16967/16968 n=3094 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16917/16967/16917) [13,1,39] r=1 lpr=16967 luod=0'0 crt=17029'7140964 lcod 17029'7140963 active] _scan_snaps no head for 7:78a0b585:::rbd_data.bd1c92ae8944a.00000000000018ad:d2 (have MIN) Sep 14 05:39:30 node1.ceph ceph-osd[1703]: 2017-09-14 05:39:30.905099 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.0( v 17029'4452427 (17021'4449425,17029'4452427] local-lis/les=16967/16968 n=3036 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16831) [30,1,11] r=1 lpr=16967 luod=0'0 crt=17029'4452427 lcod 17029'4452426 active] _scan_snaps no head for 7:0003b600:::rbd_data.a6351b238e1f29.00000000000197ed:9e (have MIN) Sep 14 05:39:39 node1.ceph ceph-osd[1703]: 2017-09-14 05:39:39.928841 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.0( v 17029'4452491 (17021'4449425,17029'4452491] local-lis/les=16967/16968 n=3040 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16831) [30,1,11] r=1 lpr=16967 luod=0'0 crt=17029'4452491 lcod 17029'4452490 active] _scan_snaps no head for 7:001201be:::rbd_data.c1ebe8238e1f29.0000000000000910:df (have MIN) Sep 14 05:39:40 node1.ceph ceph-osd[1703]: 2017-09-14 05:39:40.749771 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.0( v 17029'4452498 (17021'4449425,17029'4452498] local-lis/les=16967/16968 n=3040 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16831) [30,1,11] r=1 lpr=16967 luod=0'0 crt=17029'4452498 lcod 17029'4452497 active] _scan_snaps no head for 7:0013ec19:::rbd_data.a6351b238e1f29.0000000000026636:9e (have MIN) Sep 14 05:39:43 node1.ceph ceph-osd[1703]: 2017-09-14 05:39:43.747375 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.0( v 17029'4452519 (17021'4449425,17029'4452519] local-lis/les=16967/16968 n=3042 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16831) [30,1,11] r=1 lpr=16967 luod=0'0 crt=17029'4452519 lcod 17029'4452518 active] _scan_snaps no head for 7:0018bb42:::rbd_data.bd1c92ae8944a.000000000000141e:d4 (have MIN) Sep 14 05:39:43 node1.ceph ceph-osd[1703]: 2017-09-14 05:39:43.747422 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.0( v 17029'4452519 (17021'4449425,17029'4452519] local-lis/les=16967/16968 n=3042 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16831) [30,1,11] r=1 lpr=16967 luod=0'0 crt=17029'4452519 lcod 17029'4452518 active] _scan_snaps no head for 7:0018bb42:::rbd_data.bd1c92ae8944a.000000000000141e:d2 (have MIN) Sep 14 05:39:54 node1.ceph ceph-osd[1703]: 2017-09-14 05:39:54.698153 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.0( v 17029'4452572 (17029'4449525,17029'4452572] local-lis/les=16967/16968 n=3048 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16831) [30,1,11] r=1 lpr=16967 luod=0'0 lua=17029'4452571 crt=17029'4452572 lcod 17029'4452571 active] _scan_snaps no head for 7:0025e048:::rbd_data.b0d052238e1f29.000000000000016b:b5 (have MIN) Sep 14 05:39:54 node1.ceph ceph-osd[1703]: 2017-09-14 05:39:54.698201 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.0( v 17029'4452572 (17029'4449525,17029'4452572] local-lis/les=16967/16968 n=3048 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16831) [30,1,11] r=1 lpr=16967 luod=0'0 lua=17029'4452571 crt=17029'4452572 lcod 17029'4452571 active] _scan_snaps no head for 7:0025e048:::rbd_data.b0d052238e1f29.000000000000016b:b4 (have MIN) Sep 14 05:39:54 node1.ceph ceph-osd[1703]: 2017-09-14 05:39:54.698222 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.0( v 17029'4452572 (17029'4449525,17029'4452572] local-lis/les=16967/16968 n=3048 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16831) [30,1,11] r=1 lpr=16967 luod=0'0 lua=17029'4452571 crt=17029'4452572 lcod 17029'4452571 active] _scan_snaps no head for 7:0025e048:::rbd_data.b0d052238e1f29.000000000000016b:b3 (have MIN) Sep 14 05:39:54 node1.ceph ceph-osd[1703]: 2017-09-14 05:39:54.698240 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.0( v 17029'4452572 (17029'4449525,17029'4452572] local-lis/les=16967/16968 n=3048 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16831) [30,1,11] r=1 lpr=16967 luod=0'0 lua=17029'4452571 crt=17029'4452572 lcod 17029'4452571 active] _scan_snaps no head for 7:0025e048:::rbd_data.b0d052238e1f29.000000000000016b:b2 (have MIN) Sep 14 05:39:54 node1.ceph ceph-osd[1703]: 2017-09-14 05:39:54.698257 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.0( v 17029'4452572 (17029'4449525,17029'4452572] local-lis/les=16967/16968 n=3048 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16831) [30,1,11] r=1 lpr=16967 luod=0'0 lua=17029'4452571 crt=17029'4452572 lcod 17029'4452571 active] _scan_snaps no head for 7:0025e048:::rbd_data.b0d052238e1f29.000000000000016b:b1 (have MIN) Sep 14 05:39:54 node1.ceph ceph-osd[1703]: 2017-09-14 05:39:54.698275 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.0( v 17029'4452572 (17029'4449525,17029'4452572] local-lis/les=16967/16968 n=3048 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16831) [30,1,11] r=1 lpr=16967 luod=0'0 lua=17029'4452571 crt=17029'4452572 lcod 17029'4452571 active] _scan_snaps no head for 7:0025e048:::rbd_data.b0d052238e1f29.000000000000016b:b0 (have MIN) Sep 14 05:39:54 node1.ceph ceph-osd[1703]: 2017-09-14 05:39:54.698296 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.0( v 17029'4452572 (17029'4449525,17029'4452572] local-lis/les=16967/16968 n=3048 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16831) [30,1,11] r=1 lpr=16967 luod=0'0 lua=17029'4452571 crt=17029'4452572 lcod 17029'4452571 active] _scan_snaps no head for 7:0025e048:::rbd_data.b0d052238e1f29.000000000000016b:ae (have MIN) Sep 14 05:39:56 node1.ceph ceph-osd[1703]: 2017-09-14 05:39:56.418562 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.0( v 17029'4452578 (17029'4449525,17029'4452578] local-lis/les=16967/16968 n=3048 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16831) [30,1,11] r=1 lpr=16967 luod=0'0 crt=17029'4452578 lcod 17029'4452577 active] _scan_snaps no head for 7:00275c7b:::rbd_data.a6351b238e1f29.000000000001e750:9e (have MIN) Sep 14 05:40:09 node1.ceph ceph-osd[1703]: 2017-09-14 05:40:09.096479 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.0( v 17029'4452643 (17029'4449626,17029'4452643] local-lis/les=16967/16968 n=3054 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16831) [30,1,11] r=1 lpr=16967 luod=0'0 crt=17029'4452643 lcod 17029'4452642 active] _scan_snaps no head for 7:003664d0:::rbd_data.68c683238e1f29.0000000000000ab7:3d (have MIN) Sep 14 05:47:54 node1.ceph ceph-osd[1703]: 2017-09-14 05:47:54.084923 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[8.f4( v 17029'2520217 (17029'2517179,17029'2520217] local-lis/les=17000/17001 n=3354 ec=107/107 lis/c 17000/17000 les/c/f 17001/17017/0 17000/17000/16929) [16,1,24] r=1 lpr=17000 luod=0'0 crt=17029'2520217 lcod 17029'2520216 active] _scan_snaps no head for 8:2f389bc6:::rbd_data.9aca26238e1f29.0000000000003ed7:65 (have MIN) Sep 14 05:49:03 node1.ceph ceph-osd[1703]: 2017-09-14 05:49:03.814564 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.f4( v 17029'5288704 (17029'5285667,17029'5288704] local-lis/les=16967/16968 n=2993 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16848) [33,1,30] r=1 lpr=16967 luod=0'0 crt=17029'5288704 lcod 17029'5288703 active] _scan_snaps no head for 7:2f02395e:::rbd_data.bd1c92ae8944a.0000000000001cce:d2 (have MIN) Sep 14 05:49:04 node1.ceph ceph-osd[1703]: 2017-09-14 05:49:04.745822 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.f4( v 17029'5288716 (17029'5285667,17029'5288716] local-lis/les=16967/16968 n=2994 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16848) [33,1,30] r=1 lpr=16967 luod=0'0 crt=17029'5288716 lcod 17029'5288715 active] _scan_snaps no head for 7:2f047040:::rbd_data.c1ebe8238e1f29.0000000000002bcf:df (have MIN) Sep 14 05:49:08 node1.ceph ceph-osd[1703]: 2017-09-14 05:49:08.425863 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.f4( v 17029'5288752 (17029'5285667,17029'5288752] local-lis/les=16967/16968 n=2996 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16848) [33,1,30] r=1 lpr=16967 luod=0'0 crt=17029'5288752 lcod 17029'5288751 active] _scan_snaps no head for 7:2f0e17bd:::rbd_data.bd1c92ae8944a.0000000000002ae0:d4 (have MIN) Sep 14 05:49:08 node1.ceph ceph-osd[1703]: 2017-09-14 05:49:08.425892 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.f4( v 17029'5288752 (17029'5285667,17029'5288752] local-lis/les=16967/16968 n=2996 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16848) [33,1,30] r=1 lpr=16967 luod=0'0 crt=17029'5288752 lcod 17029'5288751 active] _scan_snaps no head for 7:2f0e17bd:::rbd_data.bd1c92ae8944a.0000000000002ae0:d2 (have MIN) Sep 14 05:49:08 node1.ceph ceph-osd[1703]: 2017-09-14 05:49:08.651254 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.f4( v 17029'5288752 (17029'5285667,17029'5288752] local-lis/les=16967/16968 n=2996 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16848) [33,1,30] r=1 lpr=16967 luod=0'0 crt=17029'5288752 lcod 17029'5288751 active] _scan_snaps no head for 7:2f0ea173:::rbd_data.a6351b238e1f29.000000000002696b:9e (have MIN) Sep 14 05:49:11 node1.ceph ceph-osd[1703]: 2017-09-14 05:49:11.196510 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.f4( v 17029'5288773 (17029'5285767,17029'5288773] local-lis/les=16967/16968 n=2997 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16848) [33,1,30] r=1 lpr=16967 luod=0'0 crt=17029'5288773 lcod 17029'5288772 active] _scan_snaps no head for 7:2f124bdd:::rbd_data.a6351b238e1f29.000000000002261e:9e (have MIN) Sep 14 05:49:12 node1.ceph ceph-osd[1703]: 2017-09-14 05:49:12.276225 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.f4( v 17029'5288790 (17029'5285767,17029'5288790] local-lis/les=16967/16968 n=2998 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16848) [33,1,30] r=1 lpr=16967 luod=0'0 crt=17029'5288790 lcod 17029'5288789 active] _scan_snaps no head for 7:2f156d15:::rbd_data.a6351b238e1f29.000000000001eb77:9e (have MIN) Sep 14 05:49:17 node1.ceph ceph-osd[1703]: 2017-09-14 05:49:17.798885 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.f4( v 17029'5288830 (17029'5285767,17029'5288830] local-lis/les=16967/16968 n=3000 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16848) [33,1,30] r=1 lpr=16967 luod=0'0 crt=17029'5288830 lcod 17029'5288829 active] _scan_snaps no head for 7:2f1f167b:::rbd_data.bd1c92ae8944a.000000000000230f:d4 (have MIN) Sep 14 05:49:17 node1.ceph ceph-osd[1703]: 2017-09-14 05:49:17.798928 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.f4( v 17029'5288830 (17029'5285767,17029'5288830] local-lis/les=16967/16968 n=3000 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16848) [33,1,30] r=1 lpr=16967 luod=0'0 crt=17029'5288830 lcod 17029'5288829 active] _scan_snaps no head for 7:2f1f167b:::rbd_data.bd1c92ae8944a.000000000000230f:d2 (have MIN) Sep 14 05:52:12 node1.ceph ceph-osd[1703]: 2017-09-14 05:52:12.047097 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[8.170( v 17029'2377231 (16792'2374174,17029'2377231] local-lis/les=16967/16968 n=3334 ec=107/107 lis/c 16967/16967 les/c/f 16968/16968/0 16894/16967/16871) [1,35,8] r=0 lpr=16967 crt=17029'2377231 lcod 17029'2377230 mlcod 17029'2377230 active+clean+scrubbing] _scan_snaps no head for 8:0e8febfa:::rbd_data.9aca26238e1f29.00000000000021cf:65 (have MIN) Sep 14 05:59:15 node1.ceph ceph-osd[1703]: 2017-09-14 05:59:15.768022 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1a4( v 17029'10799870 (17029'10796779,17029'10799870] local-lis/les=16967/16968 n=2996 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,9,1] r=2 lpr=16967 luod=0'0 crt=17029'10799870 lcod 17029'10799869 active] _scan_snaps no head for 7:25829f16:::rbd_data.bd1c92ae8944a.000000000000659e:d2 (have MIN) Sep 14 05:59:17 node1.ceph ceph-osd[1703]: 2017-09-14 05:59:17.789555 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1a4( v 17029'10799889 (17029'10796879,17029'10799889] local-lis/les=16967/16968 n=2999 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,9,1] r=2 lpr=16967 luod=0'0 crt=17029'10799889 lcod 17029'10799887 active] _scan_snaps no head for 7:2586b1bc:::rbd_data.a6351b238e1f29.0000000000020361:9e (have MIN) Sep 14 05:59:18 node1.ceph ceph-osd[1703]: 2017-09-14 05:59:18.062600 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1a4( v 17029'10799891 (17029'10796879,17029'10799891] local-lis/les=16967/16968 n=2999 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,9,1] r=2 lpr=16967 luod=0'0 crt=17029'10799891 lcod 17029'10799890 active] _scan_snaps no head for 7:25876ffa:::rbd_data.bd1c92ae8944a.0000000000001ef1:d4 (have MIN) Sep 14 05:59:18 node1.ceph ceph-osd[1703]: 2017-09-14 05:59:18.062618 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1a4( v 17029'10799891 (17029'10796879,17029'10799891] local-lis/les=16967/16968 n=2999 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,9,1] r=2 lpr=16967 luod=0'0 crt=17029'10799891 lcod 17029'10799890 active] _scan_snaps no head for 7:25876ffa:::rbd_data.bd1c92ae8944a.0000000000001ef1:d2 (have MIN) Sep 14 05:59:18 node1.ceph ceph-osd[1703]: 2017-09-14 05:59:18.906263 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1a4( v 17029'10799896 (17029'10796879,17029'10799896] local-lis/les=16967/16968 n=2999 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,9,1] r=2 lpr=16967 luod=0'0 crt=17029'10799896 lcod 17029'10799895 active] _scan_snaps no head for 7:258899e6:::rbd_data.a6351b238e1f29.000000000001bca3:9e (have MIN) Sep 14 05:59:22 node1.ceph ceph-osd[1703]: 2017-09-14 05:59:22.517520 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1a4( v 17029'10799922 (17029'10796879,17029'10799922] local-lis/les=16967/16968 n=2999 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,9,1] r=2 lpr=16967 luod=0'0 crt=17029'10799922 lcod 17029'10799921 active] _scan_snaps no head for 7:258f3963:::rbd_data.8f8aad238e1f29.0000000000000506:54 (have MIN) Sep 14 05:59:25 node1.ceph ceph-osd[1703]: 2017-09-14 05:59:25.374667 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1a4( v 17029'10799939 (17029'10796879,17029'10799939] local-lis/les=16967/16968 n=3002 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,9,1] r=2 lpr=16967 luod=0'0 crt=17029'10799939 lcod 17029'10799938 active] _scan_snaps no head for 7:25935890:::rbd_data.a6351b238e1f29.00000000000192e0:d1 (have MIN) Sep 14 05:59:25 node1.ceph ceph-osd[1703]: 2017-09-14 05:59:25.374711 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1a4( v 17029'10799939 (17029'10796879,17029'10799939] local-lis/les=16967/16968 n=3002 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,9,1] r=2 lpr=16967 luod=0'0 crt=17029'10799939 lcod 17029'10799938 active] _scan_snaps no head for 7:25935890:::rbd_data.a6351b238e1f29.00000000000192e0:9e (have MIN) Sep 14 05:59:34 node1.ceph ceph-osd[1703]: 2017-09-14 05:59:34.033906 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1a4( v 17029'10799993 (17029'10796979,17029'10799993] local-lis/les=16967/16968 n=3008 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,9,1] r=2 lpr=16967 luod=0'0 lua=17029'10799988 crt=17029'10799993 lcod 17029'10799992 active] _scan_snaps no head for 7:25a25c73:::rbd_data.a70641238e1f29.0000000000005503:ce (have MIN) Sep 14 05:59:34 node1.ceph ceph-osd[1703]: 2017-09-14 05:59:34.033932 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1a4( v 17029'10799993 (17029'10796979,17029'10799993] local-lis/les=16967/16968 n=3008 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,9,1] r=2 lpr=16967 luod=0'0 lua=17029'10799988 crt=17029'10799993 lcod 17029'10799992 active] _scan_snaps no head for 7:25a25c73:::rbd_data.a70641238e1f29.0000000000005503:9d (have MIN) Sep 14 05:59:46 node1.ceph ceph-osd[1703]: 2017-09-14 05:59:46.836191 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1a4( v 17029'10800086 (17029'10797079,17029'10800086] local-lis/les=16967/16968 n=3016 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,9,1] r=2 lpr=16967 luod=0'0 lua=17029'10800078 crt=17029'10800086 lcod 17029'10800085 active] _scan_snaps no head for 7:25b800b2:::rbd_data.b0d052238e1f29.00000000000002f0:b5 (have MIN) Sep 14 05:59:46 node1.ceph ceph-osd[1703]: 2017-09-14 05:59:46.836212 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1a4( v 17029'10800086 (17029'10797079,17029'10800086] local-lis/les=16967/16968 n=3016 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,9,1] r=2 lpr=16967 luod=0'0 lua=17029'10800078 crt=17029'10800086 lcod 17029'10800085 active] _scan_snaps no head for 7:25b800b2:::rbd_data.b0d052238e1f29.00000000000002f0:b4 (have MIN) Sep 14 05:59:46 node1.ceph ceph-osd[1703]: 2017-09-14 05:59:46.836219 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1a4( v 17029'10800086 (17029'10797079,17029'10800086] local-lis/les=16967/16968 n=3016 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,9,1] r=2 lpr=16967 luod=0'0 lua=17029'10800078 crt=17029'10800086 lcod 17029'10800085 active] _scan_snaps no head for 7:25b800b2:::rbd_data.b0d052238e1f29.00000000000002f0:b3 (have MIN) Sep 14 05:59:46 node1.ceph ceph-osd[1703]: 2017-09-14 05:59:46.836224 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1a4( v 17029'10800086 (17029'10797079,17029'10800086] local-lis/les=16967/16968 n=3016 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,9,1] r=2 lpr=16967 luod=0'0 lua=17029'10800078 crt=17029'10800086 lcod 17029'10800085 active] _scan_snaps no head for 7:25b800b2:::rbd_data.b0d052238e1f29.00000000000002f0:b2 (have MIN) Sep 14 05:59:46 node1.ceph ceph-osd[1703]: 2017-09-14 05:59:46.836229 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1a4( v 17029'10800086 (17029'10797079,17029'10800086] local-lis/les=16967/16968 n=3016 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,9,1] r=2 lpr=16967 luod=0'0 lua=17029'10800078 crt=17029'10800086 lcod 17029'10800085 active] _scan_snaps no head for 7:25b800b2:::rbd_data.b0d052238e1f29.00000000000002f0:b1 (have MIN) Sep 14 05:59:46 node1.ceph ceph-osd[1703]: 2017-09-14 05:59:46.836234 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1a4( v 17029'10800086 (17029'10797079,17029'10800086] local-lis/les=16967/16968 n=3016 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,9,1] r=2 lpr=16967 luod=0'0 lua=17029'10800078 crt=17029'10800086 lcod 17029'10800085 active] _scan_snaps no head for 7:25b800b2:::rbd_data.b0d052238e1f29.00000000000002f0:b0 (have MIN) Sep 14 05:59:46 node1.ceph ceph-osd[1703]: 2017-09-14 05:59:46.836239 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1a4( v 17029'10800086 (17029'10797079,17029'10800086] local-lis/les=16967/16968 n=3016 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,9,1] r=2 lpr=16967 luod=0'0 lua=17029'10800078 crt=17029'10800086 lcod 17029'10800085 active] _scan_snaps no head for 7:25b800b2:::rbd_data.b0d052238e1f29.00000000000002f0:ae (have MIN) Sep 14 05:59:47 node1.ceph ceph-osd[1703]: 2017-09-14 05:59:47.893420 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1a4( v 17029'10800095 (17029'10797079,17029'10800095] local-lis/les=16967/16968 n=3016 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,9,1] r=2 lpr=16967 luod=0'0 crt=17029'10800095 lcod 17029'10800094 active] _scan_snaps no head for 7:25ba93a4:::rbd_data.a6351b238e1f29.000000000001e7ae:9e (have MIN) Sep 14 05:59:49 node1.ceph ceph-osd[1703]: 2017-09-14 05:59:49.210552 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1a4( v 17029'10800103 (17029'10797079,17029'10800103] local-lis/les=16967/16968 n=3016 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,9,1] r=2 lpr=16967 luod=0'0 crt=17029'10800103 lcod 17029'10800102 active] _scan_snaps no head for 7:25bc014b:::rbd_data.a6351b238e1f29.00000000000094a4:9e (have MIN) Sep 14 06:08:39 node1.ceph ceph-osd[1703]: 2017-09-14 06:08:39.322813 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.99( v 17029'8437261 (17029'8434239,17029'8437261] local-lis/les=16990/16991 n=3107 ec=104/104 lis/c 16990/16990 les/c/f 16991/17021/0 16990/16990/16990) [18,1,29] r=1 lpr=16990 luod=0'0 crt=17029'8437261 lcod 17029'8437260 active] _scan_snaps no head for 7:991be561:::rbd_data.bd1c92ae8944a.0000000000001324:d4 (have MIN) Sep 14 06:08:39 node1.ceph ceph-osd[1703]: 2017-09-14 06:08:39.322844 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.99( v 17029'8437261 (17029'8434239,17029'8437261] local-lis/les=16990/16991 n=3107 ec=104/104 lis/c 16990/16990 les/c/f 16991/17021/0 16990/16990/16990) [18,1,29] r=1 lpr=16990 luod=0'0 crt=17029'8437261 lcod 17029'8437260 active] _scan_snaps no head for 7:991be561:::rbd_data.bd1c92ae8944a.0000000000001324:d2 (have MIN) Sep 14 06:08:43 node1.ceph ceph-osd[1703]: 2017-09-14 06:08:43.132424 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.99( v 17029'8437287 (17029'8434239,17029'8437287] local-lis/les=16990/16991 n=3108 ec=104/104 lis/c 16990/16990 les/c/f 16991/17021/0 16990/16990/16990) [18,1,29] r=1 lpr=16990 luod=0'0 crt=17029'8437287 lcod 17029'8437286 active] _scan_snaps no head for 7:992266f6:::rbd_data.a6351b238e1f29.000000000001ac5c:9e (have MIN) Sep 14 06:08:52 node1.ceph ceph-osd[1703]: 2017-09-14 06:08:52.210167 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.99( v 17029'8437357 (17029'8434339,17029'8437357] local-lis/les=16990/16991 n=3111 ec=104/104 lis/c 16990/16990 les/c/f 16991/17021/0 16990/16990/16990) [18,1,29] r=1 lpr=16990 luod=0'0 crt=17029'8437357 lcod 17029'8437356 active] _scan_snaps no head for 7:9932d568:::rbd_data.a6351b238e1f29.00000000000285b7:9e (have MIN) Sep 14 06:08:54 node1.ceph ceph-osd[1703]: 2017-09-14 06:08:54.096179 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.99( v 17029'8437371 (17029'8434339,17029'8437371] local-lis/les=16990/16991 n=3111 ec=104/104 lis/c 16990/16990 les/c/f 16991/17021/0 16990/16990/16990) [18,1,29] r=1 lpr=16990 luod=0'0 crt=17029'8437371 lcod 17029'8437370 active] _scan_snaps no head for 7:99374059:::rbd_data.a6351b238e1f29.000000000001fe69:9e (have MIN) Sep 14 06:08:57 node1.ceph ceph-osd[1703]: 2017-09-14 06:08:57.192284 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.99( v 17029'8437397 (17029'8434339,17029'8437397] local-lis/les=16990/16991 n=3112 ec=104/104 lis/c 16990/16990 les/c/f 16991/17021/0 16990/16990/16990) [18,1,29] r=1 lpr=16990 luod=0'0 crt=17029'8437397 lcod 17029'8437396 active] _scan_snaps no head for 7:993e1f60:::rbd_data.a6351b238e1f29.000000000002b080:9e (have MIN) Sep 14 06:08:58 node1.ceph ceph-osd[1703]: 2017-09-14 06:08:58.277675 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.99( v 17029'8437409 (17029'8434339,17029'8437409] local-lis/les=16990/16991 n=3114 ec=104/104 lis/c 16990/16990 les/c/f 16991/17021/0 16990/16990/16990) [18,1,29] r=1 lpr=16990 luod=0'0 crt=17029'8437409 lcod 17029'8437408 active] _scan_snaps no head for 7:993ffe21:::rbd_data.a6351b238e1f29.000000000001b0c6:9e (have MIN) Sep 14 06:11:33 node1.ceph ceph-osd[1703]: 2017-09-14 06:11:33.130433 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1c7( v 17029'7951514 (17029'7948453,17029'7951514] local-lis/les=16967/16968 n=3015 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16932/16967/16932) [14,1,33] r=1 lpr=16967 luod=0'0 crt=17029'7951514 lcod 17029'7951513 active] _scan_snaps no head for 7:e383121b:::rbd_data.bd1c92ae8944a.0000000000003b19:d2 (have MIN) Sep 14 06:11:39 node1.ceph ceph-osd[1703]: 2017-09-14 06:11:39.026285 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1c7( v 17029'7951536 (17029'7948453,17029'7951536] local-lis/les=16967/16968 n=3015 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16932/16967/16932) [14,1,33] r=1 lpr=16967 luod=0'0 crt=17029'7951536 lcod 17029'7951535 active] _scan_snaps no head for 7:e384aefd:::rbd_data.a6351b238e1f29.0000000000028c15:9e (have MIN) Sep 14 06:11:49 node1.ceph ceph-osd[1703]: 2017-09-14 06:11:49.025831 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1c7( v 17029'7951564 (17029'7948553,17029'7951564] local-lis/les=16967/16968 n=3015 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16932/16967/16932) [14,1,33] r=1 lpr=16967 luod=0'0 crt=17029'7951564 lcod 17029'7951563 active] _scan_snaps no head for 7:e386c33c:::rbd_data.a6351b238e1f29.000000000001d944:9e (have MIN) Sep 14 06:11:56 node1.ceph ceph-osd[1703]: 2017-09-14 06:11:56.196665 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1c7( v 17029'7951582 (17029'7948553,17029'7951582] local-lis/les=16967/16968 n=3015 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16932/16967/16932) [14,1,33] r=1 lpr=16967 luod=0'0 crt=17029'7951582 lcod 17029'7951581 active] _scan_snaps no head for 7:e388a90f:::rbd_data.bd1c92ae8944a.0000000000001718:d4 (have MIN) Sep 14 06:11:56 node1.ceph ceph-osd[1703]: 2017-09-14 06:11:56.196692 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1c7( v 17029'7951582 (17029'7948553,17029'7951582] local-lis/les=16967/16968 n=3015 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16932/16967/16932) [14,1,33] r=1 lpr=16967 luod=0'0 crt=17029'7951582 lcod 17029'7951581 active] _scan_snaps no head for 7:e388a90f:::rbd_data.bd1c92ae8944a.0000000000001718:d2 (have MIN) Sep 14 06:12:48 node1.ceph ceph-osd[1703]: 2017-09-14 06:12:48.053921 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1c7( v 17029'7951701 (17029'7948653,17029'7951701] local-lis/les=16967/16968 n=3020 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16932/16967/16932) [14,1,33] r=1 lpr=16967 luod=0'0 crt=17029'7951701 lcod 17029'7951700 active] _scan_snaps no head for 7:e3963682:::rbd_data.a6351b238e1f29.000000000002964a:9e (have MIN) Sep 14 06:13:12 node1.ceph ceph-osd[1703]: 2017-09-14 06:13:12.806303 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1c7( v 17029'7951751 (17029'7948653,17029'7951751] local-lis/les=16967/16968 n=3020 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16932/16967/16932) [14,1,33] r=1 lpr=16967 luod=0'0 crt=17029'7951751 lcod 17029'7951750 active] _scan_snaps no head for 7:e39c128d:::rbd_data.a6351b238e1f29.000000000001ac49:9e (have MIN) Sep 14 06:13:58 node1.ceph ceph-osd[1703]: 2017-09-14 06:13:58.239167 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1c7( v 17029'7951852 (17029'7948753,17029'7951852] local-lis/les=16967/16968 n=3021 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16932/16967/16932) [14,1,33] r=1 lpr=16967 luod=0'0 crt=17029'7951852 lcod 17029'7951851 active] _scan_snaps no head for 7:e3a64ce3:::rbd_data.bd1c92ae8944a.0000000000000b77:d2 (have MIN) Sep 14 06:14:14 node1.ceph ceph-osd[1703]: 2017-09-14 06:14:14.645002 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1c7( v 17029'7951878 (17029'7948853,17029'7951878] local-lis/les=16967/16968 n=3022 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16932/16967/16932) [14,1,33] r=1 lpr=16967 luod=0'0 crt=17029'7951878 lcod 17029'7951877 active] _scan_snaps no head for 7:e3aa5319:::rbd_data.a6351b238e1f29.000000000001c8c0:9e (have MIN) Sep 14 06:14:47 node1.ceph ceph-osd[1703]: 2017-09-14 06:14:47.430028 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1c7( v 17029'7951949 (17029'7948853,17029'7951949] local-lis/les=16967/16968 n=3027 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16932/16967/16932) [14,1,33] r=1 lpr=16967 luod=0'0 crt=17029'7951949 lcod 17029'7951948 active] _scan_snaps no head for 7:e3b15f3c:::rbd_data.bd1c92ae8944a.0000000000000b4c:d4 (have MIN) Sep 14 06:14:47 node1.ceph ceph-osd[1703]: 2017-09-14 06:14:47.430065 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1c7( v 17029'7951949 (17029'7948853,17029'7951949] local-lis/les=16967/16968 n=3027 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16932/16967/16932) [14,1,33] r=1 lpr=16967 luod=0'0 crt=17029'7951949 lcod 17029'7951948 active] _scan_snaps no head for 7:e3b15f3c:::rbd_data.bd1c92ae8944a.0000000000000b4c:d2 (have MIN) Sep 14 06:15:08 node1.ceph ceph-osd[1703]: 2017-09-14 06:15:08.480850 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1c7( v 17029'7952010 (17029'7948953,17029'7952010] local-lis/les=16967/16968 n=3028 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16932/16967/16932) [14,1,33] r=1 lpr=16967 luod=0'0 crt=17029'7952010 lcod 17029'7952009 active] _scan_snaps no head for 7:e3b6c7da:::rbd_data.bd1c92ae8944a.0000000000001614:d2 (have MIN) Sep 14 06:15:36 node1.ceph ceph-osd[1703]: 2017-09-14 06:15:36.738825 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1c7( v 17029'7952063 (17029'7949054,17029'7952063] local-lis/les=16967/16968 n=3030 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16932/16967/16932) [14,1,33] r=1 lpr=16967 luod=0'0 lua=17029'7952062 crt=17029'7952063 lcod 17029'7952062 active] _scan_snaps no head for 7:e3bdc6ec:::rbd_data.bd1c92ae8944a.000000000000032d:d4 (have MIN) Sep 14 06:15:36 node1.ceph ceph-osd[1703]: 2017-09-14 06:15:36.738856 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.1c7( v 17029'7952063 (17029'7949054,17029'7952063] local-lis/les=16967/16968 n=3030 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16932/16967/16932) [14,1,33] r=1 lpr=16967 luod=0'0 lua=17029'7952062 crt=17029'7952063 lcod 17029'7952062 active] _scan_snaps no head for 7:e3bdc6ec:::rbd_data.bd1c92ae8944a.000000000000032d:d2 (have MIN) Sep 14 06:19:36 node1.ceph ceph-osd[1703]: 2017-09-14 06:19:36.928978 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.3b7( v 17029'4831113 (16934'4828058,17029'4831113] local-lis/les=16967/16968 n=2978 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16831) [30,1,15] r=1 lpr=16967 luod=0'0 crt=17029'4831113 lcod 17029'4831112 active] _scan_snaps no head for 7:edc1e3dc:::rbd_data.bd1c92ae8944a.0000000000001a3e:d4 (have MIN) Sep 14 06:19:36 node1.ceph ceph-osd[1703]: 2017-09-14 06:19:36.929014 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.3b7( v 17029'4831113 (16934'4828058,17029'4831113] local-lis/les=16967/16968 n=2978 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16831) [30,1,15] r=1 lpr=16967 luod=0'0 crt=17029'4831113 lcod 17029'4831112 active] _scan_snaps no head for 7:edc1e3dc:::rbd_data.bd1c92ae8944a.0000000000001a3e:d2 (have MIN) Sep 14 06:19:42 node1.ceph ceph-osd[1703]: 2017-09-14 06:19:42.785234 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.3b7( v 17029'4831173 (16935'4828159,17029'4831173] local-lis/les=16967/16968 n=2982 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16831) [30,1,15] r=1 lpr=16967 luod=0'0 crt=17029'4831173 lcod 17029'4831172 active] _scan_snaps no head for 7:edcd62d4:::rbd_data.bd1c92ae8944a.0000000000005803:d2 (have MIN) Sep 14 06:19:43 node1.ceph ceph-osd[1703]: 2017-09-14 06:19:43.331398 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.3b7( v 17029'4831179 (16935'4828159,17029'4831179] local-lis/les=16967/16968 n=2983 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16831) [30,1,15] r=1 lpr=16967 luod=0'0 crt=17029'4831179 lcod 17029'4831178 active] _scan_snaps no head for 7:edcf2c4e:::rbd_data.4044a9238e1f29.0000000000000aa0:19 (have MIN) Sep 14 06:20:00 node1.ceph ceph-osd[1703]: 2017-09-14 06:20:00.259243 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.3b7( v 17029'4831337 (16936'4828259,17029'4831337] local-lis/les=16967/16968 n=2993 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16831) [30,1,15] r=1 lpr=16967 luod=0'0 crt=17029'4831337 lcod 17029'4831336 active] _scan_snaps no head for 7:edef00c3:::rbd_data.a70641238e1f29.00000000000066cd:ce (have MIN) Sep 14 06:20:00 node1.ceph ceph-osd[1703]: 2017-09-14 06:20:00.259278 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.3b7( v 17029'4831337 (16936'4828259,17029'4831337] local-lis/les=16967/16968 n=2993 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16831) [30,1,15] r=1 lpr=16967 luod=0'0 crt=17029'4831337 lcod 17029'4831336 active] _scan_snaps no head for 7:edef00c3:::rbd_data.a70641238e1f29.00000000000066cd:9d (have MIN) Sep 14 06:24:49 node1.ceph ceph-osd[1703]: 2017-09-14 06:24:49.354401 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[8.293( v 17029'2655199 (17029'2652154,17029'2655199] local-lis/les=16967/16968 n=3489 ec=2548/2548 lis/c 16967/16967 les/c/f 16968/16968/0 16909/16967/16840) [29,9,1] r=2 lpr=16967 luod=0'0 crt=17029'2655199 lcod 17029'2655198 active] _scan_snaps no head for 8:c97498ef:::rbd_data.9aca26238e1f29.0000000000001265:65 (have MIN) Sep 14 06:32:57 node1.ceph ceph-osd[1703]: 2017-09-14 06:32:57.462324 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.5f( v 17029'14294634 (17029'14291574,17029'14294634] local-lis/les=16967/16968 n=3193 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16831) [30,11,1] r=2 lpr=16967 luod=0'0 crt=17029'14294634 lcod 17029'14294633 active] _scan_snaps no head for 7:fa1e06e6:::rbd_data.bd1c92ae8944a.0000000000005928:d2 (have MIN) Sep 14 06:33:12 node1.ceph ceph-osd[1703]: 2017-09-14 06:33:12.688872 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.5f( v 17029'14294750 (17029'14291674,17029'14294750] local-lis/les=16967/16968 n=3199 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16831) [30,11,1] r=2 lpr=16967 luod=0'0 crt=17029'14294750 lcod 17029'14294749 active] _scan_snaps no head for 7:fa338bd2:::rbd_data.bd1c92ae8944a.0000000000003024:d4 (have MIN) Sep 14 06:33:12 node1.ceph ceph-osd[1703]: 2017-09-14 06:33:12.688924 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.5f( v 17029'14294750 (17029'14291674,17029'14294750] local-lis/les=16967/16968 n=3199 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16831) [30,11,1] r=2 lpr=16967 luod=0'0 crt=17029'14294750 lcod 17029'14294749 active] _scan_snaps no head for 7:fa338bd2:::rbd_data.bd1c92ae8944a.0000000000003024:d2 (have MIN) Sep 14 06:33:13 node1.ceph ceph-osd[1703]: 2017-09-14 06:33:13.201613 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.5f( v 17029'14294751 (17029'14291674,17029'14294751] local-lis/les=16967/16968 n=3199 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16831) [30,11,1] r=2 lpr=16967 luod=0'0 crt=17029'14294751 lcod 17029'14294750 active] _scan_snaps no head for 7:fa33e5aa:::rbd_data.bd1c92ae8944a.00000000000036a0:d2 (have MIN) Sep 14 06:33:15 node1.ceph ceph-osd[1703]: 2017-09-14 06:33:15.196538 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.5f( v 17029'14294765 (17029'14291674,17029'14294765] local-lis/les=16967/16968 n=3199 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16831) [30,11,1] r=2 lpr=16967 luod=0'0 crt=17029'14294765 lcod 17029'14294764 active] _scan_snaps no head for 7:fa378993:::rbd_data.a6351b238e1f29.000000000001bb13:9e (have MIN) Sep 14 06:33:16 node1.ceph ceph-osd[1703]: 2017-09-14 06:33:16.968031 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.5f( v 17029'14294771 (17029'14291674,17029'14294771] local-lis/les=16967/16968 n=3199 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16831) [30,11,1] r=2 lpr=16967 luod=0'0 crt=17029'14294771 lcod 17029'14294770 active] _scan_snaps no head for 7:fa3a3679:::rbd_data.a6351b238e1f29.000000000001c9e9:9e (have MIN) Sep 14 06:33:43 node1.ceph ceph-osd[1703]: 2017-09-14 06:33:43.583166 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.8f( v 17029'5701583 (17029'5698504,17029'5701583] local-lis/les=16967/16968 n=3050 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16909/16967/16831) [30,9,1] r=2 lpr=16967 luod=0'0 crt=17029'5701583 lcod 17029'5701582 active] _scan_snaps no head for 7:f1125769:::rbd_data.a70641238e1f29.00000000000057c6:ce (have MIN) Sep 14 06:33:43 node1.ceph ceph-osd[1703]: 2017-09-14 06:33:43.583191 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.8f( v 17029'5701583 (17029'5698504,17029'5701583] local-lis/les=16967/16968 n=3050 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16909/16967/16831) [30,9,1] r=2 lpr=16967 luod=0'0 crt=17029'5701583 lcod 17029'5701582 active] _scan_snaps no head for 7:f1125769:::rbd_data.a70641238e1f29.00000000000057c6:9d (have MIN) Sep 14 06:33:49 node1.ceph ceph-osd[1703]: 2017-09-14 06:33:49.198929 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.8f( v 17029'5701631 (17029'5698604,17029'5701631] local-lis/les=16967/16968 n=3053 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16909/16967/16831) [30,9,1] r=2 lpr=16967 luod=0'0 crt=17029'5701631 lcod 17029'5701630 active] _scan_snaps no head for 7:f11d4dd6:::rbd_data.b737b238e1f29.0000000000000314:8 (have MIN) Sep 14 06:33:49 node1.ceph ceph-osd[1703]: 2017-09-14 06:33:49.718707 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.8f( v 17029'5701635 (17029'5698604,17029'5701635] local-lis/les=16967/16968 n=3053 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16909/16967/16831) [30,9,1] r=2 lpr=16967 luod=0'0 crt=17029'5701635 lcod 17029'5701634 active] _scan_snaps no head for 7:f11e897a:::rbd_data.bd1c92ae8944a.00000000000053b5:d2 (have MIN) Sep 14 06:33:53 node1.ceph ceph-osd[1703]: 2017-09-14 06:33:53.527562 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.8f( v 17029'5701657 (17029'5698604,17029'5701657] local-lis/les=16967/16968 n=3055 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16909/16967/16831) [30,9,1] r=2 lpr=16967 luod=0'0 crt=17029'5701657 lcod 17029'5701656 active] _scan_snaps no head for 7:f1249bcb:::rbd_data.a6351b238e1f29.000000000001a3ea:d1 (have MIN) Sep 14 06:33:53 node1.ceph ceph-osd[1703]: 2017-09-14 06:33:53.527589 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.8f( v 17029'5701657 (17029'5698604,17029'5701657] local-lis/les=16967/16968 n=3055 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16909/16967/16831) [30,9,1] r=2 lpr=16967 luod=0'0 crt=17029'5701657 lcod 17029'5701656 active] _scan_snaps no head for 7:f1249bcb:::rbd_data.a6351b238e1f29.000000000001a3ea:9e (have MIN) Sep 14 06:33:58 node1.ceph ceph-osd[1703]: 2017-09-14 06:33:58.712400 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.8f( v 17029'5701696 (17029'5698604,17029'5701696] local-lis/les=16967/16968 n=3057 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16909/16967/16831) [30,9,1] r=2 lpr=16967 luod=0'0 crt=17029'5701696 lcod 17029'5701695 active] _scan_snaps no head for 7:f12ed4f9:::rbd_data.a6351b238e1f29.000000000002838e:9e (have MIN) Sep 14 06:34:00 node1.ceph ceph-osd[1703]: 2017-09-14 06:34:00.539374 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.8f( v 17029'5701710 (17029'5698704,17029'5701710] local-lis/les=16967/16968 n=3057 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16909/16967/16831) [30,9,1] r=2 lpr=16967 luod=0'0 crt=17029'5701710 lcod 17029'5701709 active] _scan_snaps no head for 7:f131990d:::rbd_data.a74f60238e1f29.000000000000167a:cf (have MIN) Sep 14 06:45:39 node1.ceph ceph-osd[1703]: 2017-09-14 06:45:39.453747 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[8.3d2( v 17029'2817669 (17029'2814640,17029'2817669] local-lis/les=17006/17007 n=3418 ec=2548/2548 lis/c 17006/17006 les/c/f 17007/17019/0 17006/17006/16871) [1,33,25] r=0 lpr=17006 crt=17029'2817669 lcod 17029'2817668 mlcod 17029'2817668 active+clean+scrubbing] _scan_snaps no head for 8:4bcef9dd:::rbd_data.d393db238e1f29.0000000000001d8a:67 (have MIN) Sep 14 07:01:24 node1.ceph ceph-osd[1703]: 2017-09-14 07:01:24.293872 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.318( v 17029'11336075 (17029'11333014,17029'11336075] local-lis/les=16967/16968 n=3053 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16834) [28,33,1] r=2 lpr=16967 luod=0'0 lua=17029'11336071 crt=17029'11336075 lcod 17029'11336074 active] _scan_snaps no head for 7:18d626d1:::rbd_data.bd1c92ae8944a.0000000000002e82:d4 (have MIN) Sep 14 07:01:24 node1.ceph ceph-osd[1703]: 2017-09-14 07:01:24.293890 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.318( v 17029'11336075 (17029'11333014,17029'11336075] local-lis/les=16967/16968 n=3053 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16834) [28,33,1] r=2 lpr=16967 luod=0'0 lua=17029'11336071 crt=17029'11336075 lcod 17029'11336074 active] _scan_snaps no head for 7:18d626d1:::rbd_data.bd1c92ae8944a.0000000000002e82:d2 (have MIN) Sep 14 07:01:25 node1.ceph ceph-osd[1703]: 2017-09-14 07:01:25.127789 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.318( v 17029'11336081 (17029'11333014,17029'11336081] local-lis/les=16967/16968 n=3054 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16834) [28,33,1] r=2 lpr=16967 luod=0'0 crt=17029'11336081 lcod 17029'11336079 active] _scan_snaps no head for 7:18d7acfb:::rbd_data.a6351b238e1f29.000000000001de47:9e (have MIN) Sep 14 07:01:34 node1.ceph ceph-osd[1703]: 2017-09-14 07:01:34.712223 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.318( v 17029'11336151 (17029'11333114,17029'11336151] local-lis/les=16967/16968 n=3057 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16834) [28,33,1] r=2 lpr=16967 luod=0'0 crt=17029'11336151 lcod 17029'11336150 active] _scan_snaps no head for 7:18e9687e:::rbd_data.a6351b238e1f29.00000000000230b6:9e (have MIN) Sep 14 07:01:39 node1.ceph ceph-osd[1703]: 2017-09-14 07:01:39.786753 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.318( v 17029'11336189 (17029'11333114,17029'11336189] local-lis/les=16967/16968 n=3057 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16834) [28,33,1] r=2 lpr=16967 luod=0'0 crt=17029'11336189 lcod 17029'11336188 active] _scan_snaps no head for 7:18f3fc72:::rbd_data.b07e94238e1f29.0000000000000583:80 (have MIN) Sep 14 07:01:45 node1.ceph ceph-osd[1703]: 2017-09-14 07:01:45.363919 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.318( v 17029'11336236 (17029'11333214,17029'11336236] local-lis/les=16967/16968 n=3063 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16834) [28,33,1] r=2 lpr=16967 luod=0'0 crt=17029'11336236 lcod 17029'11336235 active] _scan_snaps no head for 7:18ff3dea:::rbd_data.bd1c92ae8944a.0000000000002669:d2 (have MIN) Sep 14 07:11:24 node1.ceph ceph-osd[1703]: 2017-09-14 07:11:24.090220 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.386( v 17029'5158670 (17029'5155601,17029'5158670] local-lis/les=16967/16968 n=3094 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16836) [27,35,1] r=2 lpr=16967 luod=0'0 crt=17029'5158670 lcod 17029'5158669 active] _scan_snaps no head for 7:61cfaf7c:::rbd_data.a6351b238e1f29.000000000001cd1d:9e (have MIN) Sep 14 07:11:26 node1.ceph ceph-osd[1703]: 2017-09-14 07:11:26.064928 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.386( v 17029'5158678 (17029'5155601,17029'5158678] local-lis/les=16967/16968 n=3094 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16836) [27,35,1] r=2 lpr=16967 luod=0'0 crt=17029'5158678 lcod 17029'5158677 active] _scan_snaps no head for 7:61d2271c:::rbd_data.a70641238e1f29.00000000000055d2:9d (have MIN) Sep 14 07:11:26 node1.ceph ceph-osd[1703]: 2017-09-14 07:11:26.797565 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.386( v 17029'5158691 (17029'5155601,17029'5158691] local-lis/les=16967/16968 n=3095 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16836) [27,35,1] r=2 lpr=16967 luod=0'0 crt=17029'5158691 lcod 17029'5158690 active] _scan_snaps no head for 7:61d436a5:::rbd_data.b0d052238e1f29.0000000000000119:b3 (have MIN) Sep 14 07:11:26 node1.ceph ceph-osd[1703]: 2017-09-14 07:11:26.797590 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.386( v 17029'5158691 (17029'5155601,17029'5158691] local-lis/les=16967/16968 n=3095 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16836) [27,35,1] r=2 lpr=16967 luod=0'0 crt=17029'5158691 lcod 17029'5158690 active] _scan_snaps no head for 7:61d436a5:::rbd_data.b0d052238e1f29.0000000000000119:b2 (have MIN) Sep 14 07:11:26 node1.ceph ceph-osd[1703]: 2017-09-14 07:11:26.797598 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.386( v 17029'5158691 (17029'5155601,17029'5158691] local-lis/les=16967/16968 n=3095 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16836) [27,35,1] r=2 lpr=16967 luod=0'0 crt=17029'5158691 lcod 17029'5158690 active] _scan_snaps no head for 7:61d436a5:::rbd_data.b0d052238e1f29.0000000000000119:b1 (have MIN) Sep 14 07:11:26 node1.ceph ceph-osd[1703]: 2017-09-14 07:11:26.797605 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.386( v 17029'5158691 (17029'5155601,17029'5158691] local-lis/les=16967/16968 n=3095 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16836) [27,35,1] r=2 lpr=16967 luod=0'0 crt=17029'5158691 lcod 17029'5158690 active] _scan_snaps no head for 7:61d436a5:::rbd_data.b0d052238e1f29.0000000000000119:b0 (have MIN) Sep 14 07:11:26 node1.ceph ceph-osd[1703]: 2017-09-14 07:11:26.797612 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.386( v 17029'5158691 (17029'5155601,17029'5158691] local-lis/les=16967/16968 n=3095 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16836) [27,35,1] r=2 lpr=16967 luod=0'0 crt=17029'5158691 lcod 17029'5158690 active] _scan_snaps no head for 7:61d436a5:::rbd_data.b0d052238e1f29.0000000000000119:ae (have MIN) Sep 14 07:11:33 node1.ceph ceph-osd[1703]: 2017-09-14 07:11:33.488852 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.386( v 17029'5158776 (17029'5155701,17029'5158776] local-lis/les=16967/16968 n=3101 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16836) [27,35,1] r=2 lpr=16967 luod=0'0 crt=17029'5158776 lcod 17029'5158775 active] _scan_snaps no head for 7:61e823f6:::rbd_data.a6351b238e1f29.000000000001a2e0:9e (have MIN) Sep 14 07:11:38 node1.ceph ceph-osd[1703]: 2017-09-14 07:11:38.572127 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.386( v 17029'5158822 (17029'5155801,17029'5158822] local-lis/les=16967/16968 n=3104 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16836) [27,35,1] r=2 lpr=16967 luod=0'0 crt=17029'5158822 lcod 17029'5158821 active] _scan_snaps no head for 7:61f41571:::rbd_data.bd1c92ae8944a.0000000000002820:d4 (have MIN) Sep 14 07:11:38 node1.ceph ceph-osd[1703]: 2017-09-14 07:11:38.572154 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.386( v 17029'5158822 (17029'5155801,17029'5158822] local-lis/les=16967/16968 n=3104 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16836) [27,35,1] r=2 lpr=16967 luod=0'0 crt=17029'5158822 lcod 17029'5158821 active] _scan_snaps no head for 7:61f41571:::rbd_data.bd1c92ae8944a.0000000000002820:d2 (have MIN) Sep 14 07:11:43 node1.ceph ceph-osd[1703]: 2017-09-14 07:11:43.402985 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.386( v 17029'5158864 (17029'5155801,17029'5158864] local-lis/les=16967/16968 n=3107 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16836) [27,35,1] r=2 lpr=16967 luod=0'0 crt=17029'5158864 lcod 17029'5158863 active] _scan_snaps no head for 7:61fe207a:::rbd_data.a70641238e1f29.0000000000005622:ce (have MIN) Sep 14 07:11:43 node1.ceph ceph-osd[1703]: 2017-09-14 07:11:43.403010 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.386( v 17029'5158864 (17029'5155801,17029'5158864] local-lis/les=16967/16968 n=3107 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16836) [27,35,1] r=2 lpr=16967 luod=0'0 crt=17029'5158864 lcod 17029'5158863 active] _scan_snaps no head for 7:61fe207a:::rbd_data.a70641238e1f29.0000000000005622:9d (have MIN) Sep 14 07:11:59 node1.ceph ceph-osd[1703]: 2017-09-14 07:11:59.084700 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.15b( v 17029'5920129 (17029'5917109,17029'5920129] local-lis/les=16967/16968 n=2986 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,36,1] r=2 lpr=16967 luod=0'0 crt=17029'5920129 lcod 17029'5920128 active] _scan_snaps no head for 7:da86a107:::rbd_data.bd1c92ae8944a.0000000000002937:d4 (have MIN) Sep 14 07:11:59 node1.ceph ceph-osd[1703]: 2017-09-14 07:11:59.084727 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.15b( v 17029'5920129 (17029'5917109,17029'5920129] local-lis/les=16967/16968 n=2986 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,36,1] r=2 lpr=16967 luod=0'0 crt=17029'5920129 lcod 17029'5920128 active] _scan_snaps no head for 7:da86a107:::rbd_data.bd1c92ae8944a.0000000000002937:d2 (have MIN) Sep 14 07:12:01 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:01.466337 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.15b( v 17029'5920151 (17029'5917109,17029'5920151] local-lis/les=16967/16968 n=2986 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,36,1] r=2 lpr=16967 luod=0'0 crt=17029'5920151 lcod 17029'5920150 active] _scan_snaps no head for 7:da8d2a5f:::rbd_data.b0d052238e1f29.00000000000012b9:b4 (have MIN) Sep 14 07:12:01 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:01.466364 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.15b( v 17029'5920151 (17029'5917109,17029'5920151] local-lis/les=16967/16968 n=2986 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,36,1] r=2 lpr=16967 luod=0'0 crt=17029'5920151 lcod 17029'5920150 active] _scan_snaps no head for 7:da8d2a5f:::rbd_data.b0d052238e1f29.00000000000012b9:b3 (have MIN) Sep 14 07:12:01 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:01.466370 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.15b( v 17029'5920151 (17029'5917109,17029'5920151] local-lis/les=16967/16968 n=2986 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,36,1] r=2 lpr=16967 luod=0'0 crt=17029'5920151 lcod 17029'5920150 active] _scan_snaps no head for 7:da8d2a5f:::rbd_data.b0d052238e1f29.00000000000012b9:b2 (have MIN) Sep 14 07:12:01 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:01.466375 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.15b( v 17029'5920151 (17029'5917109,17029'5920151] local-lis/les=16967/16968 n=2986 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,36,1] r=2 lpr=16967 luod=0'0 crt=17029'5920151 lcod 17029'5920150 active] _scan_snaps no head for 7:da8d2a5f:::rbd_data.b0d052238e1f29.00000000000012b9:b1 (have MIN) Sep 14 07:12:01 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:01.466380 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.15b( v 17029'5920151 (17029'5917109,17029'5920151] local-lis/les=16967/16968 n=2986 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,36,1] r=2 lpr=16967 luod=0'0 crt=17029'5920151 lcod 17029'5920150 active] _scan_snaps no head for 7:da8d2a5f:::rbd_data.b0d052238e1f29.00000000000012b9:b0 (have MIN) Sep 14 07:12:01 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:01.466384 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.15b( v 17029'5920151 (17029'5917109,17029'5920151] local-lis/les=16967/16968 n=2986 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,36,1] r=2 lpr=16967 luod=0'0 crt=17029'5920151 lcod 17029'5920150 active] _scan_snaps no head for 7:da8d2a5f:::rbd_data.b0d052238e1f29.00000000000012b9:ae (have MIN) Sep 14 07:12:03 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:03.411038 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.15b( v 17029'5920173 (17029'5917109,17029'5920173] local-lis/les=16967/16968 n=2988 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,36,1] r=2 lpr=16967 luod=0'0 crt=17029'5920173 lcod 17029'5920172 active] _scan_snaps no head for 7:da91c525:::rbd_data.bd1c92ae8944a.000000000000568d:d2 (have MIN) Sep 14 07:12:04 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:04.980453 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.15b( v 17029'5920190 (17029'5917109,17029'5920190] local-lis/les=16967/16968 n=2990 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,36,1] r=2 lpr=16967 luod=0'0 crt=17029'5920190 lcod 17029'5920189 active] _scan_snaps no head for 7:da95f467:::rbd_data.a6351b238e1f29.000000000001f1f6:9e (have MIN) Sep 14 07:12:16 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:16.383346 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.15b( v 17029'5920286 (17029'5917209,17029'5920286] local-lis/les=16967/16968 n=2994 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,36,1] r=2 lpr=16967 luod=0'0 crt=17029'5920286 lcod 17029'5920285 active] _scan_snaps no head for 7:daaf0bdb:::rbd_data.a6351b238e1f29.00000000000255ae:9e (have MIN) Sep 14 07:12:17 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:17.351352 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.15b( v 17029'5920296 (17029'5917209,17029'5920296] local-lis/les=16967/16968 n=2995 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,36,1] r=2 lpr=16967 luod=0'0 crt=17029'5920296 lcod 17029'5920295 active] _scan_snaps no head for 7:dab11140:::rbd_data.b0d052238e1f29.00000000000014b2:b4 (have MIN) Sep 14 07:12:17 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:17.351379 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.15b( v 17029'5920296 (17029'5917209,17029'5920296] local-lis/les=16967/16968 n=2995 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,36,1] r=2 lpr=16967 luod=0'0 crt=17029'5920296 lcod 17029'5920295 active] _scan_snaps no head for 7:dab11140:::rbd_data.b0d052238e1f29.00000000000014b2:b3 (have MIN) Sep 14 07:12:17 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:17.351385 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.15b( v 17029'5920296 (17029'5917209,17029'5920296] local-lis/les=16967/16968 n=2995 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,36,1] r=2 lpr=16967 luod=0'0 crt=17029'5920296 lcod 17029'5920295 active] _scan_snaps no head for 7:dab11140:::rbd_data.b0d052238e1f29.00000000000014b2:b2 (have MIN) Sep 14 07:12:17 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:17.351391 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.15b( v 17029'5920296 (17029'5917209,17029'5920296] local-lis/les=16967/16968 n=2995 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,36,1] r=2 lpr=16967 luod=0'0 crt=17029'5920296 lcod 17029'5920295 active] _scan_snaps no head for 7:dab11140:::rbd_data.b0d052238e1f29.00000000000014b2:b1 (have MIN) Sep 14 07:12:17 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:17.351396 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.15b( v 17029'5920296 (17029'5917209,17029'5920296] local-lis/les=16967/16968 n=2995 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,36,1] r=2 lpr=16967 luod=0'0 crt=17029'5920296 lcod 17029'5920295 active] _scan_snaps no head for 7:dab11140:::rbd_data.b0d052238e1f29.00000000000014b2:b0 (have MIN) Sep 14 07:12:17 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:17.351400 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.15b( v 17029'5920296 (17029'5917209,17029'5920296] local-lis/les=16967/16968 n=2995 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,36,1] r=2 lpr=16967 luod=0'0 crt=17029'5920296 lcod 17029'5920295 active] _scan_snaps no head for 7:dab11140:::rbd_data.b0d052238e1f29.00000000000014b2:ae (have MIN) Sep 14 07:12:21 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:21.869173 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.15b( v 17029'5920354 (17029'5917310,17029'5920354] local-lis/les=16967/16968 n=3001 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,36,1] r=2 lpr=16967 luod=0'0 crt=17029'5920354 lcod 17029'5920353 active] _scan_snaps no head for 7:dabd306c:::rbd_data.a6351b238e1f29.000000000001c5f0:9e (have MIN) Sep 14 07:12:38 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:38.201155 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ad( v 17029'4446485 (17021'4443399,17029'4446485] local-lis/les=16967/16968 n=3080 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16848) [33,1,31] r=1 lpr=16967 luod=0'0 crt=17029'4446485 lcod 17029'4446484 active] _scan_snaps no head for 7:b58b99c5:::rbd_data.a74f60238e1f29.0000000000000ac0:cf (have MIN) Sep 14 07:12:38 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:38.201179 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ad( v 17029'4446485 (17021'4443399,17029'4446485] local-lis/les=16967/16968 n=3080 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16848) [33,1,31] r=1 lpr=16967 luod=0'0 crt=17029'4446485 lcod 17029'4446484 active] _scan_snaps no head for 7:b58b99c5:::rbd_data.a74f60238e1f29.0000000000000ac0:9c (have MIN) Sep 14 07:12:42 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:42.641680 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ad( v 17029'4446526 (17021'4443499,17029'4446526] local-lis/les=16967/16968 n=3085 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16848) [33,1,31] r=1 lpr=16967 luod=0'0 crt=17029'4446526 lcod 17029'4446525 active] _scan_snaps no head for 7:b59839eb:::rbd_data.bd1c92ae8944a.0000000000004f56:d2 (have MIN) Sep 14 07:12:43 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:43.199613 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ad( v 17029'4446536 (17021'4443499,17029'4446536] local-lis/les=16967/16968 n=3086 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16848) [33,1,31] r=1 lpr=16967 luod=0'0 crt=17029'4446536 lcod 17029'4446535 active] _scan_snaps no head for 7:b599c234:::rbd_data.a6351b238e1f29.0000000000024367:9e (have MIN) Sep 14 07:12:48 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:48.065591 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ad( v 17029'4446593 (17021'4443499,17029'4446593] local-lis/les=16967/16968 n=3094 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16848) [33,1,31] r=1 lpr=16967 luod=0'0 crt=17029'4446593 lcod 17029'4446592 active] _scan_snaps no head for 7:b5a5b941:::rbd_data.bd1c92ae8944a.0000000000000a46:d4 (have MIN) Sep 14 07:12:48 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:48.065615 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ad( v 17029'4446593 (17021'4443499,17029'4446593] local-lis/les=16967/16968 n=3094 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16848) [33,1,31] r=1 lpr=16967 luod=0'0 crt=17029'4446593 lcod 17029'4446592 active] _scan_snaps no head for 7:b5a5b941:::rbd_data.bd1c92ae8944a.0000000000000a46:d2 (have MIN) Sep 14 07:12:50 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:50.233591 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ad( v 17029'4446616 (17021'4443599,17029'4446616] local-lis/les=16967/16968 n=3098 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16848) [33,1,31] r=1 lpr=16967 luod=0'0 lua=17029'4446612 crt=17029'4446616 lcod 17029'4446614 active] _scan_snaps no head for 7:b5a9d9a4:::rbd_data.bd1c92ae8944a.0000000000002b89:d4 (have MIN) Sep 14 07:12:50 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:50.233628 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ad( v 17029'4446616 (17021'4443599,17029'4446616] local-lis/les=16967/16968 n=3098 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16848) [33,1,31] r=1 lpr=16967 luod=0'0 lua=17029'4446612 crt=17029'4446616 lcod 17029'4446614 active] _scan_snaps no head for 7:b5a9d9a4:::rbd_data.bd1c92ae8944a.0000000000002b89:d2 (have MIN) Sep 14 07:12:50 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:50.796928 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ad( v 17029'4446624 (17021'4443599,17029'4446624] local-lis/les=16967/16968 n=3099 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16848) [33,1,31] r=1 lpr=16967 luod=0'0 crt=17029'4446624 lcod 17029'4446622 active] _scan_snaps no head for 7:b5ab472e:::rbd_data.a74f60238e1f29.0000000000000ca9:9c (have MIN) Sep 14 07:12:54 node1.ceph ceph-osd[1703]: 2017-09-14 07:12:54.086749 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1ad( v 17029'4446657 (17021'4443599,17029'4446657] local-lis/les=16967/16968 n=3105 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16848) [33,1,31] r=1 lpr=16967 luod=0'0 crt=17029'4446657 lcod 17029'4446656 active] _scan_snaps no head for 7:b5b23570:::rbd_data.a4f318238e1f29.0000000000000283:8d (have MIN) Sep 14 07:13:30 node1.ceph ceph-osd[1703]: 2017-09-14 07:13:30.736619 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.319( v 17029'7686059 (17029'7683042,17029'7686059] local-lis/les=16967/16968 n=3099 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16840) [29,11,1] r=2 lpr=16967 luod=0'0 crt=17029'7686059 lcod 17029'7686058 active] _scan_snaps no head for 7:98dbbd8e:::rbd_data.8f8aad238e1f29.0000000000000a3a:54 (have MIN) Sep 14 07:13:37 node1.ceph ceph-osd[1703]: 2017-09-14 07:13:37.487541 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.319( v 17029'7686105 (17029'7683042,17029'7686105] local-lis/les=16967/16968 n=3103 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16840) [29,11,1] r=2 lpr=16967 luod=0'0 crt=17029'7686105 lcod 17029'7686104 active] _scan_snaps no head for 7:98e6ccc4:::rbd_data.c1ebe8238e1f29.0000000000002d3b:df (have MIN) Sep 14 07:13:42 node1.ceph ceph-osd[1703]: 2017-09-14 07:13:42.221765 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.319( v 17029'7686137 (17029'7683042,17029'7686137] local-lis/les=16967/16968 n=3104 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16840) [29,11,1] r=2 lpr=16967 luod=0'0 crt=17029'7686137 lcod 17029'7686136 active] _scan_snaps no head for 7:98efae7f:::rbd_data.a6351b238e1f29.000000000001b7c3:9e (have MIN) Sep 14 07:13:46 node1.ceph ceph-osd[1703]: 2017-09-14 07:13:46.756878 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.319( v 17029'7686186 (17029'7683142,17029'7686186] local-lis/les=16967/16968 n=3106 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16840) [29,11,1] r=2 lpr=16967 luod=0'0 crt=17029'7686186 lcod 17029'7686185 active] _scan_snaps no head for 7:98f8925a:::rbd_data.bd1c92ae8944a.00000000000065b4:d2 (have MIN) Sep 14 07:13:49 node1.ceph ceph-osd[1703]: 2017-09-14 07:13:49.080646 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.319( v 17029'7686217 (17029'7683142,17029'7686217] local-lis/les=16967/16968 n=3108 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16840) [29,11,1] r=2 lpr=16967 luod=0'0 crt=17029'7686217 lcod 17029'7686216 active] _scan_snaps no head for 7:98fd7b06:::rbd_data.b737b238e1f29.0000000000000516:8 (have MIN) Sep 14 07:29:05 node1.ceph ceph-osd[1703]: 2017-09-14 07:29:05.047321 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.17f( v 17029'7931641 (17029'7928567,17029'7931641] local-lis/les=16967/16968 n=3124 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16871) [1,38,27] r=0 lpr=16967 crt=17029'7931641 lcod 17029'7931640 mlcod 17029'7931640 active+clean+scrubbing+deep] _scan_snaps no head for 7:fe906208:::rbd_data.bd1c92ae8944a.0000000000005457:d2 (have MIN) Sep 14 07:30:56 node1.ceph ceph-osd[1703]: 2017-09-14 07:30:56.475566 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.17f( v 17029'7931864 (17029'7928767,17029'7931864] local-lis/les=16967/16968 n=3131 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16871) [1,38,27] r=0 lpr=16967 crt=17029'7931864 lcod 17029'7931862 mlcod 17029'7931862 active+clean+scrubbing+deep] _scan_snaps no head for 7:fea742dc:::rbd_data.bd1c92ae8944a.0000000000006f5f:d2 (have MIN) Sep 14 07:31:21 node1.ceph ceph-osd[1703]: 2017-09-14 07:31:21.284488 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.17f( v 17029'7931909 (17029'7928867,17029'7931909] local-lis/les=16967/16968 n=3133 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16871) [1,38,27] r=0 lpr=16967 crt=17029'7931909 lcod 17029'7931908 mlcod 17029'7931908 active+clean+scrubbing+deep] _scan_snaps no head for 7:feac61bb:::rbd_data.a6351b238e1f29.000000000002c231:9e (have MIN) Sep 14 07:34:14 node1.ceph ceph-osd[1703]: 2017-09-14 07:34:14.490809 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.3ca( v 17029'10564650 (17029'10561581,17029'10564650] local-lis/les=17012/17013 n=3055 ec=2543/2543 lis/c 17012/17012 les/c/f 17013/17019/0 17012/17012/16871) [1,28,26] r=0 lpr=17012 crt=17029'10564650 lcod 17029'10564649 mlcod 17029'10564649 active+clean+scrubbing] _scan_snaps no head for 7:53c6b256:::rbd_data.bd1c92ae8944a.0000000000003306:d2 (have MIN) Sep 14 07:34:25 node1.ceph ceph-osd[1703]: 2017-09-14 07:34:25.798583 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.3ca( v 17029'10564804 (17029'10561782,17029'10564804] local-lis/les=17012/17013 n=3064 ec=2543/2543 lis/c 17012/17012 les/c/f 17013/17019/0 17012/17012/16871) [1,28,26] r=0 lpr=17012 crt=17029'10564804 lcod 17029'10564803 mlcod 17029'10564803 active+clean+scrubbing] _scan_snaps no head for 7:53e7b518:::rbd_data.a70641238e1f29.0000000000007163:ce (have MIN) Sep 14 07:34:25 node1.ceph ceph-osd[1703]: 2017-09-14 07:34:25.798608 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.3ca( v 17029'10564804 (17029'10561782,17029'10564804] local-lis/les=17012/17013 n=3064 ec=2543/2543 lis/c 17012/17012 les/c/f 17013/17019/0 17012/17012/16871) [1,28,26] r=0 lpr=17012 crt=17029'10564804 lcod 17029'10564803 mlcod 17029'10564803 active+clean+scrubbing] _scan_snaps no head for 7:53e7b518:::rbd_data.a70641238e1f29.0000000000007163:9d (have MIN) Sep 14 07:34:29 node1.ceph ceph-osd[1703]: 2017-09-14 07:34:29.138352 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.3ca( v 17029'10564853 (17029'10561782,17029'10564853] local-lis/les=17012/17013 n=3069 ec=2543/2543 lis/c 17012/17012 les/c/f 17013/17019/0 17012/17012/16871) [1,28,26] r=0 lpr=17012 crt=17029'10564853 lcod 17029'10564852 mlcod 17029'10564852 active+clean+scrubbing] _scan_snaps no head for 7:53f22f69:::rbd_data.a6351b238e1f29.0000000000021039:9e (have MIN) Sep 14 07:34:32 node1.ceph ceph-osd[1703]: 2017-09-14 07:34:32.190695 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.3ca( v 17029'10564894 (17029'10561883,17029'10564894] local-lis/les=17012/17013 n=3071 ec=2543/2543 lis/c 17012/17012 les/c/f 17013/17019/0 17012/17012/16871) [1,28,26] r=0 lpr=17012 crt=17029'10564894 lcod 17029'10564893 mlcod 17029'10564893 active+clean+scrubbing] _scan_snaps no head for 7:53fc8e16:::rbd_data.a6351b238e1f29.000000000002b1fc:9e (have MIN) Sep 14 07:34:32 node1.ceph ceph-osd[1703]: 2017-09-14 07:34:32.586949 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.3ca( v 17029'10564901 (17029'10561883,17029'10564901] local-lis/les=17012/17013 n=3072 ec=2543/2543 lis/c 17012/17012 les/c/f 17013/17019/0 17012/17012/16871) [1,28,26] r=0 lpr=17012 crt=17029'10564901 lcod 17029'10564899 mlcod 17029'10564899 active+clean+scrubbing] _scan_snaps no head for 7:53fdeace:::rbd_data.bd1c92ae8944a.00000000000060b7:d2 (have MIN) Sep 14 07:51:39 node1.ceph ceph-osd[1703]: 2017-09-14 07:51:39.448698 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[8.1b4( v 17029'7471057 (17029'7467982,17029'7471057] local-lis/les=16986/16987 n=3391 ec=107/107 lis/c 16986/16986 les/c/f 16987/17014/0 16986/16986/16923) [15,1,23] r=1 lpr=16986 luod=0'0 crt=17029'7471057 lcod 17029'7471056 active] _scan_snaps no head for 8:2da5e7db:::rbd_data.1443bb238e1f29.00000000000011dd:31 (have MIN) Sep 14 07:53:57 node1.ceph ceph-osd[1703]: 2017-09-14 07:53:57.166409 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.14f( v 17029'65080277 (17029'65077216,17029'65080277] local-lis/les=16967/16968 n=2957 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16929/16967/16909) [9,1,16] r=1 lpr=16967 luod=0'0 crt=17029'65080277 lcod 17029'65080276 active] _scan_snaps no head for 7:f2850081:::rbd_data.a6351b238e1f29.000000000001fdee:9e (have MIN) Sep 14 07:54:38 node1.ceph ceph-osd[1703]: 2017-09-14 07:54:38.420837 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.14f( v 17029'65080379 (17029'65077316,17029'65080379] local-lis/les=16967/16968 n=2958 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16929/16967/16909) [9,1,16] r=1 lpr=16967 luod=0'0 crt=17029'65080379 lcod 17029'65080378 active] _scan_snaps no head for 7:f28e8fdc:::rbd_data.a74f60238e1f29.0000000000000e39:9c (have MIN) Sep 14 07:55:12 node1.ceph ceph-osd[1703]: 2017-09-14 07:55:12.236708 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.14f( v 17029'65080457 (17029'65077416,17029'65080457] local-lis/les=16967/16968 n=2959 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16929/16967/16909) [9,1,16] r=1 lpr=16967 luod=0'0 crt=17029'65080457 lcod 17029'65080456 active] _scan_snaps no head for 7:f2979839:::rbd_data.a6351b238e1f29.000000000002436c:9e (have MIN) Sep 14 07:55:23 node1.ceph ceph-osd[1703]: 2017-09-14 07:55:23.372839 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.14f( v 17029'65080485 (17029'65077416,17029'65080485] local-lis/les=16967/16968 n=2960 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16929/16967/16909) [9,1,16] r=1 lpr=16967 luod=0'0 crt=17029'65080485 lcod 17029'65080484 active] _scan_snaps no head for 7:f299f94c:::rbd_data.a6351b238e1f29.000000000000011b:9e (have MIN) Sep 14 07:56:00 node1.ceph ceph-osd[1703]: 2017-09-14 07:56:00.799585 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.14f( v 17029'65080569 (17029'65077517,17029'65080569] local-lis/les=16967/16968 n=2961 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16929/16967/16909) [9,1,16] r=1 lpr=16967 luod=0'0 crt=17029'65080569 lcod 17029'65080568 active] _scan_snaps no head for 7:f2a19c52:::rbd_data.a6351b238e1f29.000000000001de0a:9e (have MIN) Sep 14 07:56:21 node1.ceph ceph-osd[1703]: 2017-09-14 07:56:21.307564 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.14f( v 17029'65080621 (17029'65077617,17029'65080621] local-lis/les=16967/16968 n=2962 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16929/16967/16909) [9,1,16] r=1 lpr=16967 luod=0'0 crt=17029'65080621 lcod 17029'65080620 active] _scan_snaps no head for 7:f2a63c31:::rbd_data.bd1c92ae8944a.0000000000003cf5:d4 (have MIN) Sep 14 07:56:37 node1.ceph ceph-osd[1703]: 2017-09-14 07:56:37.363196 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.14f( v 17029'65080664 (17029'65077617,17029'65080664] local-lis/les=16967/16968 n=2962 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16929/16967/16909) [9,1,16] r=1 lpr=16967 luod=0'0 crt=17029'65080664 lcod 17029'65080663 active] _scan_snaps no head for 7:f2aa4bf2:::rbd_data.bd1c92ae8944a.0000000000002981:d4 (have MIN) Sep 14 07:56:37 node1.ceph ceph-osd[1703]: 2017-09-14 07:56:37.363229 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.14f( v 17029'65080664 (17029'65077617,17029'65080664] local-lis/les=16967/16968 n=2962 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16929/16967/16909) [9,1,16] r=1 lpr=16967 luod=0'0 crt=17029'65080664 lcod 17029'65080663 active] _scan_snaps no head for 7:f2aa4bf2:::rbd_data.bd1c92ae8944a.0000000000002981:d2 (have MIN) Sep 14 07:57:31 node1.ceph ceph-osd[1703]: 2017-09-14 07:57:31.659349 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.14f( v 17029'65080777 (17029'65077717,17029'65080777] local-lis/les=16967/16968 n=2965 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16929/16967/16909) [9,1,16] r=1 lpr=16967 luod=0'0 crt=17029'65080777 lcod 17029'65080776 active] _scan_snaps no head for 7:f2b3a94e:::rbd_data.bd1c92ae8944a.0000000000003159:d4 (have MIN) Sep 14 07:57:31 node1.ceph ceph-osd[1703]: 2017-09-14 07:57:31.659376 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.14f( v 17029'65080777 (17029'65077717,17029'65080777] local-lis/les=16967/16968 n=2965 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16929/16967/16909) [9,1,16] r=1 lpr=16967 luod=0'0 crt=17029'65080777 lcod 17029'65080776 active] _scan_snaps no head for 7:f2b3a94e:::rbd_data.bd1c92ae8944a.0000000000003159:d2 (have MIN) Sep 14 08:03:18 node1.ceph ceph-osd[1703]: 2017-09-14 08:03:18.968280 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[8.173( v 17029'2178298 (17029'2175252,17029'2178298] local-lis/les=17012/17013 n=3296 ec=107/107 lis/c 17012/17012 les/c/f 17013/17021/0 17012/17012/16838) [31,26,1] r=2 lpr=17012 luod=0'0 crt=17029'2178298 lcod 17029'2178297 active] _scan_snaps no head for 8:cea63715:::rbd_data.1443bb238e1f29.0000000000001790:31 (have MIN) Sep 14 08:05:09 node1.ceph ceph-osd[1703]: 2017-09-14 08:05:09.730863 7fb935fff700 -1 received signal: Hangup from PID: 8948 task name: killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw UID: 0 Sep 14 08:32:41 node1.ceph ceph-osd[1703]: 2017-09-14 08:32:41.259383 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.61( v 17029'10341019 (17029'10337979,17029'10341019] local-lis/les=17012/17013 n=2939 ec=104/104 lis/c 17012/17012 les/c/f 17013/17021/0 17012/17012/17012) [26,10,1] r=2 lpr=17012 luod=0'0 crt=17029'10341019 lcod 17029'10341018 active] _scan_snaps no head for 7:860a697f:::rbd_data.b0d052238e1f29.00000000000000bf:b3 (have MIN) Sep 14 08:32:41 node1.ceph ceph-osd[1703]: 2017-09-14 08:32:41.259495 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.61( v 17029'10341019 (17029'10337979,17029'10341019] local-lis/les=17012/17013 n=2939 ec=104/104 lis/c 17012/17012 les/c/f 17013/17021/0 17012/17012/17012) [26,10,1] r=2 lpr=17012 luod=0'0 crt=17029'10341019 lcod 17029'10341018 active] _scan_snaps no head for 7:860a697f:::rbd_data.b0d052238e1f29.00000000000000bf:b2 (have MIN) Sep 14 08:32:41 node1.ceph ceph-osd[1703]: 2017-09-14 08:32:41.259519 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.61( v 17029'10341019 (17029'10337979,17029'10341019] local-lis/les=17012/17013 n=2939 ec=104/104 lis/c 17012/17012 les/c/f 17013/17021/0 17012/17012/17012) [26,10,1] r=2 lpr=17012 luod=0'0 crt=17029'10341019 lcod 17029'10341018 active] _scan_snaps no head for 7:860a697f:::rbd_data.b0d052238e1f29.00000000000000bf:b1 (have MIN) Sep 14 08:32:41 node1.ceph ceph-osd[1703]: 2017-09-14 08:32:41.259536 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.61( v 17029'10341019 (17029'10337979,17029'10341019] local-lis/les=17012/17013 n=2939 ec=104/104 lis/c 17012/17012 les/c/f 17013/17021/0 17012/17012/17012) [26,10,1] r=2 lpr=17012 luod=0'0 crt=17029'10341019 lcod 17029'10341018 active] _scan_snaps no head for 7:860a697f:::rbd_data.b0d052238e1f29.00000000000000bf:b0 (have MIN) Sep 14 08:32:41 node1.ceph ceph-osd[1703]: 2017-09-14 08:32:41.259558 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.61( v 17029'10341019 (17029'10337979,17029'10341019] local-lis/les=17012/17013 n=2939 ec=104/104 lis/c 17012/17012 les/c/f 17013/17021/0 17012/17012/17012) [26,10,1] r=2 lpr=17012 luod=0'0 crt=17029'10341019 lcod 17029'10341018 active] _scan_snaps no head for 7:860a697f:::rbd_data.b0d052238e1f29.00000000000000bf:ae (have MIN) Sep 14 08:32:49 node1.ceph ceph-osd[1703]: 2017-09-14 08:32:49.338354 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.61( v 17029'10341073 (17029'10337979,17029'10341073] local-lis/les=17012/17013 n=2941 ec=104/104 lis/c 17012/17012 les/c/f 17013/17021/0 17012/17012/17012) [26,10,1] r=2 lpr=17012 luod=0'0 crt=17029'10341073 lcod 17029'10341072 active] _scan_snaps no head for 7:86192616:::rbd_data.a6351b238e1f29.00000000000286fe:9e (have MIN) Sep 14 08:32:56 node1.ceph ceph-osd[1703]: 2017-09-14 08:32:56.098932 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.61( v 17029'10341109 (17029'10338080,17029'10341109] local-lis/les=17012/17013 n=2943 ec=104/104 lis/c 17012/17012 les/c/f 17013/17021/0 17012/17012/17012) [26,10,1] r=2 lpr=17012 luod=0'0 crt=17029'10341109 lcod 17029'10341108 active] _scan_snaps no head for 7:862433d7:::rbd_data.bd1c92ae8944a.0000000000003283:d4 (have MIN) Sep 14 08:32:56 node1.ceph ceph-osd[1703]: 2017-09-14 08:32:56.098955 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.61( v 17029'10341109 (17029'10338080,17029'10341109] local-lis/les=17012/17013 n=2943 ec=104/104 lis/c 17012/17012 les/c/f 17013/17021/0 17012/17012/17012) [26,10,1] r=2 lpr=17012 luod=0'0 crt=17029'10341109 lcod 17029'10341108 active] _scan_snaps no head for 7:862433d7:::rbd_data.bd1c92ae8944a.0000000000003283:d2 (have MIN) Sep 14 08:33:05 node1.ceph ceph-osd[1703]: 2017-09-14 08:33:05.826726 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.61( v 17029'10341153 (17029'10338080,17029'10341153] local-lis/les=17012/17013 n=2944 ec=104/104 lis/c 17012/17012 les/c/f 17013/17021/0 17012/17012/17012) [26,10,1] r=2 lpr=17012 luod=0'0 crt=17029'10341153 lcod 17029'10341152 active] _scan_snaps no head for 7:862df68d:::rbd_data.a6351b238e1f29.000000000002bf9b:9e (have MIN) Sep 14 08:33:08 node1.ceph ceph-osd[1703]: 2017-09-14 08:33:08.576708 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.61( v 17029'10341171 (17029'10338080,17029'10341171] local-lis/les=17012/17013 n=2945 ec=104/104 lis/c 17012/17012 les/c/f 17013/17021/0 17012/17012/17012) [26,10,1] r=2 lpr=17012 luod=0'0 crt=17029'10341171 lcod 17029'10341170 active] _scan_snaps no head for 7:86336511:::rbd_data.a6351b238e1f29.000000000001a948:9e (have MIN) Sep 14 08:33:13 node1.ceph ceph-osd[1703]: 2017-09-14 08:33:13.943126 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[7.61( v 17029'10341207 (17029'10338181,17029'10341207] local-lis/les=17012/17013 n=2946 ec=104/104 lis/c 17012/17012 les/c/f 17013/17021/0 17012/17012/17012) [26,10,1] r=2 lpr=17012 luod=0'0 crt=17029'10341207 lcod 17029'10341206 active] _scan_snaps no head for 7:863c42e8:::rbd_data.a6351b238e1f29.000000000002a0ba:9e (have MIN) Sep 14 08:36:53 node1.ceph ceph-osd[1703]: 2017-09-14 08:36:53.278816 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.10a( v 17029'8443637 (17029'8440618,17029'8443637] local-lis/les=17006/17007 n=3019 ec=104/104 lis/c 17006/17006 les/c/f 17007/17017/0 17006/17006/16926) [17,1,25] r=1 lpr=17006 luod=0'0 crt=17029'8443637 lcod 17029'8443636 active] _scan_snaps no head for 7:5086d044:::rbd_data.a6351b238e1f29.000000000002673e:9e (have MIN) Sep 14 08:37:02 node1.ceph ceph-osd[1703]: 2017-09-14 08:37:02.874246 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.10a( v 17029'8443736 (17029'8440718,17029'8443736] local-lis/les=17006/17007 n=3024 ec=104/104 lis/c 17006/17006 les/c/f 17007/17017/0 17006/17006/16926) [17,1,25] r=1 lpr=17006 luod=0'0 crt=17029'8443736 lcod 17029'8443735 active] _scan_snaps no head for 7:50a20bb1:::rbd_data.a6351b238e1f29.000000000001aa02:9e (have MIN) Sep 14 08:37:03 node1.ceph ceph-osd[1703]: 2017-09-14 08:37:03.086166 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.10a( v 17029'8443742 (17029'8440718,17029'8443742] local-lis/les=17006/17007 n=3024 ec=104/104 lis/c 17006/17006 les/c/f 17007/17017/0 17006/17006/16926) [17,1,25] r=1 lpr=17006 luod=0'0 crt=17029'8443742 lcod 17029'8443741 active] _scan_snaps no head for 7:50a34ff6:::rbd_data.bd1c92ae8944a.0000000000002710:d4 (have MIN) Sep 14 08:37:03 node1.ceph ceph-osd[1703]: 2017-09-14 08:37:03.086187 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.10a( v 17029'8443742 (17029'8440718,17029'8443742] local-lis/les=17006/17007 n=3024 ec=104/104 lis/c 17006/17006 les/c/f 17007/17017/0 17006/17006/16926) [17,1,25] r=1 lpr=17006 luod=0'0 crt=17029'8443742 lcod 17029'8443741 active] _scan_snaps no head for 7:50a34ff6:::rbd_data.bd1c92ae8944a.0000000000002710:d2 (have MIN) Sep 14 08:37:03 node1.ceph ceph-osd[1703]: 2017-09-14 08:37:03.455301 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.10a( v 17029'8443753 (17029'8440718,17029'8443753] local-lis/les=17006/17007 n=3026 ec=104/104 lis/c 17006/17006 les/c/f 17007/17017/0 17006/17006/16926) [17,1,25] r=1 lpr=17006 luod=0'0 crt=17029'8443753 lcod 17029'8443752 active] _scan_snaps no head for 7:50a46850:::rbd_data.a6351b238e1f29.000000000001dff7:9e (have MIN) Sep 14 08:37:05 node1.ceph ceph-osd[1703]: 2017-09-14 08:37:05.825554 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.10a( v 17029'8443781 (17029'8440718,17029'8443781] local-lis/les=17006/17007 n=3030 ec=104/104 lis/c 17006/17006 les/c/f 17007/17017/0 17006/17006/16926) [17,1,25] r=1 lpr=17006 luod=0'0 crt=17029'8443781 lcod 17029'8443780 active] _scan_snaps no head for 7:50ab4b97:::rbd_data.32bc79238e1f29.00000000000008e8:2d (have MIN) Sep 14 08:37:05 node1.ceph ceph-osd[1703]: 2017-09-14 08:37:05.825583 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.10a( v 17029'8443781 (17029'8440718,17029'8443781] local-lis/les=17006/17007 n=3030 ec=104/104 lis/c 17006/17006 les/c/f 17007/17017/0 17006/17006/16926) [17,1,25] r=1 lpr=17006 luod=0'0 crt=17029'8443781 lcod 17029'8443780 active] _scan_snaps no head for 7:50ab4b97:::rbd_data.32bc79238e1f29.00000000000008e8:d (have MIN) Sep 14 08:37:06 node1.ceph ceph-osd[1703]: 2017-09-14 08:37:06.184809 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.10a( v 17029'8443788 (17029'8440718,17029'8443788] local-lis/les=17006/17007 n=3031 ec=104/104 lis/c 17006/17006 les/c/f 17007/17017/0 17006/17006/16926) [17,1,25] r=1 lpr=17006 luod=0'0 crt=17029'8443788 lcod 17029'8443787 active] _scan_snaps no head for 7:50acfba2:::rbd_data.a6351b238e1f29.000000000001c2ce:9e (have MIN) Sep 14 08:37:06 node1.ceph ceph-osd[1703]: 2017-09-14 08:37:06.324484 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.10a( v 17029'8443795 (17029'8440718,17029'8443795] local-lis/les=17006/17007 n=3031 ec=104/104 lis/c 17006/17006 les/c/f 17007/17017/0 17006/17006/16926) [17,1,25] r=1 lpr=17006 luod=0'0 crt=17029'8443795 lcod 17029'8443794 active] _scan_snaps no head for 7:50ae85b2:::rbd_data.a6351b238e1f29.000000000001d47e:9e (have MIN) Sep 14 08:37:10 node1.ceph ceph-osd[1703]: 2017-09-14 08:37:10.007188 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.10a( v 17029'8443838 (17029'8440818,17029'8443838] local-lis/les=17006/17007 n=3032 ec=104/104 lis/c 17006/17006 les/c/f 17007/17017/0 17006/17006/16926) [17,1,25] r=1 lpr=17006 luod=0'0 crt=17029'8443838 lcod 17029'8443837 active] _scan_snaps no head for 7:50ba692b:::rbd_data.bd1c92ae8944a.00000000000058ca:d2 (have MIN) Sep 14 08:37:15 node1.ceph ceph-osd[1703]: 2017-09-14 08:37:15.080248 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[8.286( v 17029'3927166 (16982'3924101,17029'3927166] local-lis/les=16967/16968 n=3430 ec=2548/2548 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,1,8] r=1 lpr=16967 luod=0'0 lua=17029'3927163 crt=17029'3927166 lcod 17029'3927165 active] _scan_snaps no head for 8:6140ce32:::rbd_data.1443bb238e1f29.0000000000001e03:31 (have MIN) Sep 14 08:37:18 node1.ceph ceph-osd[1703]: 2017-09-14 08:37:18.232683 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[8.286( v 17029'3927235 (16998'3924201,17029'3927235] local-lis/les=16967/16968 n=3430 ec=2548/2548 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,1,8] r=1 lpr=16967 luod=0'0 crt=17029'3927235 lcod 17029'3927234 active] _scan_snaps no head for 8:614804b6:::rbd_data.9aca26238e1f29.0000000000002f8c:65 (have MIN) Sep 14 08:37:21 node1.ceph ceph-osd[1703]: 2017-09-14 08:37:21.392124 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[8.286( v 17029'3927319 (17021'3924301,17029'3927319] local-lis/les=16967/16968 n=3432 ec=2548/2548 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,1,8] r=1 lpr=16967 luod=0'0 crt=17029'3927319 lcod 17029'3927318 active] _scan_snaps no head for 8:6151440c:::rbd_data.9aca26238e1f29.0000000000004f70:65 (have MIN) Sep 14 08:38:41 node1.ceph ceph-osd[1703]: 2017-09-14 08:38:41.272716 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.302( v 17029'11300867 (17029'11297767,17029'11300867] local-lis/les=16967/16968 n=3031 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16838) [31,1,15] r=1 lpr=16967 luod=0'0 crt=17029'11300867 lcod 17029'11300866 active] _scan_snaps no head for 7:40c4f7ad:::rbd_data.bd1c92ae8944a.0000000000000d3b:d4 (have MIN) Sep 14 08:38:41 node1.ceph ceph-osd[1703]: 2017-09-14 08:38:41.272759 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.302( v 17029'11300867 (17029'11297767,17029'11300867] local-lis/les=16967/16968 n=3031 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16838) [31,1,15] r=1 lpr=16967 luod=0'0 crt=17029'11300867 lcod 17029'11300866 active] _scan_snaps no head for 7:40c4f7ad:::rbd_data.bd1c92ae8944a.0000000000000d3b:d2 (have MIN) Sep 14 08:38:42 node1.ceph ceph-osd[1703]: 2017-09-14 08:38:42.279916 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.302( v 17029'11300880 (17029'11297867,17029'11300880] local-lis/les=16967/16968 n=3033 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16838) [31,1,15] r=1 lpr=16967 luod=0'0 crt=17029'11300880 lcod 17029'11300879 active] _scan_snaps no head for 7:40c7b81d:::rbd_data.a6351b238e1f29.000000000002650f:9e (have MIN) Sep 14 08:38:47 node1.ceph ceph-osd[1703]: 2017-09-14 08:38:47.850092 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.302( v 17029'11300945 (17029'11297867,17029'11300945] local-lis/les=16967/16968 n=3038 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16838) [31,1,15] r=1 lpr=16967 luod=0'0 lua=17029'11300944 crt=17029'11300945 lcod 17029'11300944 active] _scan_snaps no head for 7:40d87c22:::rbd_data.a74f60238e1f29.000000000000165e:cf (have MIN) Sep 14 08:38:49 node1.ceph ceph-osd[1703]: 2017-09-14 08:38:49.635101 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.302( v 17029'11300968 (17029'11297967,17029'11300968] local-lis/les=16967/16968 n=3038 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16838) [31,1,15] r=1 lpr=16967 luod=0'0 crt=17029'11300968 lcod 17029'11300967 active] _scan_snaps no head for 7:40dcba61:::rbd_data.a6351b238e1f29.0000000000023f34:9e (have MIN) Sep 14 08:38:51 node1.ceph ceph-osd[1703]: 2017-09-14 08:38:51.381810 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.302( v 17029'11300991 (17029'11297967,17029'11300991] local-lis/les=16967/16968 n=3039 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16838) [31,1,15] r=1 lpr=16967 luod=0'0 crt=17029'11300991 lcod 17029'11300990 active] _scan_snaps no head for 7:40e21955:::rbd_data.bd1c92ae8944a.00000000000057a9:d2 (have MIN) Sep 14 08:38:51 node1.ceph ceph-osd[1703]: 2017-09-14 08:38:51.473226 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.302( v 17029'11300993 (17029'11297967,17029'11300993] local-lis/les=16967/16968 n=3039 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16838) [31,1,15] r=1 lpr=16967 luod=0'0 crt=17029'11300993 lcod 17029'11300992 active] _scan_snaps no head for 7:40e26f44:::rbd_data.a4f318238e1f29.0000000000000001:8d (have MIN) Sep 14 08:38:56 node1.ceph ceph-osd[1703]: 2017-09-14 08:38:56.297329 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.302( v 17029'11301046 (17029'11297967,17029'11301046] local-lis/les=16967/16968 n=3043 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16838) [31,1,15] r=1 lpr=16967 luod=0'0 crt=17029'11301046 lcod 17029'11301045 active] _scan_snaps no head for 7:40f0197b:::rbd_data.a6351b238e1f29.0000000000026603:9e (have MIN) Sep 14 08:45:04 node1.ceph ceph-osd[1703]: 2017-09-14 08:45:04.515905 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.37a( v 17029'260993151 (17029'260990139,17029'260993151] local-lis/les=17020/17021 n=3112 ec=2543/2543 lis/c 17020/17020 les/c/f 17021/17021/0 16990/17020/16926) [17,18,1] r=2 lpr=17020 luod=0'0 lua=17029'260993147 crt=17029'260993151 lcod 17029'260993149 active] _scan_snaps no head for 7:5ecab6e0:::rbd_data.bd1c92ae8944a.00000000000025ea:d4 (have MIN) Sep 14 08:45:04 node1.ceph ceph-osd[1703]: 2017-09-14 08:45:04.515923 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.37a( v 17029'260993151 (17029'260990139,17029'260993151] local-lis/les=17020/17021 n=3112 ec=2543/2543 lis/c 17020/17020 les/c/f 17021/17021/0 16990/17020/16926) [17,18,1] r=2 lpr=17020 luod=0'0 lua=17029'260993147 crt=17029'260993151 lcod 17029'260993149 active] _scan_snaps no head for 7:5ecab6e0:::rbd_data.bd1c92ae8944a.00000000000025ea:d2 (have MIN) Sep 14 08:48:10 node1.ceph ceph-osd[1703]: 2017-09-14 08:48:10.063557 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.37a( v 17029'260993392 (17029'260990339,17029'260993392] local-lis/les=17020/17021 n=3121 ec=2543/2543 lis/c 17020/17020 les/c/f 17021/17021/0 16990/17020/16926) [17,18,1] r=2 lpr=17020 luod=0'0 crt=17029'260993392 lcod 17029'260993391 active] _scan_snaps no head for 7:5ee0ecd5:::rbd_data.a6351b238e1f29.00000000000224d2:9e (have MIN) Sep 14 08:50:29 node1.ceph ceph-osd[1703]: 2017-09-14 08:50:29.867271 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.37a( v 17029'260993591 (17029'260990539,17029'260993591] local-lis/les=17020/17021 n=3126 ec=2543/2543 lis/c 17020/17020 les/c/f 17021/17021/0 16990/17020/16926) [17,18,1] r=2 lpr=17020 luod=0'0 crt=17029'260993591 lcod 17029'260993590 active] _scan_snaps no head for 7:5ef3f096:::rbd_data.a6351b238e1f29.000000000001c358:9e (have MIN) Sep 14 08:51:56 node1.ceph ceph-osd[1703]: 2017-09-14 08:51:56.403676 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.37a( v 17029'260993705 (17029'260990639,17029'260993705] local-lis/les=17020/17021 n=3126 ec=2543/2543 lis/c 17020/17020 les/c/f 17021/17021/0 16990/17020/16926) [17,18,1] r=2 lpr=17020 luod=0'0 lua=17029'260993702 crt=17029'260993705 lcod 17029'260993704 active] _scan_snaps no head for 7:5eff36ae:::rbd_data.a6351b238e1f29.000000000002875d:9e (have MIN) Sep 14 08:52:05 node1.ceph ceph-osd[1703]: 2017-09-14 08:52:05.938122 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.391( v 17029'3246839 (17029'3243815,17029'3246839] local-lis/les=16967/16968 n=3083 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16838) [31,11,1] r=2 lpr=16967 luod=0'0 crt=17029'3246839 lcod 17029'3246838 active] _scan_snaps no head for 7:89c80372:::rbd_data.a6351b238e1f29.000000000001eda0:9e (have MIN) Sep 14 08:52:06 node1.ceph ceph-osd[1703]: 2017-09-14 08:52:06.523612 7fb93cfe9700 -1 osd.1 pg_epoch: 17029 pg[7.391( v 17029'3246844 (17029'3243815,17029'3246844] local-lis/les=16967/16968 n=3083 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16897/16967/16838) [31,11,1] r=2 lpr=16967 luod=0'0 crt=17029'3246844 lcod 17029'3246843 active] _scan_snaps no head for 7:89ca7f5e:::rbd_data.a6351b238e1f29.000000000000be5f:9e (have MIN) Sep 14 09:27:20 node1.ceph ceph-osd[1703]: 2017-09-14 09:27:20.981063 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.d8( v 17029'6692306 (17029'6689277,17029'6692306] local-lis/les=16967/16968 n=3067 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16864) [36,30,1] r=2 lpr=16967 luod=0'0 crt=17029'6692306 lcod 17029'6692304 active] _scan_snaps no head for 7:1b044318:::rbd_data.a6351b238e1f29.0000000000021cc0:9e (have MIN) Sep 14 09:27:22 node1.ceph ceph-osd[1703]: 2017-09-14 09:27:22.892828 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.d8( v 17029'6692346 (17029'6689277,17029'6692346] local-lis/les=16967/16968 n=3069 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16864) [36,30,1] r=2 lpr=16967 luod=0'0 crt=17029'6692346 lcod 17029'6692345 active] _scan_snaps no head for 7:1b0dd308:::rbd_data.bd1c92ae8944a.00000000000020ff:d4 (have MIN) Sep 14 09:27:22 node1.ceph ceph-osd[1703]: 2017-09-14 09:27:22.892851 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.d8( v 17029'6692346 (17029'6689277,17029'6692346] local-lis/les=16967/16968 n=3069 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16864) [36,30,1] r=2 lpr=16967 luod=0'0 crt=17029'6692346 lcod 17029'6692345 active] _scan_snaps no head for 7:1b0dd308:::rbd_data.bd1c92ae8944a.00000000000020ff:d2 (have MIN) Sep 14 09:27:24 node1.ceph ceph-osd[1703]: 2017-09-14 09:27:24.812899 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.d8( v 17029'6692400 (17029'6689377,17029'6692400] local-lis/les=16967/16968 n=3072 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16864) [36,30,1] r=2 lpr=16967 luod=0'0 crt=17029'6692400 lcod 17029'6692399 active] _scan_snaps no head for 7:1b1aa6d3:::rbd_data.a6351b238e1f29.00000000000190b5:9e (have MIN) Sep 14 09:27:25 node1.ceph ceph-osd[1703]: 2017-09-14 09:27:25.496384 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.d8( v 17029'6692414 (17029'6689377,17029'6692414] local-lis/les=16967/16968 n=3073 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16864) [36,30,1] r=2 lpr=16967 luod=0'0 crt=17029'6692414 lcod 17029'6692413 active] _scan_snaps no head for 7:1b1dfbd8:::rbd_data.a70641238e1f29.0000000000007365:ce (have MIN) Sep 14 09:27:25 node1.ceph ceph-osd[1703]: 2017-09-14 09:27:25.496410 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.d8( v 17029'6692414 (17029'6689377,17029'6692414] local-lis/les=16967/16968 n=3073 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16871/16967/16864) [36,30,1] r=2 lpr=16967 luod=0'0 crt=17029'6692414 lcod 17029'6692413 active] _scan_snaps no head for 7:1b1dfbd8:::rbd_data.a70641238e1f29.0000000000007365:9d (have MIN) Sep 14 09:39:24 node1.ceph ceph-osd[1703]: 2017-09-14 09:39:24.426769 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.20c( v 17029'66076036 (17029'66072981,17029'66076036] local-lis/les=16967/16968 n=2967 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16894/16967/16842) [32,8,1] r=2 lpr=16967 luod=0'0 crt=17029'66076036 lcod 17029'66076035 active] _scan_snaps no head for 7:30417ec7:::rbd_data.a6351b238e1f29.0000000000029d7e:9e (have MIN) Sep 14 09:39:29 node1.ceph ceph-osd[1703]: 2017-09-14 09:39:29.422311 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.20c( v 17029'66076069 (17029'66072981,17029'66076069] local-lis/les=16967/16968 n=2969 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16894/16967/16842) [32,8,1] r=2 lpr=16967 luod=0'0 crt=17029'66076069 lcod 17029'66076068 active] _scan_snaps no head for 7:304aa5c2:::rbd_data.bd1c92ae8944a.00000000000008ae:d4 (have MIN) Sep 14 09:39:29 node1.ceph ceph-osd[1703]: 2017-09-14 09:39:29.422344 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.20c( v 17029'66076069 (17029'66072981,17029'66076069] local-lis/les=16967/16968 n=2969 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16894/16967/16842) [32,8,1] r=2 lpr=16967 luod=0'0 crt=17029'66076069 lcod 17029'66076068 active] _scan_snaps no head for 7:304aa5c2:::rbd_data.bd1c92ae8944a.00000000000008ae:d2 (have MIN) Sep 14 09:39:37 node1.ceph ceph-osd[1703]: 2017-09-14 09:39:37.006605 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.20c( v 17029'66076154 (17029'66073081,17029'66076154] local-lis/les=16967/16968 n=2973 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16894/16967/16842) [32,8,1] r=2 lpr=16967 luod=0'0 crt=17029'66076154 lcod 17029'66076153 active] _scan_snaps no head for 7:305e2122:::rbd_data.a6351b238e1f29.0000000000024bfb:9e (have MIN) Sep 14 09:39:38 node1.ceph ceph-osd[1703]: 2017-09-14 09:39:38.228828 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.20c( v 17029'66076169 (17029'66073081,17029'66076169] local-lis/les=16967/16968 n=2973 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16894/16967/16842) [32,8,1] r=2 lpr=16967 luod=0'0 crt=17029'66076169 lcod 17029'66076168 active] _scan_snaps no head for 7:3062d575:::rbd_data.a6351b238e1f29.0000000000003f04:d1 (have MIN) Sep 14 09:39:41 node1.ceph ceph-osd[1703]: 2017-09-14 09:39:41.001700 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.20c( v 17029'66076196 (17029'66073181,17029'66076196] local-lis/les=16967/16968 n=2973 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16894/16967/16842) [32,8,1] r=2 lpr=16967 luod=0'0 crt=17029'66076196 lcod 17029'66076195 active] _scan_snaps no head for 7:3069f314:::rbd_data.32bc79238e1f29.0000000000000a64:2d (have MIN) Sep 14 09:39:41 node1.ceph ceph-osd[1703]: 2017-09-14 09:39:41.001727 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.20c( v 17029'66076196 (17029'66073181,17029'66076196] local-lis/les=16967/16968 n=2973 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16894/16967/16842) [32,8,1] r=2 lpr=16967 luod=0'0 crt=17029'66076196 lcod 17029'66076195 active] _scan_snaps no head for 7:3069f314:::rbd_data.32bc79238e1f29.0000000000000a64:d (have MIN) Sep 14 09:39:47 node1.ceph ceph-osd[1703]: 2017-09-14 09:39:47.653304 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.20c( v 17029'66076252 (17029'66073181,17029'66076252] local-lis/les=16967/16968 n=2976 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16894/16967/16842) [32,8,1] r=2 lpr=16967 luod=0'0 crt=17029'66076252 lcod 17029'66076251 active] _scan_snaps no head for 7:3079e6a7:::rbd_data.bd1c92ae8944a.000000000000396c:d4 (have MIN) Sep 14 09:39:47 node1.ceph ceph-osd[1703]: 2017-09-14 09:39:47.653328 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.20c( v 17029'66076252 (17029'66073181,17029'66076252] local-lis/les=16967/16968 n=2976 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16894/16967/16842) [32,8,1] r=2 lpr=16967 luod=0'0 crt=17029'66076252 lcod 17029'66076251 active] _scan_snaps no head for 7:3079e6a7:::rbd_data.bd1c92ae8944a.000000000000396c:d2 (have MIN) Sep 14 09:46:20 node1.ceph ceph-osd[1703]: 2017-09-14 09:46:20.948784 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[8.118( v 17029'5401617 (17029'5398561,17029'5401617] local-lis/les=16967/16968 n=3322 ec=107/107 lis/c 16967/16967 les/c/f 16968/16968/0 16929/16967/16929) [16,36,1] r=2 lpr=16967 luod=0'0 crt=17029'5401617 lcod 17029'5401616 active] _scan_snaps no head for 8:188bdd45:::rbd_data.1443bb238e1f29.00000000000012d0:31 (have MIN) Sep 14 09:47:15 node1.ceph ceph-osd[1703]: 2017-09-14 09:47:15.244402 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.2c0( v 17029'11984333 (17029'11981236,17029'11984333] local-lis/les=16967/16968 n=2992 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,1,39] r=1 lpr=16967 luod=0'0 crt=17029'11984333 lcod 17029'11984332 active] _scan_snaps no head for 7:034239fb:::rbd_data.bd1c92ae8944a.0000000000004bea:d2 (have MIN) Sep 14 09:47:16 node1.ceph ceph-osd[1703]: 2017-09-14 09:47:16.280303 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.2c0( v 17029'11984370 (17029'11981336,17029'11984370] local-lis/les=16967/16968 n=2996 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,1,39] r=1 lpr=16967 luod=0'0 crt=17029'11984370 lcod 17029'11984369 active] _scan_snaps no head for 7:0348a7a0:::rbd_data.bd1c92ae8944a.000000000000585b:d2 (have MIN) Sep 14 09:47:19 node1.ceph ceph-osd[1703]: 2017-09-14 09:47:19.956755 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.2c0( v 17029'11984436 (17029'11981336,17029'11984436] local-lis/les=16967/16968 n=3002 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,1,39] r=1 lpr=16967 luod=0'0 crt=17029'11984436 lcod 17029'11984435 active] _scan_snaps no head for 7:0357f0f4:::rbd_data.bd1c92ae8944a.0000000000005391:d2 (have MIN) Sep 14 09:47:21 node1.ceph ceph-osd[1703]: 2017-09-14 09:47:21.753719 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.2c0( v 17029'11984464 (17029'11981436,17029'11984464] local-lis/les=16967/16968 n=3006 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,1,39] r=1 lpr=16967 luod=0'0 crt=17029'11984464 lcod 17029'11984462 active] _scan_snaps no head for 7:035fe79b:::rbd_data.a74f60238e1f29.0000000000000905:9c (have MIN) Sep 14 09:47:26 node1.ceph ceph-osd[1703]: 2017-09-14 09:47:26.032308 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.2c0( v 17029'11984550 (17029'11981537,17029'11984550] local-lis/les=16967/16968 n=3011 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,1,39] r=1 lpr=16967 luod=0'0 crt=17029'11984550 lcod 17029'11984549 active] _scan_snaps no head for 7:03779a62:::rbd_data.b737b238e1f29.0000000000001cdd:8 (have MIN) Sep 14 09:47:26 node1.ceph ceph-osd[1703]: 2017-09-14 09:47:26.472687 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.2c0( v 17029'11984560 (17029'11981537,17029'11984560] local-lis/les=16967/16968 n=3012 ec=2543/2543 lis/c 16967/16967 les/c/f 16968/16968/0 16920/16967/16920) [12,1,39] r=1 lpr=16967 luod=0'0 crt=17029'11984560 lcod 17029'11984559 active] _scan_snaps no head for 7:037a0b39:::rbd_data.32bc79238e1f29.00000000000004e3:2d (have MIN) Sep 14 10:22:11 node1.ceph ceph-osd[1703]: 2017-09-14 10:22:11.831684 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1df( v 17029'5531629 (17029'5528612,17029'5531629] local-lis/les=16997/16998 n=3106 ec=104/104 lis/c 16997/16997 les/c/f 16998/17019/0 16997/16997/16871) [1,31,22] r=0 lpr=16997 crt=17029'5531629 lcod 17029'5531628 mlcod 17029'5531628 active+clean+scrubbing] _scan_snaps no head for 7:fb89e46d:::rbd_data.a70641238e1f29.0000000000006ac1:9d (have MIN) Sep 14 10:22:13 node1.ceph ceph-osd[1703]: 2017-09-14 10:22:13.403254 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1df( v 17029'5531667 (17029'5528612,17029'5531667] local-lis/les=16997/16998 n=3108 ec=104/104 lis/c 16997/16997 les/c/f 16998/17019/0 16997/16997/16871) [1,31,22] r=0 lpr=16997 crt=17029'5531667 lcod 17029'5531666 mlcod 17029'5531666 active+clean+scrubbing] _scan_snaps no head for 7:fb9249f1:::rbd_data.bd1c92ae8944a.0000000000002b55:d4 (have MIN) Sep 14 10:22:13 node1.ceph ceph-osd[1703]: 2017-09-14 10:22:13.403275 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1df( v 17029'5531667 (17029'5528612,17029'5531667] local-lis/les=16997/16998 n=3108 ec=104/104 lis/c 16997/16997 les/c/f 16998/17019/0 16997/16997/16871) [1,31,22] r=0 lpr=16997 crt=17029'5531667 lcod 17029'5531666 mlcod 17029'5531666 active+clean+scrubbing] _scan_snaps no head for 7:fb9249f1:::rbd_data.bd1c92ae8944a.0000000000002b55:d2 (have MIN) Sep 14 10:22:18 node1.ceph ceph-osd[1703]: 2017-09-14 10:22:18.116779 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.1df( v 17029'5531790 (17029'5528712,17029'5531790] local-lis/les=16997/16998 n=3117 ec=104/104 lis/c 16997/16997 les/c/f 16998/17019/0 16997/16997/16871) [1,31,22] r=0 lpr=16997 crt=17029'5531790 lcod 17029'5531789 mlcod 17029'5531789 active+clean+scrubbing] _scan_snaps no head for 7:fbacf58b:::rbd_data.bd1c92ae8944a.0000000000003fd7:d4 (have MIN) Sep 14 10:28:02 node1.ceph ceph-osd[1703]: 2017-09-14 10:28:02.158167 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.182( v 17029'4936459 (17029'4933451,17029'4936459] local-lis/les=16967/16968 n=3051 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,1,11] r=1 lpr=16967 luod=0'0 crt=17029'4936459 lcod 17029'4936458 active] _scan_snaps no head for 7:419284bc:::rbd_data.bd1c92ae8944a.0000000000002a53:d4 (have MIN) Sep 14 10:28:02 node1.ceph ceph-osd[1703]: 2017-09-14 10:28:02.158195 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.182( v 17029'4936459 (17029'4933451,17029'4936459] local-lis/les=16967/16968 n=3051 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,1,11] r=1 lpr=16967 luod=0'0 crt=17029'4936459 lcod 17029'4936458 active] _scan_snaps no head for 7:419284bc:::rbd_data.bd1c92ae8944a.0000000000002a53:d2 (have MIN) Sep 14 10:28:03 node1.ceph ceph-osd[1703]: 2017-09-14 10:28:03.617294 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.182( v 17029'4936470 (17029'4933451,17029'4936470] local-lis/les=16967/16968 n=3052 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,1,11] r=1 lpr=16967 luod=0'0 crt=17029'4936470 lcod 17029'4936469 active] _scan_snaps no head for 7:4196697f:::rbd_data.a4f318238e1f29.00000000000010c9:8d (have MIN) Sep 14 10:28:03 node1.ceph ceph-osd[1703]: 2017-09-14 10:28:03.617323 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.182( v 17029'4936470 (17029'4933451,17029'4936470] local-lis/les=16967/16968 n=3052 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,1,11] r=1 lpr=16967 luod=0'0 crt=17029'4936470 lcod 17029'4936469 active] _scan_snaps no head for 7:4196697f:::rbd_data.a4f318238e1f29.00000000000010c9:64 (have MIN) Sep 14 10:28:06 node1.ceph ceph-osd[1703]: 2017-09-14 10:28:06.103615 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.182( v 17029'4936487 (17029'4933451,17029'4936487] local-lis/les=16967/16968 n=3053 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,1,11] r=1 lpr=16967 luod=0'0 crt=17029'4936487 lcod 17029'4936486 active] _scan_snaps no head for 7:419b4fb2:::rbd_data.bd1c92ae8944a.0000000000001810:d4 (have MIN) Sep 14 10:28:06 node1.ceph ceph-osd[1703]: 2017-09-14 10:28:06.103661 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.182( v 17029'4936487 (17029'4933451,17029'4936487] local-lis/les=16967/16968 n=3053 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,1,11] r=1 lpr=16967 luod=0'0 crt=17029'4936487 lcod 17029'4936486 active] _scan_snaps no head for 7:419b4fb2:::rbd_data.bd1c92ae8944a.0000000000001810:d2 (have MIN) Sep 14 10:28:13 node1.ceph ceph-osd[1703]: 2017-09-14 10:28:13.045502 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.182( v 17029'4936560 (17029'4933551,17029'4936560] local-lis/les=16967/16968 n=3058 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,1,11] r=1 lpr=16967 luod=0'0 crt=17029'4936560 lcod 17029'4936559 active] _scan_snaps no head for 7:41a99f77:::rbd_data.bd1c92ae8944a.0000000000001926:d4 (have MIN) Sep 14 10:28:13 node1.ceph ceph-osd[1703]: 2017-09-14 10:28:13.045528 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.182( v 17029'4936560 (17029'4933551,17029'4936560] local-lis/les=16967/16968 n=3058 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,1,11] r=1 lpr=16967 luod=0'0 crt=17029'4936560 lcod 17029'4936559 active] _scan_snaps no head for 7:41a99f77:::rbd_data.bd1c92ae8944a.0000000000001926:d2 (have MIN) Sep 14 10:28:19 node1.ceph ceph-osd[1703]: 2017-09-14 10:28:19.481244 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[7.182( v 17029'4936617 (17029'4933551,17029'4936617] local-lis/les=16967/16968 n=3059 ec=104/104 lis/c 16967/16967 les/c/f 16968/16968/0 16923/16967/16923) [15,1,11] r=1 lpr=16967 luod=0'0 crt=17029'4936617 lcod 17029'4936616 active] _scan_snaps no head for 7:41b885ea:::rbd_data.68c683238e1f29.00000000000005d0:3d (have MIN) Sep 14 10:29:24 node1.ceph ceph-osd[1703]: 2017-09-14 10:29:24.539752 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.33e( v 17029'16094773 (17029'16091702,17029'16094773] local-lis/les=17009/17010 n=3062 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 lua=17029'16094769 crt=17029'16094773 lcod 17029'16094772 active] _scan_snaps no head for 7:7cc784f1:::rbd_data.a6351b238e1f29.0000000000026659:9e (have MIN) Sep 14 10:29:40 node1.ceph ceph-osd[1703]: 2017-09-14 10:29:40.006584 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.33e( v 17029'16094812 (17029'16091802,17029'16094812] local-lis/les=17009/17010 n=3063 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 crt=17029'16094812 lcod 17029'16094811 active] _scan_snaps no head for 7:7ccb44a6:::rbd_data.a74f60238e1f29.0000000000000143:cf (have MIN) Sep 14 10:29:40 node1.ceph ceph-osd[1703]: 2017-09-14 10:29:40.006610 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.33e( v 17029'16094812 (17029'16091802,17029'16094812] local-lis/les=17009/17010 n=3063 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 crt=17029'16094812 lcod 17029'16094811 active] _scan_snaps no head for 7:7ccb44a6:::rbd_data.a74f60238e1f29.0000000000000143:9c (have MIN) Sep 14 10:30:13 node1.ceph ceph-osd[1703]: 2017-09-14 10:30:13.877298 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.33e( v 17029'16094882 (17029'16091802,17029'16094882] local-lis/les=17009/17010 n=3064 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 crt=17029'16094882 lcod 17029'16094881 active] _scan_snaps no head for 7:7cd3be51:::rbd_data.bd1c92ae8944a.00000000000004ba:d2 (have MIN) Sep 14 10:30:55 node1.ceph ceph-osd[1703]: 2017-09-14 10:30:55.564397 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.33e( v 17029'16094984 (17029'16091902,17029'16094984] local-lis/les=17009/17010 n=3068 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 crt=17029'16094984 lcod 17029'16094983 active] _scan_snaps no head for 7:7cde0095:::rbd_data.bd1c92ae8944a.000000000000584a:d2 (have MIN) Sep 14 10:31:05 node1.ceph ceph-osd[1703]: 2017-09-14 10:31:05.102903 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.33e( v 17029'16095007 (17029'16092003,17029'16095007] local-lis/les=17009/17010 n=3070 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 crt=17029'16095007 lcod 17029'16095006 active] _scan_snaps no head for 7:7ce06d4a:::rbd_data.bd1c92ae8944a.000000000000151d:d4 (have MIN) Sep 14 10:31:05 node1.ceph ceph-osd[1703]: 2017-09-14 10:31:05.102926 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.33e( v 17029'16095007 (17029'16092003,17029'16095007] local-lis/les=17009/17010 n=3070 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 crt=17029'16095007 lcod 17029'16095006 active] _scan_snaps no head for 7:7ce06d4a:::rbd_data.bd1c92ae8944a.000000000000151d:d2 (have MIN) Sep 14 10:33:09 node1.ceph ceph-osd[1703]: 2017-09-14 10:33:09.409684 7fb93e7ec700 -1 osd.1 pg_epoch: 17029 pg[7.33e( v 17029'16095312 (17029'16092304,17029'16095312] local-lis/les=17009/17010 n=3076 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 crt=17029'16095312 lcod 17029'16095311 active] _scan_snaps no head for 7:7cff42c0:::rbd_data.bd1c92ae8944a.0000000000006e33:d2 (have MIN) Sep 14 10:45:03 node1.ceph ceph-osd[1703]: 2017-09-14 10:45:03.209756 7fb93d7ea700 -1 osd.1 pg_epoch: 17029 pg[8.1d3( v 17029'2260211 (17029'2257167,17029'2260211] local-lis/les=16967/16968 n=3290 ec=107/107 lis/c 16967/16967 les/c/f 16968/16968/0 16909/16967/16871) [1,9,28] r=0 lpr=16967 crt=17029'2260211 lcod 17029'2260210 mlcod 17029'2260210 active+clean+scrubbing] _scan_snaps no head for 8:cbacf8b5:::rbd_data.9aca26238e1f29.00000000000061c9:65 (have MIN) Sep 14 10:45:24 node1.ceph ceph-osd[1703]: 2017-09-14 10:45:24.894923 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[8.6f( v 17029'4249300 (17029'4246274,17029'4249300] local-lis/les=16967/16968 n=3353 ec=107/107 lis/c 16967/16967 les/c/f 16968/16968/0 16926/16967/16926) [17,7,1] r=2 lpr=16967 luod=0'0 crt=17029'4249300 lcod 17029'4249299 active] _scan_snaps no head for 8:f60f8554:::rbd_data.9aca26238e1f29.0000000000003e9e:65 (have MIN) Sep 14 10:45:29 node1.ceph ceph-osd[1703]: 2017-09-14 10:45:29.667039 7fb93dfeb700 -1 osd.1 pg_epoch: 17029 pg[8.6f( v 17029'4249385 (17029'4246374,17029'4249385] local-lis/les=16967/16968 n=3353 ec=107/107 lis/c 16967/16967 les/c/f 16968/16968/0 16926/16967/16926) [17,7,1] r=2 lpr=16967 luod=0'0 crt=17029'4249385 lcod 17029'4249384 active] _scan_snaps no head for 8:f619b342:::rbd_data.1443bb238e1f29.00000000000013dc:31 (have MIN) Sep 14 10:51:12 node1.ceph ceph-osd[1703]: 2017-09-14 10:51:12.022058 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.397( v 17029'5606992 (17029'5603984,17029'5606992] local-lis/les=17009/17010 n=3138 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 crt=17029'5606992 lcod 17029'5606991 active] _scan_snaps no head for 7:e9c56fa1:::rbd_data.bd1c92ae8944a.0000000000001745:d4 (have MIN) Sep 14 10:51:12 node1.ceph ceph-osd[1703]: 2017-09-14 10:51:12.022080 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.397( v 17029'5606992 (17029'5603984,17029'5606992] local-lis/les=17009/17010 n=3138 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 crt=17029'5606992 lcod 17029'5606991 active] _scan_snaps no head for 7:e9c56fa1:::rbd_data.bd1c92ae8944a.0000000000001745:d2 (have MIN) Sep 14 10:51:12 node1.ceph ceph-osd[1703]: 2017-09-14 10:51:12.298078 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.397( v 17029'5607014 (17029'5603984,17029'5607014] local-lis/les=17009/17010 n=3140 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 crt=17029'5607014 lcod 17029'5607013 active] _scan_snaps no head for 7:e9c9acd7:::rbd_data.a70641238e1f29.0000000000005261:9d (have MIN) Sep 14 10:51:12 node1.ceph ceph-osd[1703]: 2017-09-14 10:51:12.455785 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.397( v 17029'5607019 (17029'5603984,17029'5607019] local-lis/les=17009/17010 n=3141 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 lua=17029'5607017 crt=17029'5607019 lcod 17029'5607017 active] _scan_snaps no head for 7:e9ca8005:::rbd_data.a6351b238e1f29.000000000002b5cc:9e (have MIN) Sep 14 10:51:14 node1.ceph ceph-osd[1703]: 2017-09-14 10:51:14.627373 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.397( v 17029'5607064 (17029'5603984,17029'5607064] local-lis/les=17009/17010 n=3145 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 crt=17029'5607064 lcod 17029'5607063 active] _scan_snaps no head for 7:e9d81810:::rbd_data.a6351b238e1f29.000000000001e500:9e (have MIN) Sep 14 10:51:15 node1.ceph ceph-osd[1703]: 2017-09-14 10:51:15.019299 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.397( v 17029'5607088 (17029'5604084,17029'5607088] local-lis/les=17009/17010 n=3145 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 crt=17029'5607088 lcod 17029'5607087 active] _scan_snaps no head for 7:e9ddc264:::rbd_data.bd1c92ae8944a.00000000000011e5:d4 (have MIN) Sep 14 10:51:15 node1.ceph ceph-osd[1703]: 2017-09-14 10:51:15.019320 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.397( v 17029'5607088 (17029'5604084,17029'5607088] local-lis/les=17009/17010 n=3145 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 crt=17029'5607088 lcod 17029'5607087 active] _scan_snaps no head for 7:e9ddc264:::rbd_data.bd1c92ae8944a.00000000000011e5:d2 (have MIN) Sep 14 10:51:15 node1.ceph ceph-osd[1703]: 2017-09-14 10:51:15.068253 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.397( v 17029'5607095 (17029'5604084,17029'5607095] local-lis/les=17009/17010 n=3146 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 crt=17029'5607095 lcod 17029'5607094 active] _scan_snaps no head for 7:e9df88ec:::rbd_data.a6351b238e1f29.000000000001a391:d1 (have MIN) Sep 14 10:51:15 node1.ceph ceph-osd[1703]: 2017-09-14 10:51:15.068282 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.397( v 17029'5607095 (17029'5604084,17029'5607095] local-lis/les=17009/17010 n=3146 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 crt=17029'5607095 lcod 17029'5607094 active] _scan_snaps no head for 7:e9df88ec:::rbd_data.a6351b238e1f29.000000000001a391:9e (have MIN) Sep 14 10:51:15 node1.ceph ceph-osd[1703]: 2017-09-14 10:51:15.447078 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.397( v 17029'5607110 (17029'5604084,17029'5607110] local-lis/les=17009/17010 n=3148 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 crt=17029'5607110 lcod 17029'5607109 active] _scan_snaps no head for 7:e9e26259:::rbd_data.bd1c92ae8944a.0000000000002f2e:d4 (have MIN) Sep 14 10:51:15 node1.ceph ceph-osd[1703]: 2017-09-14 10:51:15.447100 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.397( v 17029'5607110 (17029'5604084,17029'5607110] local-lis/les=17009/17010 n=3148 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 crt=17029'5607110 lcod 17029'5607109 active] _scan_snaps no head for 7:e9e26259:::rbd_data.bd1c92ae8944a.0000000000002f2e:d2 (have MIN) Sep 14 10:51:15 node1.ceph ceph-osd[1703]: 2017-09-14 10:51:15.621057 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.397( v 17029'5607119 (17029'5604084,17029'5607119] local-lis/les=17009/17010 n=3149 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 crt=17029'5607119 lcod 17029'5607118 active] _scan_snaps no head for 7:e9e4a37f:::rbd_data.c1ebe8238e1f29.00000000000002b5:df (have MIN) Sep 14 10:51:16 node1.ceph ceph-osd[1703]: 2017-09-14 10:51:16.569001 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.397( v 17029'5607144 (17029'5604084,17029'5607144] local-lis/les=17009/17010 n=3152 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 crt=17029'5607144 lcod 17029'5607143 active] _scan_snaps no head for 7:e9e9bf11:::rbd_data.bd1c92ae8944a.000000000000227d:d4 (have MIN) Sep 14 10:51:16 node1.ceph ceph-osd[1703]: 2017-09-14 10:51:16.569027 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[7.397( v 17029'5607144 (17029'5604084,17029'5607144] local-lis/les=17009/17010 n=3152 ec=2543/2543 lis/c 17009/17009 les/c/f 17010/17021/0 17009/17009/16864) [36,1,20] r=1 lpr=17009 luod=0'0 crt=17029'5607144 lcod 17029'5607143 active] _scan_snaps no head for 7:e9e9bf11:::rbd_data.bd1c92ae8944a.000000000000227d:d2 (have MIN) Sep 14 10:59:38 node1.ceph ceph-osd[1703]: 2017-09-14 10:59:38.842537 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[8.289( v 17029'2532944 (17029'2529904,17029'2532944] local-lis/les=16967/16968 n=3275 ec=2548/2548 lis/c 16967/16967 les/c/f 16968/16968/0 16917/16967/16917) [13,1,9] r=1 lpr=16967 luod=0'0 crt=17029'2532944 lcod 17029'2532943 active] _scan_snaps no head for 8:9148f867:::rbd_data.1443bb238e1f29.0000000000001d5b:31 (have MIN) Sep 14 10:59:41 node1.ceph ceph-osd[1703]: 2017-09-14 10:59:41.447299 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[8.289( v 17029'2533017 (17029'2530004,17029'2533017] local-lis/les=16967/16968 n=3275 ec=2548/2548 lis/c 16967/16967 les/c/f 16968/16968/0 16917/16967/16917) [13,1,9] r=1 lpr=16967 luod=0'0 crt=17029'2533017 lcod 17029'2533016 active] _scan_snaps no head for 8:91517613:::rbd_data.1443bb238e1f29.000000000000220f:31 (have MIN) Sep 14 10:59:49 node1.ceph ceph-osd[1703]: 2017-09-14 10:59:49.959316 7fb93c7e8700 -1 osd.1 pg_epoch: 17029 pg[8.289( v 17029'2533315 (17029'2530304,17029'2533315] local-lis/les=16967/16968 n=3276 ec=2548/2548 lis/c 16967/16967 les/c/f 16968/16968/0 16917/16967/16917) [13,1,9] r=1 lpr=16967 luod=0'0 crt=17029'2533315 lcod 17029'2533314 active] _scan_snaps no head for 8:91775019:::rbd_data.9aca26238e1f29.0000000000003302:65 (have MIN) Sep 15 03:58:34 node1.ceph ceph-osd[1703]: 2017-09-15 03:58:34.471410 7fb935fff700 -1 received signal: Hangup from PID: 21536 task name: killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw UID: 0 Sep 15 11:10:19 node1.ceph ceph-osd[1703]: 2017-09-15 11:10:19.628730 7fb935fff700 -1 received signal: Terminated from PID: 1 task name: /usr/lib/systemd/systemd --switched-root --system --deserialize 21 UID: 0 Sep 15 11:10:19 node1.ceph ceph-osd[1703]: 2017-09-15 11:10:19.628755 7fb935fff700 -1 osd.1 18452 *** Got signal Terminated *** Sep 15 11:10:19 node1.ceph ceph-osd[1703]: 2017-09-15 11:10:19.697110 7fb935fff700 -1 osd.1 18452 shutdown Sep 15 11:23:16 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 15 11:23:16 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 15 11:23:16 node1.ceph ceph-osd[5227]: 2017-09-15 11:23:16.833260 7fe3bac2ad00 -1 Public network was set, but cluster network was not set Sep 15 11:23:16 node1.ceph ceph-osd[5227]: 2017-09-15 11:23:16.833266 7fe3bac2ad00 -1 Using public network also for cluster network Sep 15 11:23:16 node1.ceph ceph-osd[5227]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 15 11:23:17 node1.ceph ceph-osd[5227]: 2017-09-15 11:23:17.177555 7fe3bac2ad00 -1 osd.1 0 log_to_monitors {default=true} Sep 15 11:23:17 node1.ceph ceph-osd[5227]: 2017-09-15 11:23:17.420111 7fe3a0bed700 -1 osd.1 0 waiting for initial osdmap Sep 15 11:24:42 node1.ceph ceph-osd[5227]: *** Caught signal (Segmentation fault) ** Sep 15 11:24:42 node1.ceph ceph-osd[5227]: in thread 7fe3a53f6700 thread_name:bstore_kv_sync Sep 15 11:24:42 node1.ceph ceph-osd[5227]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 1: (()+0xa23b21) [0x55ba361d7b21] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 2: (()+0xf5e0) [0x7fe3b80405e0] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 3: (()+0x1cdff) [0x7fe3ba80ddff] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 4: (rocksdb::Arena::AllocateNewBlock(unsigned long)+0x4c) [0x55ba36571f3c] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 5: (rocksdb::Arena::AllocateFallback(unsigned long, bool)+0x47) [0x55ba36571fe7] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 6: (rocksdb::ConcurrentArena::AllocateAligned(unsigned long, unsigned long, rocksdb::Logger*)+0xa0) [0x55ba364f52e0] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 7: (()+0xd74527) [0x55ba36528527] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 8: (()+0xd745b3) [0x55ba365285b3] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 9: (rocksdb::MemTable::Add(unsigned long, rocksdb::ValueType, rocksdb::Slice const&, rocksdb::Slice const&, bool, rocksdb::MemTablePostProcessInfo*)+0xcf) [0x55ba364f1eff] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 10: (rocksdb::MemTableInserter::PutCF(unsigned int, rocksdb::Slice const&, rocksdb::Slice const&)+0x3d9) [0x55ba36523a49] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 11: (rocksdb::WriteBatch::Iterate(rocksdb::WriteBatch::Handler*) const+0x4cd) [0x55ba3651e7ad] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 12: (rocksdb::WriteBatchInternal::InsertInto(rocksdb::autovector const&, unsigned long, rocksdb::ColumnFamilyMemTables*, rocksdb::FlushScheduler*, bool, unsigned long, rocksdb::DB*, bool)+0x128) [0x55ba36521248] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 13: (rocksdb::DBImpl::WriteImpl(rocksdb::WriteOptions const&, rocksdb::WriteBatch*, rocksdb::WriteCallback*, unsigned long*, unsigned long, bool)+0x15db) [0x55ba365c13fb] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 14: (rocksdb::DBImpl::Write(rocksdb::WriteOptions const&, rocksdb::WriteBatch*)+0x27) [0x55ba365c1727] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 15: (RocksDBStore::submit_transaction(std::shared_ptr)+0xcf) [0x55ba3612f42f] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 16: (BlueStore::_kv_sync_thread()+0x1ac6) [0x55ba360c7016] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 17: (BlueStore::KVSyncThread::entry()+0xd) [0x55ba3610ea8d] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 18: (()+0x7e25) [0x7fe3b8038e25] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 19: (clone()+0x6d) [0x7fe3b712c34d] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 2017-09-15 11:24:42.423219 7fe3a53f6700 -1 *** Caught signal (Segmentation fault) ** Sep 15 11:24:42 node1.ceph ceph-osd[5227]: in thread 7fe3a53f6700 thread_name:bstore_kv_sync Sep 15 11:24:42 node1.ceph ceph-osd[5227]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 1: (()+0xa23b21) [0x55ba361d7b21] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 2: (()+0xf5e0) [0x7fe3b80405e0] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 3: (()+0x1cdff) [0x7fe3ba80ddff] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 4: (rocksdb::Arena::AllocateNewBlock(unsigned long)+0x4c) [0x55ba36571f3c] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 5: (rocksdb::Arena::AllocateFallback(unsigned long, bool)+0x47) [0x55ba36571fe7] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 6: (rocksdb::ConcurrentArena::AllocateAligned(unsigned long, unsigned long, rocksdb::Logger*)+0xa0) [0x55ba364f52e0] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 7: (()+0xd74527) [0x55ba36528527] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 8: (()+0xd745b3) [0x55ba365285b3] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 9: (rocksdb::MemTable::Add(unsigned long, rocksdb::ValueType, rocksdb::Slice const&, rocksdb::Slice const&, bool, rocksdb::MemTablePostProcessInfo*)+0xcf) [0x55ba364f1eff] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 10: (rocksdb::MemTableInserter::PutCF(unsigned int, rocksdb::Slice const&, rocksdb::Slice const&)+0x3d9) [0x55ba36523a49] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 11: (rocksdb::WriteBatch::Iterate(rocksdb::WriteBatch::Handler*) const+0x4cd) [0x55ba3651e7ad] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 12: (rocksdb::WriteBatchInternal::InsertInto(rocksdb::autovector const&, unsigned long, rocksdb::ColumnFamilyMemTables*, rocksdb::FlushScheduler*, bool, unsigned long, rocksdb::DB*, bool)+0x128) [0x55ba36521248] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 13: (rocksdb::DBImpl::WriteImpl(rocksdb::WriteOptions const&, rocksdb::WriteBatch*, rocksdb::WriteCallback*, unsigned long*, unsigned long, bool)+0x15db) [0x55ba365c13fb] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 14: (rocksdb::DBImpl::Write(rocksdb::WriteOptions const&, rocksdb::WriteBatch*)+0x27) [0x55ba365c1727] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 15: (RocksDBStore::submit_transaction(std::shared_ptr)+0xcf) [0x55ba3612f42f] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 16: (BlueStore::_kv_sync_thread()+0x1ac6) [0x55ba360c7016] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 17: (BlueStore::KVSyncThread::entry()+0xd) [0x55ba3610ea8d] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 18: (()+0x7e25) [0x7fe3b8038e25] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 19: (clone()+0x6d) [0x7fe3b712c34d] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 0> 2017-09-15 11:24:42.423219 7fe3a53f6700 -1 *** Caught signal (Segmentation fault) ** Sep 15 11:24:42 node1.ceph ceph-osd[5227]: in thread 7fe3a53f6700 thread_name:bstore_kv_sync Sep 15 11:24:42 node1.ceph ceph-osd[5227]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 1: (()+0xa23b21) [0x55ba361d7b21] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 2: (()+0xf5e0) [0x7fe3b80405e0] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 3: (()+0x1cdff) [0x7fe3ba80ddff] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 4: (rocksdb::Arena::AllocateNewBlock(unsigned long)+0x4c) [0x55ba36571f3c] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 5: (rocksdb::Arena::AllocateFallback(unsigned long, bool)+0x47) [0x55ba36571fe7] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 6: (rocksdb::ConcurrentArena::AllocateAligned(unsigned long, unsigned long, rocksdb::Logger*)+0xa0) [0x55ba364f52e0] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 7: (()+0xd74527) [0x55ba36528527] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 8: (()+0xd745b3) [0x55ba365285b3] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 9: (rocksdb::MemTable::Add(unsigned long, rocksdb::ValueType, rocksdb::Slice const&, rocksdb::Slice const&, bool, rocksdb::MemTablePostProcessInfo*)+0xcf) [0x55ba364f1eff] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 10: (rocksdb::MemTableInserter::PutCF(unsigned int, rocksdb::Slice const&, rocksdb::Slice const&)+0x3d9) [0x55ba36523a49] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 11: (rocksdb::WriteBatch::Iterate(rocksdb::WriteBatch::Handler*) const+0x4cd) [0x55ba3651e7ad] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 12: (rocksdb::WriteBatchInternal::InsertInto(rocksdb::autovector const&, unsigned long, rocksdb::ColumnFamilyMemTables*, rocksdb::FlushScheduler*, bool, unsigned long, rocksdb::DB*, bool)+0x128) [0x55ba36521248] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 13: (rocksdb::DBImpl::WriteImpl(rocksdb::WriteOptions const&, rocksdb::WriteBatch*, rocksdb::WriteCallback*, unsigned long*, unsigned long, bool)+0x15db) [0x55ba365c13fb] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 14: (rocksdb::DBImpl::Write(rocksdb::WriteOptions const&, rocksdb::WriteBatch*)+0x27) [0x55ba365c1727] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 15: (RocksDBStore::submit_transaction(std::shared_ptr)+0xcf) [0x55ba3612f42f] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 16: (BlueStore::_kv_sync_thread()+0x1ac6) [0x55ba360c7016] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 17: (BlueStore::KVSyncThread::entry()+0xd) [0x55ba3610ea8d] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 18: (()+0x7e25) [0x7fe3b8038e25] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: 19: (clone()+0x6d) [0x7fe3b712c34d] Sep 15 11:24:42 node1.ceph ceph-osd[5227]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 15 11:24:42 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=11/SEGV Sep 15 11:24:42 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 15 11:24:42 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 15 11:25:02 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 15 11:25:02 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 15 11:25:02 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 15 11:25:02 node1.ceph ceph-osd[6979]: 2017-09-15 11:25:02.747692 7f4f70f76d00 -1 Public network was set, but cluster network was not set Sep 15 11:25:02 node1.ceph ceph-osd[6979]: 2017-09-15 11:25:02.747699 7f4f70f76d00 -1 Using public network also for cluster network Sep 15 11:25:02 node1.ceph ceph-osd[6979]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 15 11:25:15 node1.ceph ceph-osd[6979]: 2017-09-15 11:25:15.957899 7f4f70f76d00 -1 osd.1 18473 log_to_monitors {default=true} Sep 15 17:00:55 node1.ceph ceph-osd[6979]: *** Caught signal (Segmentation fault) ** Sep 15 17:00:55 node1.ceph ceph-osd[6979]: in thread 7f4f4fbe0700 thread_name:tp_osd_tp Sep 15 17:00:55 node1.ceph ceph-osd[6979]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 1: (()+0xa23b21) [0x561972a4eb21] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 2: (()+0xf5e0) [0x7f4f6e38c5e0] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 3: (()+0x1cdff) [0x7f4f70b59dff] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 4: (rocksdb::BlockBasedTable::PutDataBlockToCache(rocksdb::Slice const&, rocksdb::Slice const&, rocksdb::Cache*, rocksdb::Cache*, rocksdb::ReadOptions const&, rocksdb::ImmutableCFOptions const&, rocksdb::BlockBasedTable::CachableEntry*, rocksdb::Block*, unsigned int, rocksdb::Slice const&, unsigned long, bool, rocksdb::Cache::Priority)+0xd6) [0x561972dbd5e6] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 5: (rocksdb::BlockBasedTable::MaybeLoadDataBlockToCache(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::Slice, rocksdb::BlockBasedTable::CachableEntry*, bool)+0x3dc) [0x561972dbe67c] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 6: (rocksdb::BlockBasedTable::NewDataBlockIterator(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::BlockIter*, bool, rocksdb::Status)+0x127) [0x561972dbe8d7] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 7: (rocksdb::BlockBasedTable::NewDataBlockIterator(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::Slice const&, rocksdb::BlockIter*, bool)+0x87) [0x561972dbee37] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 8: (rocksdb::BlockBasedTable::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, rocksdb::GetContext*, bool)+0x4e5) [0x561972dc15f5] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 9: (rocksdb::TableCache::Get(rocksdb::ReadOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::Slice const&, rocksdb::GetContext*, rocksdb::HistogramImpl*, bool, int)+0x26d) [0x561972e7a0fd] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 10: (rocksdb::Version::Get(rocksdb::ReadOptions const&, rocksdb::LookupKey const&, rocksdb::PinnableSlice*, rocksdb::Status*, rocksdb::MergeContext*, rocksdb::RangeDelAggregator*, bool*, bool*, unsigned long*)+0x7f0) [0x561972d869d0] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 11: (rocksdb::DBImpl::GetImpl(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*, bool*)+0x57f) [0x561972e2b01f] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 12: (rocksdb::DBImpl::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*)+0x19) [0x561972e2b5b9] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 13: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, std::string*)+0x86) [0x561972e2f3f6] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 14: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, std::string*)+0x4a) [0x561972e2e9da] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 15: (RocksDBStore::get(std::string const&, char const*, unsigned long, ceph::buffer::list*)+0x14a) [0x5619729a5b4a] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 16: (BlueStore::Collection::get_onode(ghobject_t const&, bool)+0x545) [0x561972952055] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 17: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ObjectStore::Transaction*)+0xd9e) [0x56197296396e] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 18: (BlueStore::queue_transactions(ObjectStore::Sequencer*, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x3a0) [0x5619729650a0] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 19: (PrimaryLogPG::queue_transaction(ObjectStore::Transaction&&, boost::intrusive_ptr)+0xa5) [0x5619726de245] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 20: (ReplicatedBackend::_do_push(boost::intrusive_ptr)+0x3fe) [0x5619727d4b1e] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 21: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x2e1) [0x5619727e2331] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 22: (PGBackend::handle_message(boost::intrusive_ptr)+0x50) [0x56197270ba10] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 23: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x58e) [0x561972677a7e] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 24: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x3f9) [0x56197250a729] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 25: (PGQueueable::RunVis::operator()(boost::intrusive_ptr const&)+0x57) [0x56197277a197] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 26: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xfce) [0x561972535c8e] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 27: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x839) [0x561972a93029] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 28: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x561972a94fc0] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 29: (()+0x7e25) [0x7f4f6e384e25] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 30: (clone()+0x6d) [0x7f4f6d47834d] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 2017-09-15 17:00:55.383238 7f4f4fbe0700 -1 *** Caught signal (Segmentation fault) ** Sep 15 17:00:55 node1.ceph ceph-osd[6979]: in thread 7f4f4fbe0700 thread_name:tp_osd_tp Sep 15 17:00:55 node1.ceph ceph-osd[6979]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 1: (()+0xa23b21) [0x561972a4eb21] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 2: (()+0xf5e0) [0x7f4f6e38c5e0] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 3: (()+0x1cdff) [0x7f4f70b59dff] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 4: (rocksdb::BlockBasedTable::PutDataBlockToCache(rocksdb::Slice const&, rocksdb::Slice const&, rocksdb::Cache*, rocksdb::Cache*, rocksdb::ReadOptions const&, rocksdb::ImmutableCFOptions const&, rocksdb::BlockBasedTable::CachableEntry*, rocksdb::Block*, unsigned int, rocksdb::Slice const&, unsigned long, bool, rocksdb::Cache::Priority)+0xd6) [0x561972dbd5e6] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 5: (rocksdb::BlockBasedTable::MaybeLoadDataBlockToCache(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::Slice, rocksdb::BlockBasedTable::CachableEntry*, bool)+0x3dc) [0x561972dbe67c] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 6: (rocksdb::BlockBasedTable::NewDataBlockIterator(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::BlockIter*, bool, rocksdb::Status)+0x127) [0x561972dbe8d7] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 7: (rocksdb::BlockBasedTable::NewDataBlockIterator(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::Slice const&, rocksdb::BlockIter*, bool)+0x87) [0x561972dbee37] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 8: (rocksdb::BlockBasedTable::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, rocksdb::GetContext*, bool)+0x4e5) [0x561972dc15f5] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 9: (rocksdb::TableCache::Get(rocksdb::ReadOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::Slice const&, rocksdb::GetContext*, rocksdb::HistogramImpl*, bool, int)+0x26d) [0x561972e7a0fd] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 10: (rocksdb::Version::Get(rocksdb::ReadOptions const&, rocksdb::LookupKey const&, rocksdb::PinnableSlice*, rocksdb::Status*, rocksdb::MergeContext*, rocksdb::RangeDelAggregator*, bool*, bool*, unsigned long*)+0x7f0) [0x561972d869d0] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 11: (rocksdb::DBImpl::GetImpl(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*, bool*)+0x57f) [0x561972e2b01f] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 12: (rocksdb::DBImpl::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*)+0x19) [0x561972e2b5b9] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 13: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, std::string*)+0x86) [0x561972e2f3f6] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 14: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, std::string*)+0x4a) [0x561972e2e9da] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 15: (RocksDBStore::get(std::string const&, char const*, unsigned long, ceph::buffer::list*)+0x14a) [0x5619729a5b4a] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 16: (BlueStore::Collection::get_onode(ghobject_t const&, bool)+0x545) [0x561972952055] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 17: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ObjectStore::Transaction*)+0xd9e) [0x56197296396e] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 18: (BlueStore::queue_transactions(ObjectStore::Sequencer*, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x3a0) [0x5619729650a0] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 19: (PrimaryLogPG::queue_transaction(ObjectStore::Transaction&&, boost::intrusive_ptr)+0xa5) [0x5619726de245] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 20: (ReplicatedBackend::_do_push(boost::intrusive_ptr)+0x3fe) [0x5619727d4b1e] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 21: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x2e1) [0x5619727e2331] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 22: (PGBackend::handle_message(boost::intrusive_ptr)+0x50) [0x56197270ba10] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 23: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x58e) [0x561972677a7e] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 24: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x3f9) [0x56197250a729] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 25: (PGQueueable::RunVis::operator()(boost::intrusive_ptr const&)+0x57) [0x56197277a197] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 26: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xfce) [0x561972535c8e] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 27: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x839) [0x561972a93029] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 28: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x561972a94fc0] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 29: (()+0x7e25) [0x7f4f6e384e25] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 30: (clone()+0x6d) [0x7f4f6d47834d] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 0> 2017-09-15 17:00:55.383238 7f4f4fbe0700 -1 *** Caught signal (Segmentation fault) ** Sep 15 17:00:55 node1.ceph ceph-osd[6979]: in thread 7f4f4fbe0700 thread_name:tp_osd_tp Sep 15 17:00:55 node1.ceph ceph-osd[6979]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 1: (()+0xa23b21) [0x561972a4eb21] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 2: (()+0xf5e0) [0x7f4f6e38c5e0] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 3: (()+0x1cdff) [0x7f4f70b59dff] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 4: (rocksdb::BlockBasedTable::PutDataBlockToCache(rocksdb::Slice const&, rocksdb::Slice const&, rocksdb::Cache*, rocksdb::Cache*, rocksdb::ReadOptions const&, rocksdb::ImmutableCFOptions const&, rocksdb::BlockBasedTable::CachableEntry*, rocksdb::Block*, unsigned int, rocksdb::Slice const&, unsigned long, bool, rocksdb::Cache::Priority)+0xd6) [0x561972dbd5e6] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 5: (rocksdb::BlockBasedTable::MaybeLoadDataBlockToCache(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::Slice, rocksdb::BlockBasedTable::CachableEntry*, bool)+0x3dc) [0x561972dbe67c] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 6: (rocksdb::BlockBasedTable::NewDataBlockIterator(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::BlockIter*, bool, rocksdb::Status)+0x127) [0x561972dbe8d7] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 7: (rocksdb::BlockBasedTable::NewDataBlockIterator(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::Slice const&, rocksdb::BlockIter*, bool)+0x87) [0x561972dbee37] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 8: (rocksdb::BlockBasedTable::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, rocksdb::GetContext*, bool)+0x4e5) [0x561972dc15f5] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 9: (rocksdb::TableCache::Get(rocksdb::ReadOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::Slice const&, rocksdb::GetContext*, rocksdb::HistogramImpl*, bool, int)+0x26d) [0x561972e7a0fd] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 10: (rocksdb::Version::Get(rocksdb::ReadOptions const&, rocksdb::LookupKey const&, rocksdb::PinnableSlice*, rocksdb::Status*, rocksdb::MergeContext*, rocksdb::RangeDelAggregator*, bool*, bool*, unsigned long*)+0x7f0) [0x561972d869d0] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 11: (rocksdb::DBImpl::GetImpl(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*, bool*)+0x57f) [0x561972e2b01f] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 12: (rocksdb::DBImpl::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*)+0x19) [0x561972e2b5b9] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 13: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, std::string*)+0x86) [0x561972e2f3f6] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 14: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, std::string*)+0x4a) [0x561972e2e9da] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 15: (RocksDBStore::get(std::string const&, char const*, unsigned long, ceph::buffer::list*)+0x14a) [0x5619729a5b4a] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 16: (BlueStore::Collection::get_onode(ghobject_t const&, bool)+0x545) [0x561972952055] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 17: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ObjectStore::Transaction*)+0xd9e) [0x56197296396e] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 18: (BlueStore::queue_transactions(ObjectStore::Sequencer*, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x3a0) [0x5619729650a0] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 19: (PrimaryLogPG::queue_transaction(ObjectStore::Transaction&&, boost::intrusive_ptr)+0xa5) [0x5619726de245] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 20: (ReplicatedBackend::_do_push(boost::intrusive_ptr)+0x3fe) [0x5619727d4b1e] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 21: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x2e1) [0x5619727e2331] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 22: (PGBackend::handle_message(boost::intrusive_ptr)+0x50) [0x56197270ba10] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 23: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x58e) [0x561972677a7e] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 24: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x3f9) [0x56197250a729] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 25: (PGQueueable::RunVis::operator()(boost::intrusive_ptr const&)+0x57) [0x56197277a197] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 26: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xfce) [0x561972535c8e] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 27: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x839) [0x561972a93029] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 28: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x561972a94fc0] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 29: (()+0x7e25) [0x7f4f6e384e25] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: 30: (clone()+0x6d) [0x7f4f6d47834d] Sep 15 17:00:55 node1.ceph ceph-osd[6979]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 15 17:00:55 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=11/SEGV Sep 15 17:00:55 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 15 17:00:55 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 15 17:01:15 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 15 17:01:15 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 15 17:01:15 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 15 17:01:15 node1.ceph ceph-osd[32301]: 2017-09-15 17:01:15.773478 7fc49c046d00 -1 Public network was set, but cluster network was not set Sep 15 17:01:15 node1.ceph ceph-osd[32301]: 2017-09-15 17:01:15.773486 7fc49c046d00 -1 Using public network also for cluster network Sep 15 17:01:15 node1.ceph ceph-osd[32301]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 15 17:02:28 node1.ceph ceph-osd[32301]: *** Caught signal (Segmentation fault) ** Sep 15 17:02:28 node1.ceph ceph-osd[32301]: in thread 7fc49c046d00 thread_name:ceph-osd Sep 15 17:02:28 node1.ceph ceph-osd[32301]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 1: (()+0xa23b21) [0x55d96b4b7b21] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 2: (()+0xf5e0) [0x7fc49945c5e0] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 3: (()+0x1cdff) [0x7fc49bc29dff] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 4: (rocksdb::Arena::AllocateNewBlock(unsigned long)+0x4c) [0x55d96b851f3c] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 5: (rocksdb::Arena::AllocateFallback(unsigned long, bool)+0x47) [0x55d96b851fe7] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 6: (rocksdb::DoGenerateLevelFilesBrief(rocksdb::LevelFilesBrief*, std::vector > const&, rocksdb::Arena*)+0x139) [0x55d96b7e4539] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 7: (rocksdb::VersionStorageInfo::GenerateLevelFilesBrief()+0x94) [0x55d96b7ec0e4] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 8: (rocksdb::Version::PrepareApply(rocksdb::MutableCFOptions const&, bool)+0x76) [0x55d96b7ef1c6] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 9: (rocksdb::VersionSet::LogAndApply(rocksdb::ColumnFamilyData*, rocksdb::MutableCFOptions const&, rocksdb::autovector const&, rocksdb::InstrumentedMutex*, rocksdb::Directory*, bool, rocksdb::ColumnFamilyOptions const*)+0xff2) [0x55d96b7f1f82] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 10: (rocksdb::DBImpl::RecoverLogFiles(std::vector > const&, unsigned long*, bool)+0x1a93) [0x55d96b7c2243] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 11: (rocksdb::DBImpl::Recover(std::vector > const&, bool, bool, bool)+0x7c6) [0x55d96b7c2fe6] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 12: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::string const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0xeb3) [0x55d96b7c4273] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 13: (rocksdb::DB::Open(rocksdb::Options const&, std::string const&, rocksdb::DB**)+0x177) [0x55d96b7c54a7] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 14: (RocksDBStore::do_open(std::ostream&, bool)+0x8db) [0x55d96b41457b] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 15: (BlueStore::_open_db(bool)+0x11f3) [0x55d96b39ff23] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 16: (BlueStore::_mount(bool)+0x3fe) [0x55d96b3d1b3e] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 17: (OSD::init()+0x3ba) [0x55d96af9aeaa] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 18: (main()+0x2def) [0x55d96aea281f] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 19: (__libc_start_main()+0xf5) [0x7fc498471c05] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 20: (()+0x4acb56) [0x55d96af40b56] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 2017-09-15 17:02:28.562033 7fc49c046d00 -1 *** Caught signal (Segmentation fault) ** Sep 15 17:02:28 node1.ceph ceph-osd[32301]: in thread 7fc49c046d00 thread_name:ceph-osd Sep 15 17:02:28 node1.ceph ceph-osd[32301]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 1: (()+0xa23b21) [0x55d96b4b7b21] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 2: (()+0xf5e0) [0x7fc49945c5e0] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 3: (()+0x1cdff) [0x7fc49bc29dff] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 4: (rocksdb::Arena::AllocateNewBlock(unsigned long)+0x4c) [0x55d96b851f3c] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 5: (rocksdb::Arena::AllocateFallback(unsigned long, bool)+0x47) [0x55d96b851fe7] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 6: (rocksdb::DoGenerateLevelFilesBrief(rocksdb::LevelFilesBrief*, std::vector > const&, rocksdb::Arena*)+0x139) [0x55d96b7e4539] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 7: (rocksdb::VersionStorageInfo::GenerateLevelFilesBrief()+0x94) [0x55d96b7ec0e4] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 8: (rocksdb::Version::PrepareApply(rocksdb::MutableCFOptions const&, bool)+0x76) [0x55d96b7ef1c6] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 9: (rocksdb::VersionSet::LogAndApply(rocksdb::ColumnFamilyData*, rocksdb::MutableCFOptions const&, rocksdb::autovector const&, rocksdb::InstrumentedMutex*, rocksdb::Directory*, bool, rocksdb::ColumnFamilyOptions const*)+0xff2) [0x55d96b7f1f82] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 10: (rocksdb::DBImpl::RecoverLogFiles(std::vector > const&, unsigned long*, bool)+0x1a93) [0x55d96b7c2243] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 11: (rocksdb::DBImpl::Recover(std::vector > const&, bool, bool, bool)+0x7c6) [0x55d96b7c2fe6] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 12: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::string const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0xeb3) [0x55d96b7c4273] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 13: (rocksdb::DB::Open(rocksdb::Options const&, std::string const&, rocksdb::DB**)+0x177) [0x55d96b7c54a7] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 14: (RocksDBStore::do_open(std::ostream&, bool)+0x8db) [0x55d96b41457b] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 15: (BlueStore::_open_db(bool)+0x11f3) [0x55d96b39ff23] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 16: (BlueStore::_mount(bool)+0x3fe) [0x55d96b3d1b3e] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 17: (OSD::init()+0x3ba) [0x55d96af9aeaa] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 18: (main()+0x2def) [0x55d96aea281f] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 19: (__libc_start_main()+0xf5) [0x7fc498471c05] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 20: (()+0x4acb56) [0x55d96af40b56] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 0> 2017-09-15 17:02:28.562033 7fc49c046d00 -1 *** Caught signal (Segmentation fault) ** Sep 15 17:02:28 node1.ceph ceph-osd[32301]: in thread 7fc49c046d00 thread_name:ceph-osd Sep 15 17:02:28 node1.ceph ceph-osd[32301]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 1: (()+0xa23b21) [0x55d96b4b7b21] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 2: (()+0xf5e0) [0x7fc49945c5e0] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 3: (()+0x1cdff) [0x7fc49bc29dff] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 4: (rocksdb::Arena::AllocateNewBlock(unsigned long)+0x4c) [0x55d96b851f3c] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 5: (rocksdb::Arena::AllocateFallback(unsigned long, bool)+0x47) [0x55d96b851fe7] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 6: (rocksdb::DoGenerateLevelFilesBrief(rocksdb::LevelFilesBrief*, std::vector > const&, rocksdb::Arena*)+0x139) [0x55d96b7e4539] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 7: (rocksdb::VersionStorageInfo::GenerateLevelFilesBrief()+0x94) [0x55d96b7ec0e4] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 8: (rocksdb::Version::PrepareApply(rocksdb::MutableCFOptions const&, bool)+0x76) [0x55d96b7ef1c6] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 9: (rocksdb::VersionSet::LogAndApply(rocksdb::ColumnFamilyData*, rocksdb::MutableCFOptions const&, rocksdb::autovector const&, rocksdb::InstrumentedMutex*, rocksdb::Directory*, bool, rocksdb::ColumnFamilyOptions const*)+0xff2) [0x55d96b7f1f82] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 10: (rocksdb::DBImpl::RecoverLogFiles(std::vector > const&, unsigned long*, bool)+0x1a93) [0x55d96b7c2243] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 11: (rocksdb::DBImpl::Recover(std::vector > const&, bool, bool, bool)+0x7c6) [0x55d96b7c2fe6] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 12: (rocksdb::DB::Open(rocksdb::DBOptions const&, std::string const&, std::vector > const&, std::vector >*, rocksdb::DB**)+0xeb3) [0x55d96b7c4273] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 13: (rocksdb::DB::Open(rocksdb::Options const&, std::string const&, rocksdb::DB**)+0x177) [0x55d96b7c54a7] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 14: (RocksDBStore::do_open(std::ostream&, bool)+0x8db) [0x55d96b41457b] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 15: (BlueStore::_open_db(bool)+0x11f3) [0x55d96b39ff23] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 16: (BlueStore::_mount(bool)+0x3fe) [0x55d96b3d1b3e] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 17: (OSD::init()+0x3ba) [0x55d96af9aeaa] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 18: (main()+0x2def) [0x55d96aea281f] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 19: (__libc_start_main()+0xf5) [0x7fc498471c05] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: 20: (()+0x4acb56) [0x55d96af40b56] Sep 15 17:02:28 node1.ceph ceph-osd[32301]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 15 17:02:28 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=11/SEGV Sep 15 17:02:28 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 15 17:02:28 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 15 17:02:48 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 15 17:02:48 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 15 17:02:48 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 15 17:02:48 node1.ceph ceph-osd[32574]: 2017-09-15 17:02:48.765239 7f8f1db17d00 -1 Public network was set, but cluster network was not set Sep 15 17:02:48 node1.ceph ceph-osd[32574]: 2017-09-15 17:02:48.765250 7f8f1db17d00 -1 Using public network also for cluster network Sep 15 17:02:48 node1.ceph ceph-osd[32574]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 15 17:02:52 node1.ceph ceph-osd[32574]: *** Caught signal (Segmentation fault) ** Sep 15 17:02:52 node1.ceph ceph-osd[32574]: in thread 7f8f1db17d00 thread_name:ceph-osd Sep 15 17:02:52 node1.ceph ceph-osd[32574]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 1: (()+0xa23b21) [0x56549eda3b21] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 2: (()+0xf5e0) [0x7f8f1af2d5e0] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 3: (()+0x1cdff) [0x7f8f1d6fadff] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 4: (rocksdb::BlockBasedTable::PutDataBlockToCache(rocksdb::Slice const&, rocksdb::Slice const&, rocksdb::Cache*, rocksdb::Cache*, rocksdb::ReadOptions const&, rocksdb::ImmutableCFOptions const&, rocksdb::BlockBasedTable::CachableEntry*, rocksdb::Block*, unsigned int, rocksdb::Slice const&, unsigned long, bool, rocksdb::Cache::Priority)+0xd6) [0x56549f1125e6] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 5: (rocksdb::BlockBasedTable::MaybeLoadDataBlockToCache(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::Slice, rocksdb::BlockBasedTable::CachableEntry*, bool)+0x3dc) [0x56549f11367c] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 6: (rocksdb::BlockBasedTable::NewDataBlockIterator(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::BlockIter*, bool, rocksdb::Status)+0x127) [0x56549f1138d7] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 7: (rocksdb::BlockBasedTable::BlockEntryIteratorState::NewSecondaryIterator(rocksdb::Slice const&)+0x89) [0x56549f11bef9] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 8: (()+0xdbd596) [0x56549f13d596] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 9: (()+0xdbd82c) [0x56549f13d82c] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 10: (()+0xdbd8a6) [0x56549f13d8a6] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 11: (rocksdb::MergingIterator::Next()+0x24d) [0x56549f12553d] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 12: (rocksdb::DBIter::FindNextUserEntryInternal(bool, bool)+0x117) [0x56549f1a35d7] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 13: (rocksdb::DBIter::Next()+0x27f) [0x56549f1a478f] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 14: (RocksDBStore::RocksDBWholeSpaceIteratorImpl::next()+0x9a) [0x56549ecf9faa] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 15: (BlueStore::_open_collections(int*)+0x41d) [0x56549ec7beed] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 16: (BlueStore::_mount(bool)+0x458) [0x56549ecbdb98] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 17: (OSD::init()+0x3ba) [0x56549e886eaa] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 18: (main()+0x2def) [0x56549e78e81f] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 19: (__libc_start_main()+0xf5) [0x7f8f19f42c05] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 20: (()+0x4acb56) [0x56549e82cb56] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 2017-09-15 17:02:52.497184 7f8f1db17d00 -1 *** Caught signal (Segmentation fault) ** Sep 15 17:02:52 node1.ceph ceph-osd[32574]: in thread 7f8f1db17d00 thread_name:ceph-osd Sep 15 17:02:52 node1.ceph ceph-osd[32574]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 1: (()+0xa23b21) [0x56549eda3b21] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 2: (()+0xf5e0) [0x7f8f1af2d5e0] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 3: (()+0x1cdff) [0x7f8f1d6fadff] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 4: (rocksdb::BlockBasedTable::PutDataBlockToCache(rocksdb::Slice const&, rocksdb::Slice const&, rocksdb::Cache*, rocksdb::Cache*, rocksdb::ReadOptions const&, rocksdb::ImmutableCFOptions const&, rocksdb::BlockBasedTable::CachableEntry*, rocksdb::Block*, unsigned int, rocksdb::Slice const&, unsigned long, bool, rocksdb::Cache::Priority)+0xd6) [0x56549f1125e6] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 5: (rocksdb::BlockBasedTable::MaybeLoadDataBlockToCache(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::Slice, rocksdb::BlockBasedTable::CachableEntry*, bool)+0x3dc) [0x56549f11367c] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 6: (rocksdb::BlockBasedTable::NewDataBlockIterator(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::BlockIter*, bool, rocksdb::Status)+0x127) [0x56549f1138d7] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 7: (rocksdb::BlockBasedTable::BlockEntryIteratorState::NewSecondaryIterator(rocksdb::Slice const&)+0x89) [0x56549f11bef9] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 8: (()+0xdbd596) [0x56549f13d596] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 9: (()+0xdbd82c) [0x56549f13d82c] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 10: (()+0xdbd8a6) [0x56549f13d8a6] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 11: (rocksdb::MergingIterator::Next()+0x24d) [0x56549f12553d] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 12: (rocksdb::DBIter::FindNextUserEntryInternal(bool, bool)+0x117) [0x56549f1a35d7] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 13: (rocksdb::DBIter::Next()+0x27f) [0x56549f1a478f] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 14: (RocksDBStore::RocksDBWholeSpaceIteratorImpl::next()+0x9a) [0x56549ecf9faa] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 15: (BlueStore::_open_collections(int*)+0x41d) [0x56549ec7beed] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 16: (BlueStore::_mount(bool)+0x458) [0x56549ecbdb98] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 17: (OSD::init()+0x3ba) [0x56549e886eaa] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 18: (main()+0x2def) [0x56549e78e81f] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 19: (__libc_start_main()+0xf5) [0x7f8f19f42c05] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 20: (()+0x4acb56) [0x56549e82cb56] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 0> 2017-09-15 17:02:52.497184 7f8f1db17d00 -1 *** Caught signal (Segmentation fault) ** Sep 15 17:02:52 node1.ceph ceph-osd[32574]: in thread 7f8f1db17d00 thread_name:ceph-osd Sep 15 17:02:52 node1.ceph ceph-osd[32574]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 1: (()+0xa23b21) [0x56549eda3b21] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 2: (()+0xf5e0) [0x7f8f1af2d5e0] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 3: (()+0x1cdff) [0x7f8f1d6fadff] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 4: (rocksdb::BlockBasedTable::PutDataBlockToCache(rocksdb::Slice const&, rocksdb::Slice const&, rocksdb::Cache*, rocksdb::Cache*, rocksdb::ReadOptions const&, rocksdb::ImmutableCFOptions const&, rocksdb::BlockBasedTable::CachableEntry*, rocksdb::Block*, unsigned int, rocksdb::Slice const&, unsigned long, bool, rocksdb::Cache::Priority)+0xd6) [0x56549f1125e6] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 5: (rocksdb::BlockBasedTable::MaybeLoadDataBlockToCache(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::Slice, rocksdb::BlockBasedTable::CachableEntry*, bool)+0x3dc) [0x56549f11367c] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 6: (rocksdb::BlockBasedTable::NewDataBlockIterator(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::BlockIter*, bool, rocksdb::Status)+0x127) [0x56549f1138d7] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 7: (rocksdb::BlockBasedTable::BlockEntryIteratorState::NewSecondaryIterator(rocksdb::Slice const&)+0x89) [0x56549f11bef9] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 8: (()+0xdbd596) [0x56549f13d596] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 9: (()+0xdbd82c) [0x56549f13d82c] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 10: (()+0xdbd8a6) [0x56549f13d8a6] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 11: (rocksdb::MergingIterator::Next()+0x24d) [0x56549f12553d] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 12: (rocksdb::DBIter::FindNextUserEntryInternal(bool, bool)+0x117) [0x56549f1a35d7] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 13: (rocksdb::DBIter::Next()+0x27f) [0x56549f1a478f] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 14: (RocksDBStore::RocksDBWholeSpaceIteratorImpl::next()+0x9a) [0x56549ecf9faa] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 15: (BlueStore::_open_collections(int*)+0x41d) [0x56549ec7beed] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 16: (BlueStore::_mount(bool)+0x458) [0x56549ecbdb98] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 17: (OSD::init()+0x3ba) [0x56549e886eaa] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 18: (main()+0x2def) [0x56549e78e81f] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 19: (__libc_start_main()+0xf5) [0x7f8f19f42c05] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: 20: (()+0x4acb56) [0x56549e82cb56] Sep 15 17:02:52 node1.ceph ceph-osd[32574]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 15 17:02:52 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=11/SEGV Sep 15 17:02:52 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 15 17:02:52 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 15 17:03:12 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 15 17:03:12 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 15 17:03:12 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 15 17:03:12 node1.ceph ceph-osd[32706]: 2017-09-15 17:03:12.747431 7f81e7ffcd00 -1 Public network was set, but cluster network was not set Sep 15 17:03:12 node1.ceph ceph-osd[32706]: 2017-09-15 17:03:12.747437 7f81e7ffcd00 -1 Using public network also for cluster network Sep 15 17:03:12 node1.ceph ceph-osd[32706]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 15 17:03:13 node1.ceph ceph-osd[32706]: *** Caught signal (Segmentation fault) ** Sep 15 17:03:13 node1.ceph ceph-osd[32706]: in thread 7f81e7ffcd00 thread_name:ceph-osd Sep 15 17:03:13 node1.ceph ceph-osd[32706]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 1: (()+0xa23b21) [0x55f176183b21] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 2: (()+0xf5e0) [0x7f81e54125e0] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 3: (()+0x1cdff) [0x7f81e7bdfdff] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 4: (rocksdb::BlockBasedTable::PutDataBlockToCache(rocksdb::Slice const&, rocksdb::Slice const&, rocksdb::Cache*, rocksdb::Cache*, rocksdb::ReadOptions const&, rocksdb::ImmutableCFOptions const&, rocksdb::BlockBasedTable::CachableEntry*, rocksdb::Block*, unsigned int, rocksdb::Slice const&, unsigned long, bool, rocksdb::Cache::Priority)+0xd6) [0x55f1764f25e6] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 5: (rocksdb::BlockBasedTable::MaybeLoadDataBlockToCache(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::Slice, rocksdb::BlockBasedTable::CachableEntry*, bool)+0x3dc) [0x55f1764f367c] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 6: (rocksdb::BlockBasedTable::NewDataBlockIterator(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::BlockIter*, bool, rocksdb::Status)+0x127) [0x55f1764f38d7] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 7: (rocksdb::BlockBasedTable::BlockEntryIteratorState::NewSecondaryIterator(rocksdb::Slice const&)+0x89) [0x55f1764fbef9] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 8: (()+0xdbd596) [0x55f17651d596] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 9: (()+0xdbd82c) [0x55f17651d82c] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 10: (()+0xdbd8a6) [0x55f17651d8a6] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 11: (rocksdb::MergingIterator::Next()+0x24d) [0x55f17650553d] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 12: (rocksdb::DBIter::Next()+0xa6) [0x55f1765845b6] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 13: (RocksDBStore::RocksDBWholeSpaceIteratorImpl::next()+0x9a) [0x55f1760d9faa] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 14: (BitmapFreelistManager::enumerate_next(unsigned long*, unsigned long*)+0xd7) [0x55f176130bd7] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 15: (BlueStore::_open_alloc()+0x1dd) [0x55f176030ecd] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 16: (BlueStore::_mount(bool)+0x443) [0x55f17609db83] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 17: (OSD::init()+0x3ba) [0x55f175c66eaa] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 18: (main()+0x2def) [0x55f175b6e81f] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 19: (__libc_start_main()+0xf5) [0x7f81e4427c05] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 20: (()+0x4acb56) [0x55f175c0cb56] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 2017-09-15 17:03:13.327454 7f81e7ffcd00 -1 *** Caught signal (Segmentation fault) ** Sep 15 17:03:13 node1.ceph ceph-osd[32706]: in thread 7f81e7ffcd00 thread_name:ceph-osd Sep 15 17:03:13 node1.ceph ceph-osd[32706]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 1: (()+0xa23b21) [0x55f176183b21] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 2: (()+0xf5e0) [0x7f81e54125e0] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 3: (()+0x1cdff) [0x7f81e7bdfdff] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 4: (rocksdb::BlockBasedTable::PutDataBlockToCache(rocksdb::Slice const&, rocksdb::Slice const&, rocksdb::Cache*, rocksdb::Cache*, rocksdb::ReadOptions const&, rocksdb::ImmutableCFOptions const&, rocksdb::BlockBasedTable::CachableEntry*, rocksdb::Block*, unsigned int, rocksdb::Slice const&, unsigned long, bool, rocksdb::Cache::Priority)+0xd6) [0x55f1764f25e6] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 5: (rocksdb::BlockBasedTable::MaybeLoadDataBlockToCache(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::Slice, rocksdb::BlockBasedTable::CachableEntry*, bool)+0x3dc) [0x55f1764f367c] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 6: (rocksdb::BlockBasedTable::NewDataBlockIterator(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::BlockIter*, bool, rocksdb::Status)+0x127) [0x55f1764f38d7] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 7: (rocksdb::BlockBasedTable::BlockEntryIteratorState::NewSecondaryIterator(rocksdb::Slice const&)+0x89) [0x55f1764fbef9] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 8: (()+0xdbd596) [0x55f17651d596] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 9: (()+0xdbd82c) [0x55f17651d82c] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 10: (()+0xdbd8a6) [0x55f17651d8a6] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 11: (rocksdb::MergingIterator::Next()+0x24d) [0x55f17650553d] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 12: (rocksdb::DBIter::Next()+0xa6) [0x55f1765845b6] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 13: (RocksDBStore::RocksDBWholeSpaceIteratorImpl::next()+0x9a) [0x55f1760d9faa] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 14: (BitmapFreelistManager::enumerate_next(unsigned long*, unsigned long*)+0xd7) [0x55f176130bd7] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 15: (BlueStore::_open_alloc()+0x1dd) [0x55f176030ecd] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 16: (BlueStore::_mount(bool)+0x443) [0x55f17609db83] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 17: (OSD::init()+0x3ba) [0x55f175c66eaa] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 18: (main()+0x2def) [0x55f175b6e81f] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 19: (__libc_start_main()+0xf5) [0x7f81e4427c05] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 20: (()+0x4acb56) [0x55f175c0cb56] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 15 17:03:13 node1.ceph ceph-osd[32706]: -224> 2017-09-15 17:03:12.747431 7f81e7ffcd00 -1 Public network was set, but cluster network was not set Sep 15 17:03:13 node1.ceph ceph-osd[32706]: -223> 2017-09-15 17:03:12.747437 7f81e7ffcd00 -1 Using public network also for cluster network Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 0> 2017-09-15 17:03:13.327454 7f81e7ffcd00 -1 *** Caught signal (Segmentation fault) ** Sep 15 17:03:13 node1.ceph ceph-osd[32706]: in thread 7f81e7ffcd00 thread_name:ceph-osd Sep 15 17:03:13 node1.ceph ceph-osd[32706]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 1: (()+0xa23b21) [0x55f176183b21] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 2: (()+0xf5e0) [0x7f81e54125e0] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 3: (()+0x1cdff) [0x7f81e7bdfdff] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 4: (rocksdb::BlockBasedTable::PutDataBlockToCache(rocksdb::Slice const&, rocksdb::Slice const&, rocksdb::Cache*, rocksdb::Cache*, rocksdb::ReadOptions const&, rocksdb::ImmutableCFOptions const&, rocksdb::BlockBasedTable::CachableEntry*, rocksdb::Block*, unsigned int, rocksdb::Slice const&, unsigned long, bool, rocksdb::Cache::Priority)+0xd6) [0x55f1764f25e6] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 5: (rocksdb::BlockBasedTable::MaybeLoadDataBlockToCache(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::Slice, rocksdb::BlockBasedTable::CachableEntry*, bool)+0x3dc) [0x55f1764f367c] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 6: (rocksdb::BlockBasedTable::NewDataBlockIterator(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::BlockIter*, bool, rocksdb::Status)+0x127) [0x55f1764f38d7] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 7: (rocksdb::BlockBasedTable::BlockEntryIteratorState::NewSecondaryIterator(rocksdb::Slice const&)+0x89) [0x55f1764fbef9] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 8: (()+0xdbd596) [0x55f17651d596] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 9: (()+0xdbd82c) [0x55f17651d82c] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 10: (()+0xdbd8a6) [0x55f17651d8a6] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 11: (rocksdb::MergingIterator::Next()+0x24d) [0x55f17650553d] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 12: (rocksdb::DBIter::Next()+0xa6) [0x55f1765845b6] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 13: (RocksDBStore::RocksDBWholeSpaceIteratorImpl::next()+0x9a) [0x55f1760d9faa] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 14: (BitmapFreelistManager::enumerate_next(unsigned long*, unsigned long*)+0xd7) [0x55f176130bd7] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 15: (BlueStore::_open_alloc()+0x1dd) [0x55f176030ecd] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 16: (BlueStore::_mount(bool)+0x443) [0x55f17609db83] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 17: (OSD::init()+0x3ba) [0x55f175c66eaa] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 18: (main()+0x2def) [0x55f175b6e81f] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 19: (__libc_start_main()+0xf5) [0x7f81e4427c05] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: 20: (()+0x4acb56) [0x55f175c0cb56] Sep 15 17:03:13 node1.ceph ceph-osd[32706]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 15 17:03:13 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=11/SEGV Sep 15 17:03:13 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 15 17:03:13 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 15 17:03:33 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 15 17:03:33 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 15 17:03:33 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 15 17:03:33 node1.ceph ceph-osd[345]: 2017-09-15 17:03:33.525576 7fae0ec7cd00 -1 Public network was set, but cluster network was not set Sep 15 17:03:33 node1.ceph ceph-osd[345]: 2017-09-15 17:03:33.525583 7fae0ec7cd00 -1 Using public network also for cluster network Sep 15 17:03:33 node1.ceph ceph-osd[345]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 15 17:04:44 node1.ceph ceph-osd[345]: 2017-09-15 17:04:44.646613 7fae0ec7cd00 -1 osd.1 18596 log_to_monitors {default=true} Sep 15 22:44:34 node1.ceph ceph-osd[345]: *** Caught signal (Segmentation fault) ** Sep 15 22:44:34 node1.ceph ceph-osd[345]: in thread 7fadf2fff700 thread_name:rocksdb:bg0 Sep 15 22:44:34 node1.ceph ceph-osd[345]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 15 22:44:34 node1.ceph ceph-osd[345]: 1: (()+0xa23b21) [0x55c9c3f7eb21] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 2: (()+0xf5e0) [0x7fae0c0925e0] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 3: (()+0x1cdff) [0x7fae0e85fdff] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 4: (rocksdb::BlockBasedTable::NewIndexIterator(rocksdb::ReadOptions const&, rocksdb::BlockIter*, rocksdb::BlockBasedTable::CachableEntry*)+0x468) [0x55c9c42f09d8] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 5: (rocksdb::BlockBasedTable::Open(rocksdb::ImmutableCFOptions const&, rocksdb::EnvOptions const&, rocksdb::BlockBasedTableOptions const&, rocksdb::InternalKeyComparator const&, std::unique_ptr >&&, unsigned long, std::unique_ptr >*, bool, bool, int)+0xe0c) [0x55c9c42f615c] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 6: (rocksdb::BlockBasedTableFactory::NewTableReader(rocksdb::TableReaderOptions const&, std::unique_ptr >&&, unsigned long, std::unique_ptr >*, bool) const+0x51) [0x55c9c42ea8e1] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 7: (rocksdb::TableCache::GetTableReader(rocksdb::EnvOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, bool, unsigned long, bool, rocksdb::HistogramImpl*, std::unique_ptr >*, bool, int, bool)+0x1de) [0x55c9c43a917e] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 8: (rocksdb::TableCache::NewIterator(rocksdb::ReadOptions const&, rocksdb::EnvOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::RangeDelAggregator*, rocksdb::TableReader**, rocksdb::HistogramImpl*, bool, rocksdb::Arena*, bool, int)+0x14b) [0x55c9c43a99db] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 9: (()+0xd4f2f9) [0x55c9c42aa2f9] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 10: (()+0xdbd596) [0x55c9c4318596] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 11: (()+0xdbd82c) [0x55c9c431882c] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 12: (rocksdb::MergingIterator::Next()+0x24d) [0x55c9c430053d] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 13: (rocksdb::CompactionIterator::Next()+0x199) [0x55c9c4341239] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 14: (rocksdb::CompactionJob::ProcessKeyValueCompaction(rocksdb::CompactionJob::SubcompactionState*)+0x73e) [0x55c9c43debee] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 15: (rocksdb::CompactionJob::Run()+0x1cf) [0x55c9c43dfdff] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 16: (rocksdb::DBImpl::BackgroundCompaction(bool*, rocksdb::JobContext*, rocksdb::LogBuffer*, void*)+0x9a7) [0x55c9c436fa67] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 17: (rocksdb::DBImpl::BackgroundCallCompaction(void*)+0x277) [0x55c9c4372f67] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 18: (rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long)+0x248) [0x55c9c43d6438] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 19: (rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*)+0x3d) [0x55c9c43d661d] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 20: (()+0xb52b0) [0x7fae0ba162b0] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 21: (()+0x7e25) [0x7fae0c08ae25] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 22: (clone()+0x6d) [0x7fae0b17e34d] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 2017-09-15 22:44:34.719722 7fadf2fff700 -1 *** Caught signal (Segmentation fault) ** Sep 15 22:44:34 node1.ceph ceph-osd[345]: in thread 7fadf2fff700 thread_name:rocksdb:bg0 Sep 15 22:44:34 node1.ceph ceph-osd[345]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 15 22:44:34 node1.ceph ceph-osd[345]: 1: (()+0xa23b21) [0x55c9c3f7eb21] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 2: (()+0xf5e0) [0x7fae0c0925e0] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 3: (()+0x1cdff) [0x7fae0e85fdff] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 4: (rocksdb::BlockBasedTable::NewIndexIterator(rocksdb::ReadOptions const&, rocksdb::BlockIter*, rocksdb::BlockBasedTable::CachableEntry*)+0x468) [0x55c9c42f09d8] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 5: (rocksdb::BlockBasedTable::Open(rocksdb::ImmutableCFOptions const&, rocksdb::EnvOptions const&, rocksdb::BlockBasedTableOptions const&, rocksdb::InternalKeyComparator const&, std::unique_ptr >&&, unsigned long, std::unique_ptr >*, bool, bool, int)+0xe0c) [0x55c9c42f615c] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 6: (rocksdb::BlockBasedTableFactory::NewTableReader(rocksdb::TableReaderOptions const&, std::unique_ptr >&&, unsigned long, std::unique_ptr >*, bool) const+0x51) [0x55c9c42ea8e1] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 7: (rocksdb::TableCache::GetTableReader(rocksdb::EnvOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, bool, unsigned long, bool, rocksdb::HistogramImpl*, std::unique_ptr >*, bool, int, bool)+0x1de) [0x55c9c43a917e] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 8: (rocksdb::TableCache::NewIterator(rocksdb::ReadOptions const&, rocksdb::EnvOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::RangeDelAggregator*, rocksdb::TableReader**, rocksdb::HistogramImpl*, bool, rocksdb::Arena*, bool, int)+0x14b) [0x55c9c43a99db] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 9: (()+0xd4f2f9) [0x55c9c42aa2f9] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 10: (()+0xdbd596) [0x55c9c4318596] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 11: (()+0xdbd82c) [0x55c9c431882c] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 12: (rocksdb::MergingIterator::Next()+0x24d) [0x55c9c430053d] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 13: (rocksdb::CompactionIterator::Next()+0x199) [0x55c9c4341239] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 14: (rocksdb::CompactionJob::ProcessKeyValueCompaction(rocksdb::CompactionJob::SubcompactionState*)+0x73e) [0x55c9c43debee] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 15: (rocksdb::CompactionJob::Run()+0x1cf) [0x55c9c43dfdff] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 16: (rocksdb::DBImpl::BackgroundCompaction(bool*, rocksdb::JobContext*, rocksdb::LogBuffer*, void*)+0x9a7) [0x55c9c436fa67] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 17: (rocksdb::DBImpl::BackgroundCallCompaction(void*)+0x277) [0x55c9c4372f67] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 18: (rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long)+0x248) [0x55c9c43d6438] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 19: (rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*)+0x3d) [0x55c9c43d661d] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 20: (()+0xb52b0) [0x7fae0ba162b0] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 21: (()+0x7e25) [0x7fae0c08ae25] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 22: (clone()+0x6d) [0x7fae0b17e34d] Sep 15 22:44:34 node1.ceph ceph-osd[345]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 15 22:44:34 node1.ceph ceph-osd[345]: 0> 2017-09-15 22:44:34.719722 7fadf2fff700 -1 *** Caught signal (Segmentation fault) ** Sep 15 22:44:34 node1.ceph ceph-osd[345]: in thread 7fadf2fff700 thread_name:rocksdb:bg0 Sep 15 22:44:34 node1.ceph ceph-osd[345]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 15 22:44:34 node1.ceph ceph-osd[345]: 1: (()+0xa23b21) [0x55c9c3f7eb21] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 2: (()+0xf5e0) [0x7fae0c0925e0] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 3: (()+0x1cdff) [0x7fae0e85fdff] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 4: (rocksdb::BlockBasedTable::NewIndexIterator(rocksdb::ReadOptions const&, rocksdb::BlockIter*, rocksdb::BlockBasedTable::CachableEntry*)+0x468) [0x55c9c42f09d8] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 5: (rocksdb::BlockBasedTable::Open(rocksdb::ImmutableCFOptions const&, rocksdb::EnvOptions const&, rocksdb::BlockBasedTableOptions const&, rocksdb::InternalKeyComparator const&, std::unique_ptr >&&, unsigned long, std::unique_ptr >*, bool, bool, int)+0xe0c) [0x55c9c42f615c] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 6: (rocksdb::BlockBasedTableFactory::NewTableReader(rocksdb::TableReaderOptions const&, std::unique_ptr >&&, unsigned long, std::unique_ptr >*, bool) const+0x51) [0x55c9c42ea8e1] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 7: (rocksdb::TableCache::GetTableReader(rocksdb::EnvOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, bool, unsigned long, bool, rocksdb::HistogramImpl*, std::unique_ptr >*, bool, int, bool)+0x1de) [0x55c9c43a917e] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 8: (rocksdb::TableCache::NewIterator(rocksdb::ReadOptions const&, rocksdb::EnvOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::RangeDelAggregator*, rocksdb::TableReader**, rocksdb::HistogramImpl*, bool, rocksdb::Arena*, bool, int)+0x14b) [0x55c9c43a99db] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 9: (()+0xd4f2f9) [0x55c9c42aa2f9] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 10: (()+0xdbd596) [0x55c9c4318596] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 11: (()+0xdbd82c) [0x55c9c431882c] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 12: (rocksdb::MergingIterator::Next()+0x24d) [0x55c9c430053d] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 13: (rocksdb::CompactionIterator::Next()+0x199) [0x55c9c4341239] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 14: (rocksdb::CompactionJob::ProcessKeyValueCompaction(rocksdb::CompactionJob::SubcompactionState*)+0x73e) [0x55c9c43debee] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 15: (rocksdb::CompactionJob::Run()+0x1cf) [0x55c9c43dfdff] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 16: (rocksdb::DBImpl::BackgroundCompaction(bool*, rocksdb::JobContext*, rocksdb::LogBuffer*, void*)+0x9a7) [0x55c9c436fa67] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 17: (rocksdb::DBImpl::BackgroundCallCompaction(void*)+0x277) [0x55c9c4372f67] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 18: (rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long)+0x248) [0x55c9c43d6438] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 19: (rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*)+0x3d) [0x55c9c43d661d] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 20: (()+0xb52b0) [0x7fae0ba162b0] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 21: (()+0x7e25) [0x7fae0c08ae25] Sep 15 22:44:34 node1.ceph ceph-osd[345]: 22: (clone()+0x6d) [0x7fae0b17e34d] Sep 15 22:44:34 node1.ceph ceph-osd[345]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 15 22:44:34 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=11/SEGV Sep 15 22:44:34 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 15 22:44:34 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 15 22:44:54 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 15 22:44:54 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 15 22:44:54 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 15 22:44:54 node1.ceph ceph-osd[30259]: 2017-09-15 22:44:54.988968 7fd95fcfdd00 -1 Public network was set, but cluster network was not set Sep 15 22:44:54 node1.ceph ceph-osd[30259]: 2017-09-15 22:44:54.988975 7fd95fcfdd00 -1 Using public network also for cluster network Sep 15 22:44:54 node1.ceph ceph-osd[30259]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 15 22:46:34 node1.ceph ceph-osd[30259]: 2017-09-15 22:46:34.741416 7fd95fcfdd00 -1 osd.1 19517 log_to_monitors {default=true} Sep 16 04:23:58 node1.ceph ceph-osd[30259]: *** Caught signal (Segmentation fault) ** Sep 16 04:23:58 node1.ceph ceph-osd[30259]: in thread 7fd9457fe700 thread_name:rocksdb:bg0 Sep 16 04:23:58 node1.ceph ceph-osd[30259]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 1: (()+0xa23b21) [0x55d560e55b21] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 2: (()+0xf5e0) [0x7fd95d1135e0] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 3: (()+0x1cdff) [0x7fd95f8e0dff] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 4: (rocksdb::BlockBasedTable::NewIndexIterator(rocksdb::ReadOptions const&, rocksdb::BlockIter*, rocksdb::BlockBasedTable::CachableEntry*)+0x468) [0x55d5611c79d8] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 5: (rocksdb::BlockBasedTable::Open(rocksdb::ImmutableCFOptions const&, rocksdb::EnvOptions const&, rocksdb::BlockBasedTableOptions const&, rocksdb::InternalKeyComparator const&, std::unique_ptr >&&, unsigned long, std::unique_ptr >*, bool, bool, int)+0xe0c) [0x55d5611cd15c] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 6: (rocksdb::BlockBasedTableFactory::NewTableReader(rocksdb::TableReaderOptions const&, std::unique_ptr >&&, unsigned long, std::unique_ptr >*, bool) const+0x51) [0x55d5611c18e1] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 7: (rocksdb::TableCache::GetTableReader(rocksdb::EnvOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, bool, unsigned long, bool, rocksdb::HistogramImpl*, std::unique_ptr >*, bool, int, bool)+0x1de) [0x55d56128017e] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 8: (rocksdb::TableCache::NewIterator(rocksdb::ReadOptions const&, rocksdb::EnvOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::RangeDelAggregator*, rocksdb::TableReader**, rocksdb::HistogramImpl*, bool, rocksdb::Arena*, bool, int)+0x14b) [0x55d5612809db] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 9: (()+0xd4f2f9) [0x55d5611812f9] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 10: (()+0xdbd596) [0x55d5611ef596] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 11: (()+0xdbd82c) [0x55d5611ef82c] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 12: (rocksdb::MergingIterator::Next()+0x24d) [0x55d5611d753d] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 13: (rocksdb::CompactionIterator::Next()+0x199) [0x55d561218239] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 14: (rocksdb::CompactionJob::ProcessKeyValueCompaction(rocksdb::CompactionJob::SubcompactionState*)+0x73e) [0x55d5612b5bee] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 15: (rocksdb::CompactionJob::Run()+0x1cf) [0x55d5612b6dff] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 16: (rocksdb::DBImpl::BackgroundCompaction(bool*, rocksdb::JobContext*, rocksdb::LogBuffer*, void*)+0x9a7) [0x55d561246a67] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 17: (rocksdb::DBImpl::BackgroundCallCompaction(void*)+0x277) [0x55d561249f67] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 18: (rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long)+0x248) [0x55d5612ad438] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 19: (rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*)+0x3d) [0x55d5612ad61d] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 20: (()+0xb52b0) [0x7fd95ca972b0] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 21: (()+0x7e25) [0x7fd95d10be25] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 22: (clone()+0x6d) [0x7fd95c1ff34d] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 2017-09-16 04:23:58.382834 7fd9457fe700 -1 *** Caught signal (Segmentation fault) ** Sep 16 04:23:58 node1.ceph ceph-osd[30259]: in thread 7fd9457fe700 thread_name:rocksdb:bg0 Sep 16 04:23:58 node1.ceph ceph-osd[30259]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 1: (()+0xa23b21) [0x55d560e55b21] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 2: (()+0xf5e0) [0x7fd95d1135e0] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 3: (()+0x1cdff) [0x7fd95f8e0dff] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 4: (rocksdb::BlockBasedTable::NewIndexIterator(rocksdb::ReadOptions const&, rocksdb::BlockIter*, rocksdb::BlockBasedTable::CachableEntry*)+0x468) [0x55d5611c79d8] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 5: (rocksdb::BlockBasedTable::Open(rocksdb::ImmutableCFOptions const&, rocksdb::EnvOptions const&, rocksdb::BlockBasedTableOptions const&, rocksdb::InternalKeyComparator const&, std::unique_ptr >&&, unsigned long, std::unique_ptr >*, bool, bool, int)+0xe0c) [0x55d5611cd15c] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 6: (rocksdb::BlockBasedTableFactory::NewTableReader(rocksdb::TableReaderOptions const&, std::unique_ptr >&&, unsigned long, std::unique_ptr >*, bool) const+0x51) [0x55d5611c18e1] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 7: (rocksdb::TableCache::GetTableReader(rocksdb::EnvOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, bool, unsigned long, bool, rocksdb::HistogramImpl*, std::unique_ptr >*, bool, int, bool)+0x1de) [0x55d56128017e] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 8: (rocksdb::TableCache::NewIterator(rocksdb::ReadOptions const&, rocksdb::EnvOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::RangeDelAggregator*, rocksdb::TableReader**, rocksdb::HistogramImpl*, bool, rocksdb::Arena*, bool, int)+0x14b) [0x55d5612809db] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 9: (()+0xd4f2f9) [0x55d5611812f9] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 10: (()+0xdbd596) [0x55d5611ef596] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 11: (()+0xdbd82c) [0x55d5611ef82c] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 12: (rocksdb::MergingIterator::Next()+0x24d) [0x55d5611d753d] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 13: (rocksdb::CompactionIterator::Next()+0x199) [0x55d561218239] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 14: (rocksdb::CompactionJob::ProcessKeyValueCompaction(rocksdb::CompactionJob::SubcompactionState*)+0x73e) [0x55d5612b5bee] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 15: (rocksdb::CompactionJob::Run()+0x1cf) [0x55d5612b6dff] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 16: (rocksdb::DBImpl::BackgroundCompaction(bool*, rocksdb::JobContext*, rocksdb::LogBuffer*, void*)+0x9a7) [0x55d561246a67] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 17: (rocksdb::DBImpl::BackgroundCallCompaction(void*)+0x277) [0x55d561249f67] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 18: (rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long)+0x248) [0x55d5612ad438] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 19: (rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*)+0x3d) [0x55d5612ad61d] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 20: (()+0xb52b0) [0x7fd95ca972b0] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 21: (()+0x7e25) [0x7fd95d10be25] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 22: (clone()+0x6d) [0x7fd95c1ff34d] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 0> 2017-09-16 04:23:58.382834 7fd9457fe700 -1 *** Caught signal (Segmentation fault) ** Sep 16 04:23:58 node1.ceph ceph-osd[30259]: in thread 7fd9457fe700 thread_name:rocksdb:bg0 Sep 16 04:23:58 node1.ceph ceph-osd[30259]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 1: (()+0xa23b21) [0x55d560e55b21] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 2: (()+0xf5e0) [0x7fd95d1135e0] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 3: (()+0x1cdff) [0x7fd95f8e0dff] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 4: (rocksdb::BlockBasedTable::NewIndexIterator(rocksdb::ReadOptions const&, rocksdb::BlockIter*, rocksdb::BlockBasedTable::CachableEntry*)+0x468) [0x55d5611c79d8] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 5: (rocksdb::BlockBasedTable::Open(rocksdb::ImmutableCFOptions const&, rocksdb::EnvOptions const&, rocksdb::BlockBasedTableOptions const&, rocksdb::InternalKeyComparator const&, std::unique_ptr >&&, unsigned long, std::unique_ptr >*, bool, bool, int)+0xe0c) [0x55d5611cd15c] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 6: (rocksdb::BlockBasedTableFactory::NewTableReader(rocksdb::TableReaderOptions const&, std::unique_ptr >&&, unsigned long, std::unique_ptr >*, bool) const+0x51) [0x55d5611c18e1] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 7: (rocksdb::TableCache::GetTableReader(rocksdb::EnvOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, bool, unsigned long, bool, rocksdb::HistogramImpl*, std::unique_ptr >*, bool, int, bool)+0x1de) [0x55d56128017e] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 8: (rocksdb::TableCache::NewIterator(rocksdb::ReadOptions const&, rocksdb::EnvOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::RangeDelAggregator*, rocksdb::TableReader**, rocksdb::HistogramImpl*, bool, rocksdb::Arena*, bool, int)+0x14b) [0x55d5612809db] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 9: (()+0xd4f2f9) [0x55d5611812f9] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 10: (()+0xdbd596) [0x55d5611ef596] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 11: (()+0xdbd82c) [0x55d5611ef82c] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 12: (rocksdb::MergingIterator::Next()+0x24d) [0x55d5611d753d] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 13: (rocksdb::CompactionIterator::Next()+0x199) [0x55d561218239] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 14: (rocksdb::CompactionJob::ProcessKeyValueCompaction(rocksdb::CompactionJob::SubcompactionState*)+0x73e) [0x55d5612b5bee] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 15: (rocksdb::CompactionJob::Run()+0x1cf) [0x55d5612b6dff] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 16: (rocksdb::DBImpl::BackgroundCompaction(bool*, rocksdb::JobContext*, rocksdb::LogBuffer*, void*)+0x9a7) [0x55d561246a67] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 17: (rocksdb::DBImpl::BackgroundCallCompaction(void*)+0x277) [0x55d561249f67] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 18: (rocksdb::ThreadPoolImpl::Impl::BGThread(unsigned long)+0x248) [0x55d5612ad438] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 19: (rocksdb::ThreadPoolImpl::Impl::BGThreadWrapper(void*)+0x3d) [0x55d5612ad61d] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 20: (()+0xb52b0) [0x7fd95ca972b0] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 21: (()+0x7e25) [0x7fd95d10be25] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: 22: (clone()+0x6d) [0x7fd95c1ff34d] Sep 16 04:23:58 node1.ceph ceph-osd[30259]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 16 04:23:58 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=11/SEGV Sep 16 04:23:58 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 16 04:23:58 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 16 04:24:18 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 16 04:24:18 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 16 04:24:18 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 16 04:24:18 node1.ceph ceph-osd[25204]: 2017-09-16 04:24:18.764215 7f920782cd00 -1 Public network was set, but cluster network was not set Sep 16 04:24:18 node1.ceph ceph-osd[25204]: 2017-09-16 04:24:18.764226 7f920782cd00 -1 Using public network also for cluster network Sep 16 04:24:18 node1.ceph ceph-osd[25204]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 16 04:25:39 node1.ceph ceph-osd[25204]: 2017-09-16 04:25:39.590549 7f920782cd00 -1 osd.1 19770 log_to_monitors {default=true} Sep 16 07:37:30 node1.ceph ceph-osd[25204]: 2017-09-16 07:37:30.948429 7f91d8bdc700 -1 received signal: Hangup from PID: 26142 task name: killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw UID: 0 Sep 16 11:59:05 node1.ceph ceph-osd[25204]: *** Caught signal (Segmentation fault) ** Sep 16 11:59:05 node1.ceph ceph-osd[25204]: in thread 7f91de3e7700 thread_name:tp_osd_tp Sep 16 11:59:05 node1.ceph ceph-osd[25204]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 1: (()+0xa23b21) [0x562da5392b21] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 2: (()+0xf5e0) [0x7f9204c425e0] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 3: (()+0x1cdff) [0x7f920740fdff] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 4: (rocksdb::BlockBasedTable::NewIndexIterator(rocksdb::ReadOptions const&, rocksdb::BlockIter*, rocksdb::BlockBasedTable::CachableEntry*)+0x468) [0x562da57049d8] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 5: (rocksdb::BlockBasedTable::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, rocksdb::GetContext*, bool)+0x275) [0x562da5705385] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 6: (rocksdb::TableCache::Get(rocksdb::ReadOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::Slice const&, rocksdb::GetContext*, rocksdb::HistogramImpl*, bool, int)+0x26d) [0x562da57be0fd] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 7: (rocksdb::Version::Get(rocksdb::ReadOptions const&, rocksdb::LookupKey const&, rocksdb::PinnableSlice*, rocksdb::Status*, rocksdb::MergeContext*, rocksdb::RangeDelAggregator*, bool*, bool*, unsigned long*)+0x7f0) [0x562da56ca9d0] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 8: (rocksdb::DBImpl::GetImpl(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*, bool*)+0x57f) [0x562da576f01f] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 9: (rocksdb::DBImpl::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*)+0x19) [0x562da576f5b9] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 10: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, std::string*)+0x86) [0x562da57733f6] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 11: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, std::string*)+0x4a) [0x562da57729da] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 12: (RocksDBStore::get(std::string const&, std::string const&, ceph::buffer::list*)+0x142) [0x562da52e9fe2] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 13: (()+0x8c56f1) [0x562da52346f1] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 14: (()+0x8c44bf) [0x562da52334bf] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 15: (BlueStore::ExtentMap::fault_range(KeyValueDB*, unsigned int, unsigned int)+0x3bf) [0x562da528beaf] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 16: (BlueStore::_do_write(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, unsigned long, ceph::buffer::list&, unsigned int)+0x243) [0x562da52a41d3] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 17: (BlueStore::_write(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long, unsigned long, ceph::buffer::list&, unsigned int)+0x109) [0x562da52a4f79] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 18: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ObjectStore::Transaction*)+0x192c) [0x562da52a84fc] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 19: (BlueStore::queue_transactions(ObjectStore::Sequencer*, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x3a0) [0x562da52a90a0] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 20: (PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x65) [0x562da501a745] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 21: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xaab) [0x562da51235db] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 22: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x2b4) [0x562da5126304] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 23: (PGBackend::handle_message(boost::intrusive_ptr)+0x50) [0x562da504fa10] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 24: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x58e) [0x562da4fbba7e] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 25: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x3f9) [0x562da4e4e729] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 26: (PGQueueable::RunVis::operator()(boost::intrusive_ptr const&)+0x57) [0x562da50be197] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 27: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xfce) [0x562da4e79c8e] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 28: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x839) [0x562da53d7029] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 29: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x562da53d8fc0] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 30: (()+0x7e25) [0x7f9204c3ae25] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 31: (clone()+0x6d) [0x7f9203d2e34d] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 2017-09-16 11:59:05.040438 7f91de3e7700 -1 *** Caught signal (Segmentation fault) ** Sep 16 11:59:05 node1.ceph ceph-osd[25204]: in thread 7f91de3e7700 thread_name:tp_osd_tp Sep 16 11:59:05 node1.ceph ceph-osd[25204]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 1: (()+0xa23b21) [0x562da5392b21] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 2: (()+0xf5e0) [0x7f9204c425e0] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 3: (()+0x1cdff) [0x7f920740fdff] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 4: (rocksdb::BlockBasedTable::NewIndexIterator(rocksdb::ReadOptions const&, rocksdb::BlockIter*, rocksdb::BlockBasedTable::CachableEntry*)+0x468) [0x562da57049d8] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 5: (rocksdb::BlockBasedTable::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, rocksdb::GetContext*, bool)+0x275) [0x562da5705385] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 6: (rocksdb::TableCache::Get(rocksdb::ReadOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::Slice const&, rocksdb::GetContext*, rocksdb::HistogramImpl*, bool, int)+0x26d) [0x562da57be0fd] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 7: (rocksdb::Version::Get(rocksdb::ReadOptions const&, rocksdb::LookupKey const&, rocksdb::PinnableSlice*, rocksdb::Status*, rocksdb::MergeContext*, rocksdb::RangeDelAggregator*, bool*, bool*, unsigned long*)+0x7f0) [0x562da56ca9d0] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 8: (rocksdb::DBImpl::GetImpl(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*, bool*)+0x57f) [0x562da576f01f] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 9: (rocksdb::DBImpl::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*)+0x19) [0x562da576f5b9] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 10: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, std::string*)+0x86) [0x562da57733f6] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 11: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, std::string*)+0x4a) [0x562da57729da] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 12: (RocksDBStore::get(std::string const&, std::string const&, ceph::buffer::list*)+0x142) [0x562da52e9fe2] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 13: (()+0x8c56f1) [0x562da52346f1] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 14: (()+0x8c44bf) [0x562da52334bf] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 15: (BlueStore::ExtentMap::fault_range(KeyValueDB*, unsigned int, unsigned int)+0x3bf) [0x562da528beaf] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 16: (BlueStore::_do_write(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, unsigned long, ceph::buffer::list&, unsigned int)+0x243) [0x562da52a41d3] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 17: (BlueStore::_write(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long, unsigned long, ceph::buffer::list&, unsigned int)+0x109) [0x562da52a4f79] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 18: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ObjectStore::Transaction*)+0x192c) [0x562da52a84fc] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 19: (BlueStore::queue_transactions(ObjectStore::Sequencer*, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x3a0) [0x562da52a90a0] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 20: (PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x65) [0x562da501a745] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 21: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xaab) [0x562da51235db] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 22: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x2b4) [0x562da5126304] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 23: (PGBackend::handle_message(boost::intrusive_ptr)+0x50) [0x562da504fa10] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 24: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x58e) [0x562da4fbba7e] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 25: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x3f9) [0x562da4e4e729] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 26: (PGQueueable::RunVis::operator()(boost::intrusive_ptr const&)+0x57) [0x562da50be197] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 27: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xfce) [0x562da4e79c8e] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 28: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x839) [0x562da53d7029] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 29: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x562da53d8fc0] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 30: (()+0x7e25) [0x7f9204c3ae25] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 31: (clone()+0x6d) [0x7f9203d2e34d] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 0> 2017-09-16 11:59:05.040438 7f91de3e7700 -1 *** Caught signal (Segmentation fault) ** Sep 16 11:59:05 node1.ceph ceph-osd[25204]: in thread 7f91de3e7700 thread_name:tp_osd_tp Sep 16 11:59:05 node1.ceph ceph-osd[25204]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 1: (()+0xa23b21) [0x562da5392b21] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 2: (()+0xf5e0) [0x7f9204c425e0] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 3: (()+0x1cdff) [0x7f920740fdff] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 4: (rocksdb::BlockBasedTable::NewIndexIterator(rocksdb::ReadOptions const&, rocksdb::BlockIter*, rocksdb::BlockBasedTable::CachableEntry*)+0x468) [0x562da57049d8] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 5: (rocksdb::BlockBasedTable::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, rocksdb::GetContext*, bool)+0x275) [0x562da5705385] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 6: (rocksdb::TableCache::Get(rocksdb::ReadOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::Slice const&, rocksdb::GetContext*, rocksdb::HistogramImpl*, bool, int)+0x26d) [0x562da57be0fd] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 7: (rocksdb::Version::Get(rocksdb::ReadOptions const&, rocksdb::LookupKey const&, rocksdb::PinnableSlice*, rocksdb::Status*, rocksdb::MergeContext*, rocksdb::RangeDelAggregator*, bool*, bool*, unsigned long*)+0x7f0) [0x562da56ca9d0] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 8: (rocksdb::DBImpl::GetImpl(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*, bool*)+0x57f) [0x562da576f01f] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 9: (rocksdb::DBImpl::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*)+0x19) [0x562da576f5b9] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 10: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, std::string*)+0x86) [0x562da57733f6] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 11: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, std::string*)+0x4a) [0x562da57729da] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 12: (RocksDBStore::get(std::string const&, std::string const&, ceph::buffer::list*)+0x142) [0x562da52e9fe2] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 13: (()+0x8c56f1) [0x562da52346f1] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 14: (()+0x8c44bf) [0x562da52334bf] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 15: (BlueStore::ExtentMap::fault_range(KeyValueDB*, unsigned int, unsigned int)+0x3bf) [0x562da528beaf] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 16: (BlueStore::_do_write(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr, unsigned long, unsigned long, ceph::buffer::list&, unsigned int)+0x243) [0x562da52a41d3] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 17: (BlueStore::_write(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, unsigned long, unsigned long, ceph::buffer::list&, unsigned int)+0x109) [0x562da52a4f79] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 18: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ObjectStore::Transaction*)+0x192c) [0x562da52a84fc] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 19: (BlueStore::queue_transactions(ObjectStore::Sequencer*, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x3a0) [0x562da52a90a0] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 20: (PrimaryLogPG::queue_transactions(std::vector >&, boost::intrusive_ptr)+0x65) [0x562da501a745] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 21: (ReplicatedBackend::do_repop(boost::intrusive_ptr)+0xaab) [0x562da51235db] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 22: (ReplicatedBackend::_handle_message(boost::intrusive_ptr)+0x2b4) [0x562da5126304] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 23: (PGBackend::handle_message(boost::intrusive_ptr)+0x50) [0x562da504fa10] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 24: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x58e) [0x562da4fbba7e] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 25: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x3f9) [0x562da4e4e729] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 26: (PGQueueable::RunVis::operator()(boost::intrusive_ptr const&)+0x57) [0x562da50be197] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 27: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xfce) [0x562da4e79c8e] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 28: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x839) [0x562da53d7029] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 29: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x562da53d8fc0] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 30: (()+0x7e25) [0x7f9204c3ae25] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: 31: (clone()+0x6d) [0x7f9203d2e34d] Sep 16 11:59:05 node1.ceph ceph-osd[25204]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 16 11:59:05 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=11/SEGV Sep 16 11:59:05 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 16 11:59:05 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 16 11:59:25 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 16 11:59:25 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 16 11:59:25 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 16 11:59:25 node1.ceph ceph-osd[12695]: 2017-09-16 11:59:25.498872 7f04c6621d00 -1 Public network was set, but cluster network was not set Sep 16 11:59:25 node1.ceph ceph-osd[12695]: 2017-09-16 11:59:25.498881 7f04c6621d00 -1 Using public network also for cluster network Sep 16 11:59:25 node1.ceph ceph-osd[12695]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 16 12:00:11 node1.ceph ceph-osd[12695]: *** Caught signal (Segmentation fault) ** Sep 16 12:00:11 node1.ceph ceph-osd[12695]: in thread 7f04c6621d00 thread_name:ceph-osd Sep 16 12:00:11 node1.ceph ceph-osd[12695]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 1: (()+0xa23b21) [0x55f1c4a65b21] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 2: (()+0xf5e0) [0x7f04c3a375e0] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 3: (()+0x1cdff) [0x7f04c6204dff] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 4: (rocksdb::BlockBasedTable::NewIndexIterator(rocksdb::ReadOptions const&, rocksdb::BlockIter*, rocksdb::BlockBasedTable::CachableEntry*)+0x468) [0x55f1c4dd79d8] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 5: (rocksdb::BlockBasedTable::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, rocksdb::GetContext*, bool)+0x275) [0x55f1c4dd8385] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 6: (rocksdb::TableCache::Get(rocksdb::ReadOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::Slice const&, rocksdb::GetContext*, rocksdb::HistogramImpl*, bool, int)+0x26d) [0x55f1c4e910fd] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 7: (rocksdb::Version::Get(rocksdb::ReadOptions const&, rocksdb::LookupKey const&, rocksdb::PinnableSlice*, rocksdb::Status*, rocksdb::MergeContext*, rocksdb::RangeDelAggregator*, bool*, bool*, unsigned long*)+0x7f0) [0x55f1c4d9d9d0] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 8: (rocksdb::DBImpl::GetImpl(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*, bool*)+0x57f) [0x55f1c4e4201f] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 9: (rocksdb::DBImpl::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*)+0x19) [0x55f1c4e425b9] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 10: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, std::string*)+0x86) [0x55f1c4e463f6] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 11: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, std::string*)+0x4a) [0x55f1c4e459da] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 12: (RocksDBStore::get(std::string const&, char const*, unsigned long, ceph::buffer::list*)+0x14a) [0x55f1c49bcb4a] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 13: (BlueStore::Collection::get_onode(ghobject_t const&, bool)+0x545) [0x55f1c4969055] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 14: (BlueStore::omap_get_values(boost::intrusive_ptr&, ghobject_t const&, std::set, std::allocator > const&, std::map, std::allocator > >*)+0xb1) [0x55f1c496ead1] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 15: (BlueStore::omap_get_values(coll_t const&, ghobject_t const&, std::set, std::allocator > const&, std::map, std::allocator > >*)+0x5c) [0x55f1c493d3cc] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 16: (PG::_has_removal_flag(ObjectStore*, spg_t)+0x14c) [0x55f1c45b99bc] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 17: (OSD::load_pgs()+0x5c5) [0x55f1c4532445] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 18: (OSD::init()+0x2179) [0x55f1c454ac69] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 19: (main()+0x2def) [0x55f1c445081f] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 20: (__libc_start_main()+0xf5) [0x7f04c2a4cc05] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 21: (()+0x4acb56) [0x55f1c44eeb56] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 2017-09-16 12:00:11.247907 7f04c6621d00 -1 *** Caught signal (Segmentation fault) ** Sep 16 12:00:11 node1.ceph ceph-osd[12695]: in thread 7f04c6621d00 thread_name:ceph-osd Sep 16 12:00:11 node1.ceph ceph-osd[12695]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 1: (()+0xa23b21) [0x55f1c4a65b21] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 2: (()+0xf5e0) [0x7f04c3a375e0] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 3: (()+0x1cdff) [0x7f04c6204dff] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 4: (rocksdb::BlockBasedTable::NewIndexIterator(rocksdb::ReadOptions const&, rocksdb::BlockIter*, rocksdb::BlockBasedTable::CachableEntry*)+0x468) [0x55f1c4dd79d8] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 5: (rocksdb::BlockBasedTable::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, rocksdb::GetContext*, bool)+0x275) [0x55f1c4dd8385] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 6: (rocksdb::TableCache::Get(rocksdb::ReadOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::Slice const&, rocksdb::GetContext*, rocksdb::HistogramImpl*, bool, int)+0x26d) [0x55f1c4e910fd] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 7: (rocksdb::Version::Get(rocksdb::ReadOptions const&, rocksdb::LookupKey const&, rocksdb::PinnableSlice*, rocksdb::Status*, rocksdb::MergeContext*, rocksdb::RangeDelAggregator*, bool*, bool*, unsigned long*)+0x7f0) [0x55f1c4d9d9d0] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 8: (rocksdb::DBImpl::GetImpl(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*, bool*)+0x57f) [0x55f1c4e4201f] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 9: (rocksdb::DBImpl::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*)+0x19) [0x55f1c4e425b9] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 10: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, std::string*)+0x86) [0x55f1c4e463f6] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 11: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, std::string*)+0x4a) [0x55f1c4e459da] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 12: (RocksDBStore::get(std::string const&, char const*, unsigned long, ceph::buffer::list*)+0x14a) [0x55f1c49bcb4a] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 13: (BlueStore::Collection::get_onode(ghobject_t const&, bool)+0x545) [0x55f1c4969055] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 14: (BlueStore::omap_get_values(boost::intrusive_ptr&, ghobject_t const&, std::set, std::allocator > const&, std::map, std::allocator > >*)+0xb1) [0x55f1c496ead1] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 15: (BlueStore::omap_get_values(coll_t const&, ghobject_t const&, std::set, std::allocator > const&, std::map, std::allocator > >*)+0x5c) [0x55f1c493d3cc] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 16: (PG::_has_removal_flag(ObjectStore*, spg_t)+0x14c) [0x55f1c45b99bc] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 17: (OSD::load_pgs()+0x5c5) [0x55f1c4532445] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 18: (OSD::init()+0x2179) [0x55f1c454ac69] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 19: (main()+0x2def) [0x55f1c445081f] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 20: (__libc_start_main()+0xf5) [0x7f04c2a4cc05] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 21: (()+0x4acb56) [0x55f1c44eeb56] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 16 12:00:11 node1.ceph ceph-osd[12695]: -373> 2017-09-16 11:59:25.498872 7f04c6621d00 -1 Public network was set, but cluster network was not set Sep 16 12:00:11 node1.ceph ceph-osd[12695]: -372> 2017-09-16 11:59:25.498881 7f04c6621d00 -1 Using public network also for cluster network Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 0> 2017-09-16 12:00:11.247907 7f04c6621d00 -1 *** Caught signal (Segmentation fault) ** Sep 16 12:00:11 node1.ceph ceph-osd[12695]: in thread 7f04c6621d00 thread_name:ceph-osd Sep 16 12:00:11 node1.ceph ceph-osd[12695]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 1: (()+0xa23b21) [0x55f1c4a65b21] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 2: (()+0xf5e0) [0x7f04c3a375e0] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 3: (()+0x1cdff) [0x7f04c6204dff] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 4: (rocksdb::BlockBasedTable::NewIndexIterator(rocksdb::ReadOptions const&, rocksdb::BlockIter*, rocksdb::BlockBasedTable::CachableEntry*)+0x468) [0x55f1c4dd79d8] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 5: (rocksdb::BlockBasedTable::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, rocksdb::GetContext*, bool)+0x275) [0x55f1c4dd8385] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 6: (rocksdb::TableCache::Get(rocksdb::ReadOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::Slice const&, rocksdb::GetContext*, rocksdb::HistogramImpl*, bool, int)+0x26d) [0x55f1c4e910fd] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 7: (rocksdb::Version::Get(rocksdb::ReadOptions const&, rocksdb::LookupKey const&, rocksdb::PinnableSlice*, rocksdb::Status*, rocksdb::MergeContext*, rocksdb::RangeDelAggregator*, bool*, bool*, unsigned long*)+0x7f0) [0x55f1c4d9d9d0] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 8: (rocksdb::DBImpl::GetImpl(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*, bool*)+0x57f) [0x55f1c4e4201f] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 9: (rocksdb::DBImpl::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*)+0x19) [0x55f1c4e425b9] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 10: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, std::string*)+0x86) [0x55f1c4e463f6] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 11: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, std::string*)+0x4a) [0x55f1c4e459da] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 12: (RocksDBStore::get(std::string const&, char const*, unsigned long, ceph::buffer::list*)+0x14a) [0x55f1c49bcb4a] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 13: (BlueStore::Collection::get_onode(ghobject_t const&, bool)+0x545) [0x55f1c4969055] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 14: (BlueStore::omap_get_values(boost::intrusive_ptr&, ghobject_t const&, std::set, std::allocator > const&, std::map, std::allocator > >*)+0xb1) [0x55f1c496ead1] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 15: (BlueStore::omap_get_values(coll_t const&, ghobject_t const&, std::set, std::allocator > const&, std::map, std::allocator > >*)+0x5c) [0x55f1c493d3cc] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 16: (PG::_has_removal_flag(ObjectStore*, spg_t)+0x14c) [0x55f1c45b99bc] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 17: (OSD::load_pgs()+0x5c5) [0x55f1c4532445] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 18: (OSD::init()+0x2179) [0x55f1c454ac69] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 19: (main()+0x2def) [0x55f1c445081f] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 20: (__libc_start_main()+0xf5) [0x7f04c2a4cc05] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: 21: (()+0x4acb56) [0x55f1c44eeb56] Sep 16 12:00:11 node1.ceph ceph-osd[12695]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 16 12:00:11 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=11/SEGV Sep 16 12:00:11 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 16 12:00:11 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 16 12:00:31 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 16 12:00:31 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 16 12:00:31 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 16 12:00:31 node1.ceph ceph-osd[12959]: 2017-09-16 12:00:31.487358 7f2b84122d00 -1 Public network was set, but cluster network was not set Sep 16 12:00:31 node1.ceph ceph-osd[12959]: 2017-09-16 12:00:31.487365 7f2b84122d00 -1 Using public network also for cluster network Sep 16 12:00:31 node1.ceph ceph-osd[12959]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 16 12:01:08 node1.ceph ceph-osd[12959]: *** Caught signal (Segmentation fault) ** Sep 16 12:01:08 node1.ceph ceph-osd[12959]: in thread 7f2b84122d00 thread_name:ceph-osd Sep 16 12:01:08 node1.ceph ceph-osd[12959]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 1: (()+0xa23b21) [0x56452d08cb21] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 2: (()+0xf5e0) [0x7f2b815385e0] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 3: (()+0x1cdff) [0x7f2b83d05dff] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 4: (rocksdb::BlockBasedTable::NewIndexIterator(rocksdb::ReadOptions const&, rocksdb::BlockIter*, rocksdb::BlockBasedTable::CachableEntry*)+0x468) [0x56452d3fe9d8] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 5: (rocksdb::BlockBasedTable::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, rocksdb::GetContext*, bool)+0x275) [0x56452d3ff385] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 6: (rocksdb::TableCache::Get(rocksdb::ReadOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::Slice const&, rocksdb::GetContext*, rocksdb::HistogramImpl*, bool, int)+0x26d) [0x56452d4b80fd] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 7: (rocksdb::Version::Get(rocksdb::ReadOptions const&, rocksdb::LookupKey const&, rocksdb::PinnableSlice*, rocksdb::Status*, rocksdb::MergeContext*, rocksdb::RangeDelAggregator*, bool*, bool*, unsigned long*)+0x7f0) [0x56452d3c49d0] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 8: (rocksdb::DBImpl::GetImpl(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*, bool*)+0x57f) [0x56452d46901f] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 9: (rocksdb::DBImpl::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*)+0x19) [0x56452d4695b9] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 10: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, std::string*)+0x86) [0x56452d46d3f6] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 11: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, std::string*)+0x4a) [0x56452d46c9da] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 12: (RocksDBStore::get(std::string const&, std::string const&, ceph::buffer::list*)+0x142) [0x56452cfe3fe2] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 13: (BlueStore::omap_get_values(boost::intrusive_ptr&, ghobject_t const&, std::set, std::allocator > const&, std::map, std::allocator > >*)+0x56c) [0x56452cf95f8c] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 14: (BlueStore::omap_get_values(coll_t const&, ghobject_t const&, std::set, std::allocator > const&, std::map, std::allocator > >*)+0x5c) [0x56452cf643cc] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 15: (PG::_has_removal_flag(ObjectStore*, spg_t)+0x14c) [0x56452cbe09bc] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 16: (OSD::load_pgs()+0x5c5) [0x56452cb59445] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 17: (OSD::init()+0x2179) [0x56452cb71c69] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 18: (main()+0x2def) [0x56452ca7781f] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 19: (__libc_start_main()+0xf5) [0x7f2b8054dc05] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 20: (()+0x4acb56) [0x56452cb15b56] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 2017-09-16 12:01:08.569928 7f2b84122d00 -1 *** Caught signal (Segmentation fault) ** Sep 16 12:01:08 node1.ceph ceph-osd[12959]: in thread 7f2b84122d00 thread_name:ceph-osd Sep 16 12:01:08 node1.ceph ceph-osd[12959]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 1: (()+0xa23b21) [0x56452d08cb21] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 2: (()+0xf5e0) [0x7f2b815385e0] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 3: (()+0x1cdff) [0x7f2b83d05dff] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 4: (rocksdb::BlockBasedTable::NewIndexIterator(rocksdb::ReadOptions const&, rocksdb::BlockIter*, rocksdb::BlockBasedTable::CachableEntry*)+0x468) [0x56452d3fe9d8] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 5: (rocksdb::BlockBasedTable::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, rocksdb::GetContext*, bool)+0x275) [0x56452d3ff385] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 6: (rocksdb::TableCache::Get(rocksdb::ReadOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::Slice const&, rocksdb::GetContext*, rocksdb::HistogramImpl*, bool, int)+0x26d) [0x56452d4b80fd] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 7: (rocksdb::Version::Get(rocksdb::ReadOptions const&, rocksdb::LookupKey const&, rocksdb::PinnableSlice*, rocksdb::Status*, rocksdb::MergeContext*, rocksdb::RangeDelAggregator*, bool*, bool*, unsigned long*)+0x7f0) [0x56452d3c49d0] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 8: (rocksdb::DBImpl::GetImpl(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*, bool*)+0x57f) [0x56452d46901f] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 9: (rocksdb::DBImpl::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*)+0x19) [0x56452d4695b9] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 10: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, std::string*)+0x86) [0x56452d46d3f6] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 11: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, std::string*)+0x4a) [0x56452d46c9da] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 12: (RocksDBStore::get(std::string const&, std::string const&, ceph::buffer::list*)+0x142) [0x56452cfe3fe2] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 13: (BlueStore::omap_get_values(boost::intrusive_ptr&, ghobject_t const&, std::set, std::allocator > const&, std::map, std::allocator > >*)+0x56c) [0x56452cf95f8c] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 14: (BlueStore::omap_get_values(coll_t const&, ghobject_t const&, std::set, std::allocator > const&, std::map, std::allocator > >*)+0x5c) [0x56452cf643cc] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 15: (PG::_has_removal_flag(ObjectStore*, spg_t)+0x14c) [0x56452cbe09bc] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 16: (OSD::load_pgs()+0x5c5) [0x56452cb59445] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 17: (OSD::init()+0x2179) [0x56452cb71c69] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 18: (main()+0x2def) [0x56452ca7781f] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 19: (__libc_start_main()+0xf5) [0x7f2b8054dc05] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 20: (()+0x4acb56) [0x56452cb15b56] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 16 12:01:08 node1.ceph ceph-osd[12959]: -727> 2017-09-16 12:00:31.487358 7f2b84122d00 -1 Public network was set, but cluster network was not set Sep 16 12:01:08 node1.ceph ceph-osd[12959]: -726> 2017-09-16 12:00:31.487365 7f2b84122d00 -1 Using public network also for cluster network Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 0> 2017-09-16 12:01:08.569928 7f2b84122d00 -1 *** Caught signal (Segmentation fault) ** Sep 16 12:01:08 node1.ceph ceph-osd[12959]: in thread 7f2b84122d00 thread_name:ceph-osd Sep 16 12:01:08 node1.ceph ceph-osd[12959]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 1: (()+0xa23b21) [0x56452d08cb21] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 2: (()+0xf5e0) [0x7f2b815385e0] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 3: (()+0x1cdff) [0x7f2b83d05dff] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 4: (rocksdb::BlockBasedTable::NewIndexIterator(rocksdb::ReadOptions const&, rocksdb::BlockIter*, rocksdb::BlockBasedTable::CachableEntry*)+0x468) [0x56452d3fe9d8] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 5: (rocksdb::BlockBasedTable::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, rocksdb::GetContext*, bool)+0x275) [0x56452d3ff385] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 6: (rocksdb::TableCache::Get(rocksdb::ReadOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::Slice const&, rocksdb::GetContext*, rocksdb::HistogramImpl*, bool, int)+0x26d) [0x56452d4b80fd] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 7: (rocksdb::Version::Get(rocksdb::ReadOptions const&, rocksdb::LookupKey const&, rocksdb::PinnableSlice*, rocksdb::Status*, rocksdb::MergeContext*, rocksdb::RangeDelAggregator*, bool*, bool*, unsigned long*)+0x7f0) [0x56452d3c49d0] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 8: (rocksdb::DBImpl::GetImpl(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*, bool*)+0x57f) [0x56452d46901f] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 9: (rocksdb::DBImpl::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*)+0x19) [0x56452d4695b9] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 10: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, std::string*)+0x86) [0x56452d46d3f6] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 11: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, std::string*)+0x4a) [0x56452d46c9da] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 12: (RocksDBStore::get(std::string const&, std::string const&, ceph::buffer::list*)+0x142) [0x56452cfe3fe2] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 13: (BlueStore::omap_get_values(boost::intrusive_ptr&, ghobject_t const&, std::set, std::allocator > const&, std::map, std::allocator > >*)+0x56c) [0x56452cf95f8c] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 14: (BlueStore::omap_get_values(coll_t const&, ghobject_t const&, std::set, std::allocator > const&, std::map, std::allocator > >*)+0x5c) [0x56452cf643cc] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 15: (PG::_has_removal_flag(ObjectStore*, spg_t)+0x14c) [0x56452cbe09bc] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 16: (OSD::load_pgs()+0x5c5) [0x56452cb59445] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 17: (OSD::init()+0x2179) [0x56452cb71c69] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 18: (main()+0x2def) [0x56452ca7781f] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 19: (__libc_start_main()+0xf5) [0x7f2b8054dc05] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: 20: (()+0x4acb56) [0x56452cb15b56] Sep 16 12:01:08 node1.ceph ceph-osd[12959]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 16 12:01:08 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=11/SEGV Sep 16 12:01:08 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 16 12:01:08 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 16 12:01:28 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 16 12:01:28 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 16 12:01:28 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 16 12:01:28 node1.ceph ceph-osd[13165]: 2017-09-16 12:01:28.769550 7f2200f48d00 -1 Public network was set, but cluster network was not set Sep 16 12:01:28 node1.ceph ceph-osd[13165]: 2017-09-16 12:01:28.769558 7f2200f48d00 -1 Using public network also for cluster network Sep 16 12:01:28 node1.ceph ceph-osd[13165]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 16 12:02:16 node1.ceph ceph-osd[13165]: *** Caught signal (Segmentation fault) ** Sep 16 12:02:16 node1.ceph ceph-osd[13165]: in thread 7f2200f48d00 thread_name:ceph-osd Sep 16 12:02:16 node1.ceph ceph-osd[13165]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 1: (()+0xa23b21) [0x558b0e589b21] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 2: (()+0xf5e0) [0x7f21fe35e5e0] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 3: (()+0x1cdff) [0x7f2200b2bdff] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 4: (rocksdb::BlockBasedTable::NewIndexIterator(rocksdb::ReadOptions const&, rocksdb::BlockIter*, rocksdb::BlockBasedTable::CachableEntry*)+0x468) [0x558b0e8fb9d8] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 5: (rocksdb::BlockBasedTable::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, rocksdb::GetContext*, bool)+0x275) [0x558b0e8fc385] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 6: (rocksdb::TableCache::Get(rocksdb::ReadOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::Slice const&, rocksdb::GetContext*, rocksdb::HistogramImpl*, bool, int)+0x26d) [0x558b0e9b50fd] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 7: (rocksdb::Version::Get(rocksdb::ReadOptions const&, rocksdb::LookupKey const&, rocksdb::PinnableSlice*, rocksdb::Status*, rocksdb::MergeContext*, rocksdb::RangeDelAggregator*, bool*, bool*, unsigned long*)+0x7f0) [0x558b0e8c19d0] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 8: (rocksdb::DBImpl::GetImpl(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*, bool*)+0x57f) [0x558b0e96601f] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 9: (rocksdb::DBImpl::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*)+0x19) [0x558b0e9665b9] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 10: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, std::string*)+0x86) [0x558b0e96a3f6] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 11: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, std::string*)+0x4a) [0x558b0e9699da] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 12: (RocksDBStore::get(std::string const&, char const*, unsigned long, ceph::buffer::list*)+0x14a) [0x558b0e4e0b4a] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 13: (BlueStore::Collection::get_onode(ghobject_t const&, bool)+0x545) [0x558b0e48d055] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 14: (BlueStore::omap_get_values(boost::intrusive_ptr&, ghobject_t const&, std::set, std::allocator > const&, std::map, std::allocator > >*)+0xb1) [0x558b0e492ad1] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 15: (BlueStore::omap_get_values(coll_t const&, ghobject_t const&, std::set, std::allocator > const&, std::map, std::allocator > >*)+0x5c) [0x558b0e4613cc] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 16: (PG::_has_removal_flag(ObjectStore*, spg_t)+0x14c) [0x558b0e0dd9bc] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 17: (OSD::load_pgs()+0x5c5) [0x558b0e056445] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 18: (OSD::init()+0x2179) [0x558b0e06ec69] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 19: (main()+0x2def) [0x558b0df7481f] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 20: (__libc_start_main()+0xf5) [0x7f21fd373c05] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 21: (()+0x4acb56) [0x558b0e012b56] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 2017-09-16 12:02:16.052007 7f2200f48d00 -1 *** Caught signal (Segmentation fault) ** Sep 16 12:02:16 node1.ceph ceph-osd[13165]: in thread 7f2200f48d00 thread_name:ceph-osd Sep 16 12:02:16 node1.ceph ceph-osd[13165]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 1: (()+0xa23b21) [0x558b0e589b21] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 2: (()+0xf5e0) [0x7f21fe35e5e0] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 3: (()+0x1cdff) [0x7f2200b2bdff] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 4: (rocksdb::BlockBasedTable::NewIndexIterator(rocksdb::ReadOptions const&, rocksdb::BlockIter*, rocksdb::BlockBasedTable::CachableEntry*)+0x468) [0x558b0e8fb9d8] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 5: (rocksdb::BlockBasedTable::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, rocksdb::GetContext*, bool)+0x275) [0x558b0e8fc385] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 6: (rocksdb::TableCache::Get(rocksdb::ReadOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::Slice const&, rocksdb::GetContext*, rocksdb::HistogramImpl*, bool, int)+0x26d) [0x558b0e9b50fd] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 7: (rocksdb::Version::Get(rocksdb::ReadOptions const&, rocksdb::LookupKey const&, rocksdb::PinnableSlice*, rocksdb::Status*, rocksdb::MergeContext*, rocksdb::RangeDelAggregator*, bool*, bool*, unsigned long*)+0x7f0) [0x558b0e8c19d0] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 8: (rocksdb::DBImpl::GetImpl(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*, bool*)+0x57f) [0x558b0e96601f] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 9: (rocksdb::DBImpl::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*)+0x19) [0x558b0e9665b9] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 10: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, std::string*)+0x86) [0x558b0e96a3f6] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 11: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, std::string*)+0x4a) [0x558b0e9699da] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 12: (RocksDBStore::get(std::string const&, char const*, unsigned long, ceph::buffer::list*)+0x14a) [0x558b0e4e0b4a] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 13: (BlueStore::Collection::get_onode(ghobject_t const&, bool)+0x545) [0x558b0e48d055] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 14: (BlueStore::omap_get_values(boost::intrusive_ptr&, ghobject_t const&, std::set, std::allocator > const&, std::map, std::allocator > >*)+0xb1) [0x558b0e492ad1] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 15: (BlueStore::omap_get_values(coll_t const&, ghobject_t const&, std::set, std::allocator > const&, std::map, std::allocator > >*)+0x5c) [0x558b0e4613cc] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 16: (PG::_has_removal_flag(ObjectStore*, spg_t)+0x14c) [0x558b0e0dd9bc] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 17: (OSD::load_pgs()+0x5c5) [0x558b0e056445] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 18: (OSD::init()+0x2179) [0x558b0e06ec69] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 19: (main()+0x2def) [0x558b0df7481f] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 20: (__libc_start_main()+0xf5) [0x7f21fd373c05] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 21: (()+0x4acb56) [0x558b0e012b56] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 16 12:02:16 node1.ceph ceph-osd[13165]: -831> 2017-09-16 12:01:28.769550 7f2200f48d00 -1 Public network was set, but cluster network was not set Sep 16 12:02:16 node1.ceph ceph-osd[13165]: -830> 2017-09-16 12:01:28.769558 7f2200f48d00 -1 Using public network also for cluster network Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 0> 2017-09-16 12:02:16.052007 7f2200f48d00 -1 *** Caught signal (Segmentation fault) ** Sep 16 12:02:16 node1.ceph ceph-osd[13165]: in thread 7f2200f48d00 thread_name:ceph-osd Sep 16 12:02:16 node1.ceph ceph-osd[13165]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 1: (()+0xa23b21) [0x558b0e589b21] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 2: (()+0xf5e0) [0x7f21fe35e5e0] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 3: (()+0x1cdff) [0x7f2200b2bdff] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 4: (rocksdb::BlockBasedTable::NewIndexIterator(rocksdb::ReadOptions const&, rocksdb::BlockIter*, rocksdb::BlockBasedTable::CachableEntry*)+0x468) [0x558b0e8fb9d8] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 5: (rocksdb::BlockBasedTable::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, rocksdb::GetContext*, bool)+0x275) [0x558b0e8fc385] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 6: (rocksdb::TableCache::Get(rocksdb::ReadOptions const&, rocksdb::InternalKeyComparator const&, rocksdb::FileDescriptor const&, rocksdb::Slice const&, rocksdb::GetContext*, rocksdb::HistogramImpl*, bool, int)+0x26d) [0x558b0e9b50fd] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 7: (rocksdb::Version::Get(rocksdb::ReadOptions const&, rocksdb::LookupKey const&, rocksdb::PinnableSlice*, rocksdb::Status*, rocksdb::MergeContext*, rocksdb::RangeDelAggregator*, bool*, bool*, unsigned long*)+0x7f0) [0x558b0e8c19d0] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 8: (rocksdb::DBImpl::GetImpl(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*, bool*)+0x57f) [0x558b0e96601f] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 9: (rocksdb::DBImpl::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, rocksdb::PinnableSlice*)+0x19) [0x558b0e9665b9] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 10: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyHandle*, rocksdb::Slice const&, std::string*)+0x86) [0x558b0e96a3f6] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 11: (rocksdb::DB::Get(rocksdb::ReadOptions const&, rocksdb::Slice const&, std::string*)+0x4a) [0x558b0e9699da] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 12: (RocksDBStore::get(std::string const&, char const*, unsigned long, ceph::buffer::list*)+0x14a) [0x558b0e4e0b4a] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 13: (BlueStore::Collection::get_onode(ghobject_t const&, bool)+0x545) [0x558b0e48d055] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 14: (BlueStore::omap_get_values(boost::intrusive_ptr&, ghobject_t const&, std::set, std::allocator > const&, std::map, std::allocator > >*)+0xb1) [0x558b0e492ad1] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 15: (BlueStore::omap_get_values(coll_t const&, ghobject_t const&, std::set, std::allocator > const&, std::map, std::allocator > >*)+0x5c) [0x558b0e4613cc] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 16: (PG::_has_removal_flag(ObjectStore*, spg_t)+0x14c) [0x558b0e0dd9bc] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 17: (OSD::load_pgs()+0x5c5) [0x558b0e056445] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 18: (OSD::init()+0x2179) [0x558b0e06ec69] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 19: (main()+0x2def) [0x558b0df7481f] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 20: (__libc_start_main()+0xf5) [0x7f21fd373c05] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: 21: (()+0x4acb56) [0x558b0e012b56] Sep 16 12:02:16 node1.ceph ceph-osd[13165]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 16 12:02:16 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=11/SEGV Sep 16 12:02:16 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 16 12:02:16 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 16 12:02:56 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 16 12:02:56 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 16 12:02:56 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 16 12:02:56 node1.ceph ceph-osd[13875]: 2017-09-16 12:02:56.257560 7fe478ee1d00 -1 Public network was set, but cluster network was not set Sep 16 12:02:56 node1.ceph ceph-osd[13875]: 2017-09-16 12:02:56.257566 7fe478ee1d00 -1 Using public network also for cluster network Sep 16 12:02:56 node1.ceph ceph-osd[13875]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 16 12:02:57 node1.ceph ceph-osd[13875]: *** Caught signal (Segmentation fault) ** Sep 16 12:02:57 node1.ceph ceph-osd[13875]: in thread 7fe478ee1d00 thread_name:ceph-osd Sep 16 12:02:57 node1.ceph ceph-osd[13875]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 1: (()+0xa23b21) [0x55c8ae72eb21] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 2: (()+0xf5e0) [0x7fe4762f75e0] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 3: (()+0x1cdff) [0x7fe478ac4dff] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 4: (rocksdb::BlockBasedTable::PutDataBlockToCache(rocksdb::Slice const&, rocksdb::Slice const&, rocksdb::Cache*, rocksdb::Cache*, rocksdb::ReadOptions const&, rocksdb::ImmutableCFOptions const&, rocksdb::BlockBasedTable::CachableEntry*, rocksdb::Block*, unsigned int, rocksdb::Slice const&, unsigned long, bool, rocksdb::Cache::Priority)+0xd6) [0x55c8aea9d5e6] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 5: (rocksdb::BlockBasedTable::MaybeLoadDataBlockToCache(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::Slice, rocksdb::BlockBasedTable::CachableEntry*, bool)+0x3dc) [0x55c8aea9e67c] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 6: (rocksdb::BlockBasedTable::NewDataBlockIterator(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::BlockIter*, bool, rocksdb::Status)+0x127) [0x55c8aea9e8d7] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 7: (rocksdb::BlockBasedTable::BlockEntryIteratorState::NewSecondaryIterator(rocksdb::Slice const&)+0x89) [0x55c8aeaa6ef9] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 8: (()+0xdbd596) [0x55c8aeac8596] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 9: (()+0xdbd82c) [0x55c8aeac882c] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 10: (()+0xdbd8a6) [0x55c8aeac88a6] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 11: (rocksdb::MergingIterator::Next()+0x24d) [0x55c8aeab053d] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 12: (rocksdb::DBIter::Next()+0xa6) [0x55c8aeb2f5b6] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 13: (RocksDBStore::RocksDBWholeSpaceIteratorImpl::next()+0x9a) [0x55c8ae684faa] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 14: (BitmapFreelistManager::enumerate_next(unsigned long*, unsigned long*)+0xd7) [0x55c8ae6dbbd7] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 15: (BlueStore::_open_alloc()+0x1dd) [0x55c8ae5dbecd] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 16: (BlueStore::_mount(bool)+0x443) [0x55c8ae648b83] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 17: (OSD::init()+0x3ba) [0x55c8ae211eaa] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 18: (main()+0x2def) [0x55c8ae11981f] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 19: (__libc_start_main()+0xf5) [0x7fe47530cc05] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 20: (()+0x4acb56) [0x55c8ae1b7b56] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 2017-09-16 12:02:57.122423 7fe478ee1d00 -1 *** Caught signal (Segmentation fault) ** Sep 16 12:02:57 node1.ceph ceph-osd[13875]: in thread 7fe478ee1d00 thread_name:ceph-osd Sep 16 12:02:57 node1.ceph ceph-osd[13875]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 1: (()+0xa23b21) [0x55c8ae72eb21] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 2: (()+0xf5e0) [0x7fe4762f75e0] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 3: (()+0x1cdff) [0x7fe478ac4dff] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 4: (rocksdb::BlockBasedTable::PutDataBlockToCache(rocksdb::Slice const&, rocksdb::Slice const&, rocksdb::Cache*, rocksdb::Cache*, rocksdb::ReadOptions const&, rocksdb::ImmutableCFOptions const&, rocksdb::BlockBasedTable::CachableEntry*, rocksdb::Block*, unsigned int, rocksdb::Slice const&, unsigned long, bool, rocksdb::Cache::Priority)+0xd6) [0x55c8aea9d5e6] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 5: (rocksdb::BlockBasedTable::MaybeLoadDataBlockToCache(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::Slice, rocksdb::BlockBasedTable::CachableEntry*, bool)+0x3dc) [0x55c8aea9e67c] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 6: (rocksdb::BlockBasedTable::NewDataBlockIterator(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::BlockIter*, bool, rocksdb::Status)+0x127) [0x55c8aea9e8d7] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 7: (rocksdb::BlockBasedTable::BlockEntryIteratorState::NewSecondaryIterator(rocksdb::Slice const&)+0x89) [0x55c8aeaa6ef9] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 8: (()+0xdbd596) [0x55c8aeac8596] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 9: (()+0xdbd82c) [0x55c8aeac882c] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 10: (()+0xdbd8a6) [0x55c8aeac88a6] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 11: (rocksdb::MergingIterator::Next()+0x24d) [0x55c8aeab053d] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 12: (rocksdb::DBIter::Next()+0xa6) [0x55c8aeb2f5b6] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 13: (RocksDBStore::RocksDBWholeSpaceIteratorImpl::next()+0x9a) [0x55c8ae684faa] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 14: (BitmapFreelistManager::enumerate_next(unsigned long*, unsigned long*)+0xd7) [0x55c8ae6dbbd7] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 15: (BlueStore::_open_alloc()+0x1dd) [0x55c8ae5dbecd] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 16: (BlueStore::_mount(bool)+0x443) [0x55c8ae648b83] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 17: (OSD::init()+0x3ba) [0x55c8ae211eaa] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 18: (main()+0x2def) [0x55c8ae11981f] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 19: (__libc_start_main()+0xf5) [0x7fe47530cc05] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 20: (()+0x4acb56) [0x55c8ae1b7b56] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 16 12:02:57 node1.ceph ceph-osd[13875]: -222> 2017-09-16 12:02:56.257560 7fe478ee1d00 -1 Public network was set, but cluster network was not set Sep 16 12:02:57 node1.ceph ceph-osd[13875]: -221> 2017-09-16 12:02:56.257566 7fe478ee1d00 -1 Using public network also for cluster network Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 0> 2017-09-16 12:02:57.122423 7fe478ee1d00 -1 *** Caught signal (Segmentation fault) ** Sep 16 12:02:57 node1.ceph ceph-osd[13875]: in thread 7fe478ee1d00 thread_name:ceph-osd Sep 16 12:02:57 node1.ceph ceph-osd[13875]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 1: (()+0xa23b21) [0x55c8ae72eb21] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 2: (()+0xf5e0) [0x7fe4762f75e0] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 3: (()+0x1cdff) [0x7fe478ac4dff] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 4: (rocksdb::BlockBasedTable::PutDataBlockToCache(rocksdb::Slice const&, rocksdb::Slice const&, rocksdb::Cache*, rocksdb::Cache*, rocksdb::ReadOptions const&, rocksdb::ImmutableCFOptions const&, rocksdb::BlockBasedTable::CachableEntry*, rocksdb::Block*, unsigned int, rocksdb::Slice const&, unsigned long, bool, rocksdb::Cache::Priority)+0xd6) [0x55c8aea9d5e6] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 5: (rocksdb::BlockBasedTable::MaybeLoadDataBlockToCache(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::Slice, rocksdb::BlockBasedTable::CachableEntry*, bool)+0x3dc) [0x55c8aea9e67c] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 6: (rocksdb::BlockBasedTable::NewDataBlockIterator(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::BlockIter*, bool, rocksdb::Status)+0x127) [0x55c8aea9e8d7] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 7: (rocksdb::BlockBasedTable::BlockEntryIteratorState::NewSecondaryIterator(rocksdb::Slice const&)+0x89) [0x55c8aeaa6ef9] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 8: (()+0xdbd596) [0x55c8aeac8596] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 9: (()+0xdbd82c) [0x55c8aeac882c] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 10: (()+0xdbd8a6) [0x55c8aeac88a6] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 11: (rocksdb::MergingIterator::Next()+0x24d) [0x55c8aeab053d] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 12: (rocksdb::DBIter::Next()+0xa6) [0x55c8aeb2f5b6] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 13: (RocksDBStore::RocksDBWholeSpaceIteratorImpl::next()+0x9a) [0x55c8ae684faa] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 14: (BitmapFreelistManager::enumerate_next(unsigned long*, unsigned long*)+0xd7) [0x55c8ae6dbbd7] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 15: (BlueStore::_open_alloc()+0x1dd) [0x55c8ae5dbecd] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 16: (BlueStore::_mount(bool)+0x443) [0x55c8ae648b83] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 17: (OSD::init()+0x3ba) [0x55c8ae211eaa] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 18: (main()+0x2def) [0x55c8ae11981f] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 19: (__libc_start_main()+0xf5) [0x7fe47530cc05] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: 20: (()+0x4acb56) [0x55c8ae1b7b56] Sep 16 12:02:57 node1.ceph ceph-osd[13875]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 16 12:02:57 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=11/SEGV Sep 16 12:02:57 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 16 12:02:57 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 16 12:03:17 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 16 12:03:17 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 16 12:03:17 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 16 12:03:17 node1.ceph ceph-osd[14310]: 2017-09-16 12:03:17.519046 7f5ae3163d00 -1 Public network was set, but cluster network was not set Sep 16 12:03:17 node1.ceph ceph-osd[14310]: 2017-09-16 12:03:17.519053 7f5ae3163d00 -1 Using public network also for cluster network Sep 16 12:03:17 node1.ceph ceph-osd[14310]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 2017-09-16 12:04:32.154790 7f5ae3163d00 -1 osd.1 19911 log_to_monitors {default=true} Sep 16 12:04:32 node1.ceph ceph-osd[14310]: *** Caught signal (Segmentation fault) ** Sep 16 12:04:32 node1.ceph ceph-osd[14310]: in thread 7f5ac1ff6700 thread_name:tp_peering Sep 16 12:04:32 node1.ceph ceph-osd[14310]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 1: (()+0xa23b21) [0x56095c70db21] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 2: (()+0xf5e0) [0x7f5ae05795e0] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 3: (()+0x1cdff) [0x7f5ae2d46dff] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 4: (rocksdb::BlockBasedTable::PutDataBlockToCache(rocksdb::Slice const&, rocksdb::Slice const&, rocksdb::Cache*, rocksdb::Cache*, rocksdb::ReadOptions const&, rocksdb::ImmutableCFOptions const&, rocksdb::BlockBasedTable::CachableEntry*, rocksdb::Block*, unsigned int, rocksdb::Slice const&, unsigned long, bool, rocksdb::Cache::Priority)+0xd6) [0x56095ca7c5e6] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 5: (rocksdb::BlockBasedTable::MaybeLoadDataBlockToCache(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::Slice, rocksdb::BlockBasedTable::CachableEntry*, bool)+0x3dc) [0x56095ca7d67c] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 6: (rocksdb::BlockBasedTable::NewDataBlockIterator(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::BlockIter*, bool, rocksdb::Status)+0x127) [0x56095ca7d8d7] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 7: (rocksdb::BlockBasedTable::BlockEntryIteratorState::NewSecondaryIterator(rocksdb::Slice const&)+0x89) [0x56095ca85ef9] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 8: (()+0xdbd596) [0x56095caa7596] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 9: (()+0xdbdb5d) [0x56095caa7b5d] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 10: (()+0xdbdb6f) [0x56095caa7b6f] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 11: (rocksdb::MergingIterator::Seek(rocksdb::Slice const&)+0xce) [0x56095ca8fc8e] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 12: (rocksdb::DBIter::Seek(rocksdb::Slice const&)+0x174) [0x56095cb0f0e4] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 13: (RocksDBStore::RocksDBWholeSpaceIteratorImpl::lower_bound(std::string const&, std::string const&)+0xa2) [0x56095c664962] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 14: (BlueStore::_omap_rmkey_range(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, std::string const&, std::string const&)+0x111) [0x56095c5c6c91] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 15: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ObjectStore::Transaction*)+0x175e) [0x56095c62332e] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 16: (BlueStore::queue_transactions(ObjectStore::Sequencer*, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x3a0) [0x56095c6240a0] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 17: (ObjectStore::queue_transaction(ObjectStore::Sequencer*, ObjectStore::Transaction&&, Context*, Context*, Context*, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x171) [0x56095c226631] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 18: (OSD::dispatch_context_transaction(PG::RecoveryCtx&, PG*, ThreadPool::TPHandle*)+0x76) [0x56095c1b3456] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 19: (OSD::process_peering_events(std::list > const&, ThreadPool::TPHandle&)+0x3bb) [0x56095c1ddf3b] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 20: (OSD::PeeringWQ::_process(std::list > const&, ThreadPool::TPHandle&)+0x17) [0x56095c23f087] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 21: (ThreadPool::worker(ThreadPool::WorkThread*)+0xa8e) [0x56095c7530fe] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 22: (ThreadPool::WorkThread::entry()+0x10) [0x56095c753fe0] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 23: (()+0x7e25) [0x7f5ae0571e25] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 24: (clone()+0x6d) [0x7f5adf66534d] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 2017-09-16 12:04:32.798442 7f5ac1ff6700 -1 *** Caught signal (Segmentation fault) ** Sep 16 12:04:32 node1.ceph ceph-osd[14310]: in thread 7f5ac1ff6700 thread_name:tp_peering Sep 16 12:04:32 node1.ceph ceph-osd[14310]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 1: (()+0xa23b21) [0x56095c70db21] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 2: (()+0xf5e0) [0x7f5ae05795e0] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 3: (()+0x1cdff) [0x7f5ae2d46dff] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 4: (rocksdb::BlockBasedTable::PutDataBlockToCache(rocksdb::Slice const&, rocksdb::Slice const&, rocksdb::Cache*, rocksdb::Cache*, rocksdb::ReadOptions const&, rocksdb::ImmutableCFOptions const&, rocksdb::BlockBasedTable::CachableEntry*, rocksdb::Block*, unsigned int, rocksdb::Slice const&, unsigned long, bool, rocksdb::Cache::Priority)+0xd6) [0x56095ca7c5e6] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 5: (rocksdb::BlockBasedTable::MaybeLoadDataBlockToCache(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::Slice, rocksdb::BlockBasedTable::CachableEntry*, bool)+0x3dc) [0x56095ca7d67c] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 6: (rocksdb::BlockBasedTable::NewDataBlockIterator(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::BlockIter*, bool, rocksdb::Status)+0x127) [0x56095ca7d8d7] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 7: (rocksdb::BlockBasedTable::BlockEntryIteratorState::NewSecondaryIterator(rocksdb::Slice const&)+0x89) [0x56095ca85ef9] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 8: (()+0xdbd596) [0x56095caa7596] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 9: (()+0xdbdb5d) [0x56095caa7b5d] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 10: (()+0xdbdb6f) [0x56095caa7b6f] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 11: (rocksdb::MergingIterator::Seek(rocksdb::Slice const&)+0xce) [0x56095ca8fc8e] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 12: (rocksdb::DBIter::Seek(rocksdb::Slice const&)+0x174) [0x56095cb0f0e4] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 13: (RocksDBStore::RocksDBWholeSpaceIteratorImpl::lower_bound(std::string const&, std::string const&)+0xa2) [0x56095c664962] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 14: (BlueStore::_omap_rmkey_range(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, std::string const&, std::string const&)+0x111) [0x56095c5c6c91] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 15: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ObjectStore::Transaction*)+0x175e) [0x56095c62332e] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 16: (BlueStore::queue_transactions(ObjectStore::Sequencer*, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x3a0) [0x56095c6240a0] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 17: (ObjectStore::queue_transaction(ObjectStore::Sequencer*, ObjectStore::Transaction&&, Context*, Context*, Context*, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x171) [0x56095c226631] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 18: (OSD::dispatch_context_transaction(PG::RecoveryCtx&, PG*, ThreadPool::TPHandle*)+0x76) [0x56095c1b3456] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 19: (OSD::process_peering_events(std::list > const&, ThreadPool::TPHandle&)+0x3bb) [0x56095c1ddf3b] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 20: (OSD::PeeringWQ::_process(std::list > const&, ThreadPool::TPHandle&)+0x17) [0x56095c23f087] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 21: (ThreadPool::worker(ThreadPool::WorkThread*)+0xa8e) [0x56095c7530fe] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 22: (ThreadPool::WorkThread::entry()+0x10) [0x56095c753fe0] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 23: (()+0x7e25) [0x7f5ae0571e25] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 24: (clone()+0x6d) [0x7f5adf66534d] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 16 12:04:32 node1.ceph ceph-osd[14310]: -5413> 2017-09-16 12:03:17.519046 7f5ae3163d00 -1 Public network was set, but cluster network was not set Sep 16 12:04:32 node1.ceph ceph-osd[14310]: -5412> 2017-09-16 12:03:17.519053 7f5ae3163d00 -1 Using public network also for cluster network Sep 16 12:04:32 node1.ceph ceph-osd[14310]: -4086> 2017-09-16 12:04:32.154790 7f5ae3163d00 -1 osd.1 19911 log_to_monitors {default=true} Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 0> 2017-09-16 12:04:32.798442 7f5ac1ff6700 -1 *** Caught signal (Segmentation fault) ** Sep 16 12:04:32 node1.ceph ceph-osd[14310]: in thread 7f5ac1ff6700 thread_name:tp_peering Sep 16 12:04:32 node1.ceph ceph-osd[14310]: ceph version 12.2.0 (32ce2a3ae5239ee33d6150705cdb24d43bab910c) luminous (rc) Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 1: (()+0xa23b21) [0x56095c70db21] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 2: (()+0xf5e0) [0x7f5ae05795e0] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 3: (()+0x1cdff) [0x7f5ae2d46dff] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 4: (rocksdb::BlockBasedTable::PutDataBlockToCache(rocksdb::Slice const&, rocksdb::Slice const&, rocksdb::Cache*, rocksdb::Cache*, rocksdb::ReadOptions const&, rocksdb::ImmutableCFOptions const&, rocksdb::BlockBasedTable::CachableEntry*, rocksdb::Block*, unsigned int, rocksdb::Slice const&, unsigned long, bool, rocksdb::Cache::Priority)+0xd6) [0x56095ca7c5e6] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 5: (rocksdb::BlockBasedTable::MaybeLoadDataBlockToCache(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::Slice, rocksdb::BlockBasedTable::CachableEntry*, bool)+0x3dc) [0x56095ca7d67c] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 6: (rocksdb::BlockBasedTable::NewDataBlockIterator(rocksdb::BlockBasedTable::Rep*, rocksdb::ReadOptions const&, rocksdb::BlockHandle const&, rocksdb::BlockIter*, bool, rocksdb::Status)+0x127) [0x56095ca7d8d7] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 7: (rocksdb::BlockBasedTable::BlockEntryIteratorState::NewSecondaryIterator(rocksdb::Slice const&)+0x89) [0x56095ca85ef9] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 8: (()+0xdbd596) [0x56095caa7596] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 9: (()+0xdbdb5d) [0x56095caa7b5d] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 10: (()+0xdbdb6f) [0x56095caa7b6f] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 11: (rocksdb::MergingIterator::Seek(rocksdb::Slice const&)+0xce) [0x56095ca8fc8e] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 12: (rocksdb::DBIter::Seek(rocksdb::Slice const&)+0x174) [0x56095cb0f0e4] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 13: (RocksDBStore::RocksDBWholeSpaceIteratorImpl::lower_bound(std::string const&, std::string const&)+0xa2) [0x56095c664962] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 14: (BlueStore::_omap_rmkey_range(BlueStore::TransContext*, boost::intrusive_ptr&, boost::intrusive_ptr&, std::string const&, std::string const&)+0x111) [0x56095c5c6c91] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 15: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ObjectStore::Transaction*)+0x175e) [0x56095c62332e] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 16: (BlueStore::queue_transactions(ObjectStore::Sequencer*, std::vector >&, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x3a0) [0x56095c6240a0] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 17: (ObjectStore::queue_transaction(ObjectStore::Sequencer*, ObjectStore::Transaction&&, Context*, Context*, Context*, boost::intrusive_ptr, ThreadPool::TPHandle*)+0x171) [0x56095c226631] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 18: (OSD::dispatch_context_transaction(PG::RecoveryCtx&, PG*, ThreadPool::TPHandle*)+0x76) [0x56095c1b3456] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 19: (OSD::process_peering_events(std::list > const&, ThreadPool::TPHandle&)+0x3bb) [0x56095c1ddf3b] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 20: (OSD::PeeringWQ::_process(std::list > const&, ThreadPool::TPHandle&)+0x17) [0x56095c23f087] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 21: (ThreadPool::worker(ThreadPool::WorkThread*)+0xa8e) [0x56095c7530fe] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 22: (ThreadPool::WorkThread::entry()+0x10) [0x56095c753fe0] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 23: (()+0x7e25) [0x7f5ae0571e25] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: 24: (clone()+0x6d) [0x7f5adf66534d] Sep 16 12:04:32 node1.ceph ceph-osd[14310]: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. Sep 16 12:04:32 node1.ceph systemd[1]: ceph-osd@1.service: main process exited, code=killed, status=11/SEGV Sep 16 12:04:32 node1.ceph systemd[1]: Unit ceph-osd@1.service entered failed state. Sep 16 12:04:32 node1.ceph systemd[1]: ceph-osd@1.service failed. Sep 16 12:04:52 node1.ceph systemd[1]: ceph-osd@1.service holdoff time over, scheduling restart. Sep 16 12:04:52 node1.ceph systemd[1]: Starting Ceph object storage daemon osd.1... Sep 16 12:04:52 node1.ceph systemd[1]: Started Ceph object storage daemon osd.1. Sep 16 12:04:53 node1.ceph ceph-osd[14676]: 2017-09-16 12:04:53.010463 7eff1f096d00 -1 Public network was set, but cluster network was not set Sep 16 12:04:53 node1.ceph ceph-osd[14676]: 2017-09-16 12:04:53.010476 7eff1f096d00 -1 Using public network also for cluster network Sep 16 12:04:53 node1.ceph ceph-osd[14676]: starting osd.1 at - osd_data /var/lib/ceph/osd/ceph-1 /var/lib/ceph/osd/ceph-1/journal Sep 16 12:06:08 node1.ceph ceph-osd[14676]: 2017-09-16 12:06:08.406998 7eff1f096d00 -1 osd.1 19915 log_to_monitors {default=true}