Bug #14438
Updated by Yuri Weinstein over 8 years ago
Run: http://pulpito.ovh.sepia.ceph.com:8081/teuthology-2016-01-20_10:02:02-upgrade:hammer-x-jewel-distro-basic-openstack/ Job: 7344 Logs: http://teuthology.ovh.sepia.ceph.com/teuthology/teuthology-2016-01-20_10:02:02-upgrade:hammer-x-jewel-distro-basic-openstack/7344/teuthology.log @zgrep `zgrep -i "^ ceph version" /a/teuthology-2016-01-20_10:02:02-upgrade:hammer-x-jewel-distro-basic-openstack/7344/remote/target092194/log/ceph-osd.0.log.gz@ /a/teuthology-2016-01-20_10:02:02-upgrade:hammer-x-jewel-distro-basic-openstack/7344/remote/target092194/log/ceph-osd.0.log.gz` <pre> 194879580-2016-01-20 10:51:52.846913 7f5023f797c0 10 osd.0 334 build_past_intervals_parallel epoch 334 194879673-2016-01-20 10:51:52.852331 7f5023f797c0 -1 osd/OSD.cc: In function 'void OSD::build_past_intervals_parallel()' thread 7f5023f797c0 time 2016-01-20 10:51:52.846933 194879836-osd/OSD.cc: 3151: FAILED assert(pg->info.history.same_interval_since == p.same_interval_since) 194879931- 194879932: ceph version 10.0.2-29-ge7107f8 (e7107f87151e9674502088bbe2d183ff4528647f) 194880008- 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x8b) [0x7f5023a651eb] 194880105- 2: (OSD::build_past_intervals_parallel()+0x1677) [0x7f50234a68d7] 194880172- 3: (OSD::load_pgs()+0x554) [0x7f50234aad64] 194880217- 4: (OSD::init()+0xf24) [0x7f50234bb214] 194880258- 5: (main()+0x297e) [0x7f502342c2de] 194880295- 6: (__libc_start_main()+0xf5) [0x7f50202a2ec5] 194880343- 7: (()+0x3137b7) [0x7f502346b7b7] 194880378- NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this. 194880471- 194880472---- begin dump of recent events --- 194880508- -9999> 2016-01-20 10:51:52.562241 7f5023f797c0 20 _collection_list_partial start:0:-1/00000000//0 end:GHMAX-64 ls.size 0 194880630- -9998> 2016-01-20 10:51:52.562289 7f5023f797c0 20 list_by_hash_bitwise prefix D0000000 194880718- -9997> 2016-01-20 10:51:52.562301 7f5023f797c0 20 list_by_hash_bitwise prefix D0000000 ob 0:3/0000000d//head 194880828- -9996> 2016-01-20 10:51:52.562310 7f5023f797c0 20 list_by_hash_bitwise prefix DC7170A1 194880916- -9995> 2016-01-20 10:51:52.562318 7f5023f797c0 20 list_by_hash_bitwise prefix DC7170A1 ob 0:3/1a0717cd/target092002.ovh.sepia.ceph.com11169-23/9d 194881063- -9994> 2016-01-20 10:51:52.562327 7f5023f797c0 20 list_by_hash_bitwise prefix DC7170A1 ob 0:3/1a0717cd/target092002.ovh.sepia.ceph.com11169-23/head 194881212- -9993> 2016-01-20 10:51:52.562336 7f5023f797c0 20 filestore(/var/lib/ceph/osd/ceph-0) objects: 0x7ffc5fb66fd0 194881323- -9992> 2016-01-20 10:51:52.562345 7f5023f797c0 20 osd.0 334 clearing temps in 0.10_head pgid 0.10 194881423- -9991> 2016-01-20 10:51:52.562355 7f5023f797c0 20 filestore(/var/lib/ceph/osd/ceph-0) collection_list pool is 0 shard is 255 pgid 0.10 194881559- -9990> 2016-01-20 10:51:52.562364 7f5023f797c0 10 filestore(/var/lib/ceph/osd/ceph-0) collection_list first checking temp pool -- 196661778- -17> 2016-01-20 10:51:52.846229 7f5023f797c0 10 osd.0 334 build_past_intervals_parallel epoch 330 196661879- -16> 2016-01-20 10:51:52.846238 7f5023f797c0 20 osd.0 0 get_map 330 - loading and decoding 0x7f5029a8ba80 196661988- -15> 2016-01-20 10:51:52.846247 7f5023f797c0 15 filestore(/var/lib/ceph/osd/ceph-0) read meta/-1/ac968fa5/osdmap.330/0 0~0 196662114- -14> 2016-01-20 10:51:52.846291 7f5023f797c0 10 filestore(/var/lib/ceph/osd/ceph-0) FileStore::read meta/-1/ac968fa5/osdmap.330/0 0~7056/7056 196662259- -13> 2016-01-20 10:51:52.846305 7f5023f797c0 10 osd.0 0 add_map_bl 330 7056 bytes 196662344- -12> 2016-01-20 10:51:52.846360 7f5023f797c0 10 osd.0 334 build_past_intervals_parallel epoch 331 196662445- -11> 2016-01-20 10:51:52.846373 7f5023f797c0 20 osd.0 0 get_map 331 - loading and decoding 0x7f5029a8ad00 196662554- -10> 2016-01-20 10:51:52.846382 7f5023f797c0 15 filestore(/var/lib/ceph/osd/ceph-0) read meta/-1/ac968f75/osdmap.331/0 0~0 196662680- -9> 2016-01-20 10:51:52.846435 7f5023f797c0 10 filestore(/var/lib/ceph/osd/ceph-0) FileStore::read meta/-1/ac968f75/osdmap.331/0 0~7056/7056 196662825- -8> 2016-01-20 10:51:52.846448 7f5023f797c0 10 osd.0 0 add_map_bl 331 7056 bytes 196662910- -7> 2016-01-20 10:51:52.846504 7f5023f797c0 10 osd.0 334 build_past_intervals_parallel epoch 332 196663011- -6> 2016-01-20 10:51:52.846521 7f5023f797c0 10 osd.0 334 build_past_intervals_parallel epoch 333 196663112- -5> 2016-01-20 10:51:52.846530 7f5023f797c0 20 osd.0 0 get_map 333 - loading and decoding 0x7f5029a89f80 196663221- -4> 2016-01-20 10:51:52.846539 7f5023f797c0 15 filestore(/var/lib/ceph/osd/ceph-0) read meta/-1/ac968dd5/osdmap.333/0 0~0 196663347- -3> 2016-01-20 10:51:52.846583 7f5023f797c0 10 filestore(/var/lib/ceph/osd/ceph-0) FileStore::read meta/-1/ac968dd5/osdmap.333/0 0~7056/7056 196663492- -2> 2016-01-20 10:51:52.846609 7f5023f797c0 10 osd.0 0 add_map_bl 333 7056 bytes 196663577- -1> 2016-01-20 10:51:52.846913 7f5023f797c0 10 osd.0 334 build_past_intervals_parallel epoch 334 196663678- 0> 2016-01-20 10:51:52.852331 7f5023f797c0 -1 osd/OSD.cc: In function 'void OSD::build_past_intervals_parallel()' thread 7f5023f797c0 time 2016-01-20 10:51:52.846933 </pre>