Bug #7508
closed2014-02-20T21:16:18.808 INFO:teuthology.task.rados.rados.0.err:[ubuntu@burnupi09.front.sepia.ceph.com]: Error: finished tid 1 when last_acked_tid was 5
0%
Description
Objecter doesn't take primary position into account.
2014-02-20T21:16:09.130 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: 1736: writing burnupi0942234-445 from 2097152 to 2179072 tid 5
2014-02-20T21:16:09.800 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: 1732: expect (ObjNum 1030 snap 0 seq_num 1030)
2014-02-20T21:16:10.378 INFO:teuthology.task.thrashosds.thrasher:in_osds: [1, 4, 0, 5, 2] out_osds: [3] dead_osds: [] live_osds: [1, 0, 4, 2, 5, 3]
2014-02-20T21:16:10.379 INFO:teuthology.task.thrashosds.thrasher:choose_action: min_in 3 min_out 0 min_live 2 min_dead 0
2014-02-20T21:16:10.379 INFO:teuthology.task.thrashosds.thrasher:Adding osd 3
2014-02-20T21:16:11.163 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: 1731: expect (ObjNum 533 snap 0 seq_num 533)
2014-02-20T21:16:11.402 INFO:teuthology.orchestra.run.err:[ubuntu@burnupi09.front.sepia.ceph.com]: marked in osd.3.
2014-02-20T21:16:11.417 INFO:teuthology.task.thrashosds.thrasher:Added osd 3
2014-02-20T21:16:12.977 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: 1731: done (6 left)
2014-02-20T21:16:12.977 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: 1732: done (5 left)
2014-02-20T21:16:12.977 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: 1735: done (4 left)
2014-02-20T21:16:12.978 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: 1737: read oid 325 snap -1
2014-02-20T21:16:12.978 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: 1734: expect (ObjNum 32 snap 0 seq_num 32)
2014-02-20T21:16:14.017 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: 1733: expect (ObjNum 1046 snap 0 seq_num 1046)
2014-02-20T21:16:16.417 INFO:teuthology.task.thrashosds.thrasher:in_osds: [1, 4, 0, 5, 2, 3] out_osds: [] dead_osds: [] live_osds: [1, 0, 4, 2, 5, 3]
2014-02-20T21:16:16.418 INFO:teuthology.task.thrashosds.thrasher:choose_action: min_in 3 min_out 0 min_live 2 min_dead 0
2014-02-20T21:16:16.418 INFO:teuthology.task.thrashosds.thrasher:Setting osd 0 primary_affinity to 0.240916
2014-02-20T21:16:17.401 INFO:teuthology.orchestra.run.err:[ubuntu@burnupi09.front.sepia.ceph.com]: set osd.0 primary-affinity to 0.240916 (8157882)
2014-02-20T21:16:17.805 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: 1733: done (4 left)
2014-02-20T21:16:17.805 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: 1734: done (3 left)
2014-02-20T21:16:17.806 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: 1738: read oid 50 snap -1
2014-02-20T21:16:17.806 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: 1736: finishing write tid 1 to burnupi0942234-445
2014-02-20T21:16:17.806 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: 1736: finishing write tid 2 to burnupi0942234-445
2014-02-20T21:16:17.806 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: 1736: finishing write tid 3 to burnupi0942234-445
2014-02-20T21:16:17.807 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: 1736: finishing write tid 4 to burnupi0942234-445
2014-02-20T21:16:17.807 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: 1736: finishing write tid 5 to burnupi0942234-445
2014-02-20T21:16:17.807 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: 1736: finishing write tid 7 to burnupi0942234-445
2014-02-20T21:16:17.807 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: 1736: finishing write tid 8 to burnupi0942234-445
2014-02-20T21:16:17.808 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: update_object_version oid 445 v 121 (ObjNum 1169 snap 0 seq_num 1169) dirty exists
2014-02-20T21:16:17.808 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: 1737: expect (ObjNum 683 snap 0 seq_num 683)
2014-02-20T21:16:18.807 INFO:teuthology.task.rados.rados.0.out:[ubuntu@burnupi09.front.sepia.ceph.com]: 1585: finishing write tid 1 to burnupi0942234-262
2014-02-20T21:16:18.808 INFO:teuthology.task.rados.rados.0.err:[ubuntu@burnupi09.front.sepia.ceph.com]: Error: finished tid 1 when last_acked_tid was 5
2014-02-20T21:16:18.912 INFO:teuthology.task.rados.rados.0.err:[ubuntu@burnupi09.front.sepia.ceph.com]: ./test/osd/RadosModel.h: In function 'virtual void WriteOp::_finish(TestOp::CallbackInfo*)' thread 7fbbe6ffd700 time 2014-02-20 21:16:29.769921
2014-02-20T21:16:18.912 INFO:teuthology.task.rados.rados.0.err:[ubuntu@burnupi09.front.sepia.ceph.com]: ./test/osd/RadosModel.h: 810: FAILED assert(0)
2014-02-20T21:16:18.930 INFO:teuthology.task.rados.rados.0.err:[ubuntu@burnupi09.front.sepia.ceph.com]: ceph version 0.77-488-g4251b78 (4251b78bd0f9bd9d2a145d1bb61cb7bd76aeab02)
2014-02-20T21:16:18.931 INFO:teuthology.task.rados.rados.0.err:[ubuntu@burnupi09.front.sepia.ceph.com]: 1: (WriteOp::_finish(TestOp::CallbackInfo*)+0x318) [0x419dc8]
2014-02-20T21:16:18.931 INFO:teuthology.task.rados.rados.0.err:[ubuntu@burnupi09.front.sepia.ceph.com]: 2: (write_callback(void*, void*)+0x21) [0x4274b1]
2014-02-20T21:16:18.931 INFO:teuthology.task.rados.rados.0.err:[ubuntu@burnupi09.front.sepia.ceph.com]: 3: (librados::C_AioComplete::finish(int)+0x1d) [0x7fbbf1269d7d]
2014-02-20T21:16:18.931 INFO:teuthology.task.rados.rados.0.err:[ubuntu@burnupi09.front.sepia.ceph.com]: 4: (Context::complete(int)+0x9) [0x7fbbf1247789]
2014-02-20T21:16:18.932 INFO:teuthology.task.rados.rados.0.err:[ubuntu@burnupi09.front.sepia.ceph.com]: 5: (Finisher::finisher_thread_entry()+0x1c0) [0x7fbbf12fa110]
2014-02-20T21:16:18.932 INFO:teuthology.task.rados.rados.0.err:[ubuntu@burnupi09.front.sepia.ceph.com]: 6: (()+0x7e9a) [0x7fbbf0ea2e9a]
2014-02-20T21:16:18.932 INFO:teuthology.task.rados.rados.0.err:[ubuntu@burnupi09.front.sepia.ceph.com]: 7: (clone()+0x6d) [0x7fbbf06b93fd]
2014-02-20T21:16:18.932 INFO:teuthology.task.rados.rados.0.err:[ubuntu@burnupi09.front.sepia.ceph.com]: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2014-02-20T21:16:18.933 INFO:teuthology.task.rados.rados.0.err:[ubuntu@burnupi09.front.sepia.ceph.com]: terminate called after throwing an instance of 'ceph::FailedAssertion'
2014-02-20T21:16:19.018 ERROR:teuthology.run_tasks:Manager failed: rados
Traceback (most recent call last):
File "/home/samuelj/teuthology/teuthology/run_tasks.py", line 84, in run_tasks
suppress = manager.__exit__(*exc_info)
File "/usr/lib/python2.7/contextlib.py", line 24, in exit
self.gen.next()