Bug #10517: ./os/ObjectStore.h: 598: FAILED assert(op->oid < om.size()) - Ceph - Ceph

Actions

Copy link

Bug #10517

closed

./os/ObjectStore.h: 598: FAILED assert(op->oid < om.size())

Added by Samuel Just over 9 years ago. Updated over 9 years ago.

Status:

Resolved

Priority:

Urgent

Assignee:

Dong Yuan

Category:

Target version:

% Done:

Source:

other

Tags:

Backport:

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

wip-sam-testing, but I think this code was not affected.

2> 2015-01-08 00:48:19.737753 7f6a6a4b0700  0 - 10.214.132.32:6801/6381 >> 10.214.134.104:6801/5896 pipe(0x415a000 sd=116 :6801 s=2 pgs=1750 cs=642 l=0 c=0x40fd020).injecting socket failure
    1> 2015-01-08 00:48:19.737804 7f6a6a4b0700  0 - 10.214.132.32:6801/6381 >> 10.214.134.104:6801/5896 pipe(0x415a000 sd=116 :6801 s=2 pgs=1750 cs=642 l=0 c=0x40fd020).fault with nothing to send, going to standby
     0> 2015-01-08 00:48:19.738557 7f6a719ca700 1 ./os/ObjectStore.h: In function 'void ObjectStore::Transaction::_update_op(ObjectStore::Transaction::Op*, std::vector&lt;unsigned int&gt;&, std::vector&lt;unsigned int&gt;&)' thread 7f6a719ca700 time 2015-01-08 00:48:19.732855
./os/ObjectStore.h: 598: FAILED assert(op>oid < om.size())

ceph version 0.90-793-g5f48d50 (5f48d505ab8a08832a65f449c7b927047c910cf9)
 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x8b) [0xba5f3b]
 2: (ObjectStore::Transaction::append(ObjectStore::Transaction&)+0x772) [0x8ca2f2]
 3: (ECBackend::handle_sub_write(pg_shard_t, std::tr1::shared_ptr&lt;OpRequest&gt;, ECSubWrite&, Context*)+0x480) [0xa1fae0]
 4: (ECBackend::handle_message(std::tr1::shared_ptr&lt;OpRequest&gt;)+0x2ba) [0xa2a59a]
 5: (ReplicatedPG::do_request(std::tr1::shared_ptr&lt;OpRequest&gt;&, ThreadPool::TPHandle&)+0x23b) [0x8320bb]
 6: (OSD::dequeue_op(boost::intrusive_ptr&lt;PG&gt;, std::tr1::shared_ptr&lt;OpRequest&gt;, ThreadPool::TPHandle&)+0x3d5) [0x6955b5]
 7: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x37b) [0x695b4b]
 8: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x821) [0xb96061]
 9: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0xb98170]
 10: (()+0x8182) [0x7f6a90246182]
 11: (clone()+0x6d) [0x7f6a8e7b1fbd]
 NOTE: a copy of the executable, or `objdump -rdS &lt;executable&gt;` is needed to interpret this.

Actions

Copy link

Updated by Samuel Just over 9 years ago

ubuntu@teuthology:/a/samuelj-2015-01-07_13:21:03-rados-wip-sam-testing-wip-testing-vanilla-fixes-basic-multi/689604

Actions

Copy link

Updated by Sage Weil over 9 years ago

Assignee set to Anonymous

Dong Yuan should look at this.. but Sam perhaps I should also try to finish the series that gets rid of append entirely?

Actions

Copy link

Updated by Sage Weil over 9 years ago

Status changed from New to 12
Assignee deleted (~~Anonymous~~)

anothe instance:

0> 2015-01-19 01:42:09.620190 7f348ecef700 1 ./os/ObjectStore.h: In function 'void ObjectStore::Transaction::_update_op(ObjectStore::Transaction::Op*, std::vector&lt;unsigned int&gt;&, std::vector&lt;unsigned int&gt;&)' thread 7f348ecef700 time 2015-01-19 01:42:09.615325
./os/ObjectStore.h: 563: FAILED assert(op>oid < om.size())

ceph version 0.91-511-g3be73b2 (3be73b28e52785db00a15de2680c7a38dac8569f)
 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x85) [0xbbd265]
 2: (ObjectStore::Transaction::append(ObjectStore::Transaction&)+0x83e) [0x8c4c0e]
 3: (ECBackend::handle_sub_write(pg_shard_t, std::tr1::shared_ptr&lt;OpRequest&gt;, ECSubWrite&, Context*)+0x49f) [0xa218ff]
 4: (ECBackend::handle_message(std::tr1::shared_ptr&lt;OpRequest&gt;)+0x313) [0xa2c5d3]
 5: (ReplicatedPG::do_request(std::tr1::shared_ptr&lt;OpRequest&gt;&, ThreadPool::TPHandle&)+0x26b) [0x82912b]
 6: (OSD::dequeue_op(boost::intrusive_ptr&lt;PG&gt;, std::tr1::shared_ptr&lt;OpRequest&gt;, ThreadPool::TPHandle&)+0x405) [0x690355]
 7: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x359) [0x6908e9]
 8: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x828) [0xbace38]
 9: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0xbaef60]
 10: (()+0x7df3) [0x7f34a9fb1df3]
 11: (clone()+0x6d) [0x7f34a8a943dd]
 NOTE: a copy of the executable, or `objdump -rdS &lt;executable&gt;` is needed to interpret this.

ubuntu@teuthology:/var/lib/teuthworker/archive/sage-2015-01-18_20:48:05-rados-wip-sage-testing-distro-basic-multi/710599

Actions

Copy link