Project

General

Profile

Actions

Bug #8361

closed

osd/osd_types.h: 2868: FAILED assert(rwstate.empty())

Added by Sergey Korolev almost 10 years ago. Updated almost 10 years ago.

Status:
Can't reproduce
Priority:
Urgent
Assignee:
-
Category:
OSD
Target version:
-
% Done:

0%

Source:
Community (user)
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

OSD crash with error

osd/osd_types.h: 2868: FAILED assert(rwstate.empty())

ceph version 0.80.1 (a38fe1169b6d2ac98b427334c12d7cf81f809b74)
1: (SharedPtrRegistry<hobject_t, ObjectContext>::OnRemoval::operator()(ObjectContext*)+0x2f5) [0x8dfee5]
2: (std::tr1::__shared_count<(_gnu_cxx::_Lock_policy)2>::~_shared_count()+0x49) [0x66e839]
3: (ReplicatedPG::OpContext::~OpContext()+0xff) [0x8de93f]
4: (ReplicatedPG::RepGather::put()+0x37) [0x8deda7]
5: (C_OSD_RepopCommit::~C_OSD_RepopCommit()+0x24) [0x8defc4]
6: (ReplicatedBackend::sub_op_modify_reply(std::tr1::shared_ptr&lt;OpRequest&gt;)+0x379) [0x967de9]
7: (ReplicatedBackend::handle_message(std::tr1::shared_ptr&lt;OpRequest&gt;)+0x3be) [0x9695ee]
8: (ReplicatedPG::do_request(std::tr1::shared_ptr&lt;OpRequest&gt;, ThreadPool::TPHandle&)+0x250) [0x847000]
9: (OSD::dequeue_op(boost::intrusive_ptr&lt;PG&gt;, std::tr1::shared_ptr&lt;OpRequest&gt;, ThreadPool::TPHandle&)+0x37c) [0x60e96c]
10: (OSD::OpWQ::_process(boost::intrusive_ptr&lt;PG&gt;, ThreadPool::TPHandle&)+0x63d) [0x64068d]
11: (ThreadPool::WorkQueueVal&lt;std::pair&lt;boost::intrusive_ptr&lt;PG&gt;, std::tr1::shared_ptr&lt;OpRequest&gt; >, boost::intrusive_ptr&lt;PG&gt; >::_void_process(void*, ThreadPool::TPHandle&)+0xae) [0x6768fe]
12: (ThreadPool::worker(ThreadPool::WorkThread*)+0x551) [0xab5721]
13: (ThreadPool::WorkThread::entry()+0x10) [0xab8760]
14: (()+0x79d1) [0x7f701bb3a9d1]
15: (clone()+0x6d) [0x7f701a875b6d]
NOTE: a copy of the executable, or `objdump -rdS &lt;executable&gt;` is needed to interpret this.

ceph version 0.80.1 (a38fe1169b6d2ac98b427334c12d7cf81f809b74)

Full log in attach


Files

ceph-osd.0.log.gz (242 KB) ceph-osd.0.log.gz Sergey Korolev, 05/15/2014 09:33 AM
ceph-osd.1.log.gz (198 KB) ceph-osd.1.log.gz Sergey Korolev, 05/22/2014 11:01 PM
Actions #1

Updated by Sage Weil almost 10 years ago

  • Subject changed from Crash OSD to osd/osd_types.h: 2868: FAILED assert(rwstate.empty())
  • Priority changed from Normal to Urgent
  • Source changed from other to Community (user)
Actions #2

Updated by Samuel Just almost 10 years ago

Any chance of being able to reproduce this with debug osd = 20, debug ms = 1?

Actions #3

Updated by Samuel Just almost 10 years ago

  • Status changed from New to Need More Info
Actions #5

Updated by Samuel Just almost 10 years ago

That log does not have logging turned on. Add

debug osd = 20
debug ms = 1

to the [osd] section of the conf file on the node on which you want to enable logging.

Actions #6

Updated by Samuel Just almost 10 years ago

  • Status changed from Need More Info to Can't reproduce
Actions

Also available in: Atom PDF