Project

General

Profile

Actions

Bug #4937

closed

osd/ReplicatedPG.cc: 1379: FAILED assert(0)

Added by Denis kaganovich almost 11 years ago. Updated almost 11 years ago.

Status:
Can't reproduce
Priority:
Urgent
Assignee:
Category:
OSD
Target version:
-
% Done:

0%

Source:
Development
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Sure down 2 osd with next messages (this is one osd info):

0> 2013-05-08 15:20:25.634740 7fe69d736700 -1 osd/ReplicatedPG.cc: In function 'ReplicatedPG::RepGather* ReplicatedPG::trim_object(const hobject_t&)' thread 7fe69d736700 time 2013-05-08 15:20:25.632849
osd/ReplicatedPG.cc: 1379: FAILED assert(0)
ceph version 0.61-127-gf0c0997 (f0c0997cb86b20fbc2613102fc58de7d64b861f4)
1: (ReplicatedPG::trim_object(hobject_t const&)+0x16d) [0x59718d]
2: (ReplicatedPG::TrimmingObjects::react(ReplicatedPG::SnapTrim const&)+0x450) [0x59d000]
3: (boost::statechart::simple_state<ReplicatedPG::TrimmingObjects, ReplicatedPG::SnapTrimmer, boost::mpl::list<mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na>, (boost::statechart::history_mode)0>::react_impl(boost::statechart::event_base const&, void const*)+0x13c) [0x5f086c]
4: (boost::statechart::state_machine<ReplicatedPG::SnapTrimmer, ReplicatedPG::NotTrimming, std::allocator<void>, boost::statechart::null_exception_translator>::process_queued_events()+0x12b) [0x5e115b]
5: (boost::statechart::state_machine<ReplicatedPG::SnapTrimmer, ReplicatedPG::NotTrimming, std::allocator<void>, boost::statechart::null_exception_translator>::process_event(boost::statechart::event_base const&)+0x2b) [0x5e12cb]
6: (ReplicatedPG::snap_trimmer()+0x4f7) [0x579d27]
7: (OSD::SnapTrimWQ::_process(PG*)+0x14) [0x652b94]
8: (ThreadPool::worker(ThreadPool::WorkThread*)+0x579) [0x8aaf79]
9: (ThreadPool::WorkThread::entry()+0x10) [0x8ad0e0]
10: (()+0x84f8) [0x7fe6c37ec4f8]
11: (clone()+0x6d) [0x7fe6c164976d]

And later:
ceph version 0.61-127-gf0c0997 (f0c0997cb86b20fbc2613102fc58de7d64b861f4)
1: /usr/bin/ceph-osd() [0x7d4617]
2: (()+0x10c70) [0x7fe6c37f4c70]
3: (gsignal()+0x35) [0x7fe6c153d275]
4: (abort()+0x139) [0x7fe6c153eb69]
5: (_gnu_cxx::_verbose_terminate_handler()+0x11d) [0x7fe6c1ef8c9d]
6: (()+0xb9e56) [0x7fe6c1ef6e56]
7: (()+0xb9e83) [0x7fe6c1ef6e83]
8: (()+0xb9f7e) [0x7fe6c1ef6f7e]
9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1d3) [0x8b7a23]
10: (ReplicatedPG::trim_object(hobject_t const&)+0x16d) [0x59718d]
11: (ReplicatedPG::TrimmingObjects::react(ReplicatedPG::SnapTrim const&)+0x450) [0x59d000]
12: (boost::statechart::simple_state<ReplicatedPG::TrimmingObjects, ReplicatedPG::SnapTrimmer, boost::mpl::list<mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na>, (boost::statechart::history_mode)0>::react_impl(boost::statechart::event_base const&, void const*)+0x13c) [0x5f086c]
13: (boost::statechart::state_machine<ReplicatedPG::SnapTrimmer, ReplicatedPG::NotTrimming, std::allocator<void>, boost::statechart::null_exception_translator>::process_queued_events()+0x12b) [0x5e115b]
14: (boost::statechart::state_machine<ReplicatedPG::SnapTrimmer, ReplicatedPG::NotTrimming, std::allocator<void>, boost::statechart::null_exception_translator>::process_event(boost::statechart::event_base const&)+0x2b) [0x5e12cb]
15: (ReplicatedPG::snap_trimmer()+0x4f7) [0x579d27]
16: (OSD::SnapTrimWQ::_process(PG*)+0x14) [0x652b94]
17: (ThreadPool::worker(ThreadPool::WorkThread*)+0x579) [0x8aaf79]
18: (ThreadPool::WorkThread::entry()+0x10) [0x8ad0e0]
19: (()+0x84f8) [0x7fe6c37ec4f8]
20: (clone()+0x6d) [0x7fe6c164976d]

Attached this part of log and compressed both full logs.


Files

ceph-osd.3.log1 (398 KB) ceph-osd.3.log1 Denis kaganovich, 05/08/2013 05:48 AM
osdbug.tar.gz (8.29 MB) osdbug.tar.gz Denis kaganovich, 05/08/2013 05:48 AM
ceph-osd.5.log.gz (21.6 MB) ceph-osd.5.log.gz Denis kaganovich, 05/10/2013 06:59 AM
trim-lost.patch (742 Bytes) trim-lost.patch Denis kaganovich, 05/14/2013 07:58 PM
Actions

Also available in: Atom PDF