Project

General

Profile

Actions

Bug #46266

open

Monitor crashed in creating pool in CrushTester::test_with_fork()

Added by Seena Fallah almost 4 years ago. Updated about 2 years ago.

Status:
Need More Info
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
2 - major
Reviewed:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):

275307d556e4147d2ad5a7a74064a399e0012d97a865818d4bc17099de946b81
28a321ddf7d0469a896f796efb595606803be806190be11dc931244282ea557f
3a900e112239b9f0ee9a5c0f2accebd4132ce2613d139114c86865629f7b5817
45a2f7bde520435b99e6b83ee775e35de18732b48ed56c14dd86c9d17403afb0
53ae5a7747df303d95f8f28697a631851e080413cebe024867883f015f182b06
59a9b122a0a1e02a2dce55c98c55e70a35d400e2dbc3b0e31d579ca6ae0b1566
5d341195e849d1b8fc568366d6076c61e65a91823896ea2fd1e408ed36f3f529
7a8bd7fbc442ee0139b78523e37d7d9450b5af67da77b679cfccf88299426d41
d6b6f43e0c31315c6493798edbb349f4cfb759ecb7984e8bf203ce12d7d3e312
f23756652603548a024c95c1877e753effe7bdd1473676104f3207deaac74488
fb70f56d305d105eaab078b0d53042c75054e5d4ac05cbf436ded29e7b18efea


Description

Hi. I was creating a new pool and one of my monitors crashed.

Jun 30 01:10:29 afra-mon2 ceph-mon[231520]: /build/ceph-14.2.9/src/common/fork_function.h: In function 'int fork_function(int, std::ostream&, std::function<signed char()>)' thread 7fb044366700 time 2020-06-30 01
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]: /build/ceph-14.2.9/src/common/fork_function.h: 34: FAILED ceph_assert((*__errno_location ()) == 4)
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  ceph version 14.2.9 (581f22da52345dba46ee232b73b990f06029a2a0) nautilus (stable)
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7fb052913e22]
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7fb052913ffd]
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  3: (CrushTester::test_with_fork(int)+0x81d) [0x7fb052e8e3dd]
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  4: (OSDMonitor::prepare_new_pool(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&, int, std::__cxx11::basic_string<char, std::char_tra
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  5: (OSDMonitor::prepare_command_impl(boost::intrusive_ptr<MonOpRequest>, std::map<std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >, boo
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  6: (OSDMonitor::prepare_command(boost::intrusive_ptr<MonOpRequest>)+0x122) [0x55c389edccb2]
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  7: (OSDMonitor::prepare_update(boost::intrusive_ptr<MonOpRequest>)+0x193) [0x55c389ee0fc3]
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  8: (PaxosService::dispatch(boost::intrusive_ptr<MonOpRequest>)+0x9be) [0x55c389e63d3e]
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  9: (PaxosService::C_RetryMessage::_finish(int)+0x64) [0x55c389dd79c4]
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  10: (C_MonOp::finish(int)+0x45) [0x55c389d7d0d5]
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  11: (Context::complete(int)+0x9) [0x55c389d7a449]
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  12: (void finish_contexts<std::__cxx11::list<Context*, std::allocator<Context*> > >(CephContext*, std::__cxx11::list<Context*, std::allocator<Context*> >&, int)+0xa8)
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  13: (Paxos::finish_round()+0x9b) [0x55c389e5b38b]
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  14: (Paxos::handle_last(boost::intrusive_ptr<MonOpRequest>)+0xbff) [0x55c389e5c56f]
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  15: (Paxos::dispatch(boost::intrusive_ptr<MonOpRequest>)+0x24b) [0x55c389e5cffb]
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  16: (Monitor::dispatch_op(boost::intrusive_ptr<MonOpRequest>)+0x15c5) [0x55c389d743c5]
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  17: (Monitor::_ms_dispatch(Message*)+0x4ca) [0x55c389d74a0a]
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  18: (Monitor::ms_dispatch(Message*)+0x26) [0x55c389da4bd6]
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  19: (Dispatcher::ms_dispatch2(boost::intrusive_ptr<Message> const&)+0x26) [0x55c389da0bb6]
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  20: (DispatchQueue::entry()+0x1219) [0x7fb052b3e539]
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  21: (DispatchQueue::DispatchThread::entry()+0xd) [0x7fb052bee93d]
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  22: (()+0x76db) [0x7fb05178b6db]
Jun 30 01:10:29 afra-mon2 ceph-mon[231520]:  23: (clone()+0x3f) [0x7fb05097188f]


Related issues 2 (1 open1 closed)

Related to RADOS - Bug #57782: [mon] high cpu usage by fn_monstore threadFix Under Review

Actions
Has duplicate RADOS - Bug #51877: crash: int fork_function(int, std::ostream&, std::function<signed char()>): assert((*__errno_location ()) == 4)Duplicate

Actions
Actions

Also available in: Atom PDF