Project

General

Profile

Actions

Bug #50512

closed

upgrade:nautilus-p2p-nautilus: unhandled event in ToDelete

Added by Yuri Weinstein about 3 years ago. Updated over 2 years ago.

Status:
Won't Fix - EOL
Priority:
High
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Run: https://pulpito.ceph.com/teuthology-2021-04-22_01:25:03-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/
Job: 6063346
Logs: http://qa-proxy.ceph.com/teuthology/teuthology-2021-04-22_01:25:03-upgrade:nautilus-p2p-nautilus-distro-basic-smithi/6063346/teuthology.log


2021-04-25T19:15:43.040 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops
2021-04-25T19:15:43.084 INFO:tasks.ceph.osd.0.smithi061.stderr:2021-04-25 19:15:43.077 7fd866157700 -1 received  signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0  (PID: 49529) UID: 0
2021-04-25T19:15:43.116 INFO:tasks.ceph.osd.1.smithi061.stderr:/build/ceph-14.2.20-122-g859f0048/src/osd/PG.cc: In function 'PG::RecoveryState::Crashed::Crashed(boost::statechart::state<PG::RecoveryState::Crashed, PG::RecoveryState::RecoveryMachine>::my_context)' thread 7f734d85e700 time 2021-04-25 19:15:43.101572
2021-04-25T19:15:43.116 INFO:tasks.ceph.osd.1.smithi061.stderr:/build/ceph-14.2.20-122-g859f0048/src/osd/PG.cc: 7274: ceph_abort_msg("we got a bad state machine event")
2021-04-25T19:15:43.116 INFO:tasks.ceph.osd.1.smithi061.stderr: ceph version 14.2.20-122-g859f004880 (859f004880bea953eac8dad0f0febb2132fd00f4) nautilus (stable)
2021-04-25T19:15:43.116 INFO:tasks.ceph.osd.1.smithi061.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xdf) [0x848108]
2021-04-25T19:15:43.116 INFO:tasks.ceph.osd.1.smithi061.stderr: 2: (PG::RecoveryState::Crashed::Crashed(boost::statechart::state<PG::RecoveryState::Crashed, PG::RecoveryState::RecoveryMachine, boost::mpl::list<mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na>, (boost::statechart::history_mode)0>::my_context)+0xd9) [0x9a3049]
2021-04-25T19:15:43.116 INFO:tasks.ceph.osd.1.smithi061.stderr: 3: ceph-osd() [0x9c2266]
2021-04-25T19:15:43.116 INFO:tasks.ceph.osd.1.smithi061.stderr: 4: (boost::statechart::simple_state<PG::RecoveryState::Started, PG::RecoveryState::RecoveryMachine, PG::RecoveryState::Start, (boost::statechart::history_mode)0>::react_impl(boost::statechart::event_base const&, void const*)+0x24b) [0xa044cb]
2021-04-25T19:15:43.116 INFO:tasks.ceph.osd.1.smithi061.stderr: 5: (boost::statechart::simple_state<PG::RecoveryState::WaitDeleteReserved, PG::RecoveryState::ToDelete, boost::mpl::list<mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na>, (boost::statechart::history_mode)0>::react_impl(boost::statechart::event_base const&, void const*)+0xc1) [0x9ff651]
2021-04-25T19:15:43.117 INFO:tasks.ceph.osd.1.smithi061.stderr: 6: (boost::statechart::state_machine<PG::RecoveryState::RecoveryMachine, PG::RecoveryState::Initial, std::allocator<boost::statechart::none>, boost::statechart::null_exception_translator>::process_event(boost::statechart::event_base const&)+0x6b) [0x9d22cb]
2021-04-25T19:15:43.117 INFO:tasks.ceph.osd.1.smithi061.stderr: 7: (PG::do_peering_event(std::shared_ptr<PGPeeringEvent>, PG::RecoveryCtx*)+0x122) [0x9c1ad2]
2021-04-25T19:15:43.117 INFO:tasks.ceph.osd.1.smithi061.stderr: 8: (OSD::dequeue_peering_evt(OSDShard*, PG*, std::shared_ptr<PGPeeringEvent>, ThreadPool::TPHandle&)+0x1b4) [0x8f51a4]
2021-04-25T19:15:43.117 INFO:tasks.ceph.osd.1.smithi061.stderr: 9: (PGPeeringItem::run(OSD*, OSDShard*, boost::intrusive_ptr<PG>&, ThreadPool::TPHandle&)+0x50) [0xb84660]
2021-04-25T19:15:43.117 INFO:tasks.ceph.osd.1.smithi061.stderr: 10: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xbed) [0x8e8a5d]
2021-04-25T19:15:43.117 INFO:tasks.ceph.osd.1.smithi061.stderr: 11: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0xf05e4c]
2021-04-25T19:15:43.117 INFO:tasks.ceph.osd.1.smithi061.stderr: 12: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0xf09010]

2021-04-25T19:15:43.117 INFO:tasks.ceph.osd.1.smithi061.stderr: 13: (()+0x76ba) [0x7f73784246ba]
2021-04-25T19:15:43.117 INFO:tasks.ceph.osd.1.smithi061.stderr: 14: (clone()+0x6d) [0x7f7377a2b41d]
2021-04-25T19:15:43.117 INFO:tasks.ceph.osd.1.smithi061.stderr:2021-04-25 19:15:43.109 7f734d85e700 -1 /build/ceph-14.2.20-122-g859f0048/src/osd/PG.cc: In function 'PG::RecoveryState::Crashed::Crashed(boost::statechart::state<PG::RecoveryState::Crashed, PG::RecoveryState::RecoveryMachine>::my_context)' thread 7f734d85e700 time 2021-04-25 19:15:43.101572
2021-04-25T19:15:43.117 INFO:tasks.ceph.osd.1.smithi061.stderr:/build/ceph-14.2.20-122-g859f0048/src/osd/PG.cc: 7274: ceph_abort_msg("we got a bad state machine event")
2021-04-25T19:15:43.117 INFO:tasks.ceph.osd.1.smithi061.stderr:
2021-04-25T19:15:43.118 INFO:tasks.ceph.osd.1.smithi061.stderr: ceph version 14.2.20-122-g859f004880 (859f004880bea953eac8dad0f0febb2132fd00f4) nautilus (stable)
2021-04-25T19:15:43.118 INFO:tasks.ceph.osd.1.smithi061.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xdf) [0x848108]
2021-04-25T19:15:43.118 INFO:tasks.ceph.osd.1.smithi061.stderr: 2: (PG::RecoveryState::Crashed::Crashed(boost::statechart::state<PG::RecoveryState::Crashed, PG::RecoveryState::RecoveryMachine, boost::mpl::list<mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na>, (boost::statechart::history_mode)0>::my_context)+0xd9) [0x9a3049]
2021-04-25T19:15:43.118 INFO:tasks.ceph.osd.1.smithi061.stderr: 3: ceph-osd() [0x9c2266]
2021-04-25T19:15:43.118 INFO:tasks.ceph.osd.1.smithi061.stderr: 4: (boost::statechart::simple_state<PG::RecoveryState::Started, PG::RecoveryState::RecoveryMachine, PG::RecoveryState::Start, (boost::statechart::history_mode)0>::react_impl(boost::statechart::event_base const&, void const*)+0x24b) [0xa044cb]
2021-04-25T19:15:43.118 INFO:tasks.ceph.osd.1.smithi061.stderr: 5: (boost::statechart::simple_state<PG::RecoveryState::WaitDeleteReserved, PG::RecoveryState::ToDelete, boost::mpl::list<mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na>, (boost::statechart::history_mode)0>::react_impl(boost::statechart::event_base const&, void const*)+0xc1) [0x9ff651]
2021-04-25T19:15:43.118 INFO:tasks.ceph.osd.1.smithi061.stderr: 6: (boost::statechart::state_machine<PG::RecoveryState::RecoveryMachine, PG::RecoveryState::Initial, std::allocator<boost::statechart::none>, boost::statechart::null_exception_translator>::process_event(boost::statechart::event_base const&)+0x6b) [0x9d22cb]
2021-04-25T19:15:43.118 INFO:tasks.ceph.osd.1.smithi061.stderr: 7: (PG::do_peering_event(std::shared_ptr<PGPeeringEvent>, PG::RecoveryCtx*)+0x122) [0x9c1ad2]
2021-04-25T19:15:43.118 INFO:tasks.ceph.osd.1.smithi061.stderr: 8: (OSD::dequeue_peering_evt(OSDShard*, PG*, std::shared_ptr<PGPeeringEvent>, ThreadPool::TPHandle&)+0x1b4) [0x8f51a4]
2021-04-25T19:15:43.118 INFO:tasks.ceph.osd.1.smithi061.stderr: 9: (PGPeeringItem::run(OSD*, OSDShard*, boost::intrusive_ptr<PG>&, ThreadPool::TPHandle&)+0x50) [0xb84660]
2021-04-25T19:15:43.118 INFO:tasks.ceph.osd.1.smithi061.stderr: 10: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xbed) [0x8e8a5d]
2021-04-25T19:15:43.118 INFO:tasks.ceph.osd.1.smithi061.stderr: 11: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0xf05e4c]
2021-04-25T19:15:43.118 INFO:tasks.ceph.osd.1.smithi061.stderr: 12: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0xf09010]
2021-04-25T19:15:43.119 INFO:tasks.ceph.osd.1.smithi061.stderr: 13: (()+0x76ba) [0x7f73784246ba]
2021-04-25T19:15:43.119 INFO:tasks.ceph.osd.1.smithi061.stderr: 14: (clone()+0x6d) [0x7f7377a2b41d]
2021-04-25T19:15:43.119 INFO:tasks.ceph.osd.1.smithi061.stderr:*** Caught signal (Aborted) **
2021-04-25T19:15:43.119 INFO:tasks.ceph.osd.1.smithi061.stderr: in thread 7f734d85e700 thread_name:tp_osd_tp
2021-04-25T19:15:43.119 INFO:tasks.ceph.osd.1.smithi061.stderr:
2021-04-25T19:15:43.124 INFO:tasks.ceph.osd.1.smithi061.stderr: ceph version 14.2.20-122-g859f004880 (859f004880bea953eac8dad0f0febb2132fd00f4) nautilus (stable)
2021-04-25T19:15:43.124 INFO:tasks.ceph.osd.1.smithi061.stderr: 1: (()+0x11390) [0x7f737842e390]
2021-04-25T19:15:43.124 INFO:tasks.ceph.osd.1.smithi061.stderr: 2: (gsignal()+0x38) [0x7f7377959428]
2021-04-25T19:15:43.124 INFO:tasks.ceph.osd.1.smithi061.stderr: 3: (abort()+0x16a) [0x7f737795b02a]
2021-04-25T19:15:43.124 INFO:tasks.ceph.osd.1.smithi061.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0x1b0) [0x8481d9]
2021-04-25T19:15:43.124 INFO:tasks.ceph.osd.1.smithi061.stderr: 5: (PG::RecoveryState::Crashed::Crashed(boost::statechart::state<PG::RecoveryState::Crashed, PG::RecoveryState::RecoveryMachine, boost::mpl::list<mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na>, (boost::statechart::history_mode)0>::my_context)+0xd9) [0x9a3049]
2021-04-25T19:15:43.124 INFO:tasks.ceph.osd.1.smithi061.stderr: 6: ceph-osd() [0x9c2266]
2021-04-25T19:15:43.124 INFO:tasks.ceph.osd.1.smithi061.stderr: 7: (boost::statechart::simple_state<PG::RecoveryState::Started, PG::RecoveryState::RecoveryMachine, PG::RecoveryState::Start, (boost::statechart::history_mode)0>::react_impl(boost::statechart::event_base const&, void const*)+0x24b) [0xa044cb]
2021-04-25T19:15:43.124 INFO:tasks.ceph.osd.1.smithi061.stderr: 8: (boost::statechart::simple_state<PG::RecoveryState::WaitDeleteReserved, PG::RecoveryState::ToDelete, boost::mpl::list<mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na, mpl_::na>, (boost::statechart::history_mode)0>::react_impl(boost::statechart::event_base const&, void const*)+0xc1) [0x9ff651]
2021-04-25T19:15:43.124 INFO:tasks.ceph.osd.1.smithi061.stderr: 9: (boost::statechart::state_machine<PG::RecoveryState::RecoveryMachine, PG::RecoveryState::Initial, std::allocator<boost::statechart::none>, boost::statechart::null_exception_translator>::process_event(boost::statechart::event_base const&)+0x6b) [0x9d22cb]
2021-04-25T19:15:43.125 INFO:tasks.ceph.osd.1.smithi061.stderr: 10: (PG::do_peering_event(std::shared_ptr<PGPeeringEvent>, PG::RecoveryCtx*)+0x122) [0x9c1ad2]
2021-04-25T19:15:43.125 INFO:tasks.ceph.osd.1.smithi061.stderr: 11: (OSD::dequeue_peering_evt(OSDShard*, PG*, std::shared_ptr<PGPeeringEvent>, ThreadPool::TPHandle&)+0x1b4) [0x8f51a4]
2021-04-25T19:15:43.125 INFO:tasks.ceph.osd.1.smithi061.stderr: 12: (PGPeeringItem::run(OSD*, OSDShard*, boost::intrusive_ptr<PG>&, ThreadPool::TPHandle&)+0x50) [0xb84660]
2021-04-25T19:15:43.125 INFO:tasks.ceph.osd.1.smithi061.stderr: 13: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xbed) [0x8e8a5d]
2021-04-25T19:15:43.125 INFO:tasks.ceph.osd.1.smithi061.stderr: 14: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0xf05e4c]
2021-04-25T19:15:43.125 INFO:tasks.ceph.osd.1.smithi061.stderr: 15: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0xf09010]
2021-04-25T19:15:43.125 INFO:tasks.ceph.osd.1.smithi061.stderr: 16: (()+0x76ba) [0x7f73784246ba]
2021-04-25T19:15:43.125 INFO:tasks.ceph.osd.1.smithi061.stderr: 17: (clone()+0x6d) [0x7f7377a2b41d]

Actions #1

Updated by Neha Ojha about 3 years ago

  • Subject changed from "PG::RecoveryState::Crashed" in upgrade:nautilus-p2p-nautilus to upgrade:nautilus-p2p-nautilus: unhandled event in ToDelete
  • Priority changed from Normal to High
2021-04-25 19:15:43.097 7f734d85e700  5 osd.1 pg_epoch: 435 pg[5.a( v 345'7845 lc 0'0 (345'7842,345'7845] lb MIN (bitwise) local-lis/les=317/318 n=3481 ec=282/282 lis/c 351/287 les/c/f 352/288/0 423/434/388) [6] r=-1 lpr=434 pi=[287,43
4)/1 crt=345'7845 lcod 345'7844 unknown NOTIFY mbc={}] enter Started/ToDelete/Deleting
2021-04-25 19:15:43.097 7f734d85e700 10 osd.1 pg_epoch: 435 pg[5.a( v 345'7845 lc 0'0 (345'7842,345'7845] lb MIN (bitwise) local-lis/les=317/318 n=3481 ec=282/282 lis/c 351/287 les/c/f 352/288/0 423/434/388) [6] r=-1 lpr=434 DELETING p
i=[287,434)/1 crt=345'7845 lcod 345'7844 unknown NOTIFY mbc={}] on_removal
2021-04-25 19:15:43.097 7f734d85e700 10 osd.1 pg_epoch: 435 pg[5.a( v 345'7845 lc 0'0 (345'7842,345'7845] lb MIN (bitwise) local-lis/les=317/318 n=3481 ec=282/282 lis/c 351/287 les/c/f 352/288/0 423/434/388) [6] r=-1 lpr=434 DELETING p
i=[287,434)/1 crt=345'7845 lcod 345'7844 unknown NOTIFY mbc={}] on_shutdown
2021-04-25 19:15:43.097 7f734d85e700 10 osd.1 pg_epoch: 435 pg[5.a( v 345'7845 lc 0'0 (345'7842,345'7845] lb MIN (bitwise) local-lis/les=317/318 n=3481 ec=282/282 lis/c 351/287 les/c/f 352/288/0 423/434/388) [6] r=-1 lpr=434 DELETING p
i=[287,434)/1 crt=345'7845 lcod 345'7844 unknown NOTIFY mbc={}] cancel_copy_ops
2021-04-25 19:15:43.097 7f734d85e700 10 osd.1 pg_epoch: 435 pg[5.a( v 345'7845 lc 0'0 (345'7842,345'7845] lb MIN (bitwise) local-lis/les=317/318 n=3481 ec=282/282 lis/c 351/287 les/c/f 352/288/0 423/434/388) [6] r=-1 lpr=434 DELETING p
i=[287,434)/1 crt=345'7845 lcod 345'7844 unknown NOTIFY mbc={}] cancel_flush_ops
2021-04-25 19:15:43.097 7f734d85e700 10 osd.1 pg_epoch: 435 pg[5.a( v 345'7845 lc 0'0 (345'7842,345'7845] lb MIN (bitwise) local-lis/les=317/318 n=3481 ec=282/282 lis/c 351/287 les/c/f 352/288/0 423/434/388) [6] r=-1 lpr=434 DELETING p
i=[287,434)/1 crt=345'7845 lcod 345'7844 unknown NOTIFY mbc={}] cancel_proxy_ops
2021-04-25 19:15:43.097 7f734d85e700 10 osd.1 pg_epoch: 435 pg[5.a( v 345'7845 lc 0'0 (345'7842,345'7845] lb MIN (bitwise) local-lis/les=317/318 n=3481 ec=282/282 lis/c 351/287 les/c/f 352/288/0 423/434/388) [6] r=-1 lpr=434 DELETING p
i=[287,434)/1 crt=345'7845 lcod 345'7844 unknown NOTIFY mbc={}] clear_backoffs 
2021-04-25 19:15:43.097 7f734d85e700 20 osd.1 pg_epoch: 435 pg[5.a( v 345'7845 lc 0'0 (345'7842,345'7845] lb MIN (bitwise) local-lis/les=317/318 n=3481 ec=282/282 lis/c 351/287 les/c/f 352/288/0 423/434/388) [6] r=-1 lpr=434 DELETING p
i=[287,434)/1 crt=345'7845 lcod 345'7844 unknown NOTIFY mbc={}] exit NotTrimming
2021-04-25 19:15:43.097 7f734d85e700 20 osd.1 pg_epoch: 435 pg[5.a( v 345'7845 lc 0'0 (345'7842,345'7845] lb MIN (bitwise) local-lis/les=317/318 n=3481 ec=282/282 lis/c 351/287 les/c/f 352/288/0 423/434/388) [6] r=-1 lpr=434 DELETING p
i=[287,434)/1 crt=345'7845 lcod 345'7844 unknown NOTIFY mbc={}] enter NotTrimming
2021-04-25 19:15:43.097 7f734d85e700 10 osd.1 pg_epoch: 435 pg[5.a( v 345'7845 lc 0'0 (345'7842,345'7845] lb MIN (bitwise) local-lis/les=317/318 n=3481 ec=282/282 lis/c 351/287 les/c/f 352/288/0 423/434/388) [6] r=-1 lpr=434 DELETING p
i=[287,434)/1 crt=345'7845 lcod 345'7844 unknown NOTIFY mbc={}] on_change
2021-04-25 19:15:43.097 7f734d85e700 10 osd.1 pg_epoch: 435 pg[5.a( v 345'7845 lc 0'0 (345'7842,345'7845] lb MIN (bitwise) local-lis/les=317/318 n=3481 ec=282/282 lis/c 351/287 les/c/f 352/288/0 423/434/388) [6] r=-1 lpr=434 DELETING p
i=[287,434)/1 crt=345'7845 lcod 345'7844 unknown NOTIFY mbc={}] clear_async_reads
2021-04-25 19:15:43.097 7f734d85e700 10 osd.1 pg_epoch: 435 pg[5.a( v 345'7845 lc 0'0 (345'7842,345'7845] lb MIN (bitwise) local-lis/les=317/318 n=3481 ec=282/282 lis/c 351/287 les/c/f 352/288/0 423/434/388) [6] r=-1 lpr=434 DELETING p
i=[287,434)/1 crt=345'7845 lcod 345'7844 unknown NOTIFY mbc={}] clear_primary_state
2021-04-25 19:15:43.097 7f734d85e700 10 osd.1 pg_epoch: 435 pg[5.a( v 345'7845 lc 0'0 (345'7842,345'7845] lb MIN (bitwise) local-lis/les=317/318 n=3481 ec=282/282 lis/c 351/287 les/c/f 352/288/0 423/434/388) [6] r=-1 lpr=434 DELETING p
i=[287,434)/1 crt=345'7845 lcod 345'7844 unknown NOTIFY mbc={}] release_backoffs [5:50000000::::0,5:58000000::::head)
2021-04-25 19:15:43.097 7f734d85e700 20 osd.1 pg_epoch: 435 pg[5.a( v 345'7845 lc 0'0 (345'7842,345'7845] lb MIN (bitwise) local-lis/les=317/318 n=3481 ec=282/282 lis/c 351/287 les/c/f 352/288/0 423/434/388) [6] r=-1 lpr=434 DELETING p
i=[287,434)/1 crt=345'7845 lcod 345'7844 unknown NOTIFY mbc={}] agent_stop
2021-04-25 19:15:43.097 7f734d85e700 10 osd.1 pg_epoch: 435 pg[5.a( v 345'7845 lc 0'0 (345'7842,345'7845] lb MIN (bitwise) local-lis/les=317/318 n=3481 ec=282/282 lis/c 351/287 les/c/f 352/288/0 423/434/388) [6] r=-1 lpr=434 DELETING p
i=[287,434)/1 crt=345'7845 lcod 345'7844 unknown NOTIFY mbc={}] cancel_recovery
2021-04-25 19:15:43.097 7f734d85e700 10 osd.1 pg_epoch: 435 pg[5.a( v 345'7845 lc 0'0 (345'7842,345'7845] lb MIN (bitwise) local-lis/les=317/318 n=3481 ec=282/282 lis/c 351/287 les/c/f 352/288/0 423/434/388) [6] r=-1 lpr=434 DELETING p
i=[287,434)/1 crt=345'7845 lcod 345'7844 unknown NOTIFY mbc={}] clear_recovery_state
2021-04-25 19:15:43.097 7f734d85e700 10 log is not dirty
2021-04-25 19:15:43.097 7f734d85e700 20 osd.1 op_wq(2) _process 5.1a to_process <> waiting <> waiting_peering {}
2021-04-25 19:15:43.097 7f734d85e700 20 osd.1 op_wq(2) _process OpQueueItem(5.1a PGPeeringEvent(epoch_sent: 435 epoch_requested: 435 MQuery 5.1a from 6 query_epoch 435 query: query(fulllog 0'0 epoch_sent 435)) prio 255 cost 10 e435) qu
eued
2021-04-25 19:15:43.097 7f734d85e700 20 osd.1 op_wq(2) _process 5.1a to_process <OpQueueItem(5.1a PGPeeringEvent(epoch_sent: 435 epoch_requested: 435 MQuery 5.1a from 6 query_epoch 435 query: query(fulllog 0'0 epoch_sent 435)) prio 255
 cost 10 e435)> waiting <> waiting_peering {}
2021-04-25 19:15:43.097 7f734d85e700 20 osd.1 op_wq(2) _process OpQueueItem(5.1a PGPeeringEvent(epoch_sent: 435 epoch_requested: 435 MQuery 5.1a from 6 query_epoch 435 query: query(fulllog 0'0 epoch_sent 435)) prio 255 cost 10 e435) pg
 0x1af78000
2021-04-25 19:15:43.097 7f734d85e700 10 osd.1 pg_epoch: 435 pg[5.1a( v 345'7845 lc 0'0 (345'7842,345'7845] lb MIN (bitwise) local-lis/les=317/318 n=3481 ec=434/282 lis/c 423/388 les/c/f 424/389/0 423/434/388) [6] r=-1 lpr=434 pi=[287,4
34)/1 crt=345'7845 unknown NOTIFY mbc={}] do_peering_event: epoch_sent: 435 epoch_requested: 435 MQuery 5.1a from 6 query_epoch 435 query: query(fulllog 0'0 epoch_sent 435)
2021-04-25 19:15:43.097 7f734d85e700  5 osd.1 pg_epoch: 435 pg[5.1a( v 345'7845 lc 0'0 (345'7842,345'7845] lb MIN (bitwise) local-lis/les=317/318 n=3481 ec=434/282 lis/c 423/388 les/c/f 424/389/0 423/434/388) [6] r=-1 lpr=434 pi=[287,4
34)/1 crt=345'7845 unknown NOTIFY mbc={}] exit Started/ToDelete/WaitDeleteReseved 0.000183 1 0.000019
2021-04-25 19:15:43.097 7f734d85e700  5 osd.1 pg_epoch: 435 pg[5.1a( v 345'7845 lc 0'0 (345'7842,345'7845] lb MIN (bitwise) local-lis/les=317/318 n=3481 ec=434/282 lis/c 423/388 les/c/f 424/389/0 423/434/388) [6] r=-1 lpr=434 pi=[287,4
34)/1 crt=345'7845 unknown NOTIFY mbc={}] exit Started/ToDelete 0.000195 0 0.000000
2021-04-25 19:15:43.097 7f734d85e700  5 osd.1 pg_epoch: 435 pg[5.1a( v 345'7845 lc 0'0 (345'7842,345'7845] lb MIN (bitwise) local-lis/les=317/318 n=3481 ec=434/282 lis/c 423/388 les/c/f 424/389/0 423/434/388) [6] r=-1 lpr=434 pi=[287,4
34)/1 crt=345'7845 unknown NOTIFY mbc={}] exit Started 0.008490 0 0.000000
2021-04-25 19:15:43.097 7f734d85e700  5 osd.1 pg_epoch: 435 pg[5.1a( v 345'7845 lc 0'0 (345'7842,345'7845] lb MIN (bitwise) local-lis/les=317/318 n=3481 ec=434/282 lis/c 423/388 les/c/f 424/389/0 423/434/388) [6] r=-1 lpr=434 pi=[287,4
34)/1 crt=345'7845 unknown NOTIFY mbc={}] enter Crashed
Actions #2

Updated by Neha Ojha over 2 years ago

  • Status changed from New to Won't Fix - EOL
Actions

Also available in: Atom PDF