Project

General

Profile

Bug #56201

crash: void OSD::do_recovery(PG*, epoch_t, uint64_t, ThreadPool::TPHandle&): assert(started <= reserved_pushes)

Added by Telemetry Bot almost 2 years ago. Updated 11 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Telemetry
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):

0d19913147f55b489d3230ab2940fdc0d60648e572ff4ea7cc459a6924d3c329
628e789b60ac61fa99b36c9029134622c335ad737732d5182455165113e6f74d
fa52de0ad1d434b5b395c00e40f2ef342500c14e516a50ca4bded3ec2f8420c4
6460f533ef8da9178f1bff336cd86ac9daef6263636aa0c936462578e4b5d55f
a9fdb0559e74800d13f4db510d6f636f3e215594e0344e0b00a889bdb952763b
bc6653d3e97546ab91414a30719628328ac28d13a3678b2d73391ab3f89f0e91


Description

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=e11765511e1628fcf2a5254818ee21f8b853c2498f1b11bc08d3cc9301f9b24b

Assert condition: started <= reserved_pushes
Assert function: void OSD::do_recovery(PG*, epoch_t, uint64_t, ThreadPool::TPHandle&)

Sanitized backtrace:

    OSD::do_recovery(PG*, unsigned int, unsigned long, ThreadPool::TPHandle&)
    ceph::osd::scheduler::PGRecovery::run(OSD*, OSDShard*, boost::intrusive_ptr<PG>&, ThreadPool::TPHandle&)
    OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)
    ShardedThreadPool::shardedthreadpool_worker(unsigned int)
    ShardedThreadPool::WorkThreadSharded::entry()

Crash dump sample:
{
    "archived": "2022-05-17 10:25:06.390715",
    "assert_condition": "started <= reserved_pushes",
    "assert_file": "osd/OSD.cc",
    "assert_func": "void OSD::do_recovery(PG*, epoch_t, uint64_t, ThreadPool::TPHandle&)",
    "assert_line": 9659,
    "assert_msg": "osd/OSD.cc: In function 'void OSD::do_recovery(PG*, epoch_t, uint64_t, ThreadPool::TPHandle&)' thread ffff66fa6540 time 2022-05-17T07:03:11.434816+0000\nosd/OSD.cc: 9659: FAILED ceph_assert(started <= reserved_pushes)",
    "assert_thread_name": "tp_osd_tp",
    "backtrace": [
        "__kernel_rt_sigreturn()",
        "gsignal()",
        "abort()",
        "(ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1b4) [0xaaaaaf8aa548]",
        "(ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0xaaaaaf8aa6e8]",
        "(OSD::do_recovery(PG*, unsigned int, unsigned long, ThreadPool::TPHandle&)+0x5b0) [0xaaaaaf93e828]",
        "(ceph::osd::scheduler::PGRecovery::run(OSD*, OSDShard*, boost::intrusive_ptr<PG>&, ThreadPool::TPHandle&)+0x28) [0xaaaaafbd6010]",
        "(OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0xad8) [0xaaaaaf95db80]",
        "(ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x2f0) [0xaaaab0000258]",
        "(ShardedThreadPool::WorkThreadSharded::entry()+0x18) [0xaaaab0000e30]",
        "/lib64/libpthread.so.0(+0x78b8) [0xffff84b168b8]",
        "/lib64/libc.so.6(+0x23a3c) [0xffff84613a3c]" 
    ],
    "ceph_version": "17.2.0",
    "crash_id": "2022-05-17T07:03:11.452311Z_592869c5-92db-48b8-89f7-78dd9d0cf5cf",
    "entity_name": "osd.f8295543f96590c890f2ba9e897d9086cd98f604",
    "os_id": "centos",
    "os_name": "CentOS Stream",
    "os_version": "8",
    "os_version_id": "8",
    "process_name": "ceph-osd",
    "stack_sig": "0d19913147f55b489d3230ab2940fdc0d60648e572ff4ea7cc459a6924d3c329",
    "timestamp": "2022-05-17T07:03:11.452311Z",
    "utsname_machine": "aarch64",
    "utsname_release": "5.4.0-1059-raspi",
    "utsname_sysname": "Linux",
    "utsname_version": "#67-Ubuntu SMP PREEMPT Mon Apr 11 14:16:01 UTC 2022" 
}

History

#1 Updated by Telemetry Bot almost 2 years ago

  • Crash signature (v1) updated (diff)
  • Crash signature (v2) updated (diff)
  • Affected Versions v15.2.11, v17.2.0 added

#2 Updated by Telemetry Bot 11 months ago

  • Crash signature (v1) updated (diff)
  • Affected Versions v15.2.16, v17.2.3, v17.2.5 added

Also available in: Atom PDF