Project

General

Profile

Actions
Copy link

Bug #54829

open

crash: void OSDMap::check_health(ceph::common::CephContext*, health_check_map_t*) const: assert(num_down_in_osds <= num_in_osds)

Added by Telemetry Bot about 2 years ago. Updated 12 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Telemetry
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
Ceph - v16.2.7, Ceph - v16.2.9, Ceph - v17.2.0, Ceph - v17.2.1, Ceph - v17.2.5
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):

06a12e029fd996fe040cb16b3238e36072f133b895d893d021382accb03674b6
6300ceac18516e975f96085938faf660be07f34ce2fe4eae289b8d684377ffd7
d54953bf630e685148c8bb57241b0739c17a9471813469e8cdf727aa6f75905e
0b7dd1e3d34aa970f475aeb780a21c036daade4bf521cceaee8259acf8f15270
2776c5d89450971681022397da3dbd397afd21386bde33a443d88ea0b93eec80
3b46c39bed1a76369857e89ec3348964b53c19b2585b6b67a4ef8f1931329686
da5da17121fb6317e52db10a9215d4e460a95d4fd54aabcde5a4edbadc76a193

Crash signature (v2):

0bd94e8d39bae181e6968ee78ce4c954edb223e93eba71d0b1458eac90d106e6

Description

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=0bd94e8d39bae181e6968ee78ce4c954edb223e93eba71d0b1458eac90d106e6

Assert condition: num_down_in_osds <= num_in_osds
Assert function: void OSDMap::check_health(ceph::common::CephContext*, health_check_map_t*) const

Sanitized backtrace:

    OSDMap::check_health(ceph::common::CephContext*, health_check_map_t*) const
    OSDMonitor::encode_pending(std::shared_ptr<MonitorDBStore::Transaction>)
    PaxosService::propose_pending()
    Context::complete(int)
    CommonSafeTimer<std::mutex>::timer_thread()
    CommonSafeTimerThread<std::mutex>::entry()

Crash dump sample:
{
    "archived": "2022-03-16 21:34:28.660957",
    "assert_condition": "num_down_in_osds <= num_in_osds",
    "assert_file": "osd/OSDMap.cc",
    "assert_func": "void OSDMap::check_health(ceph::common::CephContext*, health_check_map_t*) const",
    "assert_line": 5704,
    "assert_msg": "osd/OSDMap.cc: In function 'void OSDMap::check_health(ceph::common::CephContext*, health_check_map_t*) const' thread 7f5676582700 time 2022-03-16T21:03:16.231128+0000\nosd/OSDMap.cc: 5704: FAILED ceph_assert(num_down_in_osds <= num_in_osds)",
    "assert_thread_name": "safe_timer",
    "backtrace": [
        "/lib64/libpthread.so.0(+0x12ce0) [0x7f567f3face0]",
        "gsignal()",
        "abort()",
        "(ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a9) [0x7f56816beba3]",
        "/usr/lib64/ceph/libceph-common.so.2(+0x276d6c) [0x7f56816bed6c]",
        "(OSDMap::check_health(ceph::common::CephContext*, health_check_map_t*) const+0x3e5e) [0x7f5681b0729e]",
        "(OSDMonitor::encode_pending(std::shared_ptr<MonitorDBStore::Transaction>)+0x3c38) [0x562c11a8c218]",
        "(PaxosService::propose_pending()+0x21a) [0x562c119fd9ea]",
        "/usr/bin/ceph-mon(+0x3fdde9) [0x562c119fdde9]",
        "(Context::complete(int)+0xd) [0x562c118ebdbd]",
        "(CommonSafeTimer<std::mutex>::timer_thread()+0x10f) [0x7f56817b395f]",
        "(CommonSafeTimerThread<std::mutex>::entry()+0x11) [0x7f56817b4cf1]",
        "/lib64/libpthread.so.0(+0x81cf) [0x7f567f3f01cf]",
        "clone()" 
    ],
    "ceph_version": "16.2.7",
    "crash_id": "2022-03-16T21:03:16.233120Z_160e0a7b-4bc1-40b0-bb91-237efdb3f894",
    "entity_name": "mon.676ff60aa64518d09da9bc045a405d9067b9815e",
    "os_id": "centos",
    "os_name": "CentOS Stream",
    "os_version": "8",
    "os_version_id": "8",
    "process_name": "ceph-mon",
    "stack_sig": "06a12e029fd996fe040cb16b3238e36072f133b895d893d021382accb03674b6",
    "timestamp": "2022-03-16T21:03:16.233120Z",
    "utsname_machine": "x86_64",
    "utsname_release": "5.15.0-0.bpo.3-amd64",
    "utsname_sysname": "Linux",
    "utsname_version": "#1 SMP Debian 5.15.15-2~bpo11+1 (2022-02-03)" 
}

Actions
Copy link

Also available in: Atom PDF