Project

General

Profile

Actions

Bug #56381

closed

crash: File "mgr/cephadm/module.py", in serve: serve.serve()

Added by Telemetry Bot almost 2 years ago. Updated 12 months ago.

Status:
Duplicate
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Telemetry
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):

aed6d21d9fe6ebdf5b48f76feaea1b448252cbc8c7500a4638e3d7ca63edc78d


Description

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=298dfc576212a8359390921e1f03bc50a1e5a48e152dbb6bffbf9a6f2397d1b1

Sanitized backtrace:

    File "mgr/cephadm/module.py", in serve: serve.serve()
    File "mgr/cephadm/serve.py", in serve: self._refresh_hosts_and_daemons()
    File "mgr/cephadm/serve.py", in _refresh_hosts_and_daemons: refresh(self.mgr.cache.get_hosts())
    File "mgr/cephadm/utils.py", in forall_hosts_wrapper: return CephadmOrchestrator.instance._worker_pool.map(do_work, vals)
    File "/lib64/python3.6/multiprocessing/pool.py", in map: return self._map_async(func, iterable, mapstar, chunksize).get()
    File "/lib64/python3.6/multiprocessing/pool.py", in get: raise self._value
    File "/lib64/python3.6/multiprocessing/pool.py", in worker: result = (True, func(*args, **kwds))
    File "/lib64/python3.6/multiprocessing/pool.py", in mapstar: return list(map(*args))
    File "mgr/cephadm/utils.py", in do_work: return f(*arg)
    File "mgr/cephadm/serve.py", in refresh: if self.mgr.inventory._inventory[host].get("status", "").lower() == "maintenance":

Crash dump sample:
{
    "backtrace": [
        "  File \"/usr/share/ceph/mgr/cephadm/module.py\", line 566, in serve\n    serve.serve()",
        "  File \"/usr/share/ceph/mgr/cephadm/serve.py\", line 70, in serve\n    self._refresh_hosts_and_daemons()",
        "  File \"/usr/share/ceph/mgr/cephadm/serve.py\", line 267, in _refresh_hosts_and_daemons\n    refresh(self.mgr.cache.get_hosts())",
        "  File \"/usr/share/ceph/mgr/cephadm/utils.py\", line 82, in forall_hosts_wrapper\n    return CephadmOrchestrator.instance._worker_pool.map(do_work, vals)",
        "  File \"/lib64/python3.6/multiprocessing/pool.py\", line 266, in map\n    return self._map_async(func, iterable, mapstar, chunksize).get()",
        "  File \"/lib64/python3.6/multiprocessing/pool.py\", line 644, in get\n    raise self._value",
        "  File \"/lib64/python3.6/multiprocessing/pool.py\", line 119, in worker\n    result = (True, func(*args, **kwds))",
        "  File \"/lib64/python3.6/multiprocessing/pool.py\", line 44, in mapstar\n    return list(map(*args))",
        "  File \"/usr/share/ceph/mgr/cephadm/utils.py\", line 76, in do_work\n    return f(*arg)",
        "  File \"/usr/share/ceph/mgr/cephadm/serve.py\", line 196, in refresh\n    if self.mgr.inventory._inventory[host].get(\"status\", \"\").lower() == \"maintenance\":",
        "<redacted>" 
    ],
    "ceph_version": "17.2.0",
    "crash_id": "2022-06-17T00:15:05.213211Z_fb08a651-6e3b-45fb-93c7-85bf36ba8dc8",
    "entity_name": "mgr.46c7b0f2407930a70c870aa8ae491dea7728588e",
    "mgr_module": "cephadm",
    "mgr_module_caller": "PyModuleRunner::serve",
    "mgr_python_exception": "KeyError",
    "os_id": "centos",
    "os_name": "CentOS Stream",
    "os_version": "8",
    "os_version_id": "8",
    "process_name": "ceph-mgr",
    "stack_sig": "a030c8bdfd7bb099505b915bb322eb6f09f138e5b975a97586a8b1d97cf8c82e",
    "timestamp": "2022-06-17T00:15:05.213211Z",
    "utsname_machine": "x86_64",
    "utsname_release": "4.18.0-301.1.el8.x86_64",
    "utsname_sysname": "Linux",
    "utsname_version": "#1 SMP Tue Apr 13 16:24:22 UTC 2021" 
}


Related issues 1 (1 open0 closed)

Is duplicate of Orchestrator - Bug #56100: Gibba Cluster: 17.2.0 to 17.2.1 RC upgrade - Cephadm MGR crash - in KeyErrorNewAdam King

Actions
Actions #1

Updated by Telemetry Bot almost 2 years ago

  • Crash signature (v1) updated (diff)
  • Crash signature (v2) updated (diff)
  • Affected Versions v17.2.0 added
Actions #2

Updated by Sebastian Wagner almost 2 years ago

  • Project changed from mgr to Orchestrator
Actions #3

Updated by Redouane Kachach Elhichou almost 2 years ago

  • Related to Bug #56100: Gibba Cluster: 17.2.0 to 17.2.1 RC upgrade - Cephadm MGR crash - in KeyError added
Actions #4

Updated by Adam King over 1 year ago

  • Status changed from New to Duplicate
Actions #5

Updated by Yaarit Hatuka 12 months ago

  • Is duplicate of Bug #56100: Gibba Cluster: 17.2.0 to 17.2.1 RC upgrade - Cephadm MGR crash - in KeyError added
Actions #6

Updated by Yaarit Hatuka 12 months ago

  • Related to deleted (Bug #56100: Gibba Cluster: 17.2.0 to 17.2.1 RC upgrade - Cephadm MGR crash - in KeyError)
Actions #7

Updated by Yaarit Hatuka 12 months ago

Since this issue is marked as "Duplicate" it needs to specify what issue it duplicates in the "Related Issues" field.
I changed the relation from "Related to" to "Duplicates" https://tracker.ceph.com/issues/56100.

Actions

Also available in: Atom PDF