Project

General

Profile

Bug #47684

cephadm: auth get failed: failed to find osd.27 in keyring retval: -2

Added by Sebastian Wagner 2 months ago. Updated 17 days ago.

Status:
Fix Under Review
Priority:
Urgent
Category:
cephadm/osd
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature:

Description

Sep 29 03:53:01 sn-m01 bash[184377]: debug 2020-09-29T03:53:01.500+0000 7f70d9f88700 -1 log_channel(cluster) log [ERR] : Unhandled exception from module 'cephadm' while running on mgr.sn-m01: auth get failed: failed to find osd.27 in keyring retval: -2
Sep 29 03:53:01 sn-m01 bash[184377]: debug 2020-09-29T03:53:01.500+0000 7f70d9f88700 -1 cephadm.serve:
Sep 29 03:53:01 sn-m01 bash[184377]: debug 2020-09-29T03:53:01.500+0000 7f70d9f88700 -1 Traceback (most recent call last):
Sep 29 03:53:01 sn-m01 bash[184377]:   File "/usr/share/ceph/mgr/cephadm/module.py", line 513, in serve
Sep 29 03:53:01 sn-m01 bash[184377]:     if self.upgrade.continue_upgrade():
Sep 29 03:53:01 sn-m01 bash[184377]:   File "/usr/share/ceph/mgr/cephadm/upgrade.py", line 150, in continue_upgrade
Sep 29 03:53:01 sn-m01 bash[184377]:     self._do_upgrade()
Sep 29 03:53:01 sn-m01 bash[184377]:   File "/usr/share/ceph/mgr/cephadm/upgrade.py", line 315, in _do_upgrade
Sep 29 03:53:01 sn-m01 bash[184377]:     image=target_name
Sep 29 03:53:01 sn-m01 bash[184377]:   File "/usr/share/ceph/mgr/cephadm/module.py", line 1637, in _daemon_action
Sep 29 03:53:01 sn-m01 bash[184377]:     return self._create_daemon(daemon_spec)
Sep 29 03:53:01 sn-m01 bash[184377]:   File "/usr/share/ceph/mgr/cephadm/module.py", line 1890, in _create_daemon
Sep 29 03:53:01 sn-m01 bash[184377]:     cephadm_config, deps = self.cephadm_services[daemon_spec.daemon_type].generate_config(daemon_spec)
Sep 29 03:53:01 sn-m01 bash[184377]:   File "/usr/share/ceph/mgr/cephadm/services/cephadmservice.py", line 97, in generate_config
Sep 29 03:53:01 sn-m01 bash[184377]:     extra_ceph_config=daemon_spec.extra_config.pop('config', ''))
Sep 29 03:53:01 sn-m01 bash[184377]:   File "/usr/share/ceph/mgr/cephadm/module.py", line 1860, in _get_config_and_keyring
Sep 29 03:53:01 sn-m01 bash[184377]:     'entity': ename,
Sep 29 03:53:01 sn-m01 bash[184377]:   File "/usr/share/ceph/mgr/mgr_module.py", line 1102, in check_mon_command
Sep 29 03:53:01 sn-m01 bash[184377]:     raise MonCommandFailed(f'{cmd_dict["prefix"]} failed: {r.stderr} retval: {r.retval}')
Sep 29 03:53:01 sn-m01 bash[184377]: mgr_module.MonCommandFailed: auth get failed: failed to find osd.27 in keyring retval: -2

for the full logg see: https://tracker.ceph.com/attachments/download/5161/mgr.zip


Related issues

Related to Orchestrator - Bug #47580: cephadm: "Error ENOENT: Module not found": TypeError: type object argument after ** must be a mapping, not NoneType Pending Backport

History

#1 Updated by Sebastian Wagner 2 months ago

  • Related to Bug #47580: cephadm: "Error ENOENT: Module not found": TypeError: type object argument after ** must be a mapping, not NoneType added

#2 Updated by Sebastian Wagner 2 months ago

  • Description updated (diff)

#3 Updated by Sebastian Wagner 2 months ago

  • Priority changed from Normal to High

#4 Updated by Sebastian Wagner 2 months ago

  • Priority changed from High to Urgent

#5 Updated by Sebastian Wagner 17 days ago

  • Status changed from New to In Progress
  • Assignee set to Sebastian Wagner

#6 Updated by Sebastian Wagner 17 days ago

  • Status changed from In Progress to Fix Under Review
  • Pull request ID set to 38130

#7 Updated by Sebastian Wagner 17 days ago

workaround seems to be to manually remove the osd from cephadm's config-key store.

Also available in: Atom PDF