Bug #47684
cephadm: auth get failed: failed to find osd.27 in keyring retval: -2
% Done:
0%
Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Description
Sep 29 03:53:01 sn-m01 bash[184377]: debug 2020-09-29T03:53:01.500+0000 7f70d9f88700 -1 log_channel(cluster) log [ERR] : Unhandled exception from module 'cephadm' while running on mgr.sn-m01: auth get failed: failed to find osd.27 in keyring retval: -2 Sep 29 03:53:01 sn-m01 bash[184377]: debug 2020-09-29T03:53:01.500+0000 7f70d9f88700 -1 cephadm.serve: Sep 29 03:53:01 sn-m01 bash[184377]: debug 2020-09-29T03:53:01.500+0000 7f70d9f88700 -1 Traceback (most recent call last): Sep 29 03:53:01 sn-m01 bash[184377]: File "/usr/share/ceph/mgr/cephadm/module.py", line 513, in serve Sep 29 03:53:01 sn-m01 bash[184377]: if self.upgrade.continue_upgrade(): Sep 29 03:53:01 sn-m01 bash[184377]: File "/usr/share/ceph/mgr/cephadm/upgrade.py", line 150, in continue_upgrade Sep 29 03:53:01 sn-m01 bash[184377]: self._do_upgrade() Sep 29 03:53:01 sn-m01 bash[184377]: File "/usr/share/ceph/mgr/cephadm/upgrade.py", line 315, in _do_upgrade Sep 29 03:53:01 sn-m01 bash[184377]: image=target_name Sep 29 03:53:01 sn-m01 bash[184377]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1637, in _daemon_action Sep 29 03:53:01 sn-m01 bash[184377]: return self._create_daemon(daemon_spec) Sep 29 03:53:01 sn-m01 bash[184377]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1890, in _create_daemon Sep 29 03:53:01 sn-m01 bash[184377]: cephadm_config, deps = self.cephadm_services[daemon_spec.daemon_type].generate_config(daemon_spec) Sep 29 03:53:01 sn-m01 bash[184377]: File "/usr/share/ceph/mgr/cephadm/services/cephadmservice.py", line 97, in generate_config Sep 29 03:53:01 sn-m01 bash[184377]: extra_ceph_config=daemon_spec.extra_config.pop('config', '')) Sep 29 03:53:01 sn-m01 bash[184377]: File "/usr/share/ceph/mgr/cephadm/module.py", line 1860, in _get_config_and_keyring Sep 29 03:53:01 sn-m01 bash[184377]: 'entity': ename, Sep 29 03:53:01 sn-m01 bash[184377]: File "/usr/share/ceph/mgr/mgr_module.py", line 1102, in check_mon_command Sep 29 03:53:01 sn-m01 bash[184377]: raise MonCommandFailed(f'{cmd_dict["prefix"]} failed: {r.stderr} retval: {r.retval}') Sep 29 03:53:01 sn-m01 bash[184377]: mgr_module.MonCommandFailed: auth get failed: failed to find osd.27 in keyring retval: -2
for the full logg see: https://tracker.ceph.com/attachments/download/5161/mgr.zip
Related issues
History
#1 Updated by Sebastian Wagner over 3 years ago
- Related to Bug #47580: cephadm: "Error ENOENT: Module not found": TypeError: type object argument after ** must be a mapping, not NoneType added
#2 Updated by Sebastian Wagner over 3 years ago
- Description updated (diff)
#3 Updated by Sebastian Wagner over 3 years ago
- Priority changed from Normal to High
#4 Updated by Sebastian Wagner over 3 years ago
- Priority changed from High to Urgent
#5 Updated by Sebastian Wagner over 3 years ago
- Status changed from New to In Progress
- Assignee set to Sebastian Wagner
#6 Updated by Sebastian Wagner over 3 years ago
- Status changed from In Progress to Fix Under Review
- Pull request ID set to 38130
#7 Updated by Sebastian Wagner over 3 years ago
workaround seems to be to manually remove the osd from cephadm's config-key store.
#8 Updated by Sebastian Wagner about 3 years ago
- Status changed from Fix Under Review to Resolved