Bug #50671: cephadm.py OSD status check fails 'no keyring found at /etc/ceph/ceph.client.admin.keyring' - Orchestrator - Ceph

Actions

Copy link

Bug #50671

closed

cephadm.py OSD status check fails 'no keyring found at /etc/ceph/ceph.client.admin.keyring'

Added by Harish Munjulur almost 3 years ago. Updated almost 2 years ago.

Status:

Closed

Priority:

Normal

Assignee:

Category:

Target version:

% Done:

Source:

Tags:

Backport:

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

teuthology

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

OSD status Check fails with no keyring found.

CLI:
2021-05-01T12:08:20.050 INFO:tasks.cephadm:Waiting for OSDs to come up
2021-05-01T12:08:20.051 DEBUG:teuthology.orchestra.run.smithi039:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json

Error:
2021-05-01T12:08:20.282 INFO:teuthology.misc.health.smithi039.stderr:2021-05-01T12:08:20.280+0000 7f0e90cc4700 -1 AuthRegistry(0x7f0e8c05ebf0) no keyring found at /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin, disabling cephx

But we can see that /etc/ceph/ceph.client.admin.keyring exists.

logs: http://pulpito.ceph.com/hmunjulu-2021-05-01_11:36:13-rbd:encryption-master-distro-basic-smithi/

Actions

Copy link

Updated by Neha Ojha almost 3 years ago

Project changed from RADOS to Orchestrator

Actions

Copy link

Updated by Josh Durgin almost 3 years ago

I think this might be a permissions issue - it looks like cephadm is writing the keyring without changing its permissions:

2021-05-01T12:04:35.745 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring...
2021-05-01T12:04:35.745 DEBUG:teuthology.orchestra.run.smithi039:> set -ex
2021-05-01T12:04:35.746 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.conf
2021-05-01T12:04:35.760 DEBUG:teuthology.orchestra.run.smithi039:> set -ex
2021-05-01T12:04:35.760 DEBUG:teuthology.orchestra.run.smithi039:> sudo dd of=/etc/ceph/ceph.client.admin.keyring

Is it doing this as root or a ceph user?

The later teuthology command is run by the 'ubuntu' user, so it may not have access to it.

Actions

Copy link

Updated by Sebastian Wagner almost 3 years ago

this should be fixed with the new logic to deploy keyrings within cephadm.

Actions

Copy link

Updated by Redouane Kachach Elhichou almost 2 years ago

No updates on this issue which (as of Sebastian comments) should be fixed by the new logic of deploying keyring files. Please reopen if you are able to reproduce the issue on a recent version.

Actions

Copy link