Bug #64491: cephadm: ceph-exporter fails to deploy when placed first - Orchestrator - Ceph

Actions

Copy link

Bug #64491

closed

cephadm: ceph-exporter fails to deploy when placed first

Added by Adam King 2 months ago. Updated about 1 month ago.

Status:

Resolved

Priority:

Low

Assignee:

Adam King

Category:

Target version:

% Done:

Source:

Tags:

backport_processed

Backport:

squid, reef

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Pull request ID:

55650

Crash signature (v1):

Crash signature (v2):

Description

This is due to the default socket directory it uses being a directory that is usually made by other ceph daemons. If it is placed after those daemons or if it fails and is then deployed again later after those daemons have been deployed, it works okay. Otherwise, the initial deployment will fail with something like

2024-02-17T11:41:50.103 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Feb 17 11:41:49 smithi119 ceph-mon[25247]: [WRN] CEPHADM_DAEMON_PLACE_FAIL: Failed to place 1 daemon(s)
2024-02-17T11:41:50.103 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Feb 17 11:41:49 smithi119 ceph-mon[25247]:     Failed while placing ceph-exporter.smithi120 on smithi120: cephadm exited with an error code: 1, stderr: Non-zero exit code 125 from /usr/bin/podman container inspect --format {{.State.Status}} ceph-08320ba0-cd89-11ee-95ba-87774f69a715-ceph-exporter-smithi120
2024-02-17T11:41:50.103 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Feb 17 11:41:49 smithi119 ceph-mon[25247]: /usr/bin/podman: stderr Error: no such container ceph-08320ba0-cd89-11ee-95ba-87774f69a715-ceph-exporter-smithi120
2024-02-17T11:41:50.103 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Feb 17 11:41:49 smithi119 ceph-mon[25247]: Non-zero exit code 125 from /usr/bin/podman container inspect --format {{.State.Status}} ceph-08320ba0-cd89-11ee-95ba-87774f69a715-ceph-exporter.smithi120
2024-02-17T11:41:50.103 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Feb 17 11:41:49 smithi119 ceph-mon[25247]: /usr/bin/podman: stderr Error: no such container ceph-08320ba0-cd89-11ee-95ba-87774f69a715-ceph-exporter.smithi120
2024-02-17T11:41:50.103 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Feb 17 11:41:49 smithi119 ceph-mon[25247]: Deploy daemon ceph-exporter.smithi120 ...
2024-02-17T11:41:50.104 INFO:journalctl@ceph.mon.smithi119.smithi119.stdout:Feb 17 11:41:49 smithi119 ceph-mon[25247]: ERROR: Directory does not exist. Got: /var/run/ceph/

https://pulpito.ceph.com/yuriw-2024-02-16_20:14:07-orch-main-distro-default-smithi/7563114/

Related issues 2 (0 open — 2 closed)