Project

General

Profile

Actions

Bug #59105

open

pacific release cephadm bootstrapped cluster has mismatched version of cephadm, container image and ceph inside the docker

Added by David Smith about 1 year ago. Updated 10 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
ceph cli
Target version:
-
% Done:

0%

Source:
Community (user)
Tags:
cephadm,ceph cli,docker
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
upgrade/pacific-x
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Got the cephadm pacific release binary via github, not package

sudo wget -v https://github.com/ceph/ceph/raw/pacific/src/cephadm/cephadm -P /usr/local/sbin/
sudo chmod +x /usr/local/sbin/cephadm

then boostreap a new cluster with

sudo cephadm bootstrap --mon-ip $hostip

docker ps on the host:

CONTAINER ID   IMAGE                                     COMMAND                  CREATED         STATUS         PORTS     NAMES
0df21491f3db   quay.io/ceph/ceph-grafana:8.3.5           "/bin/sh -c 'grafana…"   4 minutes ago   Up 4 minutes             ceph-0dff13c8-c634-11ed-8d16-ab7f51718fee-grafana-ceph-admin
2ecdd61b1402   quay.io/prometheus/alertmanager:v0.23.0   "/bin/alertmanager -…"   4 minutes ago   Up 4 minutes             ceph-0dff13c8-c634-11ed-8d16-ab7f51718fee-alertmanager-ceph-admin
fd352d435ac9   quay.io/prometheus/prometheus:v2.33.4     "/bin/prometheus --c…"   4 minutes ago   Up 4 minutes             ceph-0dff13c8-c634-11ed-8d16-ab7f51718fee-prometheus-ceph-admin
2856191ce5b3   quay.io/prometheus/node-exporter:v1.3.1   "/bin/node_exporter …"   5 minutes ago   Up 5 minutes             ceph-0dff13c8-c634-11ed-8d16-ab7f51718fee-node-exporter-ceph-admin
aca9e1748b89   quay.io/ceph/ceph                         "/usr/bin/ceph-crash…"   5 minutes ago   Up 5 minutes             ceph-0dff13c8-c634-11ed-8d16-ab7f51718fee-crash-ceph-admin
19cc196b8fbc   quay.io/ceph/ceph:v16                     "/usr/bin/ceph-mgr -…"   6 minutes ago   Up 5 minutes             ceph-0dff13c8-c634-11ed-8d16-ab7f51718fee-mgr-ceph-admin-yfgxgf
e59c14cfca7c   quay.io/ceph/ceph:v16                     "/usr/bin/ceph-mon -…"   6 minutes ago   Up 6 minutes             ceph-0dff13c8-c634-11ed-8d16-ab7f51718fee-mon-ceph-admin

Shows docker image running is v16 which is correct.
dashboard also report 16.2.11

however, invoking the ceph cli via:

 sudo /usr/local/sbin/cephadm shell \
--fsid $fsid \
-c /etc/ceph/ceph.conf \
-k /etc/ceph/ceph.client.admin.keyring

root@ceph-admin:/# ceph -v
ceph version 17.2.5 (98318ae89f1a893a6ded3a640405cdbb33e08757) quincy (stable)

Here ceph says it is 17.2.5 instead of 16.2.11.
Is this expected behavior?
No ceph related apt package has been instead on the ubuntu host.
No commity package or repo has been added through cephadm install or add-repo.
Will this version mismatch cause problem?
Asking because I'm troubleshooting some of the nodes' cpu goes to 100% useage problem.

As a result of this, if adding osd nodes via ceph 17.2.5, the osd nodes brought up will run docker image of the latest, assume v17, instead of v16.
Which could have caused some of the nodes cpu useage goes to 100%.

Actions #2

Updated by Ilya Dryomov about 1 year ago

  • Target version changed from v16.2.12 to v16.2.13
Actions #3

Updated by Ilya Dryomov 10 months ago

  • Target version deleted (v16.2.13)
Actions

Also available in: Atom PDF