Bug #53074: pybind/mgr/cephadm: upgrade sequence does not continue if no MDS are active - CephFS - Ceph

Actions

Copy link

Bug #53074

closed

pybind/mgr/cephadm: upgrade sequence does not continue if no MDS are active

Added by Patrick Donnelly over 2 years ago. Updated over 2 years ago.

Status:

Resolved

Priority:

High

Assignee:

Patrick Donnelly

Category:

Target version:

Ceph - v17.0.0

% Done:

Source:

Q/A

Tags:

Backport:

pacific

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Component(FS):

Labels (FS):

qa, qa-failure

Pull request ID:

43693

Crash signature (v1):

Crash signature (v2):

Description

2021-10-27T01:43:21.149 INFO:teuthology.orchestra.run.smithi050.stdout:e29
2021-10-27T01:43:21.149 INFO:teuthology.orchestra.run.smithi050.stdout:enable_multiple, ever_enabled_multiple: 1,1
2021-10-27T01:43:21.149 INFO:teuthology.orchestra.run.smithi050.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
2021-10-27T01:43:21.149 INFO:teuthology.orchestra.run.smithi050.stdout:legacy client fscid: 1
2021-10-27T01:43:21.150 INFO:teuthology.orchestra.run.smithi050.stdout:
2021-10-27T01:43:21.150 INFO:teuthology.orchestra.run.smithi050.stdout:Filesystem 'cephfs' (1)
2021-10-27T01:43:21.150 INFO:teuthology.orchestra.run.smithi050.stdout:fs_name  cephfs
2021-10-27T01:43:21.150 INFO:teuthology.orchestra.run.smithi050.stdout:epoch    29
2021-10-27T01:43:21.151 INFO:teuthology.orchestra.run.smithi050.stdout:flags    12 joinable allow_snaps allow_multimds_snaps
2021-10-27T01:43:21.151 INFO:teuthology.orchestra.run.smithi050.stdout:created  2021-10-26T22:40:09.032023+0000
2021-10-27T01:43:21.151 INFO:teuthology.orchestra.run.smithi050.stdout:modified 2021-10-26T22:47:23.735439+0000
2021-10-27T01:43:21.151 INFO:teuthology.orchestra.run.smithi050.stdout:tableserver      0
2021-10-27T01:43:21.151 INFO:teuthology.orchestra.run.smithi050.stdout:root     0
2021-10-27T01:43:21.152 INFO:teuthology.orchestra.run.smithi050.stdout:session_timeout  60
2021-10-27T01:43:21.152 INFO:teuthology.orchestra.run.smithi050.stdout:session_autoclose        300
2021-10-27T01:43:21.152 INFO:teuthology.orchestra.run.smithi050.stdout:max_file_size    1099511627776
2021-10-27T01:43:21.152 INFO:teuthology.orchestra.run.smithi050.stdout:required_client_features {}
2021-10-27T01:43:21.153 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure     0
2021-10-27T01:43:21.153 INFO:teuthology.orchestra.run.smithi050.stdout:last_failure_osd_epoch   55
2021-10-27T01:43:21.153 INFO:teuthology.orchestra.run.smithi050.stdout:compat   compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2}
2021-10-27T01:43:21.153 INFO:teuthology.orchestra.run.smithi050.stdout:max_mds  1
2021-10-27T01:43:21.153 INFO:teuthology.orchestra.run.smithi050.stdout:in       0
2021-10-27T01:43:21.154 INFO:teuthology.orchestra.run.smithi050.stdout:up       {}
2021-10-27T01:43:21.154 INFO:teuthology.orchestra.run.smithi050.stdout:failed   0
2021-10-27T01:43:21.154 INFO:teuthology.orchestra.run.smithi050.stdout:damaged
2021-10-27T01:43:21.154 INFO:teuthology.orchestra.run.smithi050.stdout:stopped
2021-10-27T01:43:21.154 INFO:teuthology.orchestra.run.smithi050.stdout:data_pools       [3]
2021-10-27T01:43:21.155 INFO:teuthology.orchestra.run.smithi050.stdout:metadata_pool    2
2021-10-27T01:43:21.155 INFO:teuthology.orchestra.run.smithi050.stdout:inline_data      disabled
2021-10-27T01:43:21.155 INFO:teuthology.orchestra.run.smithi050.stdout:balancer
2021-10-27T01:43:21.155 INFO:teuthology.orchestra.run.smithi050.stdout:standby_count_wanted     1
2021-10-27T01:43:21.156 INFO:teuthology.orchestra.run.smithi050.stdout:
2021-10-27T01:43:21.156 INFO:teuthology.orchestra.run.smithi050.stdout:
2021-10-27T01:43:21.156 INFO:teuthology.orchestra.run.smithi050.stdout:Standby daemons:
2021-10-27T01:43:21.156 INFO:teuthology.orchestra.run.smithi050.stdout:
2021-10-27T01:43:21.156 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.cmvoyy{-1:14648} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.50:6826/3150337889,v1:172.21.15.50:6827/3150337889] compat {c=[1],r=[1],i=[1]}]
2021-10-27T01:43:21.157 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi150.dsoqre{-1:24285} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.150:6826/1947324524,v1:172.21.15.150:6827/1947324524] compat {c=[1],r=[1],i=[1]}]
2021-10-27T01:43:21.157 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi150.xrqcrl{-1:24413} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.150:6824/3043427117,v1:172.21.15.150:6825/3043427117] compat {c=[1],r=[1],i=[1]}]
2021-10-27T01:43:21.157 INFO:teuthology.orchestra.run.smithi050.stdout:[mds.cephfs.smithi050.vkzobo{-1:34150} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.50:6828/3680014385,v1:172.21.15.50:6829/3680014385] compat {c=[1],r=[1],i=[1]}]

From: /ceph/teuthology-archive/pdonnell-2021-10-26_22:12:03-fs-wip-pdonnell-testing-20211025.000447-distro-basic-smithi/6462555/teuthology.log

No MDS can join because they have incompatible compat sets. This happened because the active MDS crashed during the upgrade for unrelated reasons. cephadm should just continue the upgrade in this scenario.