Project

General

Profile

Actions

Bug #53615

closed

qa: upgrade test fails with "timeout expired in wait_until_healthy"

Added by Venky Shankar over 2 years ago. Updated about 1 year ago.

Status:
Resolved
Priority:
Normal
Category:
-
Target version:
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
qa-suite
Labels (FS):
qa, qa-failure
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

https://pulpito.ceph.com/vshankar-2021-12-15_07:13:38-fs-master-testing-default-smithi/6563822/

The test reached a point where the cluster gets upgraded to latest master and daemons are restarted. Subsequently, `require-osd-release` is set to octopus which results is `ceph.health` to fail since the cluster never reaches HEALTH_OK::

2021-12-15T07:56:04.661 INFO:teuthology.orchestra.run.smithi008.stdout:{"status":"HEALTH_WARN","checks":{"OSD_UPGRADE_FINISHED":{"severity":"HEALTH_WARN","summary":{"message":"all OSDs are running quincy or later but require_osd_release < quincy","count":0},"muted":false},"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 1 pg degraded, 1 pg undersized","count":2},"muted":false}},"mutes":[]}

AFAICT, this test should have always failed. Perhaps, the above issue is not really the problem.


Related issues 1 (0 open1 closed)

Related to RADOS - Feature #51984: [RFE] Provide warning when the 'require-osd-release' flag does not match current release.ResolvedSridhar Seshasayee

Actions
Actions #1

Updated by Patrick Donnelly over 2 years ago

  • Related to Feature #51984: [RFE] Provide warning when the 'require-osd-release' flag does not match current release. added
Actions #2

Updated by Patrick Donnelly over 2 years ago

regression caused by fix for #51984

Actions #3

Updated by Patrick Donnelly over 2 years ago

  • Status changed from New to Fix Under Review
  • Source set to Q/A
  • Pull request ID set to 44324
  • Component(FS) qa-suite added
  • Labels (FS) qa, qa-failure added
Actions #4

Updated by Patrick Donnelly over 2 years ago

  • Status changed from Fix Under Review to Resolved
Actions #5

Updated by Laura Flores about 1 year ago

Another instance during this upgrade test:
/a/yuriw-2023-03-14_21:33:13-upgrade:octopus-x-quincy-release-distro-default-smithi/7208227

Actions

Also available in: Atom PDF