Project

General

Profile

Bug #46204

cephadm upgrade test: fail if upgrade status is set to error

Added by Sebastian Wagner over 2 years ago. Updated 5 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
Adam King
Category:
teuthology
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
low-hanging-fruit
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
45920
Crash signature (v1):
Crash signature (v2):

Description

http://pulpito.ceph.com/swagner-2020-06-25_08:07:18-rados:cephadm-wip-swagner-testing-2020-06-24-1032-distro-basic-smithi/

If the upgrade fails, the test run hangs indefinitely:

INFO:cephadm:Using recent ceph image docker.io/ceph/ceph:v15.2.0
{
    "target_image": "quay.io/ceph-ci/ceph:4c17bddcef39d3df83a6ab939ac631ad6c600445",
    "in_progress": true,
    "services_complete": [],
    "message": "Error: UPGRADE_FAILED_PULL: Upgrade: failed to pull target image" 
}

Things to do here

  • add a status entry to the upgrade status dict
  • set it to "error"
  • Make sure, the upgrade tests fails, if we encounter an error.

Related issues

Related to Orchestrator - Bug #48695: cephadm: upgrade should not get blocked, on intermediate UPGRADE_FAILED_PULL Closed
Related to Orchestrator - Bug #49827: cephadm driven upgrade test takes 12 hours and still running Duplicate
Related to Orchestrator - Bug #46254: cephadm upgrade test: exit condition is wrong. we have to wait longer Can't reproduce
Related to Orchestrator - Feature #49269: cephadm: upgrade stuck in repeating sleep when a host is offline New
Related to Orchestrator - Bug #53939: ceph-nfs-upgrade, pacific: Upgrade Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon osd.0 on host smithi103 failed New

History

#1 Updated by Sebastian Wagner about 2 years ago

  • Subject changed from cephadm upgrade: fail if upgrade status is set to error to cephadm upgrade test: fail if upgrade status is set to error

#3 Updated by Sebastian Wagner almost 2 years ago

  • Related to Bug #48695: cephadm: upgrade should not get blocked, on intermediate UPGRADE_FAILED_PULL added

#4 Updated by Sebastian Wagner over 1 year ago

  • Related to Bug #49827: cephadm driven upgrade test takes 12 hours and still running added

#5 Updated by Sebastian Wagner over 1 year ago

  • Related to Bug #46254: cephadm upgrade test: exit condition is wrong. we have to wait longer added

#6 Updated by Sebastian Wagner over 1 year ago

  • Related to Feature #49269: cephadm: upgrade stuck in repeating sleep when a host is offline added

#7 Updated by Sebastian Wagner 8 months ago

  • Tags set to low-hanging-fruit

#8 Updated by Redouane Kachach Elhichou 5 months ago

  • Related to Bug #53939: ceph-nfs-upgrade, pacific: Upgrade Paused due to UPGRADE_REDEPLOY_DAEMON: Upgrading daemon osd.0 on host smithi103 failed added

#9 Updated by Redouane Kachach Elhichou 5 months ago

  • Status changed from New to Resolved
  • Assignee set to Adam King
  • Pull request ID set to 45920

Also available in: Atom PDF