Project

General

Profile

Actions
Copy link

Bug #58674

open

mds_upgrade_sequence:teuthology.exceptions.MaxWhileTries: reached maximum tries (180) after waiting for 180 seconds

Added by Prashant D about 1 year ago. Updated 12 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
test-failure
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

archive_path: /home/teuthworker/archive/lflores-2023-02-07_03:56:23-rados-wip-yuri4-testing-2023-02-07-0246-pacific-distro-default-smithi/7152653
branch: wip-yuri4-testing-2023-02-07-0246-pacific
description: rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools
conf/{client mds mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down
pg-warn} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes
3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}}

2023-02-07T04:42:03.320 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Feb 07 04:42:02 smithi167 ceph-21c7d394-a6a0-11ed-bc20-001a4aab830c-mon.smithi167[103540]: cephadm 2023-02-07T04:42:01.651525+0000 mgr.smithi167.bdbbaw (mgr.14162) 312 : cephadm [INF] Deploying daemon alertmanager.smithi167 on smithi167
2023-02-07T04:42:03.320 INFO:journalctl@ceph.mon.smithi167.smithi167.stdout:Feb 07 04:42:02 smithi167 ceph-21c7d394-a6a0-11ed-bc20-001a4aab830c-mon.smithi167[103540]: cluster 2023-02-07T04:42:02.645080+0000 mon.smithi167 (mon.0) 330 : cluster [WRN] Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON)
...
2023-02-07T04:42:23.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-02-07T04:42:23.095+0000 7fdc19b14700  1 -- 172.21.15.172:0/3137184813 shutdown_connections
2023-02-07T04:42:23.086 INFO:teuthology.orchestra.run.smithi172.stderr:2023-02-07T04:42:23.095+0000 7fdc19b14700  1 -- 172.21.15.172:0/3137184813 wait complete.
2023-02-07T04:42:23.086 INFO:teuthology.orchestra.run.smithi172.stderr:dumped monmap epoch 1
2023-02-07T04:42:23.501 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/contextutil.py", line 31, in nested
    vars.append(enter())
  File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__
    return next(self.gen)
  File "/home/teuthworker/src/github.com_ljflores_ceph_46b8e9e7acbc6819323bcd66330a0bd34ff536ce/qa/tasks/cephadm.py", line 632, in ceph_mons
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/contextutil.py", line 133, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (180) after waiting for 180 seconds
Actions
Copy link

Also available in: Atom PDF