Project

General

Profile

Actions

Bug #52321

open

qa/tasks/rook times out: 'check osd count' reached maximum tries (90) after waiting for 900 seconds

Added by Aishwarya Mathuria over 2 years ago. Updated over 1 year ago.

Status:
New
Priority:
High
Assignee:
-
Category:
mgr/rook
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
quincy,pacific
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2021-08-17T08:10:34.106 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/contextutil.py", line 31, in nested
    vars.append(enter())
  File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__
    return next(self.gen)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_a00b573203353a8db1f3e59f48e827ed27479b62/qa/tasks/rook.py", line 489, in wait_for_osds
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/contextutil.py", line 133, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'check osd count' reached maximum tries (90) after waiting for 900 seconds
2021-08-17T08:10:34.106 ERROR:tasks.rook:'check osd count' reached maximum tries (90) after waiting for 900 seconds
Traceback (most recent call last):
  File "/home/teuthworker/src/github.com_ceph_ceph-c_a00b573203353a8db1f3e59f48e827ed27479b62/qa/tasks/rook.py", line 454, in rook_toolbox
    yield
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/contextutil.py", line 31, in nested
    vars.append(enter())
  File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__
    return next(self.gen)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_a00b573203353a8db1f3e59f48e827ed27479b62/qa/tasks/rook.py", line 489, in wait_for_osds
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/contextutil.py", line 133, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'check osd count' reached maximum tries (90) after waiting for 900 seconds
2021-08-17T08:10:34.107 DEBUG:teuthology.orchestra.run.smithi087:> kubectl delete -f rook/cluster/examples/kubernetes/ceph/toolbox.yaml
2021-08-17T08:10:34.184 INFO:teuthology.orchestra.run.smithi087.stdout:deployment.apps "rook-ceph-tools" deleted
2021-08-17T08:10:34.205 ERROR:tasks.rook:'check osd count' reached maximum tries (90) after waiting for 900 seconds
Traceback (most recent call last):
  File "/home/teuthworker/src/github.com_ceph_ceph-c_a00b573203353a8db1f3e59f48e827ed27479b62/qa/tasks/rook.py", line 391, in rook_cluster
    yield
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/contextutil.py", line 31, in nested
    vars.append(enter())
  File "/usr/lib/python3.6/contextlib.py", line 81, in __enter__
    return next(self.gen)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_a00b573203353a8db1f3e59f48e827ed27479b62/qa/tasks/rook.py", line 489, in wait_for_osds
    while proceed():
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_321319b12ea4ff9b63c7655015a3156de2c3b279/teuthology/contextutil.py", line 133, in __call__
    raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: 'check osd count' reached maximum tries (90) after waiting for 900 seconds
2021-08-17T08:10:34.205 DEBUG:teuthology.orchestra.run.smithi087:> kubectl delete -f cluster.yaml

https://pulpito.ceph.com/yuriw-2021-08-16_21:15:00-rados-wip-yuri-testing-master-8.16.21-distro-basic-smithi/6342123


Related issues 1 (0 open1 closed)

Has duplicate Orchestrator - Bug #52420: rados/rook: 'wait for operator' reached maximum tries (90) after waiting for 900 secondsDuplicate

Actions
Actions

Also available in: Atom PDF