Actions
Bug #20042
closed"MaxWhileTries: 'wait_until_healthy' reached maximum" in rados-master_2017_5_20---basic-smithi
Status:
Rejected
Priority:
Urgent
Assignee:
-
Category:
-
Target version:
-
% Done:
0%
Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
rados
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
jewel-x upgrade job seems timing out
Run: http://pulpito.ceph.com/yuriw-2017-05-20_04:20:14-rados-master_2017_5_20---basic-smithi/
Job: 1199579
Logs: http://qa-proxy.ceph.com/teuthology/yuriw-2017-05-20_04:20:14-rados-master_2017_5_20---basic-smithi/1199579/teuthology.log
2017-05-20T04:53:14.624 INFO:tasks.ceph.osd.5.smithi085.stderr:2017-05-20 04:53:14.638897 7f1972eeb700 -1 osd.5 6 heartbeat_check: no reply from 172.21.15.31:6811 osd.2 since back 2017-05-20 04:34:28.313369 front 2017-05-20 04:34:28.313369 (cutoff 2017-05-20 04:52:54.638769)
2017-05-20T04:53:14.959 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 89, in run_tasks
manager.__enter__()
File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
return self.gen.next()
File "/home/teuthworker/src/github.com_ceph_ceph-c_master_2017_5_20/qa/tasks/ceph.py", line 1306, in restart
healthy(ctx=ctx, config=dict(cluster=cluster))
File "/home/teuthworker/src/github.com_ceph_ceph-c_master_2017_5_20/qa/tasks/ceph.py", line 1187, in healthy
ceph_cluster=cluster_name,
File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/misc.py", line 903, in wait_until_healthy
while proceed():
File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 132, in __call__
raise MaxWhileTries(error_msg)
MaxWhileTries: 'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds
Actions