Actions
Bug #20042
closed"MaxWhileTries: 'wait_until_healthy' reached maximum" in rados-master_2017_5_20---basic-smithi
Status:
Rejected
Priority:
Urgent
Assignee:
-
Category:
-
Target version:
-
% Done:
0%
Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
rados
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
jewel-x upgrade job seems timing out
Run: http://pulpito.ceph.com/yuriw-2017-05-20_04:20:14-rados-master_2017_5_20---basic-smithi/
Job: 1199579
Logs: http://qa-proxy.ceph.com/teuthology/yuriw-2017-05-20_04:20:14-rados-master_2017_5_20---basic-smithi/1199579/teuthology.log
2017-05-20T04:53:14.624 INFO:tasks.ceph.osd.5.smithi085.stderr:2017-05-20 04:53:14.638897 7f1972eeb700 -1 osd.5 6 heartbeat_check: no reply from 172.21.15.31:6811 osd.2 since back 2017-05-20 04:34:28.313369 front 2017-05-20 04:34:28.313369 (cutoff 2017-05-20 04:52:54.638769) 2017-05-20T04:53:14.959 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 89, in run_tasks manager.__enter__() File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/home/teuthworker/src/github.com_ceph_ceph-c_master_2017_5_20/qa/tasks/ceph.py", line 1306, in restart healthy(ctx=ctx, config=dict(cluster=cluster)) File "/home/teuthworker/src/github.com_ceph_ceph-c_master_2017_5_20/qa/tasks/ceph.py", line 1187, in healthy ceph_cluster=cluster_name, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/misc.py", line 903, in wait_until_healthy while proceed(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 132, in __call__ raise MaxWhileTries(error_msg) MaxWhileTries: 'wait_until_healthy' reached maximum tries (150) after waiting for 900 seconds
Actions