Project

General

Profile

Actions
Copy link

Bug #40989

closed

qa: RECENT_CRASH warning prevents wait_for_health_clear from completing

Added by Patrick Donnelly over 4 years ago. Updated over 4 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Sage Weil
Category:
-
Target version:
Ceph - v15.0.0
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
qa-suite
Labels (FS):
Pull request ID:
29363
Crash signature (v1):
Crash signature (v2):

Description

2019-07-26T09:36:45.952 DEBUG:tasks.ceph.mds.c:waiting for process to exit
2019-07-26T09:36:45.952 INFO:teuthology.orchestra.run:waiting for 300
2019-07-26T09:36:45.959 INFO:tasks.ceph.mds.c:Stopped
2019-07-26T09:36:45.959 INFO:tasks.cephfs.test_failover:waiting for insufficient standby daemon warning
...
2019-07-26T09:37:40.687 INFO:teuthology.orchestra.run.smithi047.stdout:{"checks":{"RECENT_CRASH":{"severity":"HEALTH_WARN","summary":{"message":"1 daemons have recently crashed"}}},"status":"HEALTH_WARN"}
2019-07-26T09:37:40.691 INFO:tasks.cephfs_test_runner:test_standby_count_wanted (tasks.cephfs.test_failover.TestFailover) ... ERROR
...
2019-07-26T09:37:51.229 INFO:tasks.cephfs_test_runner:======================================================================
2019-07-26T09:37:51.229 INFO:tasks.cephfs_test_runner:ERROR: test_standby_count_wanted (tasks.cephfs.test_failover.TestFailover)
2019-07-26T09:37:51.229 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2019-07-26T09:37:51.229 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2019-07-26T09:37:51.230 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20190726.021409/qa/tasks/cephfs/test_failover.py", line 305, in test_standby_count_wanted
2019-07-26T09:37:51.230 INFO:tasks.cephfs_test_runner:    self.wait_for_health_clear(timeout=30)
2019-07-26T09:37:51.230 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20190726.021409/qa/tasks/ceph_test_case.py", line 131, in wait_for_health_clear
2019-07-26T09:37:51.231 INFO:tasks.cephfs_test_runner:    self.wait_until_true(is_clear, timeout)
2019-07-26T09:37:51.231 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20190726.021409/qa/tasks/ceph_test_case.py", line 163, in wait_until_true
2019-07-26T09:37:51.231 INFO:tasks.cephfs_test_runner:    raise RuntimeError("Timed out after {0}s".format(elapsed))
2019-07-26T09:37:51.231 INFO:tasks.cephfs_test_runner:RuntimeError: Timed out after 30s

From: /ceph/teuthology-archive/pdonnell-2019-07-26_06:33:41-fs-wip-pdonnell-testing-20190726.021409-distro-basic-smithi/4151760/teuthology.log

Introduced-by: http://github.com/ceph/ceph/pull/29034

Actions
Copy link
 #1

Updated by Patrick Donnelly over 4 years ago

  • Status changed from New to Resolved
  • Assignee changed from Patrick Donnelly to Sage Weil
  • Pull request ID set to 29363
Actions
Copy link

Also available in: Atom PDF