Project

General

Profile

Actions

Bug #16116

closed

"AssertionError: failed to recover before timeout expired" in rados:thrash of V10.2.1

Added by Zezhu Zhang almost 8 years ago. Updated almost 7 years ago.

Status:
Can't reproduce
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
rados
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2016-06-02T02:09:30.725 INFO:tasks.ceph.ceph_manager.ceph:version 4800
stamp 2016-06-02 02:09:29.963879
last_osdmap_epoch 2428
last_pg_scan 2428
full_ratio 0.95
nearfull_ratio 0.85

OSD_STAT USED AVAIL TOTAL HB_IN PG_SUM
2 160 MB 28397 MB 30109 MB [0,1,3,4,5] 121
3 0 bytes 0 bytes 0 bytes [] 0
1 161 MB 28396 MB 30109 MB [0,2,3,4,5] 105
0 162 MB 28395 MB 30109 MB [1,2,3,4,5] 144
5 161 MB 28396 MB 30109 MB [0,1,2,3,4] 115
4 161 MB 28396 MB 30109 MB [0,1,2,3,5] 115
sum 806 MB 138 GB 147 GB

2016-06-02T02:09:30.734 INFO:tasks.thrashosds.thrasher:Traceback (most recent call last):
File "/home/foo2/src/ceph-qa-suite_master/tasks/ceph_manager.py", line 664, in wrapper
return func(self)
File "/home/foo2/src/ceph-qa-suite_master/tasks/ceph_manager.py", line 774, in do_thrash
timeout=self.config.get('timeout')
File "/home/foo2/src/ceph-qa-suite_master/tasks/ceph_manager.py", line 1761, in wait_for_recovery
'failed to recover before timeout expired'
AssertionError: failed to recover before timeout expired

2016-06-02T02:09:30.736 ERROR:teuthology.run_tasks:Manager failed: thrashosds
Traceback (most recent call last):
File "/home/foo2/src/teuthology_master/teuthology/run_tasks.py", line 146, in run_tasks
suppress = manager.__exit__(*exc_info)
File "/usr/lib/python2.7/contextlib.py", line 24, in exit
self.gen.next()
File "/home/foo2/src/ceph-qa-suite_master/tasks/thrashosds.py", line 197, in task
thrash_proc.do_join()
File "/home/foo2/src/ceph-qa-suite_master/tasks/ceph_manager.py", line 440, in do_join
self.thread.get()
File "/home/foo2/src/teuthology_master/virtualenv/local/lib/python2.7/site-packages/gevent/greenlet.py", line 274, in get
raise self._exception

Actions #1

Updated by Josh Durgin almost 7 years ago

  • Status changed from New to Can't reproduce
Actions

Also available in: Atom PDF