Ceph

Run: http://pulpito.ovh.sepia.ceph.com:8081/teuthology-2016-04-20_02:00:02-rados-infernalis-distro-basic-openstack/
Jobs: ['39177', '39119', '39060']
Logs: http://teuthology.ovh.sepia.ceph.com/teuthology/teuthology-2016-04-20_02:00:02-rados-infernalis-distro-basic-openstack/39119/teuthology.log

2016-04-20T03:40:26.895 INFO:teuthology.orchestra.run.target078212:Running: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph pg dump'
....
0.56    0    0    0    0    0    0    0    0    active+clean    2016-04-20 03:20:18.557034    0'0    495:136    [0,2,5]    0    [0,2,5]    0    0'0    2016-04-20 03:09:45.410500    0'0    2016-04-20 03:08:18.825407
86.1    0    0    0    0    0    0    0    0    active+clean    2016-04-20 03:19:59.439666    0'0    491:7    [2,4,3]    2    [2,4,3]    2    0'0    2016-04-20 03:19:58.141019    0'0    2016-04-20 03:19:58.141019
0.57    0    0    0    0    0    0    0    0    active+clean    2016-04-20 03:38:43.727780    0'0    501:150    [5,0,2]    5    [5,0,2]    5    0'0    2016-04-20 03:38:43.727680    0'0    2016-04-20 03:08:18.825408
pool 86    1    0    0    0    0    0    1    1
pool 0    0    0    0    0    0    0    0    0
 sum    1    0    0    0    0    0    1    1
osdstat    kbused    kbavail    kb    hb in    hb out
5    164632    48672612    51475068    [0,1,2,3,4]    []
3    165664    48671580    51475068    [0,1,2,4,5]    []
2    164920    48672324    51475068    [0,1,3,4,5]    []
1    0    0    0    []    []
0    169044    48668200    51475068    [1,2,3,4,5]    []
4    165472    48671772    51475068    [0,1,2,3,5]    []
 sum    829732    243356488    257375340

2016-04-20T03:40:27.492 INFO:tasks.thrashosds.thrasher:Traceback (most recent call last):
  File "/home/teuthworker/src/ceph-qa-suite_infernalis/tasks/ceph_manager.py", line 650, in wrapper
    return func(self)
  File "/home/teuthworker/src/ceph-qa-suite_infernalis/tasks/ceph_manager.py", line 697, in do_thrash
    timeout=self.config.get('timeout')
  File "/home/teuthworker/src/ceph-qa-suite_infernalis/tasks/ceph_manager.py", line 1626, in wait_for_recovery
    'failed to recover before timeout expired'
AssertionError: failed to recover before timeout expired