Project

General

Profile

Actions

Bug #2761

closed

osd: failed to recover before timeout expired

Added by Tamilarasi muthamizhan almost 12 years ago. Updated about 11 years ago.

Status:
Resolved
Priority:
High
Assignee:
Category:
-
Target version:
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Logs: ubuntu@teuthology:/a/teuthology-2012-07-09_05:00:08-regression-stable-master-basic/8039

Attaching below an excerpt from teuthology.log,config.yaml and summary.yaml for reference,

2012-07-09T06:46:07.157 ERROR:teuthology.run_tasks:Manager failed: <contextlib.GeneratorContextManager object at 0x1449e90>
Traceback (most recent call last):
File "/var/lib/teuthworker/teuthology/teuthology/run_tasks.py", line 45, in run_tasks
suppress = manager.__exit__(*exc_info)
File "/usr/lib/python2.6/contextlib.py", line 23, in exit
self.gen.next()
File "/var/lib/teuthworker/teuthology/teuthology/task/thrashosds.py", line 85, in task
manager.wait_for_recovery(config.get('timeout', 360))
File "/var/lib/teuthworker/teuthology/teuthology/task/ceph_manager.py", line 309, in wait_for_recovery
'failed to recover before timeout expired'
AssertionError: failed to recover before timeout expired
2012-07-09T06:46:07.158 DEBUG:teuthology.run_tasks:Unwinding manager <contextlib.GeneratorContextManager object at 0x137d950>
2012-07-09T06:46:07.158 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
File "/var/lib/teuthworker/teuthology/teuthology/contextutil.py", line 27, in nested
yield vars
File "/var/lib/teuthworker/teuthology/teuthology/task/ceph.py", line 1020, in task
yield
File "/var/lib/teuthworker/teuthology/teuthology/run_tasks.py", line 45, in run_tasks
suppress = manager.__exit__(*exc_info)
File "/usr/lib/python2.6/contextlib.py", line 23, in exit
self.gen.next()
File "/var/lib/teuthworker/teuthology/teuthology/task/thrashosds.py", line 85, in task
manager.wait_for_recovery(config.get('timeout', 360))
File "/var/lib/teuthworker/teuthology/teuthology/task/ceph_manager.py", line 309, in wait_for_recovery
'failed to recover before timeout expired'
AssertionError: failed to recover before timeout expired

config.yaml

kernel: &id001
kdb: true
sha1: 26ce171915f348abd1f41da1ed139d93750d987f
nuke-on-error: true
overrides:
ceph:
conf:
client:
rbd cache: true
rbd cache max dirty: 0
fs: xfs
log-whitelist:
- slow request
sha1: 03c2dc244af11b711e2514fd5f32b9bfa34183f6
roles:
- - mon.a
- osd.0
- osd.1
- osd.2
- - mds.a
- osd.3
- osd.4
- osd.5
- - client.0
targets:
: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOTCMIScDTmD9NkfsWU7xeyZ+WOXai5izYeliiXDSjJC3bT6r8Fp+rhPfcHCVHiw++VsbvKZtkhjCSnJTVPWCdpRDghzJ3nZUBImWRo3PmHo1etQpCeimaOrIJ2q0ChN5jmSOqy5B+Z4om2vXBtBY6nkdTxDOr2+MH3NrSPkQSFB0zO+VPuwKXsemeUC6urb2IZZpxY3cxNq4fafTF9PROpgOnIA+o3igyU4duKEjnCzTHZjw/PL7Eph/7p6+UQgrUwe7pgVzT+2MM0zcBtBSXNqs3dCGmpvUapOkBlDoIX02EkWRNpkM3vfeFt1EFC17B5vd61Kg40bYUG8qWGR0T
: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1atTvrZo1Sr3dY/WzNvE8gg/UeFV/U2NdmR9UlTkihYWK9nqdjirHhN/MNYVMkjY+yP3zWnbkQNx89J+XTvf1ROM+CsT3n885LCMxDtzzjwU2/x6vjwkLKSm43e8QMOfsCVl4jTniK3godrIJIg/pvUwD+dnkV/qmx3SpMnRTwzwgpfFwtFVENu7k519POG1jVrQ1tpksAke6s4/gWNsAeYxoDzP4tegWPmWIu7qHcpH8X5t/ClHWeMV6ur0yVRk/6rX0Jve98PFrsW5vFJvbZpMNMvV4ei/g8jyeCUS3OBqanRnSBgn3geLTngw4y32+squLtIKBeojNQ+8u/YNL
: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDk4GmsUmC8svnRI6Xd+mRX2MwKb4RHECAeLfqTm2COfqfolS2wKGw3U92eJcyvpZ+2p82X7uBrimjZh5JgRtxJ1aGUG4Pi60+JBYF0WpohM/3aYISFegVNET9rcapdDaAi6fFB5vhT06Q/cYEO0tPrdqGb/O3oiDSurtqtfOzkdwSPWSTY/hSegXgOeG6EjuEfvnU4BbgXWkLlDQRXCdgQd35F0SlKJVgMo+J1MgMCEK4qnBMFN614P1gBSzZCBsSUGQdjYBOzZfCRlI2bUdPDtB0kyjp7o5Ns9gLd07TLw8h9oxvI7wxG16XnLOAIzPBNOaH4OztTMGg3wJ/1e26t
tasks:
- internal.lock_machines: 3
- internal.save_config: null
- internal.check_lock: null
- internal.connect: null
- internal.check_conflict: null
- kernel: *id001
- internal.base: null
- internal.archive: null
- internal.coredump: null
- internal.syslog: null
- internal.timer: null
- chef: null
- clock: null
- ceph:
log-whitelist:
- wrongly marked me down or wrong addr
- objects unfound and apparently lost
- thrashosds:
timeout: 1200
- rbd_fsx:
clients:
- client.0
ops: 20000

ubuntu@teuthology:/a/teuthology-2012-07-09_05:00:08-regression-stable-master-basic/8039$ cat summary.yaml
ceph-sha1: 03c2dc244af11b711e2514fd5f32b9bfa34183f6
description: collection:thrash clusters:6-osd-3-machine.yaml fs:xfs.yaml thrashers:default.yaml
workloads:rbd_fsx_cache_writethrough.yaml
duration: 2710.1456501483917
failure_reason: failed to recover before timeout expired
flavor: basic
owner: scheduled_teuthology@teuthology
success: false

Actions #1

Updated by Tamilarasi muthamizhan almost 12 years ago

Logs: ubuntu@teuthology: /a/teuthology-2012-07-14_00:00:03-regression-next-testing-basic/11248

ubuntu@teuthology:/a/teuthology-2012-07-14_00:00:03-regression-next-testing-basic/11248$ cat summary.yaml
ceph-sha1: 5a5597f6c5efb702d305a39e2828cf0c085997b8
client.0-kernel-sha1: 381448be4f27edab3cdeea88bbf6670e19bf4b8a
description: collection:thrash clusters:6-osd-3-machine.yaml fs:btrfs.yaml thrashers:default.yaml
workloads:rbd_fsx_cache_writeback.yaml
duration: 2297.8276979923248
failure_reason: failed to recover before timeout expired
flavor: basic
mds.a-kernel-sha1: 381448be4f27edab3cdeea88bbf6670e19bf4b8a
mon.a-kernel-sha1: 381448be4f27edab3cdeea88bbf6670e19bf4b8a
owner: scheduled_teuthology@teuthology
success: false
ubuntu@teuthology:/a/teuthology-2012-07-14_00:00:03-regression-next-testing-basic/11248$ cat config.yaml
kernel: &id001
kdb: true
sha1: 381448be4f27edab3cdeea88bbf6670e19bf4b8a
nuke-on-error: true
overrides:
ceph:
conf:
client:
rbd cache: true
fs: btrfs
log-whitelist:
- slow request
sha1: 5a5597f6c5efb702d305a39e2828cf0c085997b8
roles:
- - mon.a
- osd.0
- osd.1
- osd.2
- - mds.a
- osd.3
- osd.4
- osd.5
- - client.0
targets:
: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCWF1ovToj1jAHkUM4IKQ3d0Bn2AzA38jBEZxCcRKBqNq//804bDbt2VOa+5UvmDdcHevcwEHvcMqnAlTh5fb0e8qCadYuJhFFF+8yfAsujTtRpvGqkP5AIe90iNspLizCeHmS7Ej8USlWmFAyUVQ6tvSkiLFJcIDf64y+mkdVdnd0WQ2ArNV9mffq/OfHhmUSVXg9+OnxW1gQMWdMcjDu99VIQUbuZASeH0wwhGvlNHBWseHHUyYuNRbdoe2KF8v41gd3D+pBPCuHcA+QqKgJkUNt4Na+dayC8M5Q44ehJ+L8067385ZN9buTnJbZRIezXY5uw3ANJxWMogNK9m39t
: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6ZmsmnHcSY7O9viGtUzt5WebiPbwcXo9tg5qgWsaqn46DeegKbdsQ55ajysSUVVhvQA5hW6J9IYyZ5MjtlY2G/whyHYG85tNpAUiuedaQHmzARtL3URZmy2ZxwXgYyPHW3t1n0cu6KSb4pTv9vBjcaCouV2wgrinHAISzDOVuUeXdIhC8Tr3MB0nD1Gw6Xcak680XsQw6oYP6cM+yGCZ7sF15W8TR9IJGmphMIvtd8aTuBo9yet5rIxUfzpCM9Jiv+XgH2oT9h9WfacuL1uQ2C/dHUWoPynK36Uv2J785bfw/hVVtuSGu9Lb1n4o8p8Z88Ex4i8KaOxMiQAs3zqOx
: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDED+iOzDd09Q014u9BeiAiv+4SK+mv7u6GE8Oc59VBcshLVF8txB4BZaXO/OyQJL033i6d6OFvFdTKI8+7bmm1X+NM/7SPVVRpqaXhhnyB3TbMJi9Aa+Ak22fJ446H0Jf91q9di1m/IS8OUoVImwD8pSnTu7rHHy4ZeGkJpv/gpdXlhm0jq1s7d8Z3WpjPMYOoxilFz80gwh1eAM8emZKhqWdT/C+0SCUYLpU0EOdI+vvOEdEUeByg6xbB3Y6mOgJD2a6PREc0aZp/zxukBdPuY3yJzgT34b0WUuE5iu6ndnDDBoUD7fq7KlsFqrSHAICANls/A7PIPwD46DLaG6oN
tasks:
- internal.lock_machines: 3
- internal.save_config: null
- internal.check_lock: null
- internal.connect: null
- internal.check_conflict: null
- kernel: *id001
- internal.base: null
- internal.archive: null
- internal.coredump: null
- internal.syslog: null
- internal.timer: null
- chef: null
- clock: null
- ceph:
log-whitelist:
- wrongly marked me down or wrong addr
- objects unfound and apparently lost
- thrashosds:
timeout: 1200
- rbd_fsx:
clients:
- client.0
ops: 20000

Actions #2

Updated by Tamilarasi muthamizhan almost 12 years ago

  • Source changed from Development to Q/A

latest logs: ubuntu@teuthology:/a/teuthology-2012-07-20_05:00:03-regression-stable-master-basic/14803

from teuthology.log:

2012-07-20T06:28:47.208 ERROR:teuthology.run_tasks:Manager failed: <contextlib.GeneratorContextManager object at 0x1dc6f90>
Traceback (most recent call last):
File "/var/lib/teuthworker/teuthology/teuthology/run_tasks.py", line 45, in run_tasks
suppress = manager.__exit__(*exc_info)
File "/usr/lib/python2.6/contextlib.py", line 23, in exit
self.gen.next()
File "/var/lib/teuthworker/teuthology/teuthology/task/thrashosds.py", line 84, in task
thrash_proc.do_join()
File "/var/lib/teuthworker/teuthology/teuthology/task/ceph_manager.py", line 83, in do_join
self.thread.get()
File "/var/lib/teuthworker/teuthology/virtualenv/lib/python2.6/site-packages/gevent/greenlet.py", line 331, in get
raise self._exception
AssertionError: failed to recover before timeout expired
2012-07-20T06:28:47.209 DEBUG:teuthology.run_tasks:Unwinding manager <contextlib.GeneratorContextManager object at 0x1daabd0>
2012-07-20T06:28:47.209 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
File "/var/lib/teuthworker/teuthology/teuthology/contextutil.py", line 27, in nested
yield vars
File "/var/lib/teuthworker/teuthology/teuthology/task/ceph.py", line 1047, in task
yield
File "/var/lib/teuthworker/teuthology/teuthology/run_tasks.py", line 45, in run_tasks
suppress = manager.__exit__(*exc_info)
File "/usr/lib/python2.6/contextlib.py", line 23, in exit
self.gen.next()
File "/var/lib/teuthworker/teuthology/teuthology/task/thrashosds.py", line 84, in task
thrash_proc.do_join()
File "/var/lib/teuthworker/teuthology/teuthology/task/ceph_manager.py", line 83, in do_join
self.thread.get()
File "/var/lib/teuthworker/teuthology/virtualenv/lib/python2.6/site-packages/gevent/greenlet.py", line 331, in get
raise self._exception
AssertionError: failed to recover before timeout expired

ubuntu@teuthology:/a/teuthology-2012-07-20_05:00:03-regression-stable-master-basic/14803$ cat summary.yaml
ceph-sha1: c99671201de9d9cdf03bbf0f4e28e8afb70c280c
client.0-kernel-sha1: 26ce171915f348abd1f41da1ed139d93750d987f
description: collection:thrash clusters:6-osd-3-machine.yaml fs:btrfs.yaml thrashers:default.yaml
workloads:rbd_fsx_nocache.yaml
duration: 2174.070540189743
failure_reason: failed to recover before timeout expired
flavor: basic
mds.a-kernel-sha1: 26ce171915f348abd1f41da1ed139d93750d987f
mon.a-kernel-sha1: 26ce171915f348abd1f41da1ed139d93750d987f
owner: scheduled_teuthology@teuthology
success: false
ubuntu@teuthology:/a/teuthology-2012-07-20_05:00:03-regression-stable-master-basic/14803$ cat config.yaml
kernel: &id001
kdb: true
sha1: 26ce171915f348abd1f41da1ed139d93750d987f
nuke-on-error: true
overrides:
ceph:
conf:
client:
rbd cache: false
fs: btrfs
log-whitelist:
- slow request
sha1: c99671201de9d9cdf03bbf0f4e28e8afb70c280c
workunit:
sha1: c99671201de9d9cdf03bbf0f4e28e8afb70c280c
roles:
- - mon.a
- osd.0
- osd.1
- osd.2
- - mds.a
- osd.3
- osd.4
- osd.5
- - client.0
targets:
: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEwyNlwC9Utqf3PCjL2JR4wwDkzpdEJuW93DOW82vYVisYEGod454JwXeNkjqzTUk6tXeRoUM9f/C6sZS3LFgHcMYt6m0sxP8DC4qU+q0YxCw9zLY8bXKe4DDjijM62h/SnyqyOWIh9amGT7wRwZEHBV1BKvZbNxQIJ7ESkuKsk/tJfWKhq7dSw6E/+MZ4yQtXvTyaJ3pK96Hq2uoUkawv+FxXBrzG3FtTTYA8gqA1SIiV3erEIQuBK/WD74i5yK4rwpfGTo7jNc0V6wrwO1BKFj/OGjSC+2LSAkBgf8WLe6UL/dHr3bBEyzm0V4xMf5Iqb8JGvkaXNEfbFqzKC2Wv
: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUMsCERn/r+eXKzlu9W/n6BFak26ReRaNUaccpQTrqOqhm3M7LiIGAeBo6JsygU9Kdtsm3115P4odiDbQLuNm0gKPw5DY7zDVqV+YRqe3kOrgIL/rxs6l6Y7htSRvzGhz7RsaG1fQH/BuaD18+s2WguKWwgRuuU1bvRYEHu0Y7qYYqUy+xJd4CGX+LMuAJzDYj5R7xIEYlJBln/c47He8q53cUUw5w48Hm47O8xo9ov7CqHCpOTZixeseY+zEm9skoLsUpBDIOmT+xUh7sOyKFhj+CnETpv3DocxGtoUgkx42GtkDhFK/dVV95Q6EOBseyYIUvFoHBKB2WV32xyxB5
: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC8bUAPl49ehcm4WuMAuuopncl9r8nQQEslbavP46ezYvI/hVQKSERVod7L7iK3pZ9iqQUyJUCkuFIR4/b2EQ8hQ+scv12K4n45DHTS8jHOCablg3vGkLPJmvKKedVYL5KPhCj6je3f0lVc+TXOGkJJvopDwhHnrh2TmRkaGOA7svsxknvT3Qx683XlNbi3S64YmU0us7IOCbXwZTEdZphzoqHHWLe0ZKkLNL72eDujtFi6LHspUoEmHBk46RrsGbhYFwlYTq47NGbj5g5ix/iS6C7bRNNCRD9GWciKqpAvZk88Zg/LbCzsV8DK4shnJuNqhBJPgKflUuqpYVZ8SuCJ
tasks:
- internal.lock_machines: 3
- internal.save_config: null
- internal.check_lock: null
- internal.connect: null
- internal.check_conflict: null
- kernel: *id001
- internal.base: null
- internal.archive: null
- internal.coredump: null
- internal.syslog: null
- internal.timer: null
- chef: null
- clock: null
- ceph:
log-whitelist:
- wrongly marked me down or wrong addr
- objects unfound and apparently lost
- thrashosds:
timeout: 1200
- rbd_fsx:
clients:
- client.0
ops: 20000

Actions #3

Updated by Tamilarasi muthamizhan over 11 years ago

Recent logs: ubuntu@teuthology:/a/teuthology-2012-08-08_00:00:07-regression-next-testing-basic/5616

2012-08-08T02:20:44.421 ERROR:teuthology.run_tasks:Manager failed: <contextlib.GeneratorContextManager object at 0x1fd6090>
Traceback (most recent call last):
  File "/var/lib/teuthworker/teuthology/teuthology/run_tasks.py", line 45, in run_tasks
    suppress = manager.__exit__(*exc_info)
  File "/usr/lib/python2.6/contextlib.py", line 23, in __exit__
    self.gen.next()
  File "/var/lib/teuthworker/teuthology/teuthology/task/thrashosds.py", line 84, in task
    thrash_proc.do_join()
  File "/var/lib/teuthworker/teuthology/teuthology/task/ceph_manager.py", line 83, in do_join
    self.thread.get()
  File "/var/lib/teuthworker/teuthology/virtualenv/lib/python2.6/site-packages/gevent/greenlet.py", line 331, in get
    raise self._exception
AssertionError: failed to recover before timeout expired
2012-08-08T02:20:44.449 DEBUG:teuthology.run_tasks:Unwinding manager <contextlib.GeneratorContextManager object at 0x1effcd0>
2012-08-08T02:20:44.449 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/var/lib/teuthworker/teuthology/teuthology/contextutil.py", line 27, in nested
    yield vars
  File "/var/lib/teuthworker/teuthology/teuthology/task/ceph.py", line 1051, in task
    yield
  File "/var/lib/teuthworker/teuthology/teuthology/run_tasks.py", line 45, in run_tasks
    suppress = manager.__exit__(*exc_info)
  File "/usr/lib/python2.6/contextlib.py", line 23, in __exit__
    self.gen.next()
  File "/var/lib/teuthworker/teuthology/teuthology/task/thrashosds.py", line 84, in task
    thrash_proc.do_join()
  File "/var/lib/teuthworker/teuthology/teuthology/task/ceph_manager.py", line 83, in do_join
    self.thread.get()
  File "/var/lib/teuthworker/teuthology/virtualenv/lib/python2.6/site-packages/gevent/greenlet.py", line 331, in get
    raise self._exception
AssertionError: failed to recover before timeout expired

Actions #4

Updated by Tamilarasi muthamizhan over 11 years ago

Recent logs: ubuntu@teuthology:/a/teuthology-2012-08-13_19:00:07-regression-master-testing-gcov/108

Actions #5

Updated by Tamilarasi muthamizhan over 11 years ago

Recent logs: ubuntu@teuthology:/a/teuthology-2012-08-16_02:00:06-regression-testing-testing-basic/2211

Actions #6

Updated by Tamilarasi muthamizhan over 11 years ago

logs: ubuntu@teuthology:/a/teuthology-2012-08-17_02:00:04-regression-testing-testing-basic/3038

Actions #7

Updated by Tamilarasi muthamizhan over 11 years ago

Logs: ubuntu@teuthology:/a/teuthology-2012-08-20_04:00:05-regression-stable-master-basic/5044

Actions #8

Updated by Sage Weil over 11 years ago

  • Status changed from New to 12

just reproduced this one with osd and msgr logs:


ubuntu@teuthology:/a/sage-cfix/5207$ cat config.yaml 
kernel: &id001
  branch: testing
  kdb: true
nuke-on-error: true
overrides:
  ceph:
    branch: bug-2956
    conf:
      global:
        debug ms: 20
        ms inject socket failures: 5000
      osd:
        debug osd: 20
    fs: btrfs
    log-whitelist:
    - slow request
roles:
- - mon.a
  - osd.0
  - osd.1
  - osd.2
- - mds.a
  - osd.3
  - osd.4
  - osd.5
- - client.0
targets:
  ubuntu@plana45.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDp3cwfZhOipCot6NiKX4cRMn4zx43QY0+5HdqzCQU2y7OrOJt3d0qvifnZPyeq8/d+aW2WL2OM8m4taz380JsP0SLmlpY8D0pGY/tN0pQDqIFd8EboMtKY6tR8unQrVzuczMqup/tkKSfdRp0zAeTiJ8qH7l9MaVcOw6WfRACb8f7APJE2gVRBrzPAdbqKzAphTRzZSz0cq722AX7XQDPT2dz7NoTp5Tk7xaQdDu2II+78B1H27IWdyYeonfy17yf9N+IA2Xzna/g5zu8apg7UvzyFmHunLyjr78dhPtR39201A0QJ5x5Qli9/UaB3LwiqnbCiGfx4xWFazdUFzxiD
  ubuntu@plana46.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCrD6s9otJ5xCNH4nyv0iJu6AoqmlNTFd8D0X9RfFBnmOMrMBWU9kwsFzPIOsuJGbSYbA8LCtjWUwaWoXmbEFtTMitxaDXp47gbVNXknHq7TGZHkWWOwKKu+tlSQBpCVzO/rzBbvJ9fcG7tewq5XcIHz0IUXsUFuEuXR1HaTUJKic2twBpaeAGNvdd6IZ9Sz9TMkfiRV/aVdcHJ/yF8bsXi3pfRPR3puMK/Nyfq5Hz/aabQo1TSyK2o0weoWV7D8vD6S8f3D7p5/5ScBhL3zUcP85SsV47W+/hTFbU8kN1Grlv2sx0fVMB/TUB/UNVdsHKGn5Nv6zb/qMqBEx9nSeZ9
  ubuntu@plana47.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCUMS+/Rfo92n0pY5cDrv+M9lss9i6+Zum4aa4aE54KsOcKkl+6yooZcZL8bllGLVL1W7BkaBOJ59dQwTVIo/UAgiKyA4J5IVwBPjwNNp4/mXzKJtKQPj0UrTCKsQrKasWPC+FVRzqJRK70cgC5D40znuopmfmENoPwCniOJALFCw3q8XLkcq1SH0jzDXJdsrnTVGxwRHYq9cF9J7fr6XZQXuAk7XO3jG1eqlF8xljmkvI0Ftux50TkOsDzpkscD5jHkxiFj/gkO2KR5GNbybdnxllHBAYuv2hoxrsW2oyIxbeforwZFV0DcDhRReRTx8BhXZ0o5erZgPgzS+ZbfWol
tasks:
- internal.lock_machines: 3
- internal.save_config: null
- internal.check_lock: null
- internal.connect: null
- internal.check_conflict: null
- kernel: *id001
- internal.base: null
- internal.archive: null
- internal.coredump: null
- internal.syslog: null
- internal.timer: null
- chef: null
- clock: null
- ceph:
    log-whitelist:
    - wrongly marked me down
    - objects unfound and apparently lost
- thrashosds:
    timeout: 1200
- radosbench:
    clients:
    - client.0
    time: 1800

Actions #9

Updated by Sage Weil over 11 years ago

  • Target version set to v0.51
Actions #10

Updated by Sage Weil over 11 years ago

  • Target version changed from v0.51 to 83
Actions #11

Updated by Tamilarasi muthamizhan over 11 years ago

Recent logs:ubuntu@teuthology: /a/teuthology-2012-08-23_19:00:08-regression-master-testing-gcov/7594

Actions #12

Updated by Sage Weil over 11 years ago

  • Target version changed from 83 to v0.52a
Actions #13

Updated by Sage Weil over 11 years ago

  • Priority changed from Urgent to High
Actions #14

Updated by Tamilarasi muthamizhan over 11 years ago

Recent logs: ubuntu@teuthology:/a/teuthology-2012-08-28_19:00:05-regression-master-testing-gcov/10872

Actions #15

Updated by Tamilarasi muthamizhan over 11 years ago

Recent logs: ubuntu@teuthology:/a/teuthology-2012-09-05_04:00:05-regression-stable-master-basic/16530

Actions #16

Updated by Samuel Just over 11 years ago

  • Status changed from 12 to 7

Testing fix in wip_push_fix c56b8a8bde6242e8b485a5d87798edf068d22642.

recovery_op leak.

Actions #17

Updated by Samuel Just over 11 years ago

  • Status changed from 7 to Resolved

Now in master/next 4e5283d476fc3405f30c91f1447e6059a1b52c8c

Actions #18

Updated by Tamilarasi muthamizhan about 11 years ago

recent log: ubuntu@teuthology:/a/teuthology-2013-02-09_20:00:03-regression-bobtail-master-basic/3922

Actions

Also available in: Atom PDF