Actions
Bug #51576
openqa/tasks/radosbench.py times out
Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:
0%
Source:
Tags:
Backport:
pacific, octopus
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
2021-07-04T16:08:49.993 INFO:tasks.radosbench.radosbench.0.smithi198.stdout:Removed 50412 objects
2021-07-04T16:08:49.993 INFO:tasks.radosbench.radosbench.0.smithi198.stdout:Clean up completed and total clean up time :3141.72
...
2021-07-04T16:08:59.005 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/run_tasks.py", line 91, in run_tasks
manager = run_one_task(taskname, ctx=ctx, config=config)
File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/run_tasks.py", line 70, in run_one_task
return task(**kwargs)
File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/task/parallel.py", line 56, in task
p.spawn(_run_spawned, ctx, confg, taskname)
File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/parallel.py", line 84, in __exit__
for result in self:
File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/parallel.py", line 98, in __next__
resurrect_traceback(result)
File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/parallel.py", line 30, in resurrect_traceback
raise exc.exc_info[1]
File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/parallel.py", line 23, in capture_traceback
return func(*args, **kwargs)
File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/task/parallel.py", line 64, in _run_spawned
mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config)
File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/run_tasks.py", line 70, in run_one_task
return task(**kwargs)
File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/task/sequential.py", line 47, in task
mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg)
File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/run_tasks.py", line 70, in run_one_task
return task(**kwargs)
File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/task/full_sequential.py", line 37, in task
mgr.__exit__(*exc_info)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/home/teuthworker/src/github.com_ceph_ceph_283df1071a4c03b56eba700b1fcc721dbaf6bc3d/qa/tasks/radosbench.py", line 140, in task
run.wait(radosbench.values(), timeout=timeout)
File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/orchestra/run.py", line 473, in wait
check_time()
File "/home/teuthworker/src/git.ceph.com_git_teuthology_26631ede9027a5643f2e47dacc5af6f1834aac45/teuthology/contextutil.py", line 133, in __call__
raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (500) after waiting for 3000 seconds
/a/yuriw-2021-07-04_14:41:02-upgrade:pacific-p2p-pacific-distro-basic-smithi/6252369
Updated by Neha Ojha over 2 years ago
- Backport changed from pacific to pacific, octopus
2021-10-12T22:45:35.298 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
File "/home/teuthworker/src/git.ceph.com_ceph_7860f3d77ee3e58c18067dbf7c5e3242c90d9096/qa/tasks/thrashosds.py", line 211, in task
yield
File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/teuthology/task/sequential.py", line 47, in task
mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg)
File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/teuthology/run_tasks.py", line 70, in run_one_task
return task(**kwargs)
File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/teuthology/task/full_sequential.py", line 37, in task
mgr.__exit__(*exc_info)
File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
next(self.gen)
File "/home/teuthworker/src/git.ceph.com_ceph_7860f3d77ee3e58c18067dbf7c5e3242c90d9096/qa/tasks/radosbench.py", line 141, in task
run.wait(radosbench.values(), timeout=timeout)
File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/teuthology/orchestra/run.py", line 473, in wait
check_time()
File "/home/teuthworker/src/git.ceph.com_git_teuthology_6f40c4ca66d0ac515a149c2e25df0d91b2dd1a9b/teuthology/contextutil.py", line 133, in __call__
raise MaxWhileTries(error_msg)
teuthology.exceptions.MaxWhileTries: reached maximum tries (500) after waiting for 3000 seconds
upgrade:octopus-p2p/octopus-p2p-stress-split/{0-cluster/{openstack start} 1-ceph-install/octopus 1.1.short_pg_log 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{fsx radosbench rbd-cls rbd-import-export rbd_api readwrite snaps-few-objects} 5-finish-upgrade 6-final-workload/{rbd-python snaps-many-objects} objectstore/filestore-xfs supported-all-distro/ubuntu_latest thrashosds-health}
/a/teuthology-2021-10-12_13:14:34-upgrade:octopus-p2p-octopus-distro-basic-smithi/6433941
Actions