Actions
Bug #63941
openrbd/test_librbd_python.sh test failures
% Done:
0%
Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
2024-01-04T01:42:58.473 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jan 04 01:42:58 smithi131 ceph-0ce17dd8-aa99-11ee-95a9-87774f69a715-mgr-y[151836]: [04/Jan/2024:01:42:58] ENGINE Bus STOPPING
2024-01-04T01:42:58.473 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jan 04 01:42:58 smithi131 ceph-0ce17dd8-aa99-11ee-95a9-87774f69a715-mgr-y[151836]: [04/Jan/2024:01:42:58] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down
2024-01-04T01:42:58.473 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jan 04 01:42:58 smithi131 ceph-0ce17dd8-aa99-11ee-95a9-87774f69a715-mgr-y[151836]: [04/Jan/2024:01:42:58] ENGINE Bus STOPPED
2024-01-04T01:42:58.474 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jan 04 01:42:58 smithi131 ceph-0ce17dd8-aa99-11ee-95a9-87774f69a715-mgr-y[151836]: [04/Jan/2024:01:42:58] ENGINE Bus STARTING
2024-01-04T01:42:58.474 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jan 04 01:42:58 smithi131 ceph-0ce17dd8-aa99-11ee-95a9-87774f69a715-mgr-y[151836]: [04/Jan/2024:01:42:58] ENGINE Serving on http://:::9283
2024-01-04T01:42:58.474 INFO:journalctl@ceph.mgr.y.smithi131.stdout:Jan 04 01:42:58 smithi131 ceph-0ce17dd8-aa99-11ee-95a9-87774f69a715-mgr-y[151836]: [04/Jan/2024:01:42:58] ENGINE Bus STARTED
2024-01-04T01:42:58.781 INFO:journalctl@ceph.mon.b.smithi151.stdout:Jan 04 01:42:58 smithi151 ceph-mon[147366]: pgmap v3917: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 676 KiB/s rd, 36 KiB/s wr, 940 op/s
2024-01-04T01:42:58.782 INFO:journalctl@ceph.mon.b.smithi151.stdout:Jan 04 01:42:58 smithi151 ceph-mon[147366]: from='client.? ' entity='client.admin'
2024-01-04T01:42:58.782 INFO:journalctl@ceph.mon.b.smithi151.stdout:Jan 04 01:42:58 smithi151 ceph-mon[147366]: from='mgr.24971 172.21.15.131:0/4201117188' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch
2024-01-04T01:42:58.782 INFO:journalctl@ceph.mon.b.smithi151.stdout:Jan 04 01:42:58 smithi151 ceph-mon[147366]: from='mgr.24971 172.21.15.131:0/4201117188' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch
2024-01-04T01:42:58.782 INFO:journalctl@ceph.mon.b.smithi151.stdout:Jan 04 01:42:58 smithi151 ceph-mon[147366]: from='mgr.24971 172.21.15.131:0/4201117188' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch
2024-01-04T01:42:58.782 INFO:journalctl@ceph.mon.b.smithi151.stdout:Jan 04 01:42:58 smithi151 ceph-mon[147366]: from='mgr.24971 172.21.15.131:0/4201117188' entity='mgr.y'
2024-01-04T01:42:58.801 INFO:journalctl@ceph.mon.a.smithi131.stdout:Jan 04 01:42:58 smithi131 ceph-mon[156876]: pgmap v3917: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 676 KiB/s rd, 36 KiB/s wr, 940 op/s
2024-01-04T01:42:58.802 INFO:journalctl@ceph.mon.a.smithi131.stdout:Jan 04 01:42:58 smithi131 ceph-mon[156876]: from='client.? ' entity='client.admin'
2024-01-04T01:42:58.802 INFO:journalctl@ceph.mon.a.smithi131.stdout:Jan 04 01:42:58 smithi131 ceph-mon[156876]: from='mgr.24971 172.21.15.131:0/4201117188' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch
2024-01-04T01:42:58.802 INFO:journalctl@ceph.mon.a.smithi131.stdout:Jan 04 01:42:58 smithi131 ceph-mon[156876]: from='mgr.24971 172.21.15.131:0/4201117188' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch
2024-01-04T01:42:58.802 INFO:journalctl@ceph.mon.a.smithi131.stdout:Jan 04 01:42:58 smithi131 ceph-mon[156876]: from='mgr.24971 172.21.15.131:0/4201117188' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch
2024-01-04T01:42:58.802 INFO:journalctl@ceph.mon.a.smithi131.stdout:Jan 04 01:42:58 smithi131 ceph-mon[156876]: from='mgr.24971 172.21.15.131:0/4201117188' entity='mgr.y'
2024-01-04T01:42:58.802 INFO:journalctl@ceph.mon.c.smithi131.stdout:Jan 04 01:42:58 smithi131 ceph-mon[159554]: pgmap v3917: 137 pgs: 137 active+clean; 4.6 MiB data, 4.7 GiB used, 711 GiB / 715 GiB avail; 676 KiB/s rd, 36 KiB/s wr, 940 op/s
2024-01-04T01:42:58.802 INFO:journalctl@ceph.mon.c.smithi131.stdout:Jan 04 01:42:58 smithi131 ceph-mon[159554]: from='client.? ' entity='client.admin'
2024-01-04T01:42:58.802 INFO:journalctl@ceph.mon.c.smithi131.stdout:Jan 04 01:42:58 smithi131 ceph-mon[159554]: from='mgr.24971 172.21.15.131:0/4201117188' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch
2024-01-04T01:42:58.802 INFO:journalctl@ceph.mon.c.smithi131.stdout:Jan 04 01:42:58 smithi131 ceph-mon[159554]: from='mgr.24971 172.21.15.131:0/4201117188' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch
2024-01-04T01:42:58.802 INFO:journalctl@ceph.mon.c.smithi131.stdout:Jan 04 01:42:58 smithi131 ceph-mon[159554]: from='mgr.24971 172.21.15.131:0/4201117188' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch
2024-01-04T01:42:58.803 INFO:journalctl@ceph.mon.c.smithi131.stdout:Jan 04 01:42:58 smithi131 ceph-mon[159554]: from='mgr.24971 172.21.15.131:0/4201117188' entity='mgr.y'
2024-01-04T01:42:58.829 INFO:tasks.workunit.client.0.smithi131.stderr:test_rbd.test_rename ... ok
2024-01-04T01:42:58.830 INFO:tasks.workunit.client.0.smithi131.stderr:
2024-01-04T01:42:58.830 INFO:tasks.workunit.client.0.smithi131.stderr:======================================================================
2024-01-04T01:42:58.830 INFO:tasks.workunit.client.0.smithi131.stderr:ERROR: test_rbd.TestImage.test_diff_iterate
2024-01-04T01:42:58.830 INFO:tasks.workunit.client.0.smithi131.stderr:----------------------------------------------------------------------
2024-01-04T01:42:58.830 INFO:tasks.workunit.client.0.smithi131.stderr:Traceback (most recent call last):
2024-01-04T01:42:58.830 INFO:tasks.workunit.client.0.smithi131.stderr: File "/usr/lib/python3.6/site-packages/nose/case.py", line 384, in tearDown
2024-01-04T01:42:58.831 INFO:tasks.workunit.client.0.smithi131.stderr: try_run(self.inst, ('teardown', 'tearDown'))
2024-01-04T01:42:58.831 INFO:tasks.workunit.client.0.smithi131.stderr: File "/usr/lib/python3.6/site-packages/nose/util.py", line 471, in try_run
2024-01-04T01:42:58.831 INFO:tasks.workunit.client.0.smithi131.stderr: return func()
2024-01-04T01:42:58.831 INFO:tasks.workunit.client.0.smithi131.stderr: File "/home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_rbd.py", line 573, in tearDown
2024-01-04T01:42:58.831 INFO:tasks.workunit.client.0.smithi131.stderr: remove_image()
2024-01-04T01:42:58.831 INFO:tasks.workunit.client.0.smithi131.stderr: File "/home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_rbd.py", line 119, in remove_image
2024-01-04T01:42:58.831 INFO:tasks.workunit.client.0.smithi131.stderr: RBD().remove(ioctx, image_name)
2024-01-04T01:42:58.832 INFO:tasks.workunit.client.0.smithi131.stderr: File "rbd.pyx", line 767, in rbd.RBD.remove
2024-01-04T01:42:58.832 INFO:tasks.workunit.client.0.smithi131.stderr:rbd.ImageHasSnapshots: [errno 39] RBD image has snapshots (error removing image)
2024-01-04T01:42:58.832 INFO:tasks.workunit.client.0.smithi131.stderr:
2024-01-04T01:42:58.832 INFO:tasks.workunit.client.0.smithi131.stderr:======================================================================
2024-01-04T01:42:58.832 INFO:tasks.workunit.client.0.smithi131.stderr:FAIL: test_rbd.TestImage.test_diff_iterate
2024-01-04T01:42:58.832 INFO:tasks.workunit.client.0.smithi131.stderr:----------------------------------------------------------------------
2024-01-04T01:42:58.832 INFO:tasks.workunit.client.0.smithi131.stderr:Traceback (most recent call last):
2024-01-04T01:42:58.833 INFO:tasks.workunit.client.0.smithi131.stderr: File "/usr/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
2024-01-04T01:42:58.833 INFO:tasks.workunit.client.0.smithi131.stderr: self.test(*self.arg)
2024-01-04T01:42:58.833 INFO:tasks.workunit.client.0.smithi131.stderr: File "/home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_rbd.py", line 1217, in test_diff_iterate
2024-01-04T01:42:58.833 INFO:tasks.workunit.client.0.smithi131.stderr: check_diff(self.image, 0, IMG_SIZE, 'snap1', [(0, 512, False)])
2024-01-04T01:42:58.833 INFO:tasks.workunit.client.0.smithi131.stderr: File "/home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_rbd.py", line 1441, in check_diff
2024-01-04T01:42:58.833 INFO:tasks.workunit.client.0.smithi131.stderr: eq(extents, expected)
2024-01-04T01:42:58.833 INFO:tasks.workunit.client.0.smithi131.stderr:AssertionError: [] != [(0, 512, False)]
2024-01-04T01:42:58.834 INFO:tasks.workunit.client.0.smithi131.stderr:
2024-01-04T01:42:58.834 INFO:tasks.workunit.client.0.smithi131.stderr:======================================================================
2024-01-04T01:42:58.834 INFO:tasks.workunit.client.0.smithi131.stderr:FAIL: test_rbd.test_pool_stats
2024-01-04T01:42:58.834 INFO:tasks.workunit.client.0.smithi131.stderr:----------------------------------------------------------------------
2024-01-04T01:42:58.834 INFO:tasks.workunit.client.0.smithi131.stderr:Traceback (most recent call last):
2024-01-04T01:42:58.834 INFO:tasks.workunit.client.0.smithi131.stderr: File "/usr/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
2024-01-04T01:42:58.834 INFO:tasks.workunit.client.0.smithi131.stderr: self.test(*self.arg)
2024-01-04T01:42:58.835 INFO:tasks.workunit.client.0.smithi131.stderr: File "/home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_rbd.py", line 140, in _require_new_format
2024-01-04T01:42:58.835 INFO:tasks.workunit.client.0.smithi131.stderr: return fn(*args, **kwargs)
2024-01-04T01:42:58.835 INFO:tasks.workunit.client.0.smithi131.stderr: File "/home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_rbd.py", line 509, in test_pool_stats
2024-01-04T01:42:58.835 INFO:tasks.workunit.client.0.smithi131.stderr: eq(stats['image_count'], 4)
2024-01-04T01:42:58.835 INFO:tasks.workunit.client.0.smithi131.stderr:AssertionError: 5 != 4
2024-01-04T01:42:58.835 INFO:tasks.workunit.client.0.smithi131.stderr:
2024-01-04T01:42:58.836 INFO:tasks.workunit.client.0.smithi131.stderr:======================================================================
2024-01-04T01:42:58.836 INFO:tasks.workunit.client.0.smithi131.stderr:FAIL: test_rbd.test_list_empty
2024-01-04T01:42:58.836 INFO:tasks.workunit.client.0.smithi131.stderr:----------------------------------------------------------------------
2024-01-04T01:42:58.836 INFO:tasks.workunit.client.0.smithi131.stderr:Traceback (most recent call last):
2024-01-04T01:42:58.836 INFO:tasks.workunit.client.0.smithi131.stderr: File "/usr/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
2024-01-04T01:42:58.836 INFO:tasks.workunit.client.0.smithi131.stderr: self.test(*self.arg)
2024-01-04T01:42:58.836 INFO:tasks.workunit.client.0.smithi131.stderr: File "/home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_rbd.py", line 378, in test_list_empty
2024-01-04T01:42:58.836 INFO:tasks.workunit.client.0.smithi131.stderr: eq([], RBD().list(ioctx))
2024-01-04T01:42:58.837 INFO:tasks.workunit.client.0.smithi131.stderr:AssertionError: [] != ['image125']
2024-01-04T01:42:58.837 INFO:tasks.workunit.client.0.smithi131.stderr:
2024-01-04T01:42:58.837 INFO:tasks.workunit.client.0.smithi131.stderr:======================================================================
2024-01-04T01:42:58.837 INFO:tasks.workunit.client.0.smithi131.stderr:FAIL: test_rbd.test_list
2024-01-04T01:42:58.837 INFO:tasks.workunit.client.0.smithi131.stderr:----------------------------------------------------------------------
2024-01-04T01:42:58.837 INFO:tasks.workunit.client.0.smithi131.stderr:Traceback (most recent call last):
2024-01-04T01:42:58.837 INFO:tasks.workunit.client.0.smithi131.stderr: File "/usr/lib/python3.6/site-packages/nose/case.py", line 197, in runTest
2024-01-04T01:42:58.837 INFO:tasks.workunit.client.0.smithi131.stderr: self.test(*self.arg)
2024-01-04T01:42:58.837 INFO:tasks.workunit.client.0.smithi131.stderr: File "/home/ubuntu/cephtest/clone.client.0/src/test/pybind/test_rbd.py", line 382, in test_list
2024-01-04T01:42:58.837 INFO:tasks.workunit.client.0.smithi131.stderr: eq([image_name], RBD().list(ioctx))
2024-01-04T01:42:58.837 INFO:tasks.workunit.client.0.smithi131.stderr:AssertionError: ['image442'] != ['image125', 'image442']
2024-01-04T01:42:58.837 INFO:tasks.workunit.client.0.smithi131.stderr:
2024-01-04T01:42:58.838 INFO:tasks.workunit.client.0.smithi131.stderr:----------------------------------------------------------------------
2024-01-04T01:42:58.838 INFO:tasks.workunit.client.0.smithi131.stderr:Ran 172 tests in 620.660s
2024-01-04T01:42:58.838 INFO:tasks.workunit.client.0.smithi131.stderr:
2024-01-04T01:42:58.838 INFO:tasks.workunit.client.0.smithi131.stderr:FAILED (SKIP=8, errors=1, failures=4)
2024-01-04T01:42:58.860 DEBUG:teuthology.orchestra.run:got remote process result: 1
2024-01-04T01:42:58.861 INFO:tasks.workunit:Stopping ['rbd/test_librbd_python.sh'] on client.0...
2024-01-04T01:42:58.861 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0
2024-01-04T01:42:59.068 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/run_tasks.py", line 105, in run_tasks
manager = run_one_task(taskname, ctx=ctx, config=config)
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/run_tasks.py", line 83, in run_one_task
return task(**kwargs)
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/task/parallel.py", line 56, in task
p.spawn(_run_spawned, ctx, confg, taskname)
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/parallel.py", line 84, in __exit__
for result in self:
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/parallel.py", line 98, in __next__
resurrect_traceback(result)
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/parallel.py", line 30, in resurrect_traceback
raise exc.exc_info[1]
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/parallel.py", line 23, in capture_traceback
return func(*args, **kwargs)
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/task/parallel.py", line 64, in _run_spawned
mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config)
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/run_tasks.py", line 83, in run_one_task
return task(**kwargs)
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/task/full_sequential.py", line 30, in task
mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg)
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/run_tasks.py", line 83, in run_one_task
return task(**kwargs)
File "/home/teuthworker/src/github.com_ceph_ceph-c_f0cadc3cff0ba3a2c1783f1ad35bebe9207c77e0/qa/tasks/workunit.py", line 129, in task
p.spawn(_run_tests, ctx, refspec, role, tests,
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/parallel.py", line 84, in __exit__
for result in self:
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/parallel.py", line 98, in __next__
resurrect_traceback(result)
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/parallel.py", line 30, in resurrect_traceback
raise exc.exc_info[1]
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/parallel.py", line 23, in capture_traceback
return func(*args, **kwargs)
File "/home/teuthworker/src/github.com_ceph_ceph-c_f0cadc3cff0ba3a2c1783f1ad35bebe9207c77e0/qa/tasks/workunit.py", line 424, in _run_tests
remote.run(
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/orchestra/remote.py", line 523, in run
r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/orchestra/run.py", line 455, in run
r.wait()
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/orchestra/run.py", line 161, in wait
self._raise_for_status()
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/orchestra/run.py", line 181, in _raise_for_status
raise CommandFailedError(
teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/test_librbd_python.sh) on smithi131 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=pacific TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh'
2024-01-04T01:42:59.181 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=12e36c9abfa54d07b3284c8238df4de2
Traceback (most recent call last):
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/run_tasks.py", line 105, in run_tasks
manager = run_one_task(taskname, ctx=ctx, config=config)
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/run_tasks.py", line 83, in run_one_task
return task(**kwargs)
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/task/parallel.py", line 56, in task
p.spawn(_run_spawned, ctx, confg, taskname)
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/parallel.py", line 84, in __exit__
for result in self:
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/parallel.py", line 98, in __next__
resurrect_traceback(result)
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/parallel.py", line 30, in resurrect_traceback
raise exc.exc_info[1]
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/parallel.py", line 23, in capture_traceback
return func(*args, **kwargs)
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/task/parallel.py", line 64, in _run_spawned
mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config)
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/run_tasks.py", line 83, in run_one_task
return task(**kwargs)
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/task/full_sequential.py", line 30, in task
mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=confg)
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/run_tasks.py", line 83, in run_one_task
return task(**kwargs)
File "/home/teuthworker/src/github.com_ceph_ceph-c_f0cadc3cff0ba3a2c1783f1ad35bebe9207c77e0/qa/tasks/workunit.py", line 129, in task
p.spawn(_run_tests, ctx, refspec, role, tests,
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/parallel.py", line 84, in __exit__
for result in self:
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/parallel.py", line 98, in __next__
resurrect_traceback(result)
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/parallel.py", line 30, in resurrect_traceback
raise exc.exc_info[1]
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/parallel.py", line 23, in capture_traceback
return func(*args, **kwargs)
File "/home/teuthworker/src/github.com_ceph_ceph-c_f0cadc3cff0ba3a2c1783f1ad35bebe9207c77e0/qa/tasks/workunit.py", line 424, in _run_tests
remote.run(
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/orchestra/remote.py", line 523, in run
r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/orchestra/run.py", line 455, in run
r.wait()
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/orchestra/run.py", line 161, in wait
self._raise_for_status()
File "/home/teuthworker/src/git.ceph.com_teuthology_01dd171a561ca33631bf0a38b105879779f72410/teuthology/orchestra/run.py", line 181, in _raise_for_status
raise CommandFailedError(
teuthology.exceptions.CommandFailedError: Command failed (workunit test rbd/test_librbd_python.sh) on smithi131 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=pacific TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rbd/test_librbd_python.sh'
2024-01-04T01:42:59.186 DEBUG:teuthology.run_tasks:Unwinding manager cephadm
2024-01-04T01:42:59.197 INFO:tasks.cephadm:Teardown begin
2024-01-04T01:42:59.198 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools
2024-01-04T01:42:59.198 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json
2024-01-04T01:42:59.551 INFO:teuthology.orchestra.run.smithi131.stdout:
Updated by Laura Flores 4 months ago
- Translation missing: en.field_tag_list set to test-failure
- Backport set to quincy
/a/yuriw-2024-01-03_01:21:07-rados-wip-yuri3-testing-2024-01-02-1236-quincy-distro-default-smithi/7504310
Updated by Ilya Dryomov 4 months ago
In https://pulpito.ceph.com/yuriw-2024-01-03_21:31:38-rados-wip-yuri7-testing-2024-01-03-0857-quincy-distro-default-smithi/7505974 the failure is caused by a mismatch between librbd version and the test version: a test script from mid-October was used against the tip of pacific. I have updated pacific branch in ceph-ci.git (the repo that was used here) with latest bits. Prashant, please rerun the test.
Updated by Ilya Dryomov 4 months ago
Laura Flores wrote:
/a/yuriw-2024-01-03_01:21:07-rados-wip-yuri3-testing-2024-01-02-1236-quincy-distro-default-smithi/7504310
Same thing here, a mismatch between librbd version (https://github.com/ceph/ceph/pull/54949 present) and the test version (https://github.com/ceph/ceph/pull/54949 not present). Laura, please rerun the test.
Updated by Ilya Dryomov 4 months ago
- Status changed from New to Need More Info
- Assignee set to Ilya Dryomov
- Backport deleted (
quincy)
Updated by Laura Flores 4 months ago
/a/yuriw-2024-01-13_16:51:28-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi/7516129
Updated by Kamoltat (Junior) Sirivadhna 4 months ago
- Subject changed from [quincy]rbd/test_librbd_python.sh test failures to rbd/test_librbd_python.sh test failures
this also affects reef as well, so removing the [quincy] header
Updated by Kamoltat (Junior) Sirivadhna 4 months ago
/a/yuriw-2024-01-15_22:01:02-rados-wip-yuri11-testing-2024-01-12-1402-reef-distro-default-smithi/7517192/
Updated by Matan Breizman 3 months ago
- Backport set to reef
/a/yuriw-2024-01-23_16:13:27-rados-wip-yuri-testing-2024-01-21-0805-reef-distro-default-smithi/7528714
Updated by Yuri Weinstein 3 months ago
Updated by Aishwarya Mathuria 3 months ago
/a/yuriw-2024-02-13_15:50:02-rados-wip-yuri2-testing-2024-02-12-0808-reef-distro-default-smithi/7558337
Updated by Ilya Dryomov 3 months ago
- Backport deleted (
reef)
The same issue affected quincy and reef branch. The way upgrade tests that are scheduled on a wip-foo branch in ceph-ci.git end up depending on release branches in ceph-ci.git which shouldn't even be there isn't nice.
I have updated quincy and reef branches in ceph-ci.git (quincy was almost a year old). Let me know if this pops up again.
Updated by Ilya Dryomov 3 months ago
Yuri Weinstein wrote:
Also in 16.2.15 RC
This is a different issue and was handled in https://github.com/ceph/ceph/pull/55418 (pacific) and https://github.com/ceph/ceph/pull/55554 (quincy).
Updated by Ilya Dryomov 3 months ago
- Has duplicate Bug #64345: rbd/test_librbd_python.sh: ERROR at teardown of TestImage.test_diff_iterate added
Actions