Bug #58656
qa: Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring)
Status:
Duplicate
Priority:
Normal
Assignee:
-
Category:
qa
Target version:
-
% Done:
0%
Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
test_cephfs_mirror_restart_sync_on_blocklist fails with below error.
tasks.cephfs.test_mirroring.TestMirroring.test_cephfs_mirror_restart_sync_on_blocklist' 2023-02-04T11:01:28.511 INFO:tasks.cephfs_test_runner:test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring) ... ERROR 2023-02-04T11:01:28.512 INFO:tasks.cephfs_test_runner: 2023-02-04T11:01:28.512 INFO:tasks.cephfs_test_runner:====================================================================== 2023-02-04T11:01:28.512 INFO:tasks.cephfs_test_runner:ERROR: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring) 2023-02-04T11:01:28.512 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-02-04T11:01:28.513 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-02-04T11:01:28.513 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_85dd219955be3f1bc845865f72e41fcd885d8c87/qa/tasks/cephfs/test_mirroring.py", line 620, in test_cephfs_mirror_restart_sync_on_blocklist 2023-02-04T11:01:28.513 INFO:tasks.cephfs_test_runner: self.check_peer_status(self.primary_fs_name, self.primary_fs_id, 2023-02-04T11:01:28.514 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_85dd219955be3f1bc845865f72e41fcd885d8c87/qa/tasks/cephfs/test_mirroring.py", line 140, in check_peer_status 2023-02-04T11:01:28.514 INFO:tasks.cephfs_test_runner: res = self.mirror_daemon_command(f'peer status for fs: {fs_name}', 2023-02-04T11:01:28.514 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_85dd219955be3f1bc845865f72e41fcd885d8c87/qa/tasks/cephfs/test_mirroring.py", line 224, in mirror_daemon_command 2023-02-04T11:01:28.514 INFO:tasks.cephfs_test_runner: p = self.mount_a.client_remote.run(args= 2023-02-04T11:01:28.515 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/orchestra/remote.py", line 525, in run 2023-02-04T11:01:28.515 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-02-04T11:01:28.515 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/orchestra/run.py", line 455, in run 2023-02-04T11:01:28.515 INFO:tasks.cephfs_test_runner: r.wait() 2023-02-04T11:01:28.516 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/orchestra/run.py", line 161, in wait 2023-02-04T11:01:28.516 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-02-04T11:01:28.516 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-02-04T11:01:28.516 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-02-04T11:01:28.517 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed (peer status for fs: cephfs) on smithi182 with status 22: 'ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror peer status cephfs@30 399ef740-1f8f-463e-b16e-72d95dd132e9' 2023-02-04T11:01:28.517 INFO:tasks.cephfs_test_runner: 2023-02-04T11:01:28.517 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-02-04T11:01:28.517 INFO:tasks.cephfs_test_runner:Ran 15 tests in 3690.547s 2023-02-04T11:01:28.518 INFO:tasks.cephfs_test_runner: 2023-02-04T11:01:28.518 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-02-04T11:01:28.518 INFO:tasks.cephfs_test_runner: 2023-02-04T11:01:28.518 INFO:tasks.cephfs_test_runner:====================================================================== 2023-02-04T11:01:28.519 INFO:tasks.cephfs_test_runner:ERROR: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring) 2023-02-04T11:01:28.519 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-02-04T11:01:28.519 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-02-04T11:01:28.519 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_85dd219955be3f1bc845865f72e41fcd885d8c87/qa/tasks/cephfs/test_mirroring.py", line 620, in test_cephfs_mirror_restart_sync_on_blocklist 2023-02-04T11:01:28.520 INFO:tasks.cephfs_test_runner: self.check_peer_status(self.primary_fs_name, self.primary_fs_id, 2023-02-04T11:01:28.520 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_85dd219955be3f1bc845865f72e41fcd885d8c87/qa/tasks/cephfs/test_mirroring.py", line 140, in check_peer_status 2023-02-04T11:01:28.520 INFO:tasks.cephfs_test_runner: res = self.mirror_daemon_command(f'peer status for fs: {fs_name}', 2023-02-04T11:01:28.520 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_85dd219955be3f1bc845865f72e41fcd885d8c87/qa/tasks/cephfs/test_mirroring.py", line 224, in mirror_daemon_command 2023-02-04T11:01:28.521 INFO:tasks.cephfs_test_runner: p = self.mount_a.client_remote.run(args= 2023-02-04T11:01:28.521 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/orchestra/remote.py", line 525, in run 2023-02-04T11:01:28.521 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-02-04T11:01:28.522 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/orchestra/run.py", line 455, in run 2023-02-04T11:01:28.522 INFO:tasks.cephfs_test_runner: r.wait() 2023-02-04T11:01:28.522 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/orchestra/run.py", line 161, in wait 2023-02-04T11:01:28.522 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-02-04T11:01:28.522 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-02-04T11:01:28.523 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-02-04T11:01:28.523 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed (peer status for fs: cephfs) on smithi182 with status 22: 'ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror peer status cephfs@30 399ef740-1f8f-463e-b16e-72d95dd132e9' 2023-02-04T11:01:28.523 INFO:tasks.cephfs_test_runner: 2023-02-04T11:01:28.524 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/run_tasks.py", line 106, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_85dd219955be3f1bc845865f72e41fcd885d8c87/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring) 2023-02-04T11:01:28.597 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=af30c714caaf4a35b2ef22f66d19c433 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/run_tasks.py", line 106, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_85dd219955be3f1bc845865f72e41fcd885d8c87/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring)
Related issues
History
#1 Updated by Venky Shankar about 1 year ago
- Status changed from New to Duplicate
Duplicate of https://tracker.ceph.com/issues/51964
#2 Updated by Laura Flores about 1 year ago
- Duplicates Bug #51964: qa: test_cephfs_mirror_restart_sync_on_blocklist failure added