Project

General

Profile

Bug #58656

qa: Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring)

Added by Jos Collin about 1 year ago. Updated about 1 year ago.

Status:
Duplicate
Priority:
Normal
Assignee:
-
Category:
qa
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

http://qa-proxy.ceph.com/teuthology/yuriw-2023-02-03_23:44:47-fs-wip-yuri8-testing-2023-01-30-1510-quincy-distro-default-smithi/7148613/teuthology.log

test_cephfs_mirror_restart_sync_on_blocklist fails with below error.

tasks.cephfs.test_mirroring.TestMirroring.test_cephfs_mirror_restart_sync_on_blocklist'
2023-02-04T11:01:28.511 INFO:tasks.cephfs_test_runner:test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring) ... ERROR
2023-02-04T11:01:28.512 INFO:tasks.cephfs_test_runner:
2023-02-04T11:01:28.512 INFO:tasks.cephfs_test_runner:======================================================================
2023-02-04T11:01:28.512 INFO:tasks.cephfs_test_runner:ERROR: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring)
2023-02-04T11:01:28.512 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2023-02-04T11:01:28.513 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2023-02-04T11:01:28.513 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_85dd219955be3f1bc845865f72e41fcd885d8c87/qa/tasks/cephfs/test_mirroring.py", line 620, in test_cephfs_mirror_restart_sync_on_blocklist
2023-02-04T11:01:28.513 INFO:tasks.cephfs_test_runner:    self.check_peer_status(self.primary_fs_name, self.primary_fs_id,
2023-02-04T11:01:28.514 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_85dd219955be3f1bc845865f72e41fcd885d8c87/qa/tasks/cephfs/test_mirroring.py", line 140, in check_peer_status
2023-02-04T11:01:28.514 INFO:tasks.cephfs_test_runner:    res = self.mirror_daemon_command(f'peer status for fs: {fs_name}',
2023-02-04T11:01:28.514 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_85dd219955be3f1bc845865f72e41fcd885d8c87/qa/tasks/cephfs/test_mirroring.py", line 224, in mirror_daemon_command
2023-02-04T11:01:28.514 INFO:tasks.cephfs_test_runner:    p = self.mount_a.client_remote.run(args=
2023-02-04T11:01:28.515 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/orchestra/remote.py", line 525, in run
2023-02-04T11:01:28.515 INFO:tasks.cephfs_test_runner:    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
2023-02-04T11:01:28.515 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/orchestra/run.py", line 455, in run
2023-02-04T11:01:28.515 INFO:tasks.cephfs_test_runner:    r.wait()
2023-02-04T11:01:28.516 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/orchestra/run.py", line 161, in wait
2023-02-04T11:01:28.516 INFO:tasks.cephfs_test_runner:    self._raise_for_status()
2023-02-04T11:01:28.516 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/orchestra/run.py", line 181, in _raise_for_status
2023-02-04T11:01:28.516 INFO:tasks.cephfs_test_runner:    raise CommandFailedError(
2023-02-04T11:01:28.517 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed (peer status for fs: cephfs) on smithi182 with status 22: 'ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror peer status cephfs@30 399ef740-1f8f-463e-b16e-72d95dd132e9'
2023-02-04T11:01:28.517 INFO:tasks.cephfs_test_runner:
2023-02-04T11:01:28.517 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2023-02-04T11:01:28.517 INFO:tasks.cephfs_test_runner:Ran 15 tests in 3690.547s
2023-02-04T11:01:28.518 INFO:tasks.cephfs_test_runner:
2023-02-04T11:01:28.518 INFO:tasks.cephfs_test_runner:FAILED (errors=1)
2023-02-04T11:01:28.518 INFO:tasks.cephfs_test_runner:
2023-02-04T11:01:28.518 INFO:tasks.cephfs_test_runner:======================================================================
2023-02-04T11:01:28.519 INFO:tasks.cephfs_test_runner:ERROR: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring)
2023-02-04T11:01:28.519 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2023-02-04T11:01:28.519 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2023-02-04T11:01:28.519 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_85dd219955be3f1bc845865f72e41fcd885d8c87/qa/tasks/cephfs/test_mirroring.py", line 620, in test_cephfs_mirror_restart_sync_on_blocklist
2023-02-04T11:01:28.520 INFO:tasks.cephfs_test_runner:    self.check_peer_status(self.primary_fs_name, self.primary_fs_id,
2023-02-04T11:01:28.520 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_85dd219955be3f1bc845865f72e41fcd885d8c87/qa/tasks/cephfs/test_mirroring.py", line 140, in check_peer_status
2023-02-04T11:01:28.520 INFO:tasks.cephfs_test_runner:    res = self.mirror_daemon_command(f'peer status for fs: {fs_name}',
2023-02-04T11:01:28.520 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_85dd219955be3f1bc845865f72e41fcd885d8c87/qa/tasks/cephfs/test_mirroring.py", line 224, in mirror_daemon_command
2023-02-04T11:01:28.521 INFO:tasks.cephfs_test_runner:    p = self.mount_a.client_remote.run(args=
2023-02-04T11:01:28.521 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/orchestra/remote.py", line 525, in run
2023-02-04T11:01:28.521 INFO:tasks.cephfs_test_runner:    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
2023-02-04T11:01:28.522 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/orchestra/run.py", line 455, in run
2023-02-04T11:01:28.522 INFO:tasks.cephfs_test_runner:    r.wait()
2023-02-04T11:01:28.522 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/orchestra/run.py", line 161, in wait
2023-02-04T11:01:28.522 INFO:tasks.cephfs_test_runner:    self._raise_for_status()
2023-02-04T11:01:28.522 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/orchestra/run.py", line 181, in _raise_for_status
2023-02-04T11:01:28.523 INFO:tasks.cephfs_test_runner:    raise CommandFailedError(
2023-02-04T11:01:28.523 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed (peer status for fs: cephfs) on smithi182 with status 22: 'ceph --admin-daemon /var/run/ceph/cephfs-mirror.asok fs mirror peer status cephfs@30 399ef740-1f8f-463e-b16e-72d95dd132e9'
2023-02-04T11:01:28.523 INFO:tasks.cephfs_test_runner:
2023-02-04T11:01:28.524 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/run_tasks.py", line 106, in run_tasks
    manager.__enter__()
  File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__
    return next(self.gen)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_85dd219955be3f1bc845865f72e41fcd885d8c87/qa/tasks/cephfs_test_runner.py", line 211, in task
    raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests)))
RuntimeError: Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring)
2023-02-04T11:01:28.597 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=af30c714caaf4a35b2ef22f66d19c433
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_00690eca1aa0bd56527bb28e9f9e35d734d406bf/teuthology/run_tasks.py", line 106, in run_tasks
    manager.__enter__()
  File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__
    return next(self.gen)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_85dd219955be3f1bc845865f72e41fcd885d8c87/qa/tasks/cephfs_test_runner.py", line 211, in task
    raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests)))
RuntimeError: Test failure: test_cephfs_mirror_restart_sync_on_blocklist (tasks.cephfs.test_mirroring.TestMirroring)

Related issues

Duplicates CephFS - Bug #51964: qa: test_cephfs_mirror_restart_sync_on_blocklist failure In Progress

History

#1 Updated by Venky Shankar about 1 year ago

  • Status changed from New to Duplicate

#2 Updated by Laura Flores about 1 year ago

  • Duplicates Bug #51964: qa: test_cephfs_mirror_restart_sync_on_blocklist failure added

Also available in: Atom PDF