Project

General

Profile

Bug #48702

qa: fwd_scrub should only scrub rank 0

Added by Patrick Donnelly 28 days ago. Updated 11 days ago.

Status:
Resolved
Priority:
Normal
Category:
-
Target version:
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
qa-suite
Labels (FS):
qa, qa-failure, scrub
Pull request ID:
Crash signature:

Description

2020-12-22T01:23:44.069 INFO:teuthology.orchestra.run.smithi032.stderr:Error EXDEV: Not rank 0
2020-12-22T01:23:44.069 DEBUG:teuthology.orchestra.run:got remote process result: 18
2020-12-22T01:23:44.069 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception:
Traceback (most recent call last):
  File "/home/teuthworker/src/github.com_batrick_ceph_wip-pdonnell-testing-20201221.205900/qa/tasks/fwd_scrub.py", line 32, in _run
    self.do_scrub()
  File "/home/teuthworker/src/github.com_batrick_ceph_wip-pdonnell-testing-20201221.205900/qa/tasks/fwd_scrub.py", line 41, in do_scrub
    rank=self.mds_rank)
  File "/home/teuthworker/src/github.com_batrick_ceph_wip-pdonnell-testing-20201221.205900/qa/tasks/cephfs/filesystem.py", line 1084, in rank_tell
    return json.loads(self.mon_manager.raw_cluster_cmd("tell", 'mds.{0}'.format(info['name']), *command))
  File "/home/teuthworker/src/github.com_batrick_ceph_wip-pdonnell-testing-20201221.205900/qa/tasks/ceph_manager.py", line 1354, in raw_cluster_cmd
    'stdout': StringIO()}).stdout.getvalue()
  File "/home/teuthworker/src/github.com_batrick_ceph_wip-pdonnell-testing-20201221.205900/qa/tasks/ceph_manager.py", line 1347, in run_cluster_cmd
    return self.controller.run(**kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 215, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 455, in run
    r.wait()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 161, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 183, in _raise_for_status
    node=self.hostname, label=self.label
teuthology.exceptions.CommandFailedError: Command failed on smithi032 with status 18: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f scrub start / recursive force'

See: /ceph/teuthology-archive/pdonnell-2020-12-21_21:14:17-fs-master-distro-basic-smithi/5728203/teuthology.log

with this qa branch: wip-pdonnell-testing-20201221.205900

History

#1 Updated by Patrick Donnelly 28 days ago

  • Status changed from In Progress to Fix Under Review
  • Pull request ID set to 38693

#2 Updated by Patrick Donnelly 11 days ago

  • Status changed from Fix Under Review to Resolved
  • Labels (FS) scrub added

Also available in: Atom PDF