Project

General

Profile

Bug #43964

qa: Test failure: test_acls

Added by Jos Collin 5 months ago. Updated 4 months ago.

Status:
Resolved
Priority:
High
Assignee:
Category:
Testing
Target version:
% Done:

0%

Source:
Community (dev)
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
Labels (FS):
Pull request ID:
Crash signature:

Description

This shows up in all runs:

2020-02-05T00:31:29.613 INFO:teuthology.orchestra.run.smithi008.stderr:Error: Unable to find a match: btrfs-progs-devel
2020-02-05T00:31:29.659 DEBUG:teuthology.orchestra.run:got remote process result: 1
2020-02-05T00:31:29.659 INFO:tasks.cephfs_test_runner:test_acls (tasks.cephfs.test_acls.TestACLs) ... ERROR
2020-02-05T00:31:29.660 INFO:tasks.cephfs_test_runner:
2020-02-05T00:31:29.660 INFO:tasks.cephfs_test_runner:======================================================================
2020-02-05T00:31:29.660 INFO:tasks.cephfs_test_runner:ERROR: test_acls (tasks.cephfs.test_acls.TestACLs)
2020-02-05T00:31:29.660 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2020-02-05T00:31:29.660 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2020-02-05T00:31:29.660 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_inter-mds-testing5/qa/tasks/cephfs/xfstests_dev.py", line 19, in setUp
2020-02-05T00:31:29.660 INFO:tasks.cephfs_test_runner:    self.prepare_xfstests_dev()
2020-02-05T00:31:29.660 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_inter-mds-testing5/qa/tasks/cephfs/xfstests_dev.py", line 24, in prepare_xfstests_dev
2020-02-05T00:31:29.660 INFO:tasks.cephfs_test_runner:    self.install_deps()
2020-02-05T00:31:29.661 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_inter-mds-testing5/qa/tasks/cephfs/xfstests_dev.py", line 128, in install_deps
2020-02-05T00:31:29.661 INFO:tasks.cephfs_test_runner:    self.mount_a.client_remote.run(args=args, omit_sudo=False)
2020-02-05T00:31:29.661 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run
2020-02-05T00:31:29.661 INFO:tasks.cephfs_test_runner:    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
2020-02-05T00:31:29.661 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 433, in run
2020-02-05T00:31:29.661 INFO:tasks.cephfs_test_runner:    r.wait()
2020-02-05T00:31:29.661 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait
2020-02-05T00:31:29.661 INFO:tasks.cephfs_test_runner:    self._raise_for_status()
2020-02-05T00:31:29.662 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 180, in _raise_for_status
2020-02-05T00:31:29.662 INFO:tasks.cephfs_test_runner:    node=self.hostname, label=self.label
2020-02-05T00:31:29.662 INFO:tasks.cephfs_test_runner:CommandFailedError: Command failed on smithi008 with status 1: 'sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel btrfs-progs-devel python2 sqlite xfsprogs-qa-devel'
2020-02-05T00:31:29.662 INFO:tasks.cephfs_test_runner:
2020-02-05T00:31:29.662 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2020-02-05T00:31:29.662 INFO:tasks.cephfs_test_runner:Ran 1 test in 22.272s
2020-02-05T00:31:29.662 INFO:tasks.cephfs_test_runner:
2020-02-05T00:31:29.662 INFO:tasks.cephfs_test_runner:FAILED (errors=1)
2020-02-05T00:31:29.663 INFO:tasks.cephfs_test_runner:
2020-02-05T00:31:29.663 INFO:tasks.cephfs_test_runner:======================================================================
2020-02-05T00:31:29.663 INFO:tasks.cephfs_test_runner:ERROR: test_acls (tasks.cephfs.test_acls.TestACLs)
2020-02-05T00:31:29.663 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2020-02-05T00:31:29.663 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2020-02-05T00:31:29.663 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_inter-mds-testing5/qa/tasks/cephfs/xfstests_dev.py", line 19, in setUp
2020-02-05T00:31:29.663 INFO:tasks.cephfs_test_runner:    self.prepare_xfstests_dev()
2020-02-05T00:31:29.663 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_inter-mds-testing5/qa/tasks/cephfs/xfstests_dev.py", line 24, in prepare_xfstests_dev
2020-02-05T00:31:29.664 INFO:tasks.cephfs_test_runner:    self.install_deps()
2020-02-05T00:31:29.664 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_inter-mds-testing5/qa/tasks/cephfs/xfstests_dev.py", line 128, in install_deps
2020-02-05T00:31:29.664 INFO:tasks.cephfs_test_runner:    self.mount_a.client_remote.run(args=args, omit_sudo=False)
2020-02-05T00:31:29.664 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run
2020-02-05T00:31:29.664 INFO:tasks.cephfs_test_runner:    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
2020-02-05T00:31:29.664 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 433, in run
2020-02-05T00:31:29.664 INFO:tasks.cephfs_test_runner:    r.wait()
2020-02-05T00:31:29.664 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait
2020-02-05T00:31:29.664 INFO:tasks.cephfs_test_runner:    self._raise_for_status()
2020-02-05T00:31:29.665 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 180, in _raise_for_status
2020-02-05T00:31:29.665 INFO:tasks.cephfs_test_runner:    node=self.hostname, label=self.label
2020-02-05T00:31:29.665 INFO:tasks.cephfs_test_runner:CommandFailedError: Command failed on smithi008 with status 1: 'sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc indent libtool lvm2 make psmisc quota sed xfsdump xfsprogs libacl-devel libattr-devel libaio-devel libuuid-devel xfsprogs-devel btrfs-progs-devel python2 sqlite xfsprogs-qa-devel'
2020-02-05T00:31:29.665 INFO:tasks.cephfs_test_runner:
2020-02-05T00:31:29.665 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/run_tasks.py", line 89, in run_tasks
    manager.__enter__()
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/github.com_ceph_ceph-c_inter-mds-testing5/qa/tasks/cephfs_test_runner.py", line 211, in task
    raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests)))
RuntimeError: Test failure: test_acls (tasks.cephfs.test_acls.TestACLs)
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 32, in nested
    vars.append(enter())
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/github.com_ceph_ceph-c_inter-mds-testing5/qa/tasks/ceph.py", line 410, in cephfs_setup
    ec_profile=config.get('cephfs_ec_profile', None))
  File "/home/teuthworker/src/github.com_ceph_ceph-c_inter-mds-testing5/qa/tasks/cephfs/filesystem.py", line 433, in __init__
    super(Filesystem, self).__init__(ctx)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_inter-mds-testing5/qa/tasks/cephfs/filesystem.py", line 249, in __init__
    super(MDSCluster, self).__init__(ctx)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_inter-mds-testing5/qa/tasks/cephfs/filesystem.py", line 198, in __init__
    self.mon_manager = ceph_manager.CephManager(self.admin_remote, ctx=ctx, logger=log.getChild('ceph_manager'))
  File "/home/teuthworker/src/github.com_ceph_ceph-c_inter-mds-testing5/qa/tasks/ceph_manager.py", line 1324, in __init__
    pools = self.list_pools()
  File "/home/teuthworker/src/github.com_ceph_ceph-c_inter-mds-testing5/qa/tasks/ceph_manager.py", line 1717, in list_pools
    osd_dump = self.get_osd_dump_json()
  File "/home/teuthworker/src/github.com_ceph_ceph-c_inter-mds-testing5/qa/tasks/ceph_manager.py", line 2290, in get_osd_dump_json
    out = self.raw_cluster_cmd('osd', 'dump', '--format=json')
  File "/home/teuthworker/src/github.com_ceph_ceph-c_inter-mds-testing5/qa/tasks/ceph_manager.py", line 1358, in raw_cluster_cmd
    stdout=StringIO(),
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 433, in run
    r.wait()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 180, in _raise_for_status
    node=self.hostname, label=self.label
CommandFailedError: Command failed on smithi162 with status 22: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json'
2020-02-05T01:50:24.057 INFO:teuthology.misc:Shutting down osd daemons...

History

#1 Updated by Jos Collin 5 months ago

  • Description updated (diff)

#2 Updated by Patrick Donnelly 5 months ago

  • Status changed from New to Fix Under Review

I believe this is from an older run where the test suites were misconfigured to use CentOS 7. Can you check? There's no link to the teuthology log in this ticket. Please add one!

#3 Updated by Patrick Donnelly 5 months ago

  • Status changed from Fix Under Review to Need More Info

clicked wrong status

#5 Updated by Patrick Donnelly 5 months ago

  • Assignee set to Rishabh Dave
  • Priority changed from Normal to High
  • Target version set to v15.0.0

From master: /ceph/teuthology-archive/teuthology-2020-01-28_03:15:03-fs-master-distro-basic-smithi/4712989/teuthology.log

#6 Updated by Rishabh Dave 4 months ago

  • Status changed from New to Fix Under Review
  • Pull request ID set to 33427

#7 Updated by Rishabh Dave 4 months ago

btrfs-progs-devel wasn't available on CentOS 8 too after which we added a fix to skip installing. The ACLs tests on CentOS 8 ran successfully after that. Right now, I am expecting same for RHEL 8.

#9 Updated by Patrick Donnelly 4 months ago

  • Status changed from Fix Under Review to Resolved

Also available in: Atom PDF