Ceph QA

@Casey Bodley Can't schedule rgw

yuriw@teuthology ~ [14:09:41]> teuthology-suite -v --ceph-repo $CEPH_REPO -c $CEPH_BRANCH --suite-repo $SUITE_REPO --suite-branch $SUITE_BRANCH -m $MACHINE_NAME -s rgw -k $DISTRO -p $PRIO -e $CEPH_QA_MAIL -l $LIMIT -S $SHA1 --force-priority --subset 111/120000
2024-04-24 14:10:35,166.166 INFO:teuthology.suite:Using random seed=7643
2024-04-24 14:10:35,170.170 INFO:teuthology.suite.run:kernel sha1: distro
2024-04-24 14:10:35,351.351 INFO:teuthology.suite.run:ceph sha1 explicitly supplied
2024-04-24 14:10:35,351.351 INFO:teuthology.suite.run:ceph sha1: 330067dbce47655d1f762ef14d546d2fde16a6a9
2024-04-24 14:10:35,351.351 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=330067dbce47655d1f762ef14d546d2fde16a6a9
2024-04-24 14:10:35,720.720 DEBUG:teuthology.packaging:looking for centos/8 x86_64 default
2024-04-24 14:10:35,720.720 DEBUG:teuthology.packaging:build: ubuntu/22.04 x86_64 default
2024-04-24 14:10:35,720.720 DEBUG:teuthology.packaging:build: centos/8 x86_64 crimson
2024-04-24 14:10:35,720.720 DEBUG:teuthology.packaging:build: centos/8 x86_64 default
2024-04-24 14:10:35,723.723 INFO:teuthology.suite.run:ceph version: 17.2.7-915.g330067db
2024-04-24 14:10:35,918.918 DEBUG:teuthology.repo_utils:git ls-remote https://github.com/ceph/ceph-ci.git wip-yuriw4-testing-20240423.151325-quincy -> 330067dbce47655d1f762ef14d546d2fde16a6a9
2024-04-24 14:10:35,919.919 INFO:teuthology.suite.run:ceph-ci branch: wip-yuriw4-testing-20240423.151325-quincy 330067dbce47655d1f762ef14d546d2fde16a6a9
2024-04-24 14:10:35,920.920 DEBUG:teuthology.repo_utils:Resetting repo at /cephfs/home/yuriw/src/github.com_ceph_ceph-c_wip-yuriw4-testing-20240423.151325-quincy to origin/wip-yuriw4-testing-20240423.151325-quincy
2024-04-24 14:10:36,033.033 DEBUG:teuthology.suite.run:Check file /cephfs/home/yuriw/src/github.com_ceph_ceph-c_wip-yuriw4-testing-20240423.151325-quincy/qa/.teuthology_branch exists
2024-04-24 14:10:36,186.186 DEBUG:teuthology.repo_utils:git ls-remote https://github.com/ceph/teuthology main -> 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17
2024-04-24 14:10:36,187.187 INFO:teuthology.suite.run:teuthology branch: main 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17
2024-04-24 14:10:36,211.211 DEBUG:teuthology.suite.run:Suite rgw in /cephfs/home/yuriw/src/github.com_ceph_ceph-c_wip-yuriw4-testing-20240423.151325-quincy/qa/suites/rgw
2024-04-24 14:10:36,212.212 DEBUG:teuthology.suite.run:subset = (111, 120000)
2024-04-24 14:10:36,212.212 DEBUG:teuthology.suite.run:no_nested_subset = False
2024-04-24 14:10:36,212.212 INFO:teuthology.suite.build_matrix:Subset=111/120000
Traceback (most recent call last):
  File "/cephfs/home/yuriw/teuthology/virtualenv/bin/teuthology-suite", line 8, in <module>
    sys.exit(main())
  File "/cephfs/home/yuriw/teuthology/scripts/suite.py", line 226, in main
    return teuthology.suite.main(args)
  File "/cephfs/home/yuriw/teuthology/teuthology/suite/__init__.py", line 145, in main
    run.prepare_and_schedule()
  File "/cephfs/home/yuriw/teuthology/teuthology/suite/run.py", line 438, in prepare_and_schedule
    num_jobs = self.schedule_suite()
  File "/cephfs/home/yuriw/teuthology/teuthology/suite/run.py", line 587, in schedule_suite
    configs = build_matrix(suite_path,
  File "/cephfs/home/yuriw/teuthology/teuthology/suite/build_matrix.py", line 62, in build_matrix
    mat, first, matlimit = _get_matrix(path, subset, no_nested_subset)
  File "/cephfs/home/yuriw/teuthology/teuthology/suite/build_matrix.py", line 69, in _get_matrix
    mat = _build_matrix(path, mincyclicity=divisions, no_nested_subset=no_nested_subset)
  File "/cephfs/home/yuriw/teuthology/teuthology/suite/build_matrix.py", line 152, in _build_matrix
    submat = _build_matrix(
  File "/cephfs/home/yuriw/teuthology/teuthology/suite/build_matrix.py", line 132, in _build_matrix
    submat = _build_matrix(
  File "/cephfs/home/yuriw/teuthology/teuthology/suite/build_matrix.py", line 80, in _build_matrix
    raise IOError('%s does not exist (abs %s)' % (path, os.path.abspath(path)))
OSError: /cephfs/home/yuriw/src/github.com_ceph_ceph-c_wip-yuriw4-testing-20240423.151325-quincy/qa/suites/rgw/crypt/ubuntu_latest.yaml does not exist (abs /cephfs/home/yuriw/src/github.com_ceph_ceph-c_wip-yuriw4-testing-20240423.151325-quincy/qa/suites/rgw/crypt/ubuntu_latest.yaml)

Hi Yuri,

This needs a rerun for krbd since krbd_rxbounce job died on reboot for some reason.

Ilya Dryomov wrote in #note-7:

Hi Yuri,

This needs a rerun for krbd since krbd_rxbounce job died on reboot for some reason.

scheduled