Actions
Bug #45583
openteuthology-suite: "--subset" combined with "--filter" generates duplicate jobs
Added by Sebastian Wagner almost 4 years ago. Updated almost 4 years ago.
Status:
New
Priority:
Normal
Assignee:
-
Category:
-
% Done:
0%
Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):
Description
scheduled via
teuthology-suite -k distro --priority 75 --suite rados --filter cephadm --subset 1135/9999 --email swagner@suse.com --ceph wip-swagner-testing-2020-05-15-2348 --machine-type smithi
scheduled
- http://pulpito.ceph.com/swagner-2020-05-18_08:24:15-rados-wip-swagner-testing-2020-05-15-2348-distro-basic-smithi/5066708
- http://pulpito.ceph.com/swagner-2020-05-18_08:24:15-rados-wip-swagner-testing-2020-05-15-2348-distro-basic-smithi/5066741
both having the description:
rados/cephadm/upgrade/{1-start.yaml 2-start-upgrade.yaml 3-wait.yaml distro$/{rhel_8.0.yaml} fixed-2.yaml}
Updated by Kyrylo Shatskyy almost 4 years ago
Do you have output of the teuthology-suite cli?
Updated by Kyrylo Shatskyy almost 4 years ago
Let me guess, you've run the same teuthology-suite command at a same time in two different terminals?
In this case the behavior is known, you have not only this test duplicating.
Updated by Kyrylo Shatskyy almost 4 years ago
Hm, I took another look, it indeed generates duplicates:
teuthology-describe /home/kyr/src/git.ceph.com_ceph-c_wip-swagner-testing-2020-05-15-2348/qa/suites/rados --subset 1135/9999 --seed 2547 --filter cephadm -sp | sort
# 67/312 /home/kyr/src/git.ceph.com_ceph-c_wip-swagner-testing-2020-05-15-2348/qa/suites/rados
rados/cephadm/orchestrator_cli/{2-node-mgr.yaml orchestrator_cli.yaml supported-random-distro$/{rhel_8.yaml}}
rados/cephadm/orchestrator_cli/{2-node-mgr.yaml orchestrator_cli.yaml supported-random-distro$/{ubuntu_latest.yaml}}
rados/cephadm/smoke/{distro/centos_7.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/centos_7.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/centos_8.0.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/centos_8.0.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/centos_latest.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/centos_latest.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/rhel_7.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/rhel_7.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/rhel_8.0.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/rhel_8.0.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/rhel_latest.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/rhel_latest.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/ubuntu_18.04_podman.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/ubuntu_18.04_podman.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/ubuntu_18.04.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/ubuntu_18.04.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/ubuntu_latest.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/ubuntu_latest.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/centos_7.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/centos_7.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/centos_8.0.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/centos_8.0.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/centos_latest.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/centos_latest.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/rhel_7.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/rhel_7.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/rhel_8.0.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/rhel_8.0.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/rhel_latest.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/rhel_latest.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/ubuntu_18.04.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/ubuntu_18.04.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/ubuntu_latest.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/ubuntu_latest.yaml start.yaml}
rados/cephadm/upgrade/{1-start.yaml 2-start-upgrade.yaml 3-wait.yaml distro$/{rhel_8.0.yaml} fixed-2.yaml}
rados/cephadm/upgrade/{1-start.yaml 2-start-upgrade.yaml 3-wait.yaml distro$/{rhel_8.0.yaml} fixed-2.yaml}
rados/cephadm/with-work/{distro/centos_8.0.yaml fixed-2.yaml mode/packaged.yaml msgr/async-v1only.yaml start.yaml tasks/rados_api_tests.yaml}
rados/cephadm/with-work/{distro/centos_8.0.yaml fixed-2.yaml mode/root.yaml msgr/async-v2only.yaml start.yaml tasks/rados_python.yaml}
rados/cephadm/with-work/{distro/centos_latest.yaml fixed-2.yaml mode/packaged.yaml msgr/async.yaml start.yaml tasks/rados_api_tests.yaml}
rados/cephadm/with-work/{distro/centos_latest.yaml fixed-2.yaml mode/root.yaml msgr/async-v2only.yaml start.yaml tasks/rados_python.yaml}
rados/cephadm/with-work/{distro/rhel_8.0.yaml fixed-2.yaml mode/packaged.yaml msgr/async.yaml start.yaml tasks/rados_api_tests.yaml}
rados/cephadm/with-work/{distro/rhel_8.0.yaml fixed-2.yaml mode/root.yaml msgr/async-v1only.yaml start.yaml tasks/rados_python.yaml}
rados/cephadm/with-work/{distro/rhel_latest.yaml fixed-2.yaml mode/packaged.yaml msgr/async-v2only.yaml start.yaml tasks/rados_api_tests.yaml}
rados/cephadm/with-work/{distro/rhel_latest.yaml fixed-2.yaml mode/packaged.yaml msgr/async.yaml start.yaml tasks/rados_api_tests.yaml}
rados/cephadm/with-work/{distro/rhel_latest.yaml fixed-2.yaml mode/root.yaml msgr/async-v1only.yaml start.yaml tasks/rados_python.yaml}
rados/cephadm/with-work/{distro/ubuntu_18.04_podman.yaml fixed-2.yaml mode/packaged.yaml msgr/async-v1only.yaml start.yaml tasks/rados_api_tests.yaml}
rados/cephadm/with-work/{distro/ubuntu_18.04_podman.yaml fixed-2.yaml mode/packaged.yaml msgr/async-v2only.yaml start.yaml tasks/rados_api_tests.yaml}
rados/cephadm/with-work/{distro/ubuntu_18.04_podman.yaml fixed-2.yaml mode/root.yaml msgr/async.yaml start.yaml tasks/rados_python.yaml}
rados/cephadm/with-work/{distro/ubuntu_18.04.yaml fixed-2.yaml mode/packaged.yaml msgr/async-v2only.yaml start.yaml tasks/rados_api_tests.yaml}
rados/cephadm/with-work/{distro/ubuntu_18.04.yaml fixed-2.yaml mode/root.yaml msgr/async-v1only.yaml start.yaml tasks/rados_python.yaml}
rados/cephadm/with-work/{distro/ubuntu_18.04.yaml fixed-2.yaml mode/root.yaml msgr/async.yaml start.yaml tasks/rados_python.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm.yaml}
Updated by Kyrylo Shatskyy almost 4 years ago
The same amount of tests when scheduling:
(virtualenv) kyr@teuthology:~$ teuthology-suite -k distro --priority 75 --suite rados --filter cephadm --subset 1135/9999 --ceph wip-swagner-testing-2020-05-15-2348 --machine-type smithi --dry-run --seed 2547 2>&1 | grep -c Scheduling 67
Interesting that duplicates does not appear if use full suite name 'rados:cephadm' instead of filtering (btw, this generates list of jobs much faster):
teuthology-suite -k distro --priority 75 --suite rados:cephadm --subset 1135/9999 --ceph wip-swagner-testing-2020-05-15-2348 --machine-type smithi --dry-run --seed 2547 2>&1 | grep -c Scheduling 33
And same results with describe:
$ teuthology-describe /home/kyr/src/git.ceph.com_ceph-c_wip-swagner-testing-2020-05-15-2348/qa/suites/rados/cephadm --subset 1135/9999 --seed 2547 -s # 33/33 /home/kyr/src/git.ceph.com_ceph-c_wip-swagner-testing-2020-05-15-2348/qa/suites/rados/cephadm
Updated by Kyrylo Shatskyy almost 4 years ago
interested that such suites like 'rados/cephadm/with-work', 'rados/cephadm/orchestrator_cli', and 'rados/cephadm/upgrade' are not affected by duplication. But for example `workunits` sub-suite is affected:
(virtualenv) kyr@teuthology:~$ teuthology-describe /home/kyr/src/git.ceph.com_ceph-c_wip-swagner-testing-2020-05-15-2348/qa/suites/rados/cephadm --subset 1135/9999 --seed 2547 --filter workunits -sp | sort | grep workunits
cephadm/workunits/{distro/centos_latest.yaml task/test_adoption.yaml}
cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm_repos.yaml}
cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm.yaml}
cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_adoption.yaml}
cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm_repos.yaml}
cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm.yaml}
(virtualenv) kyr@teuthology:~$ teuthology-describe /home/kyr/src/git.ceph.com_ceph-c_wip-swagner-testing-2020-05-15-2348/qa/suites/rados --subset 1135/9999 --seed 2547 --filter cephadm -sp | sort | grep workunits
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm.yaml}
Updated by Kyrylo Shatskyy almost 4 years ago
Another interesting observation, the issue is not reproduced when `--subset` is not used, compare:
$ teuthology-describe /home/kyr/src/git.ceph.com_ceph-c_wip-swagner-testing-2020-05-15-2348/qa/suites/rados -sp | grep -F cephadm/workunits | sort
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm.yaml}
and
$ teuthology-describe /home/kyr/src/git.ceph.com_ceph-c_wip-swagner-testing-2020-05-15-2348/qa/suites/rados -sp --subset 1/10 | grep -F cephadm/workunits | sort
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm.yaml}
Updated by Sebastian Wagner almost 4 years ago
- Subject changed from teuthology-suite schedules the same job twice to teuthology-suite: `subset` generates duplicate jobs
Updated by Sebastian Wagner almost 4 years ago
- Subject changed from teuthology-suite: `subset` generates duplicate jobs to teuthology-suite: `--subset` generates duplicate jobs
Updated by Nathan Cutler almost 4 years ago
- Subject changed from teuthology-suite: `--subset` generates duplicate jobs to teuthology-suite: "--subset" combined with "--filter" generates duplicate jobs
Actions