Project

General

Profile

Actions
Copy link

Bug #45583

open

teuthology-suite: "--subset" combined with "--filter" generates duplicate jobs

Added by Sebastian Wagner almost 4 years ago. Updated almost 4 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

http://pulpito.ceph.com/swagner-2020-05-18_08:24:15-rados-wip-swagner-testing-2020-05-15-2348-distro-basic-smithi/

scheduled via

teuthology-suite -k distro --priority 75 --suite rados --filter cephadm  --subset 1135/9999  --email swagner@suse.com --ceph wip-swagner-testing-2020-05-15-2348  --machine-type smithi

scheduled

both having the description:

    rados/cephadm/upgrade/{1-start.yaml 2-start-upgrade.yaml 3-wait.yaml distro$/{rhel_8.0.yaml} fixed-2.yaml}
Actions
Copy link
 #1

Updated by Kyrylo Shatskyy almost 4 years ago

Do you have output of the teuthology-suite cli?

Actions
Copy link
 #2

Updated by Kyrylo Shatskyy almost 4 years ago

Let me guess, you've run the same teuthology-suite command at a same time in two different terminals?
In this case the behavior is known, you have not only this test duplicating.

Actions
Copy link
 #3

Updated by Kyrylo Shatskyy almost 4 years ago

Hm, I took another look, it indeed generates duplicates:

teuthology-describe /home/kyr/src/git.ceph.com_ceph-c_wip-swagner-testing-2020-05-15-2348/qa/suites/rados --subset 1135/9999 --seed 2547 --filter cephadm -sp | sort
# 67/312 /home/kyr/src/git.ceph.com_ceph-c_wip-swagner-testing-2020-05-15-2348/qa/suites/rados
rados/cephadm/orchestrator_cli/{2-node-mgr.yaml orchestrator_cli.yaml supported-random-distro$/{rhel_8.yaml}}
rados/cephadm/orchestrator_cli/{2-node-mgr.yaml orchestrator_cli.yaml supported-random-distro$/{ubuntu_latest.yaml}}
rados/cephadm/smoke/{distro/centos_7.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/centos_7.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/centos_8.0.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/centos_8.0.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/centos_latest.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/centos_latest.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/rhel_7.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/rhel_7.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/rhel_8.0.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/rhel_8.0.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/rhel_latest.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/rhel_latest.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/ubuntu_18.04_podman.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/ubuntu_18.04_podman.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/ubuntu_18.04.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/ubuntu_18.04.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/ubuntu_latest.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke/{distro/ubuntu_latest.yaml fixed-2.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/centos_7.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/centos_7.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/centos_8.0.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/centos_8.0.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/centos_latest.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/centos_latest.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/rhel_7.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/rhel_7.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/rhel_8.0.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/rhel_8.0.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/rhel_latest.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/rhel_latest.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/ubuntu_18.04.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/ubuntu_18.04.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/ubuntu_latest.yaml start.yaml}
rados/cephadm/smoke-roleless/{distro/ubuntu_latest.yaml start.yaml}
rados/cephadm/upgrade/{1-start.yaml 2-start-upgrade.yaml 3-wait.yaml distro$/{rhel_8.0.yaml} fixed-2.yaml}
rados/cephadm/upgrade/{1-start.yaml 2-start-upgrade.yaml 3-wait.yaml distro$/{rhel_8.0.yaml} fixed-2.yaml}
rados/cephadm/with-work/{distro/centos_8.0.yaml fixed-2.yaml mode/packaged.yaml msgr/async-v1only.yaml start.yaml tasks/rados_api_tests.yaml}
rados/cephadm/with-work/{distro/centos_8.0.yaml fixed-2.yaml mode/root.yaml msgr/async-v2only.yaml start.yaml tasks/rados_python.yaml}
rados/cephadm/with-work/{distro/centos_latest.yaml fixed-2.yaml mode/packaged.yaml msgr/async.yaml start.yaml tasks/rados_api_tests.yaml}
rados/cephadm/with-work/{distro/centos_latest.yaml fixed-2.yaml mode/root.yaml msgr/async-v2only.yaml start.yaml tasks/rados_python.yaml}
rados/cephadm/with-work/{distro/rhel_8.0.yaml fixed-2.yaml mode/packaged.yaml msgr/async.yaml start.yaml tasks/rados_api_tests.yaml}
rados/cephadm/with-work/{distro/rhel_8.0.yaml fixed-2.yaml mode/root.yaml msgr/async-v1only.yaml start.yaml tasks/rados_python.yaml}
rados/cephadm/with-work/{distro/rhel_latest.yaml fixed-2.yaml mode/packaged.yaml msgr/async-v2only.yaml start.yaml tasks/rados_api_tests.yaml}
rados/cephadm/with-work/{distro/rhel_latest.yaml fixed-2.yaml mode/packaged.yaml msgr/async.yaml start.yaml tasks/rados_api_tests.yaml}
rados/cephadm/with-work/{distro/rhel_latest.yaml fixed-2.yaml mode/root.yaml msgr/async-v1only.yaml start.yaml tasks/rados_python.yaml}
rados/cephadm/with-work/{distro/ubuntu_18.04_podman.yaml fixed-2.yaml mode/packaged.yaml msgr/async-v1only.yaml start.yaml tasks/rados_api_tests.yaml}
rados/cephadm/with-work/{distro/ubuntu_18.04_podman.yaml fixed-2.yaml mode/packaged.yaml msgr/async-v2only.yaml start.yaml tasks/rados_api_tests.yaml}
rados/cephadm/with-work/{distro/ubuntu_18.04_podman.yaml fixed-2.yaml mode/root.yaml msgr/async.yaml start.yaml tasks/rados_python.yaml}
rados/cephadm/with-work/{distro/ubuntu_18.04.yaml fixed-2.yaml mode/packaged.yaml msgr/async-v2only.yaml start.yaml tasks/rados_api_tests.yaml}
rados/cephadm/with-work/{distro/ubuntu_18.04.yaml fixed-2.yaml mode/root.yaml msgr/async-v1only.yaml start.yaml tasks/rados_python.yaml}
rados/cephadm/with-work/{distro/ubuntu_18.04.yaml fixed-2.yaml mode/root.yaml msgr/async.yaml start.yaml tasks/rados_python.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm.yaml}

Actions
Copy link
 #4

Updated by Kyrylo Shatskyy almost 4 years ago

The same amount of tests when scheduling:

(virtualenv) kyr@teuthology:~$ teuthology-suite -k distro --priority 75 --suite rados --filter cephadm  --subset 1135/9999 --ceph wip-swagner-testing-2020-05-15-2348  --machine-type smithi --dry-run --seed 2547 2>&1 | grep -c Scheduling
67

Interesting that duplicates does not appear if use full suite name 'rados:cephadm' instead of filtering (btw, this generates list of jobs much faster):
teuthology-suite -k distro --priority 75 --suite rados:cephadm  --subset 1135/9999 --ceph wip-swagner-testing-2020-05-15-2348  --machine-type smithi --dry-run --seed 2547 2>&1 | grep -c Scheduling
33

And same results with describe:

$ teuthology-describe /home/kyr/src/git.ceph.com_ceph-c_wip-swagner-testing-2020-05-15-2348/qa/suites/rados/cephadm --subset 1135/9999 --seed 2547  -s
# 33/33 /home/kyr/src/git.ceph.com_ceph-c_wip-swagner-testing-2020-05-15-2348/qa/suites/rados/cephadm

Actions
Copy link
 #5

Updated by Kyrylo Shatskyy almost 4 years ago

interested that such suites like 'rados/cephadm/with-work', 'rados/cephadm/orchestrator_cli', and 'rados/cephadm/upgrade' are not affected by duplication. But for example `workunits` sub-suite is affected:

(virtualenv) kyr@teuthology:~$ teuthology-describe /home/kyr/src/git.ceph.com_ceph-c_wip-swagner-testing-2020-05-15-2348/qa/suites/rados/cephadm --subset 1135/9999 --seed 2547 --filter workunits  -sp | sort | grep workunits
cephadm/workunits/{distro/centos_latest.yaml task/test_adoption.yaml}
cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm_repos.yaml}
cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm.yaml}
cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_adoption.yaml}
cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm_repos.yaml}
cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm.yaml}
(virtualenv) kyr@teuthology:~$ teuthology-describe /home/kyr/src/git.ceph.com_ceph-c_wip-swagner-testing-2020-05-15-2348/qa/suites/rados --subset 1135/9999 --seed 2547 --filter cephadm  -sp | sort | grep workunits
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm.yaml}
Actions
Copy link
 #6

Updated by Kyrylo Shatskyy almost 4 years ago

Another interesting observation, the issue is not reproduced when `--subset` is not used, compare:

$ teuthology-describe /home/kyr/src/git.ceph.com_ceph-c_wip-swagner-testing-2020-05-15-2348/qa/suites/rados -sp | grep -F cephadm/workunits | sort
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm.yaml}

and
$ teuthology-describe /home/kyr/src/git.ceph.com_ceph-c_wip-swagner-testing-2020-05-15-2348/qa/suites/rados -sp --subset 1/10 | grep -F cephadm/workunits | sort
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm.yaml}
rados/cephadm/workunits/{distro/centos_latest.yaml task/test_cephadm.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_adoption.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm_repos.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm.yaml}
rados/cephadm/workunits/{distro/ubuntu_18.04_podman.yaml task/test_cephadm.yaml}

Actions
Copy link
 #7

Updated by Sebastian Wagner almost 4 years ago

  • Subject changed from teuthology-suite schedules the same job twice to teuthology-suite: `subset` generates duplicate jobs
Actions
Copy link
 #8

Updated by Sebastian Wagner almost 4 years ago

  • Subject changed from teuthology-suite: `subset` generates duplicate jobs to teuthology-suite: `--subset` generates duplicate jobs
Actions
Copy link
 #9

Updated by Nathan Cutler almost 4 years ago

  • Subject changed from teuthology-suite: `--subset` generates duplicate jobs to teuthology-suite: "--subset" combined with "--filter" generates duplicate jobs
Actions
Copy link

Also available in: Atom PDF