Bug #13665: "queued" jobs are not properly reported - teuthology - Ceph

Actions

Copy link

Bug #13665

closed

"queued" jobs are not properly reported

Added by Yuri Weinstein over 8 years ago. Updated about 8 years ago.

Status:

Closed

Priority:

Urgent

Assignee:

Category:

% Done:

Source:

Q/A

Tags:

Backport:

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Crash signature (v1):

Crash signature (v2):

Description

Runs:

http://pulpito.ceph.com/teuthology-2015-10-29_21:00:11-rados-infernalis-distro-basic-multi/

Notice - queued and never executed jobs, however emails on completion were sent without counting them in.

For example for the run above - "[Ceph-qa] 1 failed, 3 passed in teuthology-2015-10-31_18:15:09-upgrade:dumpling-firefly-x-giant-distro-basic-vps"

Seen this for vps and baremetal runs

Actions

Copy link

Updated by Yuri Weinstein over 8 years ago

also:

http://pulpito.ceph.com/teuthology-2015-10-30_17:10:02-upgrade:hammer-x-infernalis-distro-basic-vps/
http://pulpito.ceph.com/teuthology-2015-10-29_21:00:11-rados-infernalis-distro-basic-multi/

Actions

Copy link

Updated by Yuri Weinstein over 8 years ago

@zackc here is a case:

teuthology@teuthology:~$ echo $filter 
upgrade:hammer-x/f-h-x-offline/1-pre.yaml,upgrade:hammer-x/f-h-x-offline/2-upgrade.yaml,upgrade:hammer-x/f-h-x-offline/3-infernalis.yaml,upgrade:hammer-x/f-h-x-offline/4-after.yaml
teuthology@teuthology:~$ teuthology-suite -v -c infernalis -k distro -m vps -s upgrade/hammer-x ~/vps.yaml -p 100 --filter="$filter" 
2015-11-04 16:16:10,588.588 INFO:teuthology.suite:kernel sha1: distro
2015-11-04 16:16:10,588.588 DEBUG:teuthology.suite:Defaults for machine_type vps distro None: arch=x86_64, release=centos7, pkg_type=rpm
2015-11-04 16:16:10,588.588 DEBUG:teuthology.suite:Gitbuilder URL: http://gitbuilder.ceph.com/ceph-rpm-centos7-x86_64-basic/ref/infernalis/sha1
2015-11-04 16:16:10,607.607 INFO:teuthology.suite:ceph sha1: bb2ecea240f3a1d525bcb35670cb07bd1f0ca299
2015-11-04 16:16:10,607.607 DEBUG:teuthology.suite:Defaults for machine_type vps distro None: arch=x86_64, release=centos7, pkg_type=rpm
2015-11-04 16:16:10,607.607 DEBUG:teuthology.suite:Looking for packages at http://gitbuilder.ceph.com/ceph-rpm-centos7-x86_64-basic/sha1/bb2ecea240f3a1d525bcb35670cb07bd1f0ca299/version
2015-11-04 16:16:10,611.611 INFO:teuthology.suite:ceph version: v9.2.0
2015-11-04 16:16:10,611.611 INFO:teuthology.suite:teuthology branch: master
2015-11-04 16:16:11,938.938 INFO:teuthology.suite:ceph-qa-suite branch: infernalis f9e22c5e046d032a6a52b4530ae225752a6ed085
2015-11-04 16:16:11,939.939 INFO:teuthology.repo_utils:Fetching from upstream into /home/teuthology/src/teuthology_master
2015-11-04 16:16:12,609.609 INFO:teuthology.repo_utils:Resetting repo at /home/teuthology/src/teuthology_master to branch master
2015-11-04 16:16:12,616.616 INFO:teuthology.repo_utils:Bootstrapping /home/teuthology/src/teuthology_master
2015-11-04 16:16:20,197.197 INFO:teuthology.repo_utils:Bootstrap exited with status 0
2015-11-04 16:16:20,198.198 INFO:teuthology.repo_utils:Fetching from upstream into /home/teuthology/src/ceph-qa-suite_infernalis
2015-11-04 16:16:21,520.520 INFO:teuthology.repo_utils:Resetting repo at /home/teuthology/src/ceph-qa-suite_infernalis to branch infernalis
2015-11-04 16:16:21,565.565 DEBUG:teuthology.suite:Suite upgrade:hammer-x in /home/teuthology/src/ceph-qa-suite_infernalis/suites/upgrade/hammer-x
2015-11-04 16:16:21,572.572 INFO:teuthology.suite:Suite upgrade:hammer-x in /home/teuthology/src/ceph-qa-suite_infernalis/suites/upgrade/hammer-x generated 20 jobs (not yet filtered)
2015-11-04 16:16:21,580.580 INFO:teuthology.suite:Scheduling upgrade:hammer-x/f-h-x-offline/1-pre.yaml
Job scheduled with name teuthology-2015-11-04_16:16:10-upgrade:hammer-x-infernalis-distro-basic-vps and ID 1138893
2015-11-04 16:16:22,174.174 INFO:teuthology.suite:Scheduling upgrade:hammer-x/f-h-x-offline/2-upgrade.yaml
Job scheduled with name teuthology-2015-11-04_16:16:10-upgrade:hammer-x-infernalis-distro-basic-vps and ID 1138894
2015-11-04 16:16:22,674.674 INFO:teuthology.suite:Scheduling upgrade:hammer-x/f-h-x-offline/3-infernalis.yaml
Job scheduled with name teuthology-2015-11-04_16:16:10-upgrade:hammer-x-infernalis-distro-basic-vps and ID 1138895
2015-11-04 16:16:23,188.188 INFO:teuthology.suite:Scheduling upgrade:hammer-x/f-h-x-offline/4-after.yaml
Job scheduled with name teuthology-2015-11-04_16:16:10-upgrade:hammer-x-infernalis-distro-basic-vps and ID 1138896
2015-11-04 16:16:23,663.663 INFO:teuthology.suite:Suite upgrade:hammer-x in /home/teuthology/src/ceph-qa-suite_infernalis/suites/upgrade/hammer-x scheduled 4 jobs.
2015-11-04 16:16:23,663.663 INFO:teuthology.suite:Suite upgrade:hammer-x in /home/teuthology/src/ceph-qa-suite_infernalis/suites/upgrade/hammer-x -- 16 jobs were filtered out.
Job scheduled with name teuthology-2015-11-04_16:16:10-upgrade:hammer-x-infernalis-distro-basic-vps and ID 1138897
2015-11-04 16:16:24,110.110 INFO:teuthology.suite:Test results viewable at http://pulpito.ceph.com/teuthology-2015-11-04_16:16:10-upgrade:hammer-x-infernalis-distro-basic-vps/

In pulpito: http://pulpito.ceph.com/teuthology-2015-11-04_16:16:10-upgrade:hammer-x-infernalis-distro-basic-vps/

All 'queued' and resulting email came empty of cause, subject "[Ceph-qa] in teuthology-2015-11-04_16:16:10-upgrade:hammer-x-infernalis-distro-basic-vps"

Actions

Copy link