Project

General

Profile

Actions

Bug #16569

open

teuthology-kill cound not kill all jobs,it still lost one job

Added by de lan almost 8 years ago. Updated almost 8 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
% Done:

0%

Source:
other
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

HI!
when i use zhe order "teuthology-kill" to kill all jobs,but it still lost one job.

what i have down list:
(virtualenv)teuthology@scheduler:~$ teuthology-queue -m plana
2016-07-01 16:48:43,549.549 INFO:teuthology.beanstalk:Checking Beanstalk Queue...
Job: 1 priority: 1000 xxg-2016-07-01_16:47:26-fs-wip-xxg-testing-2016-06-25---basic-plana/86
Job: 2 priority: 1000 xxg-2016-07-01_16:47:26-fs-wip-xxg-testing-2016-06-25---basic-plana/87
Job: 3 priority: 1000 xxg-2016-07-01_16:47:26-fs-wip-xxg-testing-2016-06-25---basic-plana/88
Job: 4 priority: 1000 xxg-2016-07-01_16:47:26-fs-wip-xxg-testing-2016-06-25---basic-plana/89
Job: 5 priority: 1000 xxg-2016-07-01_16:47:26-fs-wip-xxg-testing-2016-06-25---basic-plana/90

(virtualenv)teuthology@scheduler:~$
(virtualenv)teuthology@scheduler:~$ teuthology-kill -r xxg-2016-07-01_16:47:26-fs-wip-xxg-testing-2016-06-25---basic-plana -m plana
2016-07-01 16:49:06,788.788 INFO:teuthology.kill:Checking Beanstalk Queue...
2016-07-01 16:49:06,830.830 INFO:teuthology.kill:Deleting job from queue. ID: 86 Name: xxg-2016-07-01_16:47:26-fs-wip-xxg-testing-2016-06-25---basic-plana Desc: fs/basic/{clusters/fixed-2-ucephfs.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_kernel_untar_build.yaml}
2016-07-01 16:49:06,853.853 INFO:teuthology.kill:Deleting job from queue. ID: 87 Name: xxg-2016-07-01_16:47:26-fs-wip-xxg-testing-2016-06-25---basic-plana Desc: fs/basic/{clusters/fixed-2-ucephfs.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_kernel_untar_build.yaml}
2016-07-01 16:49:06,875.875 INFO:teuthology.kill:Deleting job from queue. ID: 88 Name: xxg-2016-07-01_16:47:26-fs-wip-xxg-testing-2016-06-25---basic-plana Desc: fs/basic/{clusters/fixed-2-ucephfs.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_kernel_untar_build.yaml}
2016-07-01 16:49:06,896.896 INFO:teuthology.kill:Deleting job from queue. ID: 89 Name: xxg-2016-07-01_16:47:26-fs-wip-xxg-testing-2016-06-25---basic-plana Desc: fs/basic/{clusters/fixed-2-ucephfs.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_kernel_untar_build.yaml}
2016-07-01 16:49:06,927.927 INFO:teuthology.kill:Deleting jobs from paddles: [u'90', u'89', u'88', u'87', u'86']
2016-07-01 16:49:07,051.051 INFO:teuthology.kill:No teuthology processes running
(virtualenv)teuthology@scheduler:~$ teuthology-queue -m plana
2016-07-01 16:49:09,677.677 INFO:teuthology.beanstalk:Checking Beanstalk Queue...
Job: 1 priority: 1000 xxg-2016-07-01_16:47:26-fs-wip-xxg-testing-2016-06-25---basic-plana/90

Actions #1

Updated by Zezhu Zhang almost 8 years ago

I fix teuthology/kill.py of remove_beanstalk_jobs(): x=0;

result:

(virtualenv)teuthology@scheduler:~$ teuthology-queue -m plana
2016-07-01 17:36:12,883.883 INFO:teuthology.beanstalk:Checking Beanstalk Queue...
Job: 1 priority: 1000 xxg-2016-07-01_17:30:45-fs-wip-xxg-testing-2016-06-25---basic-plana/92
Job: 2 priority: 1000 xxg-2016-07-01_17:30:45-fs-wip-xxg-testing-2016-06-25---basic-plana/93
Job: 3 priority: 1000 xxg-2016-07-01_17:30:45-fs-wip-xxg-testing-2016-06-25---basic-plana/94
Job: 4 priority: 1000 xxg-2016-07-01_17:30:45-fs-wip-xxg-testing-2016-06-25---basic-plana/95

(virtualenv)teuthology@scheduler:~$
(virtualenv)teuthology@scheduler:~$
(virtualenv)teuthology@scheduler:~$
(virtualenv)teuthology@scheduler:~$ teuthology-kill -r xxg-2016-07-01_17:30:45-fs-wip-xxg-testing-2016-06-25---basic-plana -m plana
2016-07-01 17:36:57,509.509 INFO:teuthology.kill:Checking Beanstalk Queue...
2016-07-01 17:36:57,534.534 INFO:teuthology.kill:Deleting job from queue. ID: 92 Name: xxg-2016-07-01_17:30:45-fs-wip-xxg-testing-2016-06-25---basic-plana Desc: fs/basic/{clusters/fixed-2-ucephfs.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_kernel_untar_build.yaml}
2016-07-01 17:36:57,550.550 INFO:teuthology.kill:Deleting job from queue. ID: 93 Name: xxg-2016-07-01_17:30:45-fs-wip-xxg-testing-2016-06-25---basic-plana Desc: fs/basic/{clusters/fixed-2-ucephfs.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_kernel_untar_build.yaml}
2016-07-01 17:36:57,567.567 INFO:teuthology.kill:Deleting job from queue. ID: 94 Name: xxg-2016-07-01_17:30:45-fs-wip-xxg-testing-2016-06-25---basic-plana Desc: fs/basic/{clusters/fixed-2-ucephfs.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_kernel_untar_build.yaml}
2016-07-01 17:36:57,586.586 INFO:teuthology.kill:Deleting job from queue. ID: 95 Name: xxg-2016-07-01_17:30:45-fs-wip-xxg-testing-2016-06-25---basic-plana Desc: fs/basic/{clusters/fixed-2-ucephfs.yaml debug/mds_client.yaml dirfrag/frag_enable.yaml fs/btrfs.yaml inline/yes.yaml overrides/whitelist_wrongly_marked_down.yaml tasks/cfuse_workunit_kernel_untar_build.yaml}
2016-07-01 17:36:57,634.634 INFO:teuthology.kill:Deleting jobs from paddles: [u'95', u'94', u'93', u'92']
2016-07-01 17:36:57,902.902 INFO:teuthology.kill:Killing Pids: [4592]
(virtualenv)teuthology@scheduler:~$ teuthology-queue -m plana
2016-07-01 17:37:07,840.840 INFO:teuthology.beanstalk:Checking Beanstalk Queue...
2016-07-01 17:37:07,843.843 INFO:teuthology.beanstalk:No jobs in Beanstalk Queue

Actions

Also available in: Atom PDF