Bug #46840
openerrors while using "teuthology-queue -D"
0%
Description
Was running `teuthology-queue -m smithi -D teuthology-2020-08-03_04`
Jobs actually did get deleted, but errors were observed:
at the begining =>
2020-08-05 19:36:34,463.463 INFO:teuthology.beanstalk:Checking Beanstalk Queue... /home/yuriw/teuthology/virtualenv/lib/python3.6/site-packages/beanstalkc.py:141: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details. return self._parse_yaml(body)
at the end =>
2020-08-05 19:34:25,845.845 ERROR:teuthology.report:Job deletion failed Traceback (most recent call last): File "/home/yuriw/teuthology/teuthology/report.py", line 543, in try_delete_job reporter.delete_job(run_name, job_id) File "/home/yuriw/teuthology/teuthology/report.py", line 426, in delete_job response.raise_for_status() File "/home/yuriw/teuthology/virtualenv/lib/python3.6/site-packages/requests/models.py", line 940, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http://paddles.front.sepia.ceph.com:80/runs/teuthology-2020-08-03_04:15:02-multimds-master-testing-basic-smithi/jobs/5282065/
Updated by Yuri Weinstein over 3 years ago
- Project changed from Ceph to teuthology
Updated by Kyrylo Shatskyy over 3 years ago
Do you have a full log? I think this is expected behavior, but I need to see the full log.
My suggestion it is trying to delete first_in_suite and last_in_suite job, which we do not post anymore to paddles, however we should try to delete them in case the run can be scheduled with older version of teuthology-suite/queue (people do not like to update their teuthology sandboxes to the recent version). If not delete them, they remain in paddles and overall status of the run can be displayed incorrectly in pulpito.
Updated by Kyrylo Shatskyy over 3 years ago
{code}
/home/yuriw/teuthology/virtualenv/lib/python3.6/site-packages/beanstalkc.py:141: YAMLLoadWarning: calling yaml.load() without Loader=... is deprecated, as the default Loader is unsafe. Please read https://msg.pyyaml.org/load for full details.
{code}
That is known issue which belongs to beanstalkd, which they do not update.
Updated by Yuri Weinstein over 3 years ago
Full log is too big, here is the snippets:
Deleting teuthology-2020-08-03_05:15:02-krbd-octopus-testing-basic-smithi/5282931 Deleting teuthology-2020-08-03_05:15:02-krbd-octopus-testing-basic-smithi/5282932 Deleting teuthology-2020-08-03_05:15:02-krbd-octopus-testing-basic-smithi/5282933 Deleting teuthology-2020-08-03_05:15:02-krbd-octopus-testing-basic-smithi/5282934 2020-08-06 17:22:07,738.738 ERROR:teuthology.report:Job deletion failed Traceback (most recent call last): File "/home/yuriw/teuthology/teuthology/report.py", line 543, in try_delete_job reporter.delete_job(run_name, job_id) File "/home/yuriw/teuthology/teuthology/report.py", line 426, in delete_job response.raise_for_status() File "/home/yuriw/teuthology/virtualenv/lib/python3.6/site-packages/requests/models.py", line 940, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http://paddles.front.sepia.ceph.com:80/runs/teuthology-2020-08-03_05:15:02-krbd-octopus-testing-basic-smithi/jobs/5282934/ Deleting teuthology-2020-08-03_06:00:02-rbd-nautilus-distro-basic-smithi/5282975 2020-08-06 17:22:07,778.778 ERROR:teuthology.report:Job deletion failed Traceback (most recent call last): File "/home/yuriw/teuthology/teuthology/report.py", line 543, in try_delete_job reporter.delete_job(run_name, job_id) File "/home/yuriw/teuthology/teuthology/report.py", line 426, in delete_job response.raise_for_status() File "/home/yuriw/teuthology/virtualenv/lib/python3.6/site-packages/requests/models.py", line 940, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http://paddles.front.sepia.ceph.com:80/runs/teuthology-2020-08-03_06:00:02-rbd-nautilus-distro-basic-smithi/jobs/5282975/ Deleting teuthology-2020-08-03_06:00:02-rbd-nautilus-distro-basic-smithi/5282976 Deleting teuthology-2020-08-03_06:00:02-rbd-nautilus-distro-basic-smithi/5282977 Deleting teuthology-2020-08-03_06:00:02-rbd-nautilus-distro-basic-smithi/5282978 Deleting teuthology-2020-08-03_06:00:02-rbd-nautilus-distro-basic-smithi/5282979 Deleting teuthology-2020-08-03_06:00:02-rbd-nautilus-distro-basic-smithi/5282980 Deleting teuthology-2020-08-03_06:00:02-rbd-octopus-distro-basic-smithi/5282981 2020-08-06 17:22:08,153.153 ERROR:teuthology.report:Job deletion failed Traceback (most recent call last): File "/home/yuriw/teuthology/teuthology/report.py", line 543, in try_delete_job reporter.delete_job(run_name, job_id) File "/home/yuriw/teuthology/teuthology/report.py", line 426, in delete_job response.raise_for_status() File "/home/yuriw/teuthology/virtualenv/lib/python3.6/site-packages/requests/models.py", line 940, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http://paddles.front.sepia.ceph.com:80/runs/teuthology-2020-08-03_06:00:02-rbd-octopus-distro-basic-smithi/jobs/5282981/ Deleting teuthology-2020-08-03_06:00:02-rbd-nautilus-distro-basic-smithi/5282982 Deleting teuthology-2020-08-03_06:00:02-rbd-octopus-distro-basic-smithi/5282983 Deleting teuthology-2020-08-03_06:00:02-rbd-nautilus-distro-basic-smithi/5282984
eleting teuthology-2020-08-03_06:00:02-rbd-octopus-distro-basic-smithi/5283246 Deleting teuthology-2020-08-03_06:00:02-rbd-octopus-distro-basic-smithi/5283247 Deleting teuthology-2020-08-03_06:00:02-rbd-octopus-distro-basic-smithi/5283248 Deleting teuthology-2020-08-03_06:00:02-rbd-octopus-distro-basic-smithi/5283249 Deleting teuthology-2020-08-03_06:00:02-rbd-octopus-distro-basic-smithi/5283250 Deleting teuthology-2020-08-03_06:00:02-rbd-octopus-distro-basic-smithi/5283251 Deleting teuthology-2020-08-03_06:00:02-rbd-octopus-distro-basic-smithi/5283252 Deleting teuthology-2020-08-03_06:00:02-rbd-octopus-distro-basic-smithi/5283253 Deleting teuthology-2020-08-03_06:00:02-rbd-octopus-distro-basic-smithi/5283254 Deleting teuthology-2020-08-03_06:00:02-rbd-octopus-distro-basic-smithi/5283255 Deleting teuthology-2020-08-03_06:00:02-rbd-octopus-distro-basic-smithi/5283256 Deleting teuthology-2020-08-03_06:00:02-rbd-octopus-distro-basic-smithi/5283257 Deleting teuthology-2020-08-03_06:00:02-rbd-octopus-distro-basic-smithi/5283258 2020-08-06 17:22:27,696.696 ERROR:teuthology.report:Job deletion failed Traceback (most recent call last): File "/home/yuriw/teuthology/teuthology/report.py", line 543, in try_delete_job reporter.delete_job(run_name, job_id) File "/home/yuriw/teuthology/teuthology/report.py", line 426, in delete_job response.raise_for_status() File "/home/yuriw/teuthology/virtualenv/lib/python3.6/site-packages/requests/models.py", line 940, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http://paddles.front.sepia.ceph.com:80/runs/teuthology-2020-08-03_06:00:02-rbd-octopus-distro-basic-smithi/jobs/5283258/ Deleting teuthology-2020-08-03_10:25:03-kcephfs-master-testing-basic-smithi/5283888 2020-08-06 17:22:27,729.729 ERROR:teuthology.report:Job deletion failed Traceback (most recent call last): File "/home/yuriw/teuthology/teuthology/report.py", line 543, in try_delete_job reporter.delete_job(run_name, job_id) File "/home/yuriw/teuthology/teuthology/report.py", line 426, in delete_job response.raise_for_status() File "/home/yuriw/teuthology/virtualenv/lib/python3.6/site-packages/requests/models.py", line 940, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 404 Client Error: Not Found for url: http://paddles.front.sepia.ceph.com:80/runs/teuthology-2020-08-03_10:25:03-kcephfs-master-testing-basic-smithi/jobs/5283888/ Deleting teuthology-2020-08-03_10:25:03-kcephfs-master-testing-basic-smithi/5283889 Deleting teuthology-2020-08-03_10:25:03-kcephfs-master-testing-basic-smithi/5283890 Deleting teuthology-2020-08-03_10:25:03-kcephfs-master-testing-basic-smithi/5283891 Deleting teuthology-2020-08-03_10:25:03-kcephfs-master-testing-basic-smithi/5283892 Deleting teuthology-2020-08-03_10:25:03-kcephfs-master-testing-basic-smithi/5283893 Deleting teuthology-2020-08-03_10:25:03-kcephfs-master-testing-basic-smithi/5283894
Updated by Yuri Weinstein over 2 years ago
- Related to Bug #53262: "teuthology-queue -m smithi -D xx" fails "404 Client Error: Not Found for url" added