Bug #57935
closedall test jobs get stuck at "Running task ansible.cephlab..."
0%
Description
https://pulpito.ceph.com/dis-2022-10-25_23:10:37-rbd-wip-dis-testing-distro-default-smithi/
2022-10-26T12:33:24.459 INFO:teuthology.run_tasks:Running task internal.timer...
2022-10-26T12:33:24.470 INFO:teuthology.task.internal:Starting timer...
2022-10-26T12:33:24.470 INFO:teuthology.run_tasks:Running task pcp...
2022-10-26T12:33:24.486 INFO:teuthology.run_tasks:Running task selinux...
2022-10-26T12:33:24.510 DEBUG:teuthology.task.selinux:Excluding smithi027: OS 'ubuntu' does not support SELinux
2022-10-26T12:33:24.511 DEBUG:teuthology.task.selinux:Excluding smithi190: OS 'ubuntu' does not support SELinux
2022-10-26T12:33:24.511 DEBUG:teuthology.task.selinux:Getting current SELinux state
2022-10-26T12:33:24.511 DEBUG:teuthology.task.selinux:Existing SELinux modes: {}
2022-10-26T12:33:24.511 INFO:teuthology.task.selinux:Putting SELinux into permissive mode
2022-10-26T12:33:24.512 INFO:teuthology.run_tasks:Running task ansible.cephlab...
Updated by Dan Mick over 1 year ago
It's conceivable this is related to the RHEV problems, currently still affecting quay.ceph,io, git.ceph.com, labdashboard.front, and nagios.front. Focusing on quay at the moment.
Updated by Laura Flores over 1 year ago
Note from Dan:
It's looking more and more like we're just going to have to rebuild these broken VMs from scratch. Luckily in many cases that won't involve complete data loss.
Updated by Christian Rohmann over 1 year ago
Could you kindly give an update on the state of the restoration process?
Mostly I would love to know what the implications for testing of upcoming point releases (e.g. 16.2.11) still are.
Updated by Laura Flores over 1 year ago
Hi Christian,
The lab was fixed a few weeks ago, and we are close to cutting the RC for v16.2.11. We expect to finish testing over the holidays and release at the beginning of January.