Project

General

Profile

Actions

Bug #46320

closed

teuthology/task/kernel: stuck at querying

Added by Patrick Donnelly almost 4 years ago. Updated over 3 years ago.

Status:
Can't reproduce
Priority:
High
Assignee:
-
Category:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

2020-07-01T12:03:33.815 INFO:teuthology.run_tasks:Running task kernel...
2020-07-01T12:03:33.835 DEBUG:teuthology.task.kernel:normalized config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}}
2020-07-01T12:03:33.836 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}}, timeout 300
2020-07-01T12:03:33.836 INFO:teuthology.orchestra.run.smithi125:> sudo lsb_release -is
2020-07-01T12:03:33.892 INFO:teuthology.orchestra.run.smithi125.stdout:CentOS
2020-07-01T12:03:33.892 DEBUG:teuthology.misc:System to be installed: CentOS
2020-07-01T12:03:33.893 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing
2020-07-01T12:03:34.103 DEBUG:teuthology.task.kernel:sha1 for client.0 is 556853900c89275f667d7cda681eca33c54b8e71
2020-07-01T12:03:34.103 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "556853900c89275f667d7cda681eca33c54b8e71"...
2020-07-01T12:03:34.104 INFO:teuthology.orchestra.run.smithi125:> uname -r
2020-07-01T12:03:34.119 INFO:teuthology.orchestra.run.smithi125.stdout:4.18.0-193.6.3.el8_2.x86_64
2020-07-01T12:03:34.119 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-193.6.3.el8_2.x86_64 vs 556853900c89275f667d7cda681eca33c54b8e71
2020-07-01T12:03:34.120 DEBUG:teuthology.task.kernel:failed to parse current kernel version
2020-07-01T12:03:34.120 INFO:teuthology.orchestra.run.smithi164:> sudo lsb_release -is
2020-07-01T12:03:34.177 INFO:teuthology.orchestra.run.smithi164.stdout:CentOS
2020-07-01T12:03:34.178 DEBUG:teuthology.misc:System to be installed: CentOS
2020-07-01T12:03:34.178 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing
2020-07-01T12:03:34.376 DEBUG:teuthology.task.kernel:sha1 for client.1 is 556853900c89275f667d7cda681eca33c54b8e71
2020-07-01T12:03:34.376 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "556853900c89275f667d7cda681eca33c54b8e71"...
2020-07-01T12:03:34.377 INFO:teuthology.orchestra.run.smithi164:> uname -r
2020-07-01T12:03:34.393 INFO:teuthology.orchestra.run.smithi164.stdout:4.18.0-193.6.3.el8_2.x86_64
2020-07-01T12:03:34.393 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-193.6.3.el8_2.x86_64 vs 556853900c89275f667d7cda681eca33c54b8e71
2020-07-01T12:03:34.393 DEBUG:teuthology.task.kernel:failed to parse current kernel version
2020-07-01T12:03:34.394 INFO:teuthology.orchestra.run.smithi137:> sudo lsb_release -is
2020-07-01T12:03:34.453 INFO:teuthology.orchestra.run.smithi137.stdout:CentOS
2020-07-01T12:03:34.454 DEBUG:teuthology.misc:System to be installed: CentOS
2020-07-01T12:03:34.455 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing
2020-07-01T12:03:34.660 DEBUG:teuthology.task.kernel:sha1 for client.2 is 556853900c89275f667d7cda681eca33c54b8e71
2020-07-01T12:03:34.660 INFO:teuthology.task.kernel:Checking kernel version of client.2, want "556853900c89275f667d7cda681eca33c54b8e71"...
2020-07-01T12:03:34.661 INFO:teuthology.orchestra.run.smithi137:> uname -r
2020-07-01T12:03:34.677 INFO:teuthology.orchestra.run.smithi137.stdout:4.18.0-193.6.3.el8_2.x86_64
2020-07-01T12:03:34.678 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-193.6.3.el8_2.x86_64 vs 556853900c89275f667d7cda681eca33c54b8e71
2020-07-01T12:03:34.678 DEBUG:teuthology.task.kernel:failed to parse current kernel version
2020-07-01T12:03:34.679 INFO:teuthology.orchestra.run.smithi032:> sudo lsb_release -is
2020-07-01T12:03:34.747 INFO:teuthology.orchestra.run.smithi032.stdout:CentOS
2020-07-01T12:03:34.749 DEBUG:teuthology.misc:System to be installed: CentOS
2020-07-01T12:03:34.750 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F8%2Fx86_64&ref=testing

From: /ceph/teuthology-archive/pdonnell-2020-07-01_06:40:26-kcephfs-wip-pdonnell-testing-20200701.033411-distro-basic-smithi/5193249/teuthology.log

Actions #1

Updated by Patrick Donnelly almost 4 years ago

Looks like there are more systemic issues with teuthology/sepia right now. Lots of tests are failing in odd ways.

Actions #2

Updated by Nathan Cutler almost 4 years ago

current kernel version is 4.18.0-193.6.3.el8_2.x86_64 vs 556853900c89275f667d7cda681eca33c54b8e71

That there is a sha1 here is fine - there is a code path for handling that. But that code path assumes the current kernel version ("4.18.0-193.6.3.el8_2.x86_64" in this case) will match the regular expression

[-_]g([0-9a-f]{6,40})

but it does not match. Hence we see the message "failed to parse current kernel version".

The question is: why does the current kernel version not match the regular expression? My guess: because the currently-installed kernel is a distro kernel and the code path is expecting a testing kernel.

Actions #3

Updated by Kyrylo Shatskyy over 3 years ago

@Nathan Weinberg So what would be a resolution for this?

Actions #4

Updated by Nathan Cutler over 3 years ago

If there haven't been any other instances of this failure for 3 months (Patrick could confirm), then it could just be closed?

Actions #5

Updated by Patrick Donnelly over 3 years ago

  • Status changed from New to Can't reproduce
Actions

Also available in: Atom PDF