Ceph » RADOS

Discussed this with Neha and we took a bit of a look on a node where the test failed.

In order to enable the PowerTools repo (for snappy-devel) we need the file /etc/yum.repos.d/CentOS-Stream-PowerTools.repo which is provided by the centos-stream-repos package.

[root@smithi101 ~]# rpm -V centos-stream-repos
missing   c /etc/yum.repos.d/CentOS-Stream-AppStream.repo
missing   c /etc/yum.repos.d/CentOS-Stream-BaseOS.repo
missing   c /etc/yum.repos.d/CentOS-Stream-Debuginfo.repo
missing   c /etc/yum.repos.d/CentOS-Stream-Extras.repo
missing   c /etc/yum.repos.d/CentOS-Stream-HighAvailability.repo
missing   c /etc/yum.repos.d/CentOS-Stream-Media.repo
missing   c /etc/yum.repos.d/CentOS-Stream-PowerTools.repo
missing   c /etc/yum.repos.d/CentOS-Stream-RealTime.repo

So it was installed but then these files were deleted. It turns out the code here does that.

https://github.com/ceph/ceph-cm-ansible/blob/4beeec90f7adfbf5573f811b4092584a8e7de68a/roles/testnode/tasks/yum/repos.yml#L5-L9

So it looks like we either need to change that or add a patch like the following.

diff --git a/qa/workunits/rados/test_envlibrados_for_rocksdb.sh b/qa/workunits/rados/test_envlibrados_for_rocksdb.sh
index badb25e1102..0118125e2e4 100755
--- a/qa/workunits/rados/test_envlibrados_for_rocksdb.sh
+++ b/qa/workunits/rados/test_envlibrados_for_rocksdb.sh
@@ -26,6 +26,7 @@ case $(distro_id) in
         case $(distro_id) in
             centos)
                 # centos needs PowerTools repo for snappy-devel
+                test -x /usr/bin/dnf && sudo dnf -y reinstall centos-stream-repos
                 test -x /usr/bin/dnf && sudo dnf config-manager --set-enabled powertools || true
                 ;;
             rhel)

https://github.com/ceph/ceph-cm-ansible/pull/638

I'd love for that test -x /usr/bin/dnf && sudo dnf config-manager --set-enabled powertools || true line to go away after this gets merged. That kind of OS configuration should be done in ceph-cm-ansible else we end up with conflicts.

Neha Ojha wrote:

David Galloway wrote:

https://github.com/ceph/ceph-cm-ansible/pull/638

I'd love for that test -x /usr/bin/dnf && sudo dnf config-manager --set-enabled powertools || true line to go away after this gets merged. That kind of OS configuration should be done in ceph-cm-ansible else we end up with conflicts.

Thanks David! Works fine now.

rados:singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8.stream}}

https://pulpito.ceph.com/nojha-2021-07-14_17:00:14-rados:singleton-master-distro-basic-smithi/6271398/

We'll create a separate PR to clean the script up.

The centos 8.3 tests fail without test -x /usr/bin/dnf && sudo dnf config-manager --set-enabled powertools || true line

2021-07-16T17:51:30.886 INFO:tasks.workunit.client.0.smithi140.stderr:+ install_one snappy-devel
2021-07-16T17:51:30.886 INFO:tasks.workunit.client.0.smithi140.stderr:+ case $(distro_id) in
2021-07-16T17:51:30.886 INFO:tasks.workunit.client.0.smithi140.stderr:++ distro_id
2021-07-16T17:51:30.886 INFO:tasks.workunit.client.0.smithi140.stderr:++ source /etc/os-release
2021-07-16T17:51:30.887 INFO:tasks.workunit.client.0.smithi140.stderr:+++ NAME='CentOS Linux'
2021-07-16T17:51:30.887 INFO:tasks.workunit.client.0.smithi140.stderr:+++ VERSION=8
2021-07-16T17:51:30.887 INFO:tasks.workunit.client.0.smithi140.stderr:+++ ID=centos
2021-07-16T17:51:30.888 INFO:tasks.workunit.client.0.smithi140.stderr:+++ ID_LIKE='rhel fedora'
2021-07-16T17:51:30.888 INFO:tasks.workunit.client.0.smithi140.stderr:+++ VERSION_ID=8
2021-07-16T17:51:30.888 INFO:tasks.workunit.client.0.smithi140.stderr:+++ PLATFORM_ID=platform:el8
2021-07-16T17:51:30.888 INFO:tasks.workunit.client.0.smithi140.stderr:+++ PRETTY_NAME='CentOS Linux 8'
2021-07-16T17:51:30.889 INFO:tasks.workunit.client.0.smithi140.stderr:+++ ANSI_COLOR='0;31'
2021-07-16T17:51:30.889 INFO:tasks.workunit.client.0.smithi140.stderr:+++ CPE_NAME=cpe:/o:centos:centos:8
2021-07-16T17:51:30.889 INFO:tasks.workunit.client.0.smithi140.stderr:+++ HOME_URL=https://centos.org/
2021-07-16T17:51:30.889 INFO:tasks.workunit.client.0.smithi140.stderr:+++ BUG_REPORT_URL=https://bugs.centos.org/
2021-07-16T17:51:30.889 INFO:tasks.workunit.client.0.smithi140.stderr:+++ CENTOS_MANTISBT_PROJECT=CentOS-8
2021-07-16T17:51:30.890 INFO:tasks.workunit.client.0.smithi140.stderr:+++ CENTOS_MANTISBT_PROJECT_VERSION=8
2021-07-16T17:51:30.890 INFO:tasks.workunit.client.0.smithi140.stderr:++ echo centos
2021-07-16T17:51:30.890 INFO:tasks.workunit.client.0.smithi140.stderr:+ sudo yum install -y snappy-devel
2021-07-16T17:51:31.442 INFO:tasks.workunit.client.0.smithi140.stdout:Last metadata expiration check: 0:03:41 ago on Fri 16 Jul 2021 05:47:50 PM UTC.
2021-07-16T17:51:32.061 INFO:tasks.workunit.client.0.smithi140.stdout:No match for argument: snappy-devel
2021-07-16T17:51:32.079 INFO:tasks.workunit.client.0.smithi140.stderr:Error: Unable to find a match: snappy-devel

https://pulpito.ceph.com/nojha-2021-07-16_17:30:02-rados:singleton-master-distro-basic-smithi/6276224/

http://qa-proxy.ceph.com/teuthology/yuriw-2021-07-16_17:39:36-rados-wip-yuri7-testing-2021-07-16-0906-octopus-distro-basic-smithi/6276447/teuthology.log

Deepika Upadhyay wrote:

http://qa-proxy.ceph.com/teuthology/yuriw-2021-07-16_17:39:36-rados-wip-yuri7-testing-2021-07-16-0906-octopus-distro-basic-smithi/6276447/teuthology.log

That wasn't CentOS 8.stream :). Is snappy-devel also needed in CentOS8?

Oh, I see. Okay. I will fix.

David Galloway wrote:

Oh, I see. Okay. I will fix.

Awesome, thanks! :)

Deepika Upadhyay wrote:

David Galloway wrote:

Oh, I see. Okay. I will fix.

Awesome, thanks! :)

Should be fixed now.

David Galloway wrote:

Deepika Upadhyay wrote:

David Galloway wrote:

Oh, I see. Okay. I will fix.

Awesome, thanks! :)

Should be fixed now.

https://github.com/ceph/ceph/pull/42429