Ceph

Happened at:

• https://github.com/ceph/ceph/pull/30076
• https://github.com/ceph/ceph/pull/30073

From https://jenkins.ceph.com/view/all/job/ceph-pull-requests/33059/console

adding repo from: https://dl.fedoraproject.org/pub/epel/7/x86_64/

[dl.fedoraproject.org_pub_epel_7_x86_64_]
name=added from: https://dl.fedoraproject.org/pub/epel/7/x86_64/
baseurl=https://dl.fedoraproject.org/pub/epel/7/x86_64/
enabled=1

Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
 * base: mirrors.standaloneinstaller.com
 * centos-sclo-rh: mirrors.standaloneinstaller.com
 * centos-sclo-sclo: mirrors.standaloneinstaller.com
 * epel: mirror.23media.com
 * extras: mirrors.standaloneinstaller.com
 * updates: mirrors.standaloneinstaller.com
Package epel-release-7-11.noarch already installed and latest version
Nothing to do
Loaded plugins: fastestmirror
=================================== repo: cr ===================================
[cr]
async = True
bandwidth = 0
base_persistdir = /var/lib/yum/repos/x86_64/7
baseurl = http://mirror.centos.org/centos/7/cr/x86_64/
cache = 0
cachedir = /var/cache/yum/x86_64/7/cr
check_config_file_age = True
compare_providers_priority = 80
cost = 1000
deltarpm_metadata_percentage = 100
deltarpm_percentage = 
enabled = 1
enablegroups = True
exclude = 
failovermethod = priority
ftp_disable_epsv = False
gpgcadir = /var/lib/yum/repos/x86_64/7/cr/gpgcadir
gpgcakey = 
gpgcheck = True
gpgdir = /var/lib/yum/repos/x86_64/7/cr/gpgdir
gpgkey = file:///etc/pki/rpm-gpg/RPM-GPG-KEY-CentOS-7
hdrdir = /var/cache/yum/x86_64/7/cr/headers
http_caching = all
includepkgs = 
ip_resolve = 
keepalive = True
keepcache = False
mddownloadpolicy = sqlite
mdpolicy = group:small
mediaid = 
metadata_expire = 21600
metadata_expire_filter = read-only:present
metalink = 
minrate = 0
mirrorlist = 
mirrorlist_expire = 86400
name = CentOS-7 - cr
old_base_cache_dir = 
password = 
persistdir = /var/lib/yum/repos/x86_64/7/cr
pkgdir = /var/cache/yum/x86_64/7/cr/packages
proxy = False
proxy_dict = 
proxy_password = 
proxy_username = 
repo_gpgcheck = False
retries = 10
skip_if_unavailable = False
ssl_check_cert_permissions = True
sslcacert = 
sslclientcert = 
sslclientkey = 
sslverify = True
throttle = 0
timeout = 30.0
ui_id = cr/7/x86_64
ui_repoid_vars = releasever,
   basearch
username = 

Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
 * base: mirrors.standaloneinstaller.com
 * centos-sclo-rh: mirrors.standaloneinstaller.com
 * centos-sclo-sclo: mirrors.standaloneinstaller.com
 * epel: mirror.23media.com
 * extras: mirrors.standaloneinstaller.com
 * updates: mirrors.standaloneinstaller.com
Package centos-release-scl-2-3.el7.centos.noarch already installed and latest version
Nothing to do
Loaded plugins: fastestmirror
Loading mirror speeds from cached hostfile
 * base: mirrors.standaloneinstaller.com
 * centos-sclo-rh: mirrors.standaloneinstaller.com
 * centos-sclo-sclo: mirrors.standaloneinstaller.com
 * epel: mirror.23media.com
 * extras: mirrors.standaloneinstaller.com
 * updates: mirrors.standaloneinstaller.com
Package python-qt5-rpm-macros-5.12.1-2.el7.noarch already installed and latest version
Package ocaml-srpm-macros-5-2.el7.noarch already installed and latest version
Package erlang-rpm-macros-0.1.4-1.el7.noarch already installed and latest version
Package ghc-rpm-macros-1.0.12-1.el7.x86_64 already installed and latest version
Package blis-srpm-macros-0.4.1-2.el7.noarch already installed and latest version
Package openblas-srpm-macros-1-1.el7.noarch already installed and latest version
Package python3-other-rpm-macros-3-25.el7.noarch already installed and latest version
Package kf5-rpm-macros-5.52.0-1.el7.noarch already installed and latest version
Package perl-srpm-macros-1-8.el7.noarch already installed and latest version
Package 1:blender-rpm-macros-2.68a-8.el7.noarch already installed and latest version
Package epel-rpm-macros-7-21.noarch already installed and latest version
Resolving Dependencies
--> Running transaction check
---> Package python-rpm-macros.noarch 0:3-25.el7 will be updated
---> Package python-rpm-macros.noarch 0:3-32.el7 will be an update
---> Package python-srpm-macros.noarch 0:3-25.el7 will be updated
---> Package python-srpm-macros.noarch 0:3-32.el7 will be an update
---> Package python2-rpm-macros.noarch 0:3-25.el7 will be updated
---> Package python2-rpm-macros.noarch 0:3-32.el7 will be an update
---> Package python3-rpm-macros.noarch 0:3-25.el7 will be updated
---> Package python3-rpm-macros.noarch 0:3-32.el7 will be an update
---> Package qt5-rpm-macros.noarch 0:5.9.2-3.el7 will be updated
---> Package qt5-rpm-macros.noarch 0:5.9.7-2.el7 will be an update
--> Finished Dependency Resolution

Dependencies Resolved

================================================================================
 Package                    Arch           Version             Repository  Size
================================================================================
Updating:
 python-rpm-macros          noarch         3-32.el7            cr         8.8 k
 python-srpm-macros         noarch         3-32.el7            cr         8.4 k
 python2-rpm-macros         noarch         3-32.el7            cr         7.7 k
 python3-rpm-macros         noarch         3-32.el7            cr         7.7 k
 qt5-rpm-macros             noarch         5.9.7-2.el7         cr          27 k

Transaction Summary
================================================================================
Upgrade  5 Packages

Total download size: 60 k
Downloading packages:
No Presto metadata available for cr
--------------------------------------------------------------------------------
Total                                              212 kB/s |  60 kB  00:00     
Running transaction check
Running transaction test

Transaction check error:
  file /etc/rpm/macros.python from install of python-rpm-macros-3-32.el7.noarch conflicts with file from package python-devel-2.7.5-80.el7_6.x86_64

I'm guessing both of those packages are required for make check so I'm not sure I can do much besides filing https://bugs.centos.org/view.php?id=16379

@David - thanks for opening the upstream bug report. Advice there is:

You should be enabling the CR repo to pick up both

python-devel.x86_64 2.7.5-86.el7 cr
python-rpm-macros noarch 3-32.el7 cr 8.8 k

(Are they just saying that enabling the CR repo is a no-no?)

I'm guessing both of those packages are required for make check

That's my guess, too, but this bug just cropped up out of nowhere, so it does feel like a packaging issue somewhere in the dependencies.

I was able to reproduce this and updated the bug. If we change do_cmake to update python-devel, it'll actually pull python-rpm-macros in. I don't know if that's sane/safe though.

python-rpm-macros is not an explicit build dependency of Ceph - it is not mentioned anywhere in ceph.spec.in. python-devel is a build dependency of Ceph, and presumably python-rpm-macros is being pulled in as a dependency of python-devel. Assuming the repos are up-to-date, this should "just work".

In the bug, TrevorH says: "The point is that python-rpm-macros.noarch has moved from EPEL to the distro itself. All would be fine with a compete `yum --enablerepo=cr update` first."

@David: I suppose we could put that yum update into install-deps.sh somewhere, but what puzzles me is why we're not seeing this issue outside of mimic.

Aha! In mimic install-deps.sh we have:

if test $ID = centos -a $VERSION_ID = 7 ; then
    $SUDO yum-config-manager --enable cr

And that's because #37335 never got backported to mimic.

Nice find! Are you handling the backport or? How can I help?

• https://github.com/ceph/ceph/pull/30190
• https://github.com/ceph/ceph-build/pull/1389

the immediate problem in mimic is fixed now.

Not true. The build failure happened again, in https://github.com/ceph/ceph/pull/30227, so I'm staging Kefu's fix for backport.