Ceph

Installation of ceph-common package on Oracle Linux 9 with cephadm fails due to the activation of the OracleLinux EPEL repository (oracle-epel).

# cephadm add-repo --release reef
Writing repo to /etc/yum.repos.d/ceph.repo...
Enabling EPEL...
Completed adding repo.

I suppose that command 'dnf install epel-release' was executed under the hook, however on OL, default installed epel-release is the OracleLinux custom one, not Fedora:

# dnf install epel-release
Last metadata expiration check: 0:01:12 ago on Sun 28 Apr 2024 12:39:49 PM CEST.
Dependencies resolved.
=====================================================================================================================================================================================================================================
 Package                                                   Architecture                             Version                                               Repository                                                         Size
=====================================================================================================================================================================================================================================
Installing:
 oracle-epel-release-el9                                   x86_64                                   1.0-1.el9                                             s

Which breaks the installation of ceph-common because of some missing dependencies:

# cephadm install ceph-common
Installing packages ['ceph-common']...
Non-zero exit code 1 from yum install -y ceph-common
yum: stdout Last metadata expiration check: 0:04:59 ago on Sun 28 Apr 2024 12:34:12 PM CEST.
yum: stdout (try to add '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages)
yum: stderr Error: 
yum: stderr  Problem: conflicting requests
yum: stderr   - nothing provides libtcmalloc.so.4()(64bit) needed by ceph-common-2:18.2.2-0.el9.x86_64 from Ceph
yum: stderr   - nothing provides libarrow.so.900()(64bit) needed by ceph-common-2:18.2.2-0.el9.x86_64 from Ceph
yum: stderr   - nothing provides libparquet.so.900()(64bit) needed by ceph-common-2:18.2.2-0.el9.x86_64 from Ceph
yum: stderr   - nothing provides liboath.so.0()(64bit) needed by ceph-common-2:18.2.2-0.el9.x86_64 from Ceph
yum: stderr   - nothing provides liboath.so.0(LIBOATH_1.10.0)(64bit) needed by ceph-common-2:18.2.2-0.el9.x86_64 from Ceph
yum: stderr   - nothing provides liboath.so.0(LIBOATH_1.2.0)(64bit) needed by ceph-common-2:18.2.2-0.el9.x86_64 from Ceph
Traceback (most recent call last):
  File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main
    return _run_code(code, main_globals, None,
  File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code
    exec(code, run_globals)
  File "/usr/sbin/cephadm/__main__.py", line 10700, in <module>
  File "/usr/sbin/cephadm/__main__.py", line 10688, in main
  File "/usr/sbin/cephadm/__main__.py", line 8882, in command_install
  File "/usr/sbin/cephadm/__main__.py", line 8728, in install
  File "/usr/sbin/cephadm/__main__.py", line 2135, in call_throws
RuntimeError: Failed command: yum install -y ceph-common: Last metadata expiration check: 0:04:59 ago on Sun 28 Apr 2024 12:34:12 PM CEST.
(try to add '--skip-broken' to skip uninstallable packages or '--nobest' to use not only best candidate packages)

The workaround is easy as ceph-common installation works with the add by hand of the Fedora repository:

dnf install https://dl.fedoraproject.org/pub/epel/epel-release-latest-9.noarch.rpm

So I would say that this is not really a cephadm bug, but rather a result of missing packages in the Oracle EPEL repository.

I have identified those 3 missing packages:
- parquet-libs
- libarrow
- libarrow-doc

I'm not sure if we should directly request Oracle to add the missing packages to the Oracle EPEL repository to allow ceph-common to be installed ?

In any case, I think that until this is resolved, it should probably be documented here: https://docs.ceph.com/en/latest/cephadm/install/#enable-ceph-cli

Regards,
Philippe.