Project

General

Profile

Bug #23981

install-deps.sh fails with "No such file or directory" on openSUSE Tumbleweed

Added by Lenz Grimmer about 2 years ago. Updated 4 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
-
Target version:
-
% Done:

0%

Source:
Community (dev)
Tags:
Backport:
nautilus
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature:

Description

When running install-deps.sh from withing my Tumbleweed-based Docker container, it fails with the following error message:

metis:/ceph # cat /etc/os-release 
NAME="openSUSE Tumbleweed" 
# VERSION="20180501" 
ID="opensuse-tumbleweed" 
ID_LIKE="opensuse suse" 
VERSION_ID="20180501" 
PRETTY_NAME="openSUSE Tumbleweed" 
ANSI_COLOR="0;32" 
CPE_NAME="cpe:/o:opensuse:tumbleweed:20180501" 
BUG_REPORT_URL="https://bugs.opensuse.org" 
HOME_URL="https://www.opensuse.org/" 
metis:/ceph # ./install-deps.sh 
Using zypper to install dependencies
Loading repository data...
Reading installed packages...
'lsb-release' is already installed.
No update candidate for 'lsb-release-3.0-1.1.noarch'. The highest available version is already installed.
'systemd-rpm-macros' is already installed.
No update candidate for 'systemd-rpm-macros-3-13.1.noarch'. The highest available version is already installed.
Resolving package dependencies...

Nothing to do.
Loading repository data...
Reading installed packages...
'gperftools-devel >= 2.4' is already installed.
No update candidate for 'gperftools-devel-2.5-6.1.x86_64'. The highest available version is already installed.
'leveldb-devel > 1.2' is already installed.
No update candidate for 'leveldb-devel-1.20-3.11.x86_64'. The highest available version is already installed.
'libblkid-devel >= 2.17' is already installed.
No update candidate for 'libblkid-devel-2.31.1-4.1.x86_64'. The highest available version is already installed.
'liblz4-devel >= 1.7' is already installed.
No update candidate for 'liblz4-devel-1.8.1.2-1.1.x86_64'. The highest available version is already installed.
'perl' is already installed.
No update candidate for 'perl-5.26.1-5.1.x86_64'. The highest available version is already installed.
'udev' is already installed.
No update candidate for 'udev-237-4.1.x86_64'. The highest available version is already installed.
'systemd' is already installed.
No update candidate for 'systemd-237-4.1.x86_64'. The highest available version is already installed.
'python' is already installed.
No update candidate for 'python-2.7.14-7.1.x86_64'. The highest available version is already installed.
'pkgconfig' not found in package names. Trying capabilities.
'pkg-config' providing 'pkgconfig' is already installed.
'util-linux' is already installed.
No update candidate for 'util-linux-2.31.1-4.1.x86_64'. The highest available version is already installed.
'cmake' is already installed.
No update candidate for 'cmake-3.10.3-1.1.x86_64'. The highest available version is already installed.
'net-tools' is already installed.
No update candidate for 'net-tools-2.0+git20170221.479bb4a-3.1.x86_64'. The highest available version is already installed.
'python3-setuptools' is already installed.
No update candidate for 'python3-setuptools-39.0.1-1.1.noarch'. The highest available version is already installed.
'gcc-c++' is already installed.
No update candidate for 'gcc-c++-7-2.9.x86_64'. The highest available version is already installed.
'libcurl-devel' is already installed.
No update candidate for 'libcurl-devel-7.59.0-1.1.x86_64'. The highest available version is already installed.
'parted' is already installed.
No update candidate for 'parted-3.2-20.1.x86_64'. The highest available version is already installed.
'python-base' is already installed.
No update candidate for 'python-base-2.7.14-7.3.x86_64'. The highest available version is already installed.
'make' is already installed.
No update candidate for 'make-4.2.1-5.1.x86_64'. The highest available version is already installed.
'btrfsprogs' is already installed.
No update candidate for 'btrfsprogs-4.16-1.1.x86_64'. The highest available version is already installed.
'python3-devel' is already installed.
No update candidate for 'python3-devel-3.6.5-2.1.x86_64'. The highest available version is already installed.
'python-requests' not found in package names. Trying capabilities.
'python2-requests' providing 'python-requests' is already installed.
'libxml2-devel' is already installed.
No update candidate for 'libxml2-devel-2.9.8-2.1.x86_64'. The highest available version is already installed.
'libopenssl-devel' is already installed.
No update candidate for 'libopenssl-devel-1.1.0h-1.1.noarch'. The highest available version is already installed.
'procps' is already installed.
No update candidate for 'procps-3.3.14-1.1.x86_64'. The highest available version is already installed.
'libtool' is already installed.
No update candidate for 'libtool-2.4.6-4.81.x86_64'. The highest available version is already installed.
'xfsprogs' is already installed.
No update candidate for 'xfsprogs-4.15.1-2.1.x86_64'. The highest available version is already installed.
'which' is already installed.
No update candidate for 'which-2.21-4.1.x86_64'. The highest available version is already installed.
'cryptsetup' is already installed.
No update candidate for 'cryptsetup-2.0.1-1.2.x86_64'. The highest available version is already installed.
'openldap2-devel' is already installed.
No update candidate for 'openldap2-devel-2.4.46-33.1.x86_64'. The highest available version is already installed.
'libexpat-devel' is already installed.
No update candidate for 'libexpat-devel-2.2.5-1.1.x86_64'. The highest available version is already installed.
'libuuid-devel' is already installed.
No update candidate for 'libuuid-devel-2.31.1-4.1.x86_64'. The highest available version is already installed.
'bc' is already installed.
No update candidate for 'bc-1.07.1-1.10.x86_64'. The highest available version is already installed.
'socat' is already installed.
No update candidate for 'socat-1.7.3.2-4.1.x86_64'. The highest available version is already installed.
'gdbm' not found in package names. Trying capabilities.
'libgdbm4' providing 'gdbm' is already installed.
'libbz2-devel' is already installed.
No update candidate for 'libbz2-devel-1.0.6-41.1.x86_64'. The highest available version is already installed.
'lsb-release' is already installed.
No update candidate for 'lsb-release-3.0-1.1.noarch'. The highest available version is already installed.
'python-devel' is already installed.
No update candidate for 'python-devel-2.7.14-7.3.x86_64'. The highest available version is already installed.
'mozilla-nss-devel' is already installed.
No update candidate for 'mozilla-nss-devel-3.36.1-1.1.x86_64'. The highest available version is already installed.
'libudev-devel' is already installed.
No update candidate for 'libudev-devel-237-4.1.x86_64'. The highest available version is already installed.
'python-nose' not found in package names. Trying capabilities.
'python2-nose' providing 'python-nose' is already installed.
'xmlstarlet' is already installed.
No update candidate for 'xmlstarlet-1.6.1-1.10.x86_64'. The highest available version is already installed.
'jq' is already installed.
No update candidate for 'jq-1.5-5.5.x86_64'. The highest available version is already installed.
'python-PrettyTable' not found in package names. Trying capabilities.
'python2-PrettyTable' providing 'python-PrettyTable' is already installed.
'python-coverage' not found in package names. Trying capabilities.
'python2-coverage' providing 'python-coverage' is already installed.
'libaio-devel' is already installed.
No update candidate for 'libaio-devel-0.3.109-21.3.x86_64'. The highest available version is already installed.
'python-Sphinx' not found in package names. Trying capabilities.
'python2-Sphinx' providing 'python-Sphinx' is already installed.
'fuse-devel' is already installed.
No update candidate for 'fuse-devel-2.9.7-1.2.x86_64'. The highest available version is already installed.
'gperf' is already installed.
No update candidate for 'gperf-3.1-2.1.x86_64'. The highest available version is already installed.
'python-Cython' not found in package names. Trying capabilities.
'python2-Cython' providing 'python-Cython' is already installed.
'python-bcrypt' not found in package names. Trying capabilities.
'python2-bcrypt' providing 'python-bcrypt' is already installed.
'yasm' is already installed.
No update candidate for 'yasm-1.3.0-5.1.x86_64'. The highest available version is already installed.
'keyutils-devel' is already installed.
There is an update candidate for 'keyutils-devel', but it is from a different vendor. Use 'zypper install keyutils-devel-1.5.10-59.32.x86_64' to install this candidate.
'python-Routes' not found in package names. Trying capabilities.
'python2-Routes' providing 'python-Routes' is already installed.
'python-tox' not found in package names. Trying capabilities.
'python2-tox' providing 'python-tox' is already installed.
'systemd-rpm-macros' is already installed.
No update candidate for 'systemd-rpm-macros-3-13.1.noarch'. The highest available version is already installed.
'python-CherryPy' not found in package names. Trying capabilities.
'python2-CherryPy' providing 'python-CherryPy' is already installed.
'rdma-core-devel' is already installed.
No update candidate for 'rdma-core-devel-16.4-3.1.x86_64'. The highest available version is already installed.
'babeltrace-devel' is already installed.
No update candidate for 'babeltrace-devel-1.5.4-2.1.x86_64'. The highest available version is already installed.
'cunit-devel' is already installed.
No update candidate for 'cunit-devel-2.1.3-5.10.x86_64'. The highest available version is already installed.
'liboath-devel' is already installed.
There is an update candidate for 'liboath-devel', but it is from a different vendor. Use 'zypper install liboath-devel-2.6.2-3.1.x86_64' to install this candidate.
'lttng-ust-devel' is already installed.
No update candidate for 'lttng-ust-devel-2.10.1-3.1.x86_64'. The highest available version is already installed.
'pkgconfig(systemd)' not found in package names. Trying capabilities.
'systemd' providing 'pkgconfig(systemd)' is already installed.
'python-Werkzeug' not found in package names. Trying capabilities.
'python2-Werkzeug' providing 'python-Werkzeug' is already installed.
'python-numpy-devel' not found in package names. Trying capabilities.
'python2-numpy-devel' providing 'python-numpy-devel' is already installed.
'python-pecan' not found in package names. Trying capabilities.
'python2-pecan' providing 'python-pecan' is already installed.
'python-virtualenv' not found in package names. Trying capabilities.
'python2-virtualenv' providing 'python-virtualenv' is already installed.
'python3-Cython' is already installed.
No update candidate for 'python3-Cython-0.28.2-1.1.x86_64'. The highest available version is already installed.
'snappy-devel' is already installed.
No update candidate for 'snappy-devel-1.1.7-1.1.x86_64'. The highest available version is already installed.
'valgrind-devel' is already installed.
No update candidate for 'valgrind-devel-3.13.0-3.1.x86_64'. The highest available version is already installed.
'xfsprogs-devel' is already installed.
No update candidate for 'xfsprogs-devel-4.15.1-2.1.x86_64'. The highest available version is already installed.
Resolving package dependencies...

Nothing to do.
Using base prefix '/usr'
New python executable in /ceph/install-deps-python2.7_tmp/bin/python3
Also creating executable in /ceph/install-deps-python2.7_tmp/bin/python
Installing setuptools, pip, wheel...
  Complete output from command /ceph/install-deps-python2.7_tmp/bin/python3 - setuptools pip wheel:
  Traceback (most recent call last):
  File "<stdin>", line 3, in <module>
  File "/usr/lib64/python3.6/pkgutil.py", line 4, in <module>
    from functools import singledispatch as simplegeneric
  File "/ceph/install-deps-python2.7_tmp/lib64/python3.6/functools.py", line 22, in <module>
    from types import MappingProxyType
ImportError: bad magic number in 'types': b'\x03\xf3\r\n'
----------------------------------------
...Installing setuptools, pip, wheel...done.
Traceback (most recent call last):
  File "/usr/bin/virtualenv", line 11, in <module>
    load_entry_point('virtualenv==15.1.0', 'console_scripts', 'virtualenv')()
  File "/usr/lib/python3.6/site-packages/virtualenv.py", line 713, in main
    symlink=options.symlink)
  File "/usr/lib/python3.6/site-packages/virtualenv.py", line 945, in create_environment
    download=download,
  File "/usr/lib/python3.6/site-packages/virtualenv.py", line 901, in install_wheel
    call_subprocess(cmd, show_stdout=False, extra_env=env, stdin=SCRIPT)
  File "/usr/lib/python3.6/site-packages/virtualenv.py", line 797, in call_subprocess
    % (cmd_desc, proc.returncode))
OSError: Command /ceph/install-deps-python2.7_tmp/bin/python3 - setuptools pip wheel failed with error code 1
./install-deps.sh: line 308: /ceph/install-deps-python2.7_tmp/bin/pip: No such file or directory
./install-deps.sh: line 309: /ceph/install-deps-python2.7_tmp/bin/virtualenv: No such file or directory
./install-deps.sh: line 312: /ceph/install-deps-python2.7/bin/activate: No such file or directory
Requirement already satisfied: setuptools<36,>=0.8 in /usr/lib/python3.6/site-packages (35.0.2)
Requirement already satisfied: pip>=7.0 in /usr/lib/python3.6/site-packages (10.0.1)
Requirement already satisfied: wheel>=0.24 in /usr/lib/python3.6/site-packages (0.31.0)
Requirement already satisfied: six>=1.6.0 in /usr/lib/python3.6/site-packages (from setuptools<36,>=0.8) (1.11.0)
Requirement already satisfied: packaging>=16.8 in /usr/lib/python3.6/site-packages (from setuptools<36,>=0.8) (17.1)
Requirement already satisfied: appdirs>=1.4.0 in /usr/lib/python3.6/site-packages (from setuptools<36,>=0.8) (1.4.3)
Requirement already satisfied: pyparsing>=2.0.2 in /usr/lib/python3.6/site-packages (from packaging>=16.8->setuptools<36,>=0.8) (2.2.0)
./install-deps.sh: line 318: /ceph/install-deps-python2.7/bin/activate: No such file or directory


Related issues

Duplicated by Ceph - Bug #42665: ./install-deps.sh fails with "Python.h: No such file or directory" for building xmlsec when python2 header file not installed Duplicate
Copied to Ceph - Backport #43288: nautilus: install-deps.sh fails with "No such file or directory" on openSUSE Tumbleweed Resolved

History

#1 Updated by Ernesto Puerta almost 2 years ago

This has been reproduced in a CentOS docker as well. Seems a bytecode .pyc from a previous version is causing a mistmatch.

2 ways to deal with this common scenario:
  • Either regularly delete all .pyc files: sudo find -name "*.pyc" -delete
  • Avoid python from generating .pyc files: EXPORT PYTHONDONTWRITEBYTECODE=1

#2 Updated by Kai Wagner about 1 year ago

Ernesto Puerta wrote:

This has been reproduced in a CentOS docker as well. Seems a bytecode .pyc from a previous version is causing a mistmatch.

Don't believe that. Reproduced that right now on a complete fresh Tumbleweed VM and I get the same error.

#3 Updated by Kai Wagner about 1 year ago

Fixed it.

python2-virtualenv and python2-devel were missing.

After I installed both it went through smoothly.

#4 Updated by Nathan Cutler 6 months ago

  • Assignee set to Nathan Cutler

#5 Updated by Nathan Cutler 6 months ago

  • Status changed from New to Fix Under Review
  • Backport set to nautilus
  • Pull request ID set to 32153

#6 Updated by Nathan Cutler 6 months ago

  • Status changed from Fix Under Review to Resolved

#7 Updated by Nathan Cutler 6 months ago

  • Status changed from Resolved to Pending Backport

#8 Updated by Nathan Cutler 6 months ago

  • Copied to Backport #43288: nautilus: install-deps.sh fails with "No such file or directory" on openSUSE Tumbleweed added

#9 Updated by Nathan Cutler 5 months ago

  • Duplicated by Bug #42665: ./install-deps.sh fails with "Python.h: No such file or directory" for building xmlsec when python2 header file not installed added

#10 Updated by Nathan Cutler 4 months ago

  • Status changed from Pending Backport to Resolved

While running with --resolve-parent, the script "backport-create-issue" noticed that all backports of this issue are in status "Resolved" or "Rejected".

Also available in: Atom PDF