Project

General

Profile

Actions

Bug #14275

closed

Ceph "giant" packages no longer available for installation on Ubuntu 14.04 "trusty"

Added by Lenz Grimmer over 8 years ago. Updated about 8 years ago.

Status:
Resolved
Priority:
High
Category:
-
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

We noticed this on our automated test/build system, which is based on Ubuntu Linux 14.04 "trusty". Some time after 5pm CET on 2016-01-06, something must have changed on the DEB repository on http://ceph.com/debian-giant , as our test system started installing the older ceph packages from Ubuntu instead of using the ones from the ceph.com repo.

How to repeat: set up a vanilla Ubuntu 14.04 "trusty" system and add the ceph.com APT repo as outlined in the documentation at http://docs.ceph.com/docs/master/install/get-packages/

The file /etc/apt/sources.list.d/ceph.conf should look as follows:

deb http://download.ceph.com/debian-giant/ trusty main

However, running "apt-get update ; apt-get install ceph" will pick the Ubuntu packages instead:

% sudo apt-get install ceph
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following extra packages will be installed:
ceph-common libcephfs1 libgoogle-perftools4 libleveldb1 libsnappy1
libtcmalloc-minimal4 libunwind8 python-blinker python-ceph python-flask
python-itsdangerous python-jinja2 python-markupsafe python-werkzeug
Suggested packages:
ceph-mds python-flask-doc python-jinja2-doc ipython python-genshi
python-greenlet python-redis python-werkzeug-doc
The following NEW packages will be installed:
ceph ceph-common libcephfs1 libgoogle-perftools4 libleveldb1 libsnappy1
libtcmalloc-minimal4 libunwind8 python-blinker python-ceph python-flask
python-itsdangerous python-jinja2 python-markupsafe python-werkzeug
0 upgraded, 15 newly installed, 0 to remove and 26 not upgraded.
Need to get 7.581 kB/11,9 MB of archives.
After this operation, 62,7 MB of additional disk space will be used.
Do you want to continue? [Y/n]
Get:1 http://de.archive.ubuntu.com/ubuntu/ trusty-updates/main libcephfs1 amd64 0.80.10-0ubuntu1.14.04.3 [1.517 kB]
Get:2 http://de.archive.ubuntu.com/ubuntu/ trusty-updates/main python-werkzeug all 0.9.4+dfsg-1.1ubuntu2 [236 kB]
Get:3 http://de.archive.ubuntu.com/ubuntu/ trusty/main python-markupsafe amd64 0.18-1build2 [14,3 kB]
Get:4 http://de.archive.ubuntu.com/ubuntu/ trusty/main python-jinja2 all 2.7.2-2 [161 kB]
Get:5 http://de.archive.ubuntu.com/ubuntu/ trusty/main python-itsdangerous all 0.22+dfsg1-1build1 [11,5 kB]
Get:6 http://de.archive.ubuntu.com/ubuntu/ trusty/main python-flask all 0.10.1-2build1 [51,7 kB]
Get:7 http://de.archive.ubuntu.com/ubuntu/ trusty-updates/main python-ceph amd64 0.80.10-0ubuntu1.14.04.3 [35,3 kB]
Get:8 http://de.archive.ubuntu.com/ubuntu/ trusty/main libsnappy1 amd64 1.1.0-1ubuntu1 [11,2 kB]
Get:9 http://de.archive.ubuntu.com/ubuntu/ trusty/main libleveldb1 amd64 1.15.0-2 [117 kB]
Get:10 http://de.archive.ubuntu.com/ubuntu/ trusty-updates/main ceph amd64 0.80.10-0ubuntu1.14.04.3 [5.396 kB]
Get:11 http://de.archive.ubuntu.com/ubuntu/ trusty/main python-blinker all 1.3.dfsg1-1ubuntu2 [29,8 kB]
Fetched 7.581 kB in 5s (1.355 kB/s)
Selecting previously unselected package libcephfs1.
(Reading database ... 401027 files and directories currently installed.)
Preparing to unpack .../libcephfs1_0.80.10-0ubuntu1.14.04.3_amd64.deb ...
Unpacking libcephfs1 (0.80.10-0ubuntu1.14.04.3) ...
Selecting previously unselected package python-werkzeug.
Preparing to unpack .../python-werkzeug_0.9.4+dfsg-1.1ubuntu2_all.deb ...
Unpacking python-werkzeug (0.9.4+dfsg-1.1ubuntu2) ...
Selecting previously unselected package python-markupsafe.
Preparing to unpack .../python-markupsafe_0.18-1build2_amd64.deb ...
Unpacking python-markupsafe (0.18-1build2) ...
Selecting previously unselected package python-jinja2.
Preparing to unpack .../python-jinja2_2.7.2-2_all.deb ...
Unpacking python-jinja2 (2.7.2-2) ...
Selecting previously unselected package python-itsdangerous.
Preparing to unpack .../python-itsdangerous_0.22+dfsg1-1build1_all.deb ...
Unpacking python-itsdangerous (0.22+dfsg1-1build1) ...
Selecting previously unselected package python-flask.
Preparing to unpack .../python-flask_0.10.1-2build1_all.deb ...
Unpacking python-flask (0.10.1-2build1) ...
Selecting previously unselected package python-ceph.
Preparing to unpack .../python-ceph_0.80.10-0ubuntu1.14.04.3_amd64.deb ...
Unpacking python-ceph (0.80.10-0ubuntu1.14.04.3) ...
Selecting previously unselected package libtcmalloc-minimal4.
Preparing to unpack .../libtcmalloc-minimal4_2.1-2ubuntu1.1_amd64.deb ...
Unpacking libtcmalloc-minimal4 (2.1-2ubuntu1.1) ...
Selecting previously unselected package libunwind8.
Preparing to unpack .../libunwind8_1.1-2.2ubuntu3_amd64.deb ...
Unpacking libunwind8 (1.1-2.2ubuntu3) ...
Selecting previously unselected package libgoogle-perftools4.
Preparing to unpack .../libgoogle-perftools4_2.1-2ubuntu1.1_amd64.deb ...
Unpacking libgoogle-perftools4 (2.1-2ubuntu1.1) ...
Selecting previously unselected package ceph-common.
Preparing to unpack .../ceph-common_0.80.10-0ubuntu1.14.04.3_amd64.deb ...
Unpacking ceph-common (0.80.10-0ubuntu1.14.04.3) ...
dpkg: warning: unable to delete old directory '/etc/ceph': Directory not empty
Selecting previously unselected package libsnappy1.
Preparing to unpack .../libsnappy1_1.1.0-1ubuntu1_amd64.deb ...
Unpacking libsnappy1 (1.1.0-1ubuntu1) ...
Selecting previously unselected package libleveldb1:amd64.
Preparing to unpack .../libleveldb1_1.15.0-2_amd64.deb ...
Unpacking libleveldb1:amd64 (1.15.0-2) ...
Selecting previously unselected package ceph.
Preparing to unpack .../ceph_0.80.10-0ubuntu1.14.04.3_amd64.deb ...
Unpacking ceph (0.80.10-0ubuntu1.14.04.3) ...
Selecting previously unselected package python-blinker.
Preparing to unpack .../python-blinker_1.3.dfsg1-1ubuntu2_all.deb ...
Unpacking python-blinker (1.3.dfsg1-1ubuntu2) ...
Processing triggers for man-db (2.6.7.1-1ubuntu1) ...
Processing triggers for ureadahead (0.100.0-16) ...
Setting up libcephfs1 (0.80.10-0ubuntu1.14.04.3) ...
Setting up python-werkzeug (0.9.4+dfsg-1.1ubuntu2) ...
Setting up python-markupsafe (0.18-1build2) ...
Setting up python-jinja2 (2.7.2-2) ...
Setting up python-itsdangerous (0.22+dfsg1-1build1) ...
Setting up python-flask (0.10.1-2build1) ...
Setting up python-ceph (0.80.10-0ubuntu1.14.04.3) ...
Setting up libtcmalloc-minimal4 (2.1-2ubuntu1.1) ...
Setting up libunwind8 (1.1-2.2ubuntu3) ...
Setting up libgoogle-perftools4 (2.1-2ubuntu1.1) ...
Setting up ceph-common (0.80.10-0ubuntu1.14.04.3) ...
Setting up libsnappy1 (1.1.0-1ubuntu1) ...
Setting up libleveldb1:amd64 (1.15.0-2) ...
Setting up ceph (0.80.10-0ubuntu1.14.04.3) ...
ceph-all start/running
Setting up python-blinker (1.3.dfsg1-1ubuntu2) ...
Processing triggers for libc-bin (2.19-0ubuntu6.6) ...

Somehow apt decides to choose the Ubuntu packages instead of the ones that should be available from ceph.com.

Actions #1

Updated by Yehuda Sadeh over 8 years ago

  • Project changed from rgw to Ceph
Actions #2

Updated by Loïc Dachary about 8 years ago

  • Project changed from Ceph to sepia
  • Priority changed from Normal to High
Actions #3

Updated by Alfredo Deza about 8 years ago

  • Status changed from New to 4

Have you had this issue appear again? You might've hit download.ceph.com while we were doing an actual release.

If this is consistent for you then we might need to investigate further.

Actions #4

Updated by David Galloway about 8 years ago

  • Assignee set to David Galloway
Actions #5

Updated by Lenz Grimmer about 8 years ago

Just verified this and it is still the case. Adding the ceph-giant apt repo and running apt-get install ceph still installs ceph-0.80.10-0ubuntu1.14.04.3 from the Ubuntu repo instead of the ones provided by the debian-giant repo on download.ceph.com.

Actions #6

Updated by David Galloway about 8 years ago

I'm leaning toward apt configuration problem.

Can you paste or upload your apt configs and verify you've followed the steps here: http://docs.ceph.com/docs/master/start/quick-start-preflight/#advanced-package-tool-apt

Actions #7

Updated by Lenz Grimmer about 8 years ago

I started with a freshly installed Ubuntu 14.04 "trusty" system and followed the steps outlined in http://docs.ceph.com/docs/master/start/quick-start-preflight/#advanced-package-tool-apt

The apt Repo on ceph.com is added correctly, but running "apt-get install ceph" still gives me the Ceph packages from the Ubuntu repo (0.80.10-0ubuntu1.14.04.3) instead of the one from http://download.ceph.com/debian-giant/

See http://pastebin.com/Xgksqu20 for details. I did not make any changes to the stock apt configuration.

Actions #8

Updated by Dan Mick about 8 years ago

  • Project changed from sepia to devops

Package experts: can you render an opinion here? I don't see whether it's obviously a client config, package repo, or docs problem

Actions #9

Updated by Kevin Lamontagne about 8 years ago

Hi, the packages declared in the file

http://download.ceph.com/debian-giant/dists/precise/main/binary-amd64/Packages

are only ceph-deploy and radosgw-agent.

apt-policy confirms the ceph-deploy package candidate version 1.5.31, but not other ceph packages from the repo.

The same file for hammer has all the packages:
http://download.ceph.com/debian-hammer/dists/precise/main/binary-amd64/Packages

Actions #10

Updated by David Galloway about 8 years ago

Ah, I understand the issue now. So looks like the Packages file in a few repos needs to be re-generated.

I'm guessing our release team likely has a tool to take care of this so a dpkg-scanpackages isn't necessary for each of these.

Based on filesize and timestamp, these need to be regenerated.

-rw-r--r-- 1  7.1K Jan  5 18:47 ./dists/wheezy/main/binary-amd64/Packages
-rw-r--r-- 1  2.5K Jan  5 18:47 ./dists/wheezy/main/binary-amd64/Packages.gz
-rw-r--r-- 1  2.7K Jan  5 18:47 ./dists/wheezy/main/binary-amd64/Packages.bz2
-rw-r--r-- 1  1.3K Jan  5 18:47 ./dists/wheezy/main/binary-i386/Packages
-rw-r--r-- 1  688 Jan  5 18:47 ./dists/wheezy/main/binary-i386/Packages.gz
-rw-r--r-- 1  777 Jan  5 18:47 ./dists/wheezy/main/binary-i386/Packages.bz2
-rw-r--r-- 1  1.3K Jan  5 18:47 ./dists/wheezy/main/binary-armhf/Packages
-rw-r--r-- 1  688 Jan  5 18:47 ./dists/wheezy/main/binary-armhf/Packages.gz
-rw-r--r-- 1  777 Jan  5 18:47 ./dists/wheezy/main/binary-armhf/Packages.bz2
-rw-r--r-- 1  1.3K Jan  5 18:47 ./dists/trusty/main/binary-amd64/Packages
-rw-r--r-- 1  680 Jan  5 18:47 ./dists/trusty/main/binary-amd64/Packages.gz
-rw-r--r-- 1  771 Jan  5 18:47 ./dists/trusty/main/binary-amd64/Packages.bz2
-rw-r--r-- 1  1.3K Jan  5 18:47 ./dists/trusty/main/binary-i386/Packages
-rw-r--r-- 1  680 Jan  5 18:47 ./dists/trusty/main/binary-i386/Packages.gz
-rw-r--r-- 1  771 Jan  5 18:47 ./dists/trusty/main/binary-i386/Packages.bz2
-rw-r--r-- 1  1.3K Jan  5 18:47 ./dists/trusty/main/binary-armhf/Packages
-rw-r--r-- 1  680 Jan  5 18:47 ./dists/trusty/main/binary-armhf/Packages.gz
-rw-r--r-- 1  771 Jan  5 18:47 ./dists/trusty/main/binary-armhf/Packages.bz2
-rw-r--r-- 1  1.3K Jan  5 18:47 ./dists/precise/main/binary-amd64/Packages
-rw-r--r-- 1  682 Jan  5 18:47 ./dists/precise/main/binary-amd64/Packages.gz
-rw-r--r-- 1  771 Jan  5 18:47 ./dists/precise/main/binary-amd64/Packages.bz2
-rw-r--r-- 1  1.3K Jan  5 18:47 ./dists/precise/main/binary-i386/Packages
-rw-r--r-- 1  682 Jan  5 18:47 ./dists/precise/main/binary-i386/Packages.gz
-rw-r--r-- 1  771 Jan  5 18:47 ./dists/precise/main/binary-i386/Packages.bz2
-rw-r--r-- 1  1.3K Jan  5 18:47 ./dists/precise/main/binary-armhf/Packages
-rw-r--r-- 1  682 Jan  5 18:47 ./dists/precise/main/binary-armhf/Packages.gz
-rw-r--r-- 1  771 Jan  5 18:47 ./dists/precise/main/binary-armhf/Packages.bz2
-rw-r--r-- 1  714 Jan  5 18:47 ./dists/jessie/main/binary-amd64/Packages
-rw-r--r-- 1  492 Jan  5 18:47 ./dists/jessie/main/binary-amd64/Packages.gz
-rw-r--r-- 1  536 Jan  5 18:47 ./dists/jessie/main/binary-amd64/Packages.bz2
-rw-r--r-- 1  714 Jan  5 18:47 ./dists/jessie/main/binary-i386/Packages
-rw-r--r-- 1  492 Jan  5 18:47 ./dists/jessie/main/binary-i386/Packages.gz
-rw-r--r-- 1  536 Jan  5 18:47 ./dists/jessie/main/binary-i386/Packages.bz2
-rw-r--r-- 1  714 Jan  5 18:47 ./dists/jessie/main/binary-armhf/Packages
-rw-r--r-- 1  492 Jan  5 18:47 ./dists/jessie/main/binary-armhf/Packages.gz
-rw-r--r-- 1  536 Jan  5 18:47 ./dists/jessie/main/binary-armhf/Packages.bz2
Actions #11

Updated by Alfredo Deza about 8 years ago

  • Status changed from 4 to Resolved

This should now be working. We had to sync the public repository.

[node1][DEBUG ] Setting up ceph (0.87.2-1trusty) ...
[node1][DEBUG ] ceph-all start/running
[node1][DEBUG ] Processing triggers for ureadahead (0.100.0-16) ...
[node1][DEBUG ] Setting up ceph-mds (0.87.2-1trusty) ...
[node1][DEBUG ] ceph-mds-all start/running
[node1][DEBUG ] Processing triggers for libc-bin (2.19-0ubuntu6.5) ...
[node1][DEBUG ] Processing triggers for ureadahead (0.100.0-16) ...
[node1][INFO  ] Running command: sudo ceph --version
[node1][DEBUG ] ceph version 0.87.2 (87a7cec9ab11c677de2ab23a7668a77d2f5b955e)
Actions

Also available in: Atom PDF