Bug #6622: nightly runs:apt-get failures on ubuntu - Ceph - Ceph

Actions

Copy link

Bug #6622

closed

nightly runs:apt-get failures on ubuntu

Added by Tamilarasi muthamizhan over 10 years ago. Updated over 10 years ago.

Status:

Resolved

Priority:

Urgent

Assignee:

Sandon Van Ness

Category:

Target version:

% Done:

Source:

other

Tags:

Backport:

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

logs:ubuntu@teuthology:/a/teuthology-2013-10-23_01:35:02-upgrade-small-next-testing-basic-vps/64863

2013-10-23T05:04:15.669 DEBUG:teuthology.orchestra.run:Running [10.214.138.131]: 'wget -q -O- http://gitbuilder.ceph.com/ceph-deb-precise-x86_64-basic/ref/dumpling/version'
2013-10-23T05:04:15.684 INFO:teuthology.task.install:Package version is 0.67.4-11-g299ddd3-1precise
2013-10-23T05:04:15.684 DEBUG:teuthology.orchestra.run:Running [10.214.138.131]: 'echo deb http://gitbuilder.ceph.com/ceph-deb-precise-x86_64-basic/ref/dumpling precise main | sudo tee /etc/apt/sources.list.d/ceph.list'
2013-10-23T05:04:15.747 DEBUG:teuthology.orchestra.run:Running [10.214.138.138]: 'sudo apt-get update && sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=0.67.4-11-g299ddd3-1precise ceph-dbg=0.67.4-11-g299ddd3-1precise ceph-mds=0.67.4-11-g299ddd3-1precise ceph-mds-dbg=0.67.4-11-g299ddd3-1precise ceph-common=0.67.4-11-g299ddd3-1precise ceph-common-dbg=0.67.4-11-g299ddd3-1precise ceph-fuse=0.67.4-11-g299ddd3-1precise ceph-fuse-dbg=0.67.4-11-g299ddd3-1precise ceph-test=0.67.4-11-g299ddd3-1precise ceph-test-dbg=0.67.4-11-g299ddd3-1precise radosgw=0.67.4-11-g299ddd3-1precise radosgw-dbg=0.67.4-11-g299ddd3-1precise python-ceph=0.67.4-11-g299ddd3-1precise libcephfs1=0.67.4-11-g299ddd3-1precise libcephfs1-dbg=0.67.4-11-g299ddd3-1precise librados2=0.67.4-11-g299ddd3-1precise librados2-dbg=0.67.4-11-g299ddd3-1precise librbd1=0.67.4-11-g299ddd3-1precise librbd1-dbg=0.67.4-11-g299ddd3-1precise'
2013-10-23T05:04:15.772 DEBUG:teuthology.orchestra.run:Running [10.214.138.131]: 'sudo apt-get update && sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=0.67.4-11-g299ddd3-1precise ceph-dbg=0.67.4-11-g299ddd3-1precise ceph-mds=0.67.4-11-g299ddd3-1precise ceph-mds-dbg=0.67.4-11-g299ddd3-1precise ceph-common=0.67.4-11-g299ddd3-1precise ceph-common-dbg=0.67.4-11-g299ddd3-1precise ceph-fuse=0.67.4-11-g299ddd3-1precise ceph-fuse-dbg=0.67.4-11-g299ddd3-1precise ceph-test=0.67.4-11-g299ddd3-1precise ceph-test-dbg=0.67.4-11-g299ddd3-1precise radosgw=0.67.4-11-g299ddd3-1precise radosgw-dbg=0.67.4-11-g299ddd3-1precise python-ceph=0.67.4-11-g299ddd3-1precise libcephfs1=0.67.4-11-g299ddd3-1precise libcephfs1-dbg=0.67.4-11-g299ddd3-1precise librados2=0.67.4-11-g299ddd3-1precise librados2-dbg=0.67.4-11-g299ddd3-1precise librbd1=0.67.4-11-g299ddd3-1precise librbd1-dbg=0.67.4-11-g299ddd3-1precise'
2013-10-23T05:04:19.755 INFO:teuthology.orchestra.run.err:[10.214.138.131]: E: Unable to correct problems, you have held broken packages.
2013-10-23T05:04:19.757 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/home/teuthworker/teuthology-next/teuthology/contextutil.py", line 25, in nested
    vars.append(enter())
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/teuthology-next/teuthology/task/install.py", line 607, in install
    install_packages(ctx, install_info, config)
  File "/home/teuthworker/teuthology-next/teuthology/task/install.py", line 389, in install_packages
    ctx, remote, pkgs[system_type], config)
  File "/home/teuthworker/teuthology-next/teuthology/parallel.py", line 88, in __exit__
    raise
CommandFailedError: Command failed on 10.214.138.131 with status 100: 'sudo apt-get update && sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=0.67.4-11-g299ddd3-1precise ceph-dbg=0.67.4-11-g299ddd3-1precise ceph-mds=0.67.4-11-g299ddd3-1precise ceph-mds-dbg=0.67.4-11-g299ddd3-1precise ceph-common=0.67.4-11-g299ddd3-1precise ceph-common-dbg=0.67.4-11-g299ddd3-1precise ceph-fuse=0.67.4-11-g299ddd3-1precise ceph-fuse-dbg=0.67.4-11-g299ddd3-1precise ceph-test=0.67.4-11-g299ddd3-1precise ceph-test-dbg=0.67.4-11-g299ddd3-1precise radosgw=0.67.4-11-g299ddd3-1precise radosgw-dbg=0.67.4-11-g299ddd3-1precise python-ceph=0.67.4-11-g299ddd3-1precise libcephfs1=0.67.4-11-g299ddd3-1precise libcephfs1-dbg=0.67.4-11-g299ddd3-1precise librados2=0.67.4-11-g299ddd3-1precise librados2-dbg=0.67.4-11-g299ddd3-1precise librbd1=0.67.4-11-g299ddd3-1precise librbd1-dbg=0.67.4-11-g299ddd3-1precise'

Actions

Copy link

Updated by Sandon Van Ness over 10 years ago

I manually recreated what was happening on a new vm to get the full apt output. here is the problem:

Reading state information... Done
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
ceph-test : Depends: libcurl3-gnutls (>= 7.28.0) but 7.22.0-3ubuntu4 is to be installed
radosgw : Depends: libcurl3-gnutls (>= 7.28.0) but 7.22.0-3ubuntu4 is to be installed
E: Unable to correct problems, you have held broken packages.

It looks like the gitbuilder has a ceph pckage for libcurl3-gnutls but the machines don't:

ubuntu@gitbuilder-ceph-deb-precise-amd64-basic:~$ dpkg -l | grep -i libcurl
ii libcurl3 7.22.0-3ubuntu4.1 Multi-protocol file transfer library (OpenSSL)
ii libcurl3-gnutls 7.29.0-1precise.ceph easy-to-use client-side URL transfer library (GnuTLS flavour)
ii libcurl4-gnutls-dev 7.29.0-1precise.ceph development files and documentation for libcurl (GnuTLS flavour)

It looks like this is in the ceph-extras package but aparrantly ceph-extra's is not being used in our upgrade task or does teuthology add this repo at any point? I think on rhel/centos/etc because of other requirements we have had ceph-extras as one of the repos installed by ceph-qa-chef. Should we do the same for ubuntu? Not sure if this would break anything else.

Actions

Copy link

Updated by Sage Weil over 10 years ago

the ceph-build-deb-native.sh script has been updated to include the curl gnutls packages in the generated repo. i ran it on the two precise gitbuilder but didn't do the others. re-running the latest autobuild-ceph fab against these gitbuilders should fix it.

also, while you're doing that, maybe update the host lists at the top of the fabfile so we can more easily keep them all up to date?

Actions

Copy link