Project

General

Profile

Actions

Bug #9658

closed

upgrade from dumpling to firefly is broken

Added by Tamilarasi muthamizhan over 9 years ago. Updated over 9 years ago.

Status:
Resolved
Priority:
Urgent
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

This is definitely blocking the upgrade testing for giant.

logs: http://qa-proxy.ceph.com/teuthology/teuthology-2014-10-01_19:10:01-upgrade:dumpling-firefly-x:parallel-giant-distro-basic-multi/525199/teuthology.log

2014-10-03T01:06:12.958 INFO:teuthology.orchestra.run.plana09:Running: 'echo deb http://gitbuilder.ceph.com/ceph-deb-precise-x86_64-basic/ref/firefly precise main | sudo tee /etc/apt/sources.list.d/ceph.list'
2014-10-03T01:06:12.972 INFO:teuthology.orchestra.run.plana09:Running: 'sudo apt-get update && sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=0.80.6-27-g711a7e6-1precise ceph-dbg=0.80.6-27-g711a7e6-1precise ceph-mds=0.80.6-27-g711a7e6-1precise ceph-mds-dbg=0.80.6-27-g711a7e6-1precise ceph-common=0.80.6-27-g711a7e6-1precise ceph-common-dbg=0.80.6-27-g711a7e6-1precise ceph-fuse=0.80.6-27-g711a7e6-1precise ceph-fuse-dbg=0.80.6-27-g711a7e6-1precise ceph-test=0.80.6-27-g711a7e6-1precise ceph-test-dbg=0.80.6-27-g711a7e6-1precise radosgw=0.80.6-27-g711a7e6-1precise radosgw-dbg=0.80.6-27-g711a7e6-1precise python-ceph=0.80.6-27-g711a7e6-1precise libcephfs1=0.80.6-27-g711a7e6-1precise libcephfs1-dbg=0.80.6-27-g711a7e6-1precise libcephfs-java=0.80.6-27-g711a7e6-1precise librados2=0.80.6-27-g711a7e6-1precise librados2-dbg=0.80.6-27-g711a7e6-1precise librbd1=0.80.6-27-g711a7e6-1precise librbd1-dbg=0.80.6-27-g711a7e6-1precise'
2014-10-03T01:06:56.053 INFO:teuthology.orchestra.run.plana09.stderr:dpkg: error processing /var/cache/apt/archives/ceph_0.80.6-27-g711a7e6-1precise_amd64.deb (--unpack):
2014-10-03T01:06:56.054 INFO:teuthology.orchestra.run.plana09.stderr: trying to overwrite '/usr/share/pyshared/ceph_rest_api.py', which is also in package python-ceph 0.67.11-18-g69d85fa-1precise
2014-10-03T01:06:56.054 INFO:teuthology.orchestra.run.plana09.stderr:dpkg-deb: error: subprocess paste was killed by signal (Broken pipe)
2014-10-03T01:06:57.239 INFO:teuthology.orchestra.run.plana09.stderr:dpkg: considering deconfiguration of ceph, which would be broken by installation of ceph-common ...
2014-10-03T01:06:57.239 INFO:teuthology.orchestra.run.plana09.stderr:dpkg: yes, will deconfigure ceph (broken by ceph-common).
2014-10-03T01:07:26.006 INFO:teuthology.orchestra.run.plana09.stderr:Errors were encountered while processing:
2014-10-03T01:07:26.007 INFO:teuthology.orchestra.run.plana09.stderr: /var/cache/apt/archives/ceph_0.80.6-27-g711a7e6-1precise_amd64.deb
2014-10-03T01:07:26.014 INFO:teuthology.orchestra.run.plana09.stderr:E: Sub-process /usr/bin/dpkg returned an error code (1)
2014-10-03T01:07:26.016 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/run_tasks.py", line 53, in run_tasks
    manager.__enter__()
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/teuthology_master/teuthology/task/install.py", line 1130, in upgrade
    upgrade_common(ctx, config, upgrade_old_style)
  File "/home/teuthworker/src/teuthology_master/teuthology/task/install.py", line 1083, in upgrade_common
    deploy_style(ctx, node, remote, pkgs, system_type)
  File "/home/teuthworker/src/teuthology_master/teuthology/task/install.py", line 999, in upgrade_old_style
    _upgrade_deb_packages(ctx, node, remote, pkgs)
  File "/home/teuthworker/src/teuthology_master/teuthology/task/install.py", line 917, in _upgrade_deb_packages
    stdout=StringIO(),
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 128, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 361, in run
    r.wait()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 105, in wait
    exitstatus=status, node=self.hostname)
CommandFailedError: Command failed on plana09 with status 100: 'sudo apt-get update && sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=0.80.6-27-g711a7e6-1precise ceph-dbg=0.80.6-27-g711a7e6-1precise ceph-mds=0.80.6-27-g711a7e6-1precise ceph-mds-dbg=0.80.6-27-g711a7e6-1precise ceph-common=0.80.6-27-g711a7e6-1precise ceph-common-dbg=0.80.6-27-g711a7e6-1precise ceph-fuse=0.80.6-27-g711a7e6-1precise ceph-fuse-dbg=0.80.6-27-g711a7e6-1precise ceph-test=0.80.6-27-g711a7e6-1precise ceph-test-dbg=0.80.6-27-g711a7e6-1precise radosgw=0.80.6-27-g711a7e6-1precise radosgw-dbg=0.80.6-27-g711a7e6-1precise python-ceph=0.80.6-27-g711a7e6-1precise libcephfs1=0.80.6-27-g711a7e6-1precise libcephfs1-dbg=0.80.6-27-g711a7e6-1precise libcephfs-java=0.80.6-27-g711a7e6-1precise librados2=0.80.6-27-g711a7e6-1precise librados2-dbg=0.80.6-27-g711a7e6-1precise librbd1=0.80.6-27-g711a7e6-1precise librbd1-dbg=0.80.6-27-g711a7e6-1precise'
2014-10-03T01:07:26.018 DEBUG:teuthology.run_tasks:Unwinding manager ceph

Related issues 2 (0 open2 closed)

Has duplicate devops - Bug #9667: Missing packages in upgrade:dumpling-firefly-x:parallel-giant-distro-basic-multi run DuplicateSandon Van Ness10/06/2014

Actions
Has duplicate devops - Bug #9654: "error: subprocess paste was killed by signal (Broken pipe)" in upgrade:dumpling-firefly-x:parallel-giant-distro-basic-multi runDuplicateSandon Van Ness10/03/2014

Actions
Actions #1

Updated by Tamilarasi muthamizhan over 9 years ago

  • Project changed from devops to Ceph
Actions #3

Updated by Sage Weil over 9 years ago

  • Status changed from New to In Progress
  • Assignee set to Sage Weil

this is broken by commit:eb0f6e347969b40c0655d3165a6c4531c6b595a3, which is post 0.80.6. phew! yay testing.

Actions #4

Updated by Tamilarasi muthamizhan over 9 years ago

  • Status changed from In Progress to New
  • Assignee deleted (Sage Weil)

sandon: looks like the problem is a file that was in python-ceph was moved to ceph and apt is bailing due to over-writing the file. We need to either do --force-overwrite or someone didn't think of the reprocussions of upgrades when moving that file
the file is: /usr/share/pyshared/ceph_rest_api.py

Actions #5

Updated by Tamilarasi muthamizhan over 9 years ago

  • Assignee set to Sage Weil
Actions #6

Updated by Tamilarasi muthamizhan over 9 years ago

  • Status changed from New to In Progress
Actions #7

Updated by Sage Weil over 9 years ago

possible debian fix in wip-9658. asked ceph-maintainers and branto for review and help with the spec file change.

Actions #8

Updated by Sage Weil over 9 years ago

  • Project changed from Ceph to devops
Actions #9

Updated by Sage Weil over 9 years ago

  • Status changed from In Progress to 7
Actions #10

Updated by Sage Weil over 9 years ago

  • Assignee changed from Sage Weil to Tamilarasi muthamizhan
Actions #11

Updated by Sage Weil over 9 years ago

Tamil, this should be fixed in the wip-9658 branch.. can you test please? The firefly backport will be a bit different; will do that next.

Actions #12

Updated by Tamilarasi muthamizhan over 9 years ago

sure, am testing it now

Actions #13

Updated by Tamilarasi muthamizhan over 9 years ago

ubuntu@teuthology:/a/teuthology-2014-10-06_10:31:05-upgrade:dumpling-firefly-x:parallel-wip-9658-distro-basic-vps/529856

Actions #14

Updated by Tamilarasi muthamizhan over 9 years ago

ubuntu@teuthology:/a/teuthology-2014-10-06_14:06:56-upgrade:dumpling-firefly-x:parallel-wip-9658-firefly-distro-basic-vps/530695$ tail -f teuthology.log

Actions #15

Updated by Sage Weil over 9 years ago

  • Status changed from 7 to Resolved
Actions

Also available in: Atom PDF