Project

General

Profile

Actions

Bug #11415

closed

Packaging failures in upgrade:hammer-x-next-distro-basic-multi run

Added by Yuri Weinstein about 9 years ago. Updated almost 9 years ago.

Status:
Resolved
Priority:
High
Assignee:
Category:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
upgrade/hammer-x
Crash signature (v1):
Crash signature (v2):

Description

Run: http://pulpito.ceph.com/teuthology-2015-04-16_13:11:53-upgrade:hammer-x-next-distro-basic-multi/
Jobs: all
Logs for one: http://qa-proxy.ceph.com/teuthology/teuthology-2015-04-16_13:11:53-upgrade:hammer-x-next-distro-basic-multi/850512/

Per Josh "sounds like teuthology's install task might just need to add libradosstriper1 to the list of ceph packages it installs"

2015-04-16T13:15:54.008 INFO:teuthology.orchestra.run.plana58.stdout: ceph-common : Depends: python-rados (= 0.94-912-g33bdae7-1precise) but 0.94.1-4-gb01e68f-1precise is to be installed
2015-04-16T13:15:54.008 INFO:teuthology.orchestra.run.plana58.stdout:               Depends: python-cephfs (= 0.94-912-g33bdae7-1precise) but 0.94.1-4-gb01e68f-1precise is to be installed
2015-04-16T13:15:54.009 INFO:teuthology.orchestra.run.plana58.stdout:               Depends: python-rbd (= 0.94-912-g33bdae7-1precise) but 0.94.1-4-gb01e68f-1precise is to be installed
2015-04-16T13:15:54.009 INFO:teuthology.orchestra.run.plana58.stdout: ceph-test : Depends: libradosstriper1 but it is not going to be installed
2015-04-16T13:15:54.036 INFO:teuthology.orchestra.run.plana58.stderr:E: Unable to correct problems, you have held broken packages.

Related issues 1 (0 open1 closed)

Blocks teuthology - Feature #10781: upgrade:hammer-x suiteResolvedYuri Weinstein02/06/2015

Actions
Actions #1

Updated by Yuri Weinstein about 9 years ago

  • Priority changed from Normal to High
Actions #2

Updated by Zack Cerza about 9 years ago

  • Status changed from New to Need More Info

Why can't this just be pulled in as a dependency?

Actions #4

Updated by Dan Mick about 9 years ago

Apparently the specific-version thing we do in install.py requires us to explicitly list all the packages we want to install. I don't fully understand it either, but Josh was not surprised.

Yuri, if you want to try a teuthology branch with the package explicitly added, I made one at wip-11415

Actions #5

Updated by Yuri Weinstein about 9 years ago

Dan, tried that wip
Run: http://pulpito-rdu.front.sepia.ceph.com/teuthology-2015-04-22_11:36:23-upgrade:hammer-x-next-distro-basic-typica/
4 jobs still failed, error looks similar, but it feels like it's a next error.

http://typica002.front.sepia.ceph.com/teuthology-2015-04-22_11:36:23-upgrade:hammer-x-next-distro-basic-typica/2424/

015-04-22T11:41:06.919 INFO:teuthology.orchestra.run.typica110.stdout:Reading package lists...
2015-04-22T11:41:06.924 INFO:teuthology.orchestra.run.typica110:Running: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install librbd1-dbg=0.94-912-g33bdae7-1precise ceph=0.94-912-g33bdae7-1precise ceph-test=0.94-912-g33bdae7-1precise ceph-dbg=0.94-912-g33bdae7-1precise libradosstriper1=0.94-912-g33bdae7-1precise rbd-fuse=0.94-912-g33bdae7-1precise librados2-dbg=0.94-912-g33bdae7-1precise ceph-fuse-dbg=0.94-912-g33bdae7-1precise libcephfs-jni=0.94-912-g33bdae7-1precise libcephfs1-dbg=0.94-912-g33bdae7-1precise radosgw=0.94-912-g33bdae7-1precise librados2=0.94-912-g33bdae7-1precise libcephfs1=0.94-912-g33bdae7-1precise ceph-mds=0.94-912-g33bdae7-1precise radosgw-dbg=0.94-912-g33bdae7-1precise librbd1=0.94-912-g33bdae7-1precise python-ceph=0.94-912-g33bdae7-1precise ceph-test-dbg=0.94-912-g33bdae7-1precise libradosstriper1-dbg=0.94-912-g33bdae7-1precise ceph-fuse=0.94-912-g33bdae7-1precise ceph-common=0.94-912-g33bdae7-1precise libcephfs-java=0.94-912-g33bdae7-1precise ceph-common-dbg=0.94-912-g33bdae7-1precise ceph-mds-dbg=0.94-912-g33bdae7-1precise'
2015-04-22T11:41:06.941 INFO:teuthology.orchestra.run.typica110.stdout:Reading package lists...
2015-04-22T11:41:07.166 INFO:teuthology.orchestra.run.typica110.stdout:Building dependency tree...
2015-04-22T11:41:07.167 INFO:teuthology.orchestra.run.typica110.stdout:Reading state information...
2015-04-22T11:41:07.285 INFO:teuthology.orchestra.run.typica110.stdout:Some packages could not be installed. This may mean that you have
2015-04-22T11:41:07.285 INFO:teuthology.orchestra.run.typica110.stdout:requested an impossible situation or if you are using the unstable
2015-04-22T11:41:07.286 INFO:teuthology.orchestra.run.typica110.stdout:distribution that some required packages have not yet been created
2015-04-22T11:41:07.286 INFO:teuthology.orchestra.run.typica110.stdout:or been moved out of Incoming.
2015-04-22T11:41:07.286 INFO:teuthology.orchestra.run.typica110.stdout:The following information may help to resolve the situation:
2015-04-22T11:41:07.287 INFO:teuthology.orchestra.run.typica110.stdout:
2015-04-22T11:41:07.287 INFO:teuthology.orchestra.run.typica110.stdout:The following packages have unmet dependencies:
2015-04-22T11:41:07.287 INFO:teuthology.orchestra.run.typica110.stdout: ceph-common : Depends: python-rados (= 0.94-912-g33bdae7-1precise) but 0.94.1-6-g8a58d83-1precise is to be installed
2015-04-22T11:41:07.288 INFO:teuthology.orchestra.run.typica110.stdout:               Depends: python-cephfs (= 0.94-912-g33bdae7-1precise) but 0.94.1-6-g8a58d83-1precise is to be installed
2015-04-22T11:41:07.288 INFO:teuthology.orchestra.run.typica110.stdout:               Depends: python-rbd (= 0.94-912-g33bdae7-1precise) but 0.94.1-6-g8a58d83-1precise is to be installed
2015-04-22T11:41:07.301 INFO:teuthology.orchestra.run.typica110.stderr:E: Unable to correct problems, you have held broken packages.
Actions #6

Updated by Dan Mick about 9 years ago

  • Assignee set to Dan Mick
Actions #7

Updated by Dan Mick about 9 years ago

Yeah, I don't know what those mean.

Actions #8

Updated by Yuri Weinstein almost 9 years ago

Run: http://pulpito.ceph.com/teuthology-2015-04-26_10:33:21-upgrade:hammer-x-next-distro-basic-multi/
Jobs: ['864066', '864068', '864070', '864073']
Logs for one: http://pulpito.ceph.com/teuthology-2015-04-26_10:33:21-upgrade:hammer-x-next-distro-basic-multi/864066

2015-04-26T15:02:05.756 INFO:teuthology.orchestra.run.mira012.stdout:The following packages have unmet dependencies:
2015-04-26T15:02:05.757 INFO:teuthology.orchestra.run.mira012.stdout: ceph-common : Depends: librbd1 (= 0.94.1-8-g74c2dc1-1trusty) but 0.94-912-g33bdae7-1trusty is to be installed
2015-04-26T15:02:05.757 INFO:teuthology.orchestra.run.mira012.stdout: ceph-test : Depends: libradosstriper1 but it is not going to be installed
2015-04-26T15:02:05.787 INFO:teuthology.orchestra.run.mira012.stderr:E: Unable to correct problems, you have held broken packages.
Actions #9

Updated by Yuri Weinstein almost 9 years ago

Dan, I am not sure what we do next?

Actions #10

Updated by Yuri Weinstein almost 9 years ago

  • Regression set to No

One more run - http://pulpito-rdu.front.sepia.ceph.com/teuthology-2015-05-05_19:31:06-upgrade:hammer-x-next-distro-basic-typica/
Job: 10832
Logs: http://typica002.front.sepia.ceph.com/teuthology-2015-05-05_19:31:06-upgrade:hammer-x-next-distro-basic-typica/10832/teuthology.log

Error:

2015-05-05T19:50:04.808 INFO:teuthology.orchestra.run.typica052.stdout:
2015-05-05T19:50:04.809 INFO:teuthology.orchestra.run.typica052.stdout:The following packages have unmet dependencies:
2015-05-05T19:50:04.809 INFO:teuthology.orchestra.run.typica052.stdout: ceph-common : Depends: librbd1 (= 0.94.1-45-gbc51476-1trusty) but 0.94-917-g2ffb030-1trusty is to be installed
2015-05-05T19:50:04.809 INFO:teuthology.orchestra.run.typica052.stdout: ceph-test : Depends: libradosstriper1 but it is not going to be installed
2015-05-05T19:50:04.851 INFO:teuthology.orchestra.run.typica052.stderr:E: Unable to correct problems, you have held broken packages.
2015-05-05T19:50:04.855 ERROR:teuthology.parallel:Exception in parallel execution
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 82, in __exit__
    for result in self:
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 101, in next
    resurrect_traceback(result)
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 19, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/task/parallel.py", line 50, in _run_spawned
    mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/teuthology_master/teuthology/run_tasks.py", line 41, in run_one_task
    return fn(**kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/task/sequential.py", line 48, in task
    mgr.__enter__()
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/teuthology_master/teuthology/task/install.py", line 1144, in upgrade
    upgrade_common(ctx, config, upgrade_old_style)
  File "/home/teuthworker/src/teuthology_master/teuthology/task/install.py", line 1090, in upgrade_common
    deploy_style(ctx, node, remote, pkgs, system_type)
  File "/home/teuthworker/src/teuthology_master/teuthology/task/install.py", line 1003, in upgrade_old_style
    _upgrade_deb_packages(ctx, node, remote, pkgs)
  File "/home/teuthworker/src/teuthology_master/teuthology/task/install.py", line 938, in _upgrade_deb_packages
    ] + ['%s=%s' % (d, version) for d in debs],
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 156, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 378, in run
    r.wait()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 114, in wait
    label=self.label)
CommandFailedError: Command failed on typica052 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install librbd1-dbg=0.94-917-g2ffb030-1trusty ceph=0.94-917-g2ffb030-1trusty ceph-test=0.94-917-g2ffb030-1trusty ceph-dbg=0.94-917-g2ffb030-1trusty rbd-fuse=0.94-917-g2ffb030-1trusty librados2-dbg=0.94-917-g2ffb030-1trusty ceph-fuse-dbg=0.94-917-g2ffb030-1trusty libcephfs-jni=0.94-917-g2ffb030-1trusty libcephfs1-dbg=0.94-917-g2ffb030-1trusty radosgw=0.94-917-g2ffb030-1trusty librados2=0.94-917-g2ffb030-1trusty libcephfs1=0.94-917-g2ffb030-1trusty ceph-mds=0.94-917-g2ffb030-1trusty radosgw-dbg=0.94-917-g2ffb030-1trusty librbd1=0.94-917-g2ffb030-1trusty python-ceph=0.94-917-g2ffb030-1trusty ceph-test-dbg=0.94-917-g2ffb030-1trusty ceph-fuse=0.94-917-g2ffb030-1trusty ceph-common=0.94-917-g2ffb030-1trusty libcephfs-java=0.94-917-g2ffb030-1trusty ceph-common-dbg=0.94-917-g2ffb030-1trusty ceph-mds-dbg=0.94-917-g2ffb030-1trusty'

Original yaml:

archive_path: /home/teuthworker/archive/teuthology-2015-05-05_19:31:06-upgrade:hammer-x-next-distro-basic-typica/10832
branch: next
description: upgrade:hammer-x/parallel/{0-cluster/start.yaml 1-hammer-install/hammer.yaml
  2-workload/{ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml
  test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-final-workload/{rados-snaps-few-objects.yaml
  rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml
  rgw_swift.yaml} distros/ubuntu_14.04.yaml}
email: ceph-qa@ceph.com
job_id: '10832'
kernel:
  kdb: true
  sha1: distro
last_in_suite: false
machine_type: typica
name: teuthology-2015-05-05_19:31:06-upgrade:hammer-x-next-distro-basic-typica
nuke-on-error: true
os_type: ubuntu
os_version: '14.04'
overrides:
  admin_socket:
    branch: next
  ceph:
    conf:
      mon:
        debug mon: 20
        debug ms: 1
        debug paxos: 20
        mon warn on legacy crush tunables: false
      osd:
        debug filestore: 20
        debug journal: 20
        debug ms: 1
        debug osd: 20
    log-whitelist:
    - slow request
    - scrub mismatch
    - ScrubResult
    sha1: 2ffb030099ccccae9b87404b8af2578b1da07506
  ceph-deploy:
    branch:
      dev: next
    conf:
      client:
        log file: /var/log/ceph/ceph-$name.$pid.log
      mon:
        debug mon: 1
        debug ms: 20
        debug paxos: 20
        osd default pool size: 2
  install:
    ceph:
      sha1: 2ffb030099ccccae9b87404b8af2578b1da07506
  workunit:
    sha1: 2ffb030099ccccae9b87404b8af2578b1da07506
owner: scheduled_teuthology@typica002
priority: 90
roles:
- - mon.a
  - mds.a
  - osd.0
  - osd.1
- - mon.b
  - mon.c
  - osd.2
  - osd.3
- - client.0
  - client.1
sha1: 2ffb030099ccccae9b87404b8af2578b1da07506
suite: upgrade:hammer-x
suite_branch: next
suite_path: /home/teuthworker/src/ceph-qa-suite_next
tasks:
- chef: null
- clock.check: null
- install:
    branch: hammer
- print: '**** done installing hammer'
- ceph:
    fs: xfs
- print: '**** done ceph'
- parallel:
  - workload
  - upgrade-sequence
- print: '**** done parallel'
- rados:
    clients:
    - client.0
    ec_pool: true
    objects: 50
    op_weights:
      append: 100
      copy_from: 50
      delete: 50
      read: 100
      rmattr: 25
      rollback: 50
      setattr: 25
      snap_create: 50
      snap_remove: 50
      write: 0
    ops: 4000
- print: '**** done rados ec task'
- rados:
    clients:
    - client.1
    objects: 50
    op_weights:
      delete: 50
      read: 100
      rollback: 50
      snap_create: 50
      snap_remove: 50
      write: 100
    ops: 4000
- print: '**** done rados 4-final-workload'
- workunit:
    clients:
      client.1:
      - rados/load-gen-mix.sh
- print: '**** done rados/load-gen-mix.sh 4-final-workload'
- mon_thrash:
    revive_delay: 20
    thrash_delay: 1
- print: '**** done mon_thrash 4-final-workload'
- workunit:
    clients:
      client.1:
      - rados/test.sh
- print: '**** done rados/test.sh 4-final-workload'
- workunit:
    clients:
      client.1:
      - cls/test_cls_rbd.sh
- print: '**** done cls/test_cls_rbd.sh 4-final-workload'
- workunit:
    clients:
      client.1:
      - rbd/import_export.sh
    env:
      RBD_CREATE_ARGS: --new-format
- print: '**** done rbd/import_export.sh 4-final-workload'
- rgw:
  - client.1
- print: '**** done rgw 4-final-workload'
- swift:
    client.1:
      rgw_server: client.1
- print: '**** done swift 4-final-workload'
teuthology_branch: master
tube: typica
upgrade-sequence:
  sequential:
  - install.upgrade:
      mon.a: null
      mon.b: null
  - print: '**** done install.upgrade mon.a and mon.b'
  - ceph.restart:
    - mon.a
    - mon.b
    - mon.c
    - mds.a
    - osd.0
    - osd.1
    - osd.2
    - osd.3
  - print: '**** done ceph.restart all'
verbose: true
worker_log: /home/teuthworker/archive/worker_logs/worker.typica.14527
workload:
  sequential:
  - workunit:
      branch: hammer
      clients:
        client.0:
        - cls
  - print: '**** done cls 2-workload'
  - workunit:
      branch: hammer
      clients:
        client.0:
        - rados/load-gen-big.sh
  - print: '**** done rados/load-gen-big.sh 2-workload'
  - workunit:
      branch: hammer
      clients:
        client.0:
        - rbd/test_librbd.sh
  - print: '**** done rbd/test_librbd.sh 2-workload'
  - workunit:
      branch: hammer
      clients:
        client.0:
        - rbd/test_librbd_python.sh
  - print: '**** done rbd/test_librbd_python.sh 2-workload'
Actions #11

Updated by Dan Mick almost 9 years ago

  • Status changed from Need More Info to Resolved

I suspect this is resolved by Zack's changes to be more flexible interpreting the dpkg -l states; if it pops up again we can reopen

Actions

Also available in: Atom PDF