Actions
Bug #11415
closedPackaging failures in upgrade:hammer-x-next-distro-basic-multi run
Added by Yuri Weinstein about 9 years ago. Updated almost 9 years ago.
% Done:
0%
Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
upgrade/hammer-x
Crash signature (v1):
Crash signature (v2):
Description
Run: http://pulpito.ceph.com/teuthology-2015-04-16_13:11:53-upgrade:hammer-x-next-distro-basic-multi/
Jobs: all
Logs for one: http://qa-proxy.ceph.com/teuthology/teuthology-2015-04-16_13:11:53-upgrade:hammer-x-next-distro-basic-multi/850512/
Per Josh "sounds like teuthology's install task might just need to add libradosstriper1 to the list of ceph packages it installs"
2015-04-16T13:15:54.008 INFO:teuthology.orchestra.run.plana58.stdout: ceph-common : Depends: python-rados (= 0.94-912-g33bdae7-1precise) but 0.94.1-4-gb01e68f-1precise is to be installed 2015-04-16T13:15:54.008 INFO:teuthology.orchestra.run.plana58.stdout: Depends: python-cephfs (= 0.94-912-g33bdae7-1precise) but 0.94.1-4-gb01e68f-1precise is to be installed 2015-04-16T13:15:54.009 INFO:teuthology.orchestra.run.plana58.stdout: Depends: python-rbd (= 0.94-912-g33bdae7-1precise) but 0.94.1-4-gb01e68f-1precise is to be installed 2015-04-16T13:15:54.009 INFO:teuthology.orchestra.run.plana58.stdout: ceph-test : Depends: libradosstriper1 but it is not going to be installed 2015-04-16T13:15:54.036 INFO:teuthology.orchestra.run.plana58.stderr:E: Unable to correct problems, you have held broken packages.
Updated by Yuri Weinstein about 9 years ago
- Priority changed from Normal to High
Updated by Zack Cerza about 9 years ago
- Status changed from New to Need More Info
Why can't this just be pulled in as a dependency?
Updated by Yuri Weinstein about 9 years ago
Latest run with same issues:
http://pulpito-rdu.front.sepia.ceph.com/teuthology-2015-04-21_14:16:53-upgrade:hammer-x-next-distro-basic-typica/
Zack - what info you need that I can add?
Updated by Dan Mick about 9 years ago
Apparently the specific-version thing we do in install.py requires us to explicitly list all the packages we want to install. I don't fully understand it either, but Josh was not surprised.
Yuri, if you want to try a teuthology branch with the package explicitly added, I made one at wip-11415
Updated by Yuri Weinstein about 9 years ago
Dan, tried that wip
Run: http://pulpito-rdu.front.sepia.ceph.com/teuthology-2015-04-22_11:36:23-upgrade:hammer-x-next-distro-basic-typica/
4 jobs still failed, error looks similar, but it feels like it's a next error.
015-04-22T11:41:06.919 INFO:teuthology.orchestra.run.typica110.stdout:Reading package lists... 2015-04-22T11:41:06.924 INFO:teuthology.orchestra.run.typica110:Running: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install librbd1-dbg=0.94-912-g33bdae7-1precise ceph=0.94-912-g33bdae7-1precise ceph-test=0.94-912-g33bdae7-1precise ceph-dbg=0.94-912-g33bdae7-1precise libradosstriper1=0.94-912-g33bdae7-1precise rbd-fuse=0.94-912-g33bdae7-1precise librados2-dbg=0.94-912-g33bdae7-1precise ceph-fuse-dbg=0.94-912-g33bdae7-1precise libcephfs-jni=0.94-912-g33bdae7-1precise libcephfs1-dbg=0.94-912-g33bdae7-1precise radosgw=0.94-912-g33bdae7-1precise librados2=0.94-912-g33bdae7-1precise libcephfs1=0.94-912-g33bdae7-1precise ceph-mds=0.94-912-g33bdae7-1precise radosgw-dbg=0.94-912-g33bdae7-1precise librbd1=0.94-912-g33bdae7-1precise python-ceph=0.94-912-g33bdae7-1precise ceph-test-dbg=0.94-912-g33bdae7-1precise libradosstriper1-dbg=0.94-912-g33bdae7-1precise ceph-fuse=0.94-912-g33bdae7-1precise ceph-common=0.94-912-g33bdae7-1precise libcephfs-java=0.94-912-g33bdae7-1precise ceph-common-dbg=0.94-912-g33bdae7-1precise ceph-mds-dbg=0.94-912-g33bdae7-1precise' 2015-04-22T11:41:06.941 INFO:teuthology.orchestra.run.typica110.stdout:Reading package lists... 2015-04-22T11:41:07.166 INFO:teuthology.orchestra.run.typica110.stdout:Building dependency tree... 2015-04-22T11:41:07.167 INFO:teuthology.orchestra.run.typica110.stdout:Reading state information... 2015-04-22T11:41:07.285 INFO:teuthology.orchestra.run.typica110.stdout:Some packages could not be installed. This may mean that you have 2015-04-22T11:41:07.285 INFO:teuthology.orchestra.run.typica110.stdout:requested an impossible situation or if you are using the unstable 2015-04-22T11:41:07.286 INFO:teuthology.orchestra.run.typica110.stdout:distribution that some required packages have not yet been created 2015-04-22T11:41:07.286 INFO:teuthology.orchestra.run.typica110.stdout:or been moved out of Incoming. 2015-04-22T11:41:07.286 INFO:teuthology.orchestra.run.typica110.stdout:The following information may help to resolve the situation: 2015-04-22T11:41:07.287 INFO:teuthology.orchestra.run.typica110.stdout: 2015-04-22T11:41:07.287 INFO:teuthology.orchestra.run.typica110.stdout:The following packages have unmet dependencies: 2015-04-22T11:41:07.287 INFO:teuthology.orchestra.run.typica110.stdout: ceph-common : Depends: python-rados (= 0.94-912-g33bdae7-1precise) but 0.94.1-6-g8a58d83-1precise is to be installed 2015-04-22T11:41:07.288 INFO:teuthology.orchestra.run.typica110.stdout: Depends: python-cephfs (= 0.94-912-g33bdae7-1precise) but 0.94.1-6-g8a58d83-1precise is to be installed 2015-04-22T11:41:07.288 INFO:teuthology.orchestra.run.typica110.stdout: Depends: python-rbd (= 0.94-912-g33bdae7-1precise) but 0.94.1-6-g8a58d83-1precise is to be installed 2015-04-22T11:41:07.301 INFO:teuthology.orchestra.run.typica110.stderr:E: Unable to correct problems, you have held broken packages.
Updated by Yuri Weinstein about 9 years ago
Run: http://pulpito.ceph.com/teuthology-2015-04-26_10:33:21-upgrade:hammer-x-next-distro-basic-multi/
Jobs: ['864066', '864068', '864070', '864073']
Logs for one: http://pulpito.ceph.com/teuthology-2015-04-26_10:33:21-upgrade:hammer-x-next-distro-basic-multi/864066
2015-04-26T15:02:05.756 INFO:teuthology.orchestra.run.mira012.stdout:The following packages have unmet dependencies: 2015-04-26T15:02:05.757 INFO:teuthology.orchestra.run.mira012.stdout: ceph-common : Depends: librbd1 (= 0.94.1-8-g74c2dc1-1trusty) but 0.94-912-g33bdae7-1trusty is to be installed 2015-04-26T15:02:05.757 INFO:teuthology.orchestra.run.mira012.stdout: ceph-test : Depends: libradosstriper1 but it is not going to be installed 2015-04-26T15:02:05.787 INFO:teuthology.orchestra.run.mira012.stderr:E: Unable to correct problems, you have held broken packages.
Updated by Yuri Weinstein almost 9 years ago
- Regression set to No
One more run - http://pulpito-rdu.front.sepia.ceph.com/teuthology-2015-05-05_19:31:06-upgrade:hammer-x-next-distro-basic-typica/
Job: 10832
Logs: http://typica002.front.sepia.ceph.com/teuthology-2015-05-05_19:31:06-upgrade:hammer-x-next-distro-basic-typica/10832/teuthology.log
Error:
2015-05-05T19:50:04.808 INFO:teuthology.orchestra.run.typica052.stdout:
2015-05-05T19:50:04.809 INFO:teuthology.orchestra.run.typica052.stdout:The following packages have unmet dependencies:
2015-05-05T19:50:04.809 INFO:teuthology.orchestra.run.typica052.stdout: ceph-common : Depends: librbd1 (= 0.94.1-45-gbc51476-1trusty) but 0.94-917-g2ffb030-1trusty is to be installed
2015-05-05T19:50:04.809 INFO:teuthology.orchestra.run.typica052.stdout: ceph-test : Depends: libradosstriper1 but it is not going to be installed
2015-05-05T19:50:04.851 INFO:teuthology.orchestra.run.typica052.stderr:E: Unable to correct problems, you have held broken packages.
2015-05-05T19:50:04.855 ERROR:teuthology.parallel:Exception in parallel execution
Traceback (most recent call last):
File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 82, in __exit__
for result in self:
File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 101, in next
resurrect_traceback(result)
File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 19, in capture_traceback
return func(*args, **kwargs)
File "/home/teuthworker/src/teuthology_master/teuthology/task/parallel.py", line 50, in _run_spawned
mgr = run_tasks.run_one_task(taskname, ctx=ctx, config=config)
File "/home/teuthworker/src/teuthology_master/teuthology/run_tasks.py", line 41, in run_one_task
return fn(**kwargs)
File "/home/teuthworker/src/teuthology_master/teuthology/task/sequential.py", line 48, in task
mgr.__enter__()
File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
return self.gen.next()
File "/home/teuthworker/src/teuthology_master/teuthology/task/install.py", line 1144, in upgrade
upgrade_common(ctx, config, upgrade_old_style)
File "/home/teuthworker/src/teuthology_master/teuthology/task/install.py", line 1090, in upgrade_common
deploy_style(ctx, node, remote, pkgs, system_type)
File "/home/teuthworker/src/teuthology_master/teuthology/task/install.py", line 1003, in upgrade_old_style
_upgrade_deb_packages(ctx, node, remote, pkgs)
File "/home/teuthworker/src/teuthology_master/teuthology/task/install.py", line 938, in _upgrade_deb_packages
] + ['%s=%s' % (d, version) for d in debs],
File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 156, in run
r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 378, in run
r.wait()
File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 114, in wait
label=self.label)
CommandFailedError: Command failed on typica052 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install librbd1-dbg=0.94-917-g2ffb030-1trusty ceph=0.94-917-g2ffb030-1trusty ceph-test=0.94-917-g2ffb030-1trusty ceph-dbg=0.94-917-g2ffb030-1trusty rbd-fuse=0.94-917-g2ffb030-1trusty librados2-dbg=0.94-917-g2ffb030-1trusty ceph-fuse-dbg=0.94-917-g2ffb030-1trusty libcephfs-jni=0.94-917-g2ffb030-1trusty libcephfs1-dbg=0.94-917-g2ffb030-1trusty radosgw=0.94-917-g2ffb030-1trusty librados2=0.94-917-g2ffb030-1trusty libcephfs1=0.94-917-g2ffb030-1trusty ceph-mds=0.94-917-g2ffb030-1trusty radosgw-dbg=0.94-917-g2ffb030-1trusty librbd1=0.94-917-g2ffb030-1trusty python-ceph=0.94-917-g2ffb030-1trusty ceph-test-dbg=0.94-917-g2ffb030-1trusty ceph-fuse=0.94-917-g2ffb030-1trusty ceph-common=0.94-917-g2ffb030-1trusty libcephfs-java=0.94-917-g2ffb030-1trusty ceph-common-dbg=0.94-917-g2ffb030-1trusty ceph-mds-dbg=0.94-917-g2ffb030-1trusty'
Original yaml:
archive_path: /home/teuthworker/archive/teuthology-2015-05-05_19:31:06-upgrade:hammer-x-next-distro-basic-typica/10832
branch: next
description: upgrade:hammer-x/parallel/{0-cluster/start.yaml 1-hammer-install/hammer.yaml
2-workload/{ec-rados-default.yaml rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml
test_rbd_python.yaml} 3-upgrade-sequence/upgrade-all.yaml 4-final-workload/{rados-snaps-few-objects.yaml
rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml rbd_import_export.yaml
rgw_swift.yaml} distros/ubuntu_14.04.yaml}
email: ceph-qa@ceph.com
job_id: '10832'
kernel:
kdb: true
sha1: distro
last_in_suite: false
machine_type: typica
name: teuthology-2015-05-05_19:31:06-upgrade:hammer-x-next-distro-basic-typica
nuke-on-error: true
os_type: ubuntu
os_version: '14.04'
overrides:
admin_socket:
branch: next
ceph:
conf:
mon:
debug mon: 20
debug ms: 1
debug paxos: 20
mon warn on legacy crush tunables: false
osd:
debug filestore: 20
debug journal: 20
debug ms: 1
debug osd: 20
log-whitelist:
- slow request
- scrub mismatch
- ScrubResult
sha1: 2ffb030099ccccae9b87404b8af2578b1da07506
ceph-deploy:
branch:
dev: next
conf:
client:
log file: /var/log/ceph/ceph-$name.$pid.log
mon:
debug mon: 1
debug ms: 20
debug paxos: 20
osd default pool size: 2
install:
ceph:
sha1: 2ffb030099ccccae9b87404b8af2578b1da07506
workunit:
sha1: 2ffb030099ccccae9b87404b8af2578b1da07506
owner: scheduled_teuthology@typica002
priority: 90
roles:
- - mon.a
- mds.a
- osd.0
- osd.1
- - mon.b
- mon.c
- osd.2
- osd.3
- - client.0
- client.1
sha1: 2ffb030099ccccae9b87404b8af2578b1da07506
suite: upgrade:hammer-x
suite_branch: next
suite_path: /home/teuthworker/src/ceph-qa-suite_next
tasks:
- chef: null
- clock.check: null
- install:
branch: hammer
- print: '**** done installing hammer'
- ceph:
fs: xfs
- print: '**** done ceph'
- parallel:
- workload
- upgrade-sequence
- print: '**** done parallel'
- rados:
clients:
- client.0
ec_pool: true
objects: 50
op_weights:
append: 100
copy_from: 50
delete: 50
read: 100
rmattr: 25
rollback: 50
setattr: 25
snap_create: 50
snap_remove: 50
write: 0
ops: 4000
- print: '**** done rados ec task'
- rados:
clients:
- client.1
objects: 50
op_weights:
delete: 50
read: 100
rollback: 50
snap_create: 50
snap_remove: 50
write: 100
ops: 4000
- print: '**** done rados 4-final-workload'
- workunit:
clients:
client.1:
- rados/load-gen-mix.sh
- print: '**** done rados/load-gen-mix.sh 4-final-workload'
- mon_thrash:
revive_delay: 20
thrash_delay: 1
- print: '**** done mon_thrash 4-final-workload'
- workunit:
clients:
client.1:
- rados/test.sh
- print: '**** done rados/test.sh 4-final-workload'
- workunit:
clients:
client.1:
- cls/test_cls_rbd.sh
- print: '**** done cls/test_cls_rbd.sh 4-final-workload'
- workunit:
clients:
client.1:
- rbd/import_export.sh
env:
RBD_CREATE_ARGS: --new-format
- print: '**** done rbd/import_export.sh 4-final-workload'
- rgw:
- client.1
- print: '**** done rgw 4-final-workload'
- swift:
client.1:
rgw_server: client.1
- print: '**** done swift 4-final-workload'
teuthology_branch: master
tube: typica
upgrade-sequence:
sequential:
- install.upgrade:
mon.a: null
mon.b: null
- print: '**** done install.upgrade mon.a and mon.b'
- ceph.restart:
- mon.a
- mon.b
- mon.c
- mds.a
- osd.0
- osd.1
- osd.2
- osd.3
- print: '**** done ceph.restart all'
verbose: true
worker_log: /home/teuthworker/archive/worker_logs/worker.typica.14527
workload:
sequential:
- workunit:
branch: hammer
clients:
client.0:
- cls
- print: '**** done cls 2-workload'
- workunit:
branch: hammer
clients:
client.0:
- rados/load-gen-big.sh
- print: '**** done rados/load-gen-big.sh 2-workload'
- workunit:
branch: hammer
clients:
client.0:
- rbd/test_librbd.sh
- print: '**** done rbd/test_librbd.sh 2-workload'
- workunit:
branch: hammer
clients:
client.0:
- rbd/test_librbd_python.sh
- print: '**** done rbd/test_librbd_python.sh 2-workload'
Updated by Dan Mick almost 9 years ago
- Status changed from Need More Info to Resolved
I suspect this is resolved by Zack's changes to be more flexible interpreting the dpkg -l states; if it pops up again we can reopen
Actions