Actions
Bug #9018
closed"LibRadosTwoPoolsPP*" failed in upgrade:dumpling-x-firefly---basic-vps
Status:
Resolved
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:
0%
Source:
Q/A
Tags:
Backport:
Regression:
Severity:
2 - major
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
2014-08-05T10:36:23.565 INFO:teuthology.task.workunit.client.1.out:[10.214.138.115]: [ PASSED ] 32 tests.
2014-08-05T10:36:23.565 INFO:teuthology.task.workunit.client.1.out:[10.214.138.115]: [ FAILED ] 4 tests, listed below:
2014-08-05T10:36:23.565 INFO:teuthology.task.workunit.client.1.out:[10.214.138.115]: [ FAILED ] LibRadosTwoPoolsPP.HitSetRead
2014-08-05T10:36:23.565 INFO:teuthology.task.workunit.client.1.out:[10.214.138.115]: [ FAILED ] LibRadosTwoPoolsPP.HitSetWrite
2014-08-05T10:36:23.565 INFO:teuthology.task.workunit.client.1.out:[10.214.138.115]: [ FAILED ] LibRadosTwoPoolsPP.HitSetTrim
2014-08-05T10:36:23.565 INFO:teuthology.task.workunit.client.1.out:[10.214.138.115]: [ FAILED ] LibRadosTwoPoolsECPP.HitSetRead
2014-08-05T10:36:23.566 INFO:teuthology.task.workunit.client.1.out:[10.214.138.115]:
2014-08-05T10:36:23.566 INFO:teuthology.task.workunit.client.1.out:[10.214.138.115]: 4 FAILED TESTS
2014-08-05T10:36:23.567 INFO:teuthology.task.workunit:Stopping rados/test.sh on client.1...
2014-08-05T10:36:23.567 DEBUG:teuthology.orchestra.run:Running [10.214.138.115]: 'rm -rf -- /home/ubuntu/cephtest/workunits.list /home/ubuntu/cephtest/workunit.client.1'
2014-08-05T10:36:23.574 ERROR:teuthology.parallel:Exception in parallel execution
Traceback (most recent call last):
File "/home/teuthworker/src/teuthology_firefly/teuthology/parallel.py", line 82, in __exit__
for result in self:
File "/home/teuthworker/src/teuthology_firefly/teuthology/parallel.py", line 101, in next
resurrect_traceback(result)
File "/home/teuthworker/src/teuthology_firefly/teuthology/parallel.py", line 19, in capture_traceback
return func(*args, **kwargs)
File "/home/teuthworker/src/teuthology_firefly/teuthology/task/workunit.py", line 359, in _run_tests
args=args,
File "/home/teuthworker/src/teuthology_firefly/teuthology/orchestra/remote.py", line 106, in run
r = self._runner(client=self.ssh, **kwargs)
File "/home/teuthworker/src/teuthology_firefly/teuthology/orchestra/run.py", line 330, in run
r.exitstatus = _check_status(r.exitstatus)
File "/home/teuthworker/src/teuthology_firefly/teuthology/orchestra/run.py", line 326, in _check_status
raise CommandFailedError(command=r.command, exitstatus=status, node=host)
CommandFailedError: Command failed on 10.214.138.115 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b65cef678777c1b87d25385595bf0df96168703e TESTDIR="/home/ubuntu/cephtest" CEPH_ID="1" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.1/rados/test.sh'
2014-08-05T10:36:23.575 ERROR:teuthology.run_tasks:Saw exception from tasks.
archive_path: /var/lib/teuthworker/archive/teuthology-2014-08-05_09:22:33-upgrade:dumpling-x-firefly---basic-vps/400351
branch: firefly
description: upgrade:dumpling-x/parallel/{0-cluster/start.yaml 1-dumpling-install/cuttlefish-dumpling.yaml
2-workload/rados_api.yaml 3-upgrade-sequence/upgrade-all.yaml 4-final-upgrade/client.yaml
5-final-workload/rados_mon_thrash.yaml debian_7.0.yaml}
email: ceph-qa@ceph.com
job_id: '400351'
last_in_suite: false
machine_type: vps
name: teuthology-2014-08-05_09:22:33-upgrade:dumpling-x-firefly---basic-vps
nuke-on-error: true
os_type: debian
os_version: '7.0'
overrides:
admin_socket:
branch: firefly
ceph:
conf:
global:
osd heartbeat grace: 40
mon:
debug mon: 20
debug ms: 1
debug paxos: 20
mon warn on legacy crush tunables: false
osd:
debug filestore: 20
debug journal: 20
debug ms: 1
debug osd: 20
log-whitelist:
- slow request
- scrub mismatch
- ScrubResult
sha1: b65cef678777c1b87d25385595bf0df96168703e
ceph-deploy:
branch:
dev: firefly
conf:
client:
log file: /var/log/ceph/ceph-$name.$pid.log
mon:
debug mon: 1
debug ms: 20
debug paxos: 20
osd default pool size: 2
install:
ceph:
sha1: b65cef678777c1b87d25385595bf0df96168703e
s3tests:
branch: firefly
workunit:
sha1: b65cef678777c1b87d25385595bf0df96168703e
owner: scheduled_yuriw
priority: 1000
roles:
- - mon.a
- mds.a
- osd.0
- osd.1
- - mon.b
- mon.c
- osd.2
- osd.3
- - client.0
- client.1
suite: upgrade:dumpling-x
suite_branch: firefly
targets:
ubuntu@vpm045.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcs1s6eDRNESBgt1lfjQf7twJvGoNsbSOLwdckqnAfj48lQ6sJFBIam6GqllKxQ4HPmwkqwkw5LxN9mcdAWgq7i8Odp+NdMUiR7y+wxkfji98KDn557lacq95vgPfJzmDd1YAKsh6qMrAgUvVSNs7JF1xdWkJEPtSuYPICjRYlWt2gMBbiQEsY/26eapE+OTWSoDeIKJZXY6+llPgeZDTPjajkh8qlCSWy8OJ6Jb3MlV4vqhCLfbvCIzg0BUGL0Gd0sZxLv/oiIByhVXTnebGtABpQMuWbS5GW63BLksPJiR/RHIaSpvbzR7F1dw9DfyCM/nsCj8II36nuxJGA7xbX
ubuntu@vpm046.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvf8A2FDMNMyjrHDw+wY9PswMjoQQiiy26xDPosmOQ6VpKotAX8hCIXLJYnkLwPy0uNlxjRTkI/6A4kPNBCeqG80QVrPIkqhaUwHe76cFdf1RTl9dq6GyQkbATcrRPFBinFNArGeVeFzhyfCAE6FsHTBKTUabgU9wb8T5NVt6gqrCkP5v/EV8VVgTa+wq6FkMN5F9hYxce037/gN3Hc5GuvMbBe0CCCMoleqAavFeAo0aBLBbVVN1tdo4EVfQNiFsDLXma1vLGvSCt18OY3q2AxvLGUzFjI0SSoI1j+ZZpLcA71mW886eerUOxVbhUvOSgRD6YH3//HnTTC9Ikdign
ubuntu@vpm047.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpO50oPJhWGE3NvkPECbbc5sgJtai9o/aCDV1ssx8I2ricOobxh8I4zROXJ9TQter4h595puuuR1+gXRVdv24ajfdsYnF9z1OiXk2bVukwiswbWFPOV3dbbWmfVfUUItLHkGBl5rcjK8qbA5DSRj1uEueoqoAn0Q08hm+i8f+ASEqZT/yu810Ip3R42N6bdYz+KKI3prD41Gsv7ptS0mube6rmZN1giR2sFBW6Eht8Lj99weG7cKE4bhq4kHrD4uMUcA6u9+P3repslaWhFf2arTGlkgR0bK0Mj4YU8sgPOn5r08Ixzv9hAMNeXCzJmZdoZOmt8OrsqS1RoySKZ8Lj
tasks:
- internal.lock_machines:
- 3
- vps
- internal.save_config: null
- internal.check_lock: null
- internal.connect: null
- internal.serialize_remote_roles: null
- internal.check_conflict: null
- internal.check_ceph_data: null
- internal.vm_setup: null
- internal.base: null
- internal.archive: null
- internal.coredump: null
- internal.sudo: null
- internal.syslog: null
- internal.timer: null
- chef: null
- clock.check: null
- install:
branch: cuttlefish
- print: '**** done cuttlefish install'
- ceph:
fs: xfs
- print: '**** done ceph'
- install.upgrade:
all:
branch: dumpling
- ceph.restart: null
- parallel:
- workload
- upgrade-sequence
- print: '**** done parallel'
- install.upgrade:
client.0: null
- print: '**** done install.upgrade'
- mon_thrash:
revive_delay: 20
thrash_delay: 1
- workunit:
clients:
client.1:
- rados/test.sh
teuthology_branch: firefly
tube: vps
upgrade-sequence:
sequential:
- install.upgrade:
mon.a: null
mon.b: null
- ceph.restart:
- mon.a
- mon.b
- mon.c
- mds.a
- osd.0
- osd.1
- osd.2
- osd.3
verbose: true
worker_log: /var/lib/teuthworker/archive/worker_logs/worker.vps.8741
workload:
sequential:
- workunit:
branch: dumpling
clients:
client.0:
- rados/test-upgrade-firefly.sh
- cls
description: upgrade:dumpling-x/parallel/{0-cluster/start.yaml 1-dumpling-install/cuttlefish-dumpling.yaml
2-workload/rados_api.yaml 3-upgrade-sequence/upgrade-all.yaml 4-final-upgrade/client.yaml
5-final-workload/rados_mon_thrash.yaml debian_7.0.yaml}
duration: 2657.217125892639
failure_reason: 'Command failed on 10.214.138.115 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp
&& cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
CEPH_REF=b65cef678777c1b87d25385595bf0df96168703e TESTDIR="/home/ubuntu/cephtest"
CEPH_ID="1" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage
timeout 3h /home/ubuntu/cephtest/workunit.client.1/rados/test.sh'''
flavor: basic
owner: scheduled_yuriw
success: false
Actions