Project

General

Profile

Actions

Bug #9065

closed

LibRados* tests failed in upgrade:dumpling-x-firefly---basic-vps

Added by Yuri Weinstein over 9 years ago. Updated over 9 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

This should be fixed by https://github.com/ceph/ceph/pull/2236 (in review)

Logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-08-10_15:13:02-upgrade:dumpling-x-firefly---basic-vps/413968/

014-08-10T16:16:57.284 INFO:tasks.workunit.client.1.vpm112.stdout:[==========] 36 tests from 4 test cases ran. (561343 ms total)
2014-08-10T16:16:57.284 INFO:tasks.workunit.client.1.vpm112.stdout:[  PASSED  ] 32 tests.
2014-08-10T16:16:57.284 INFO:tasks.workunit.client.1.vpm112.stdout:[  FAILED  ] 4 tests, listed below:
2014-08-10T16:16:57.285 INFO:tasks.workunit.client.1.vpm112.stdout:[  FAILED  ] LibRadosTwoPoolsPP.HitSetRead
2014-08-10T16:16:57.285 INFO:tasks.workunit.client.1.vpm112.stdout:[  FAILED  ] LibRadosTwoPoolsPP.HitSetWrite
2014-08-10T16:16:57.285 INFO:tasks.workunit.client.1.vpm112.stdout:[  FAILED  ] LibRadosTwoPoolsPP.HitSetTrim
2014-08-10T16:16:57.286 INFO:tasks.workunit.client.1.vpm112.stdout:[  FAILED  ] LibRadosTwoPoolsECPP.HitSetRead
2014-08-10T16:16:57.286 INFO:tasks.workunit.client.1.vpm112.stdout:
2014-08-10T16:16:57.286 INFO:tasks.workunit.client.1.vpm112.stdout: 4 FAILED TESTS
2014-08-10T16:16:57.288 INFO:tasks.workunit:Stopping rados/test.sh on client.1...
2014-08-10T16:16:57.289 INFO:teuthology.orchestra.run.vpm112:Running: 'rm -rf -- /home/ubuntu/cephtest/workunits.list /home/ubuntu/cephtest/workunit.client.1'
2014-08-10T16:16:57.338 ERROR:teuthology.parallel:Exception in parallel execution
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 82, in __exit__
    for result in self:
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 101, in next
    resurrect_traceback(result)
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 19, in capture_traceback
    return func(*args, **kwargs)
  File "/var/lib/teuthworker/src/ceph-qa-suite_firefly/tasks/workunit.py", line 359, in _run_tests
    args=args,
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 114, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 401, in run
    r.wait()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 102, in wait
    exitstatus=status, node=self.hostname)
CommandFailedError: Command failed on vpm112 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=e087862d5bd894572a6c223b45f4275cadd4b480 TESTDIR="/home/ubuntu/cephtest" CEPH_ID="1" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.1/rados/test.sh'
2014-08-10T16:16:57.376 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
archive_path: /var/lib/teuthworker/archive/teuthology-2014-08-10_15:13:02-upgrade:dumpling-x-firefly---basic-vps/413968
branch: firefly
description: upgrade:dumpling-x/parallel/{0-cluster/start.yaml 1-dumpling-install/cuttlefish-dumpling.yaml
  2-workload/rados_api.yaml 3-upgrade-sequence/upgrade-all.yaml 4-final-upgrade/client.yaml
  5-final-workload/rados_mon_thrash.yaml distros/ubuntu_12.04.yaml}
email: ceph-qa@ceph.com
job_id: '413968'
last_in_suite: false
machine_type: vps
name: teuthology-2014-08-10_15:13:02-upgrade:dumpling-x-firefly---basic-vps
nuke-on-error: true
os_type: ubuntu
os_version: '12.04'
overrides:
  admin_socket:
    branch: firefly
  ceph:
    conf:
      global:
        osd heartbeat grace: 40
      mon:
        debug mon: 20
        debug ms: 1
        debug paxos: 20
        mon warn on legacy crush tunables: false
      osd:
        debug filestore: 20
        debug journal: 20
        debug ms: 1
        debug osd: 20
    log-whitelist:
    - slow request
    - scrub mismatch
    - ScrubResult
    sha1: e087862d5bd894572a6c223b45f4275cadd4b480
  ceph-deploy:
    branch:
      dev: firefly
    conf:
      client:
        log file: /var/log/ceph/ceph-$name.$pid.log
      mon:
        debug mon: 1
        debug ms: 20
        debug paxos: 20
        osd default pool size: 2
  install:
    ceph:
      sha1: e087862d5bd894572a6c223b45f4275cadd4b480
  s3tests:
    branch: firefly
  workunit:
    sha1: e087862d5bd894572a6c223b45f4275cadd4b480
owner: scheduled_teuthology@teuthology
priority: 1000
roles:
- - mon.a
  - mds.a
  - osd.0
  - osd.1
- - mon.b
  - mon.c
  - osd.2
  - osd.3
- - client.0
  - client.1
suite: upgrade:dumpling-x
suite_branch: firefly
suite_path: /var/lib/teuthworker/src/ceph-qa-suite_firefly
targets:
  ubuntu@vpm112.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDq4amQdQ7GzIjaysQSx7EBOjEJex+9CgqT9t+Pd+sVD6XZbMlbq4yQl0tGuW2KDASw702pmPH9wYJ8NoVgmMsE1ZuhHAMA//lf3sVvSqg7ct+BYHjTCvywIyn07edNbPQGp9T5JwjIVmTK3d5g9QGSiJSBYf9KXiWmheFPl7kNyCXBt4WCd/1jcnruKrKWxGJ1aWOgSvrxuqgoT5YS4kHXz4tRN2C44t6+vtP6Dairjdt+2Nw0dmlPEkzlhLI3tIzvwC0DlRSU1z+PRYUEaWfMkDxJdeGr4WFmH8T+x9airKbu3jVLOqLql5ERh97O+aSdNBVDPIQVACV0DVSvN75x
  ubuntu@vpm143.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDWPyeJeAC5RZEmrtRYplOCJqsJPQkGXwaqaDkAqllP8BcpbmJFVCSSCXegtzU1LahWiLusu+4qAQ3q9t0IR6iDkhru1i2VsQlDRUeJVPlaDLzmno1f/alAIc9o1Lu7b5lKau5KyGvehXTYc34+3R5ry6enJNavzFWSvyoHo9R483mdYBS1dYqNt+5M3/qgp4kJnJhqp5fwr+0rsePBtaLPSlTO4lU0o6sJzbRP3FIXHIvp9iryefzKh8VNOoLgh8i9iUxGvi0VlVr0UH7vKK5JGvyPhTu4E9x6AcJeia7W4t6zvaJ5Z1N8urF40mvqk+5otLLfgOWuvClefXQ3UD8v
  ubuntu@vpm144.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEm/zJbNTvxGcCJq1BFgmbcjwePOoh2OaLVBqHLT1IdiLxb7nReuAIG5SfDTGoaq7PSXJ+1cHL8bUytpiCrM8WYHaMQessQ0Sc5A1MDD109qEodo+Y25Or8Pj69OSxhp4LVhoIdwFlttekMSaX4g9xKaKJKuTl2IIsW4gRKB/3zfvcuLC52qiCyCyFkFnzYPUvn3X3Ju+KI9TUDE+u8wtJ04ga/UdM9N020HeZEYjezTeAFlX0cR1ixISgZnwqn0DI9PdPTiA7QlSx8JHbuqzFn6yQdS+UZmglR1hBZN9ZFc6BXBqKFyjd7LYsOr2z3NFUhBZ9T6WKOMJmyhNcPotb
tasks:
- internal.lock_machines:
  - 3
  - vps
- internal.save_config: null
- internal.check_lock: null
- internal.connect: null
- internal.serialize_remote_roles: null
- internal.check_conflict: null
- internal.check_ceph_data: null
- internal.vm_setup: null
- internal.base: null
- internal.archive: null
- internal.coredump: null
- internal.sudo: null
- internal.syslog: null
- internal.timer: null
- chef: null
- clock.check: null
- install:
    branch: cuttlefish
- print: '**** done cuttlefish install'
- ceph:
    fs: xfs
- print: '**** done ceph'
- install.upgrade:
    all:
      branch: dumpling
- ceph.restart: null
- parallel:
  - workload
  - upgrade-sequence
- print: '**** done parallel'
- install.upgrade:
    client.0: null
- print: '**** done install.upgrade'
- mon_thrash:
    revive_delay: 20
    thrash_delay: 1
- workunit:
    clients:
      client.1:
      - rados/test.sh
teuthology_branch: master
tube: vps
upgrade-sequence:
  sequential:
  - install.upgrade:
      mon.a: null
      mon.b: null
  - ceph.restart:
    - mon.a
    - mon.b
    - mon.c
    - mds.a
    - osd.0
    - osd.1
    - osd.2
    - osd.3
verbose: true
worker_log: /var/lib/teuthworker/archive/worker_logs/worker.vps.19964
workload:
  sequential:
  - workunit:
      branch: dumpling
      clients:
        client.0:
        - rados/test-upgrade-firefly.sh
        - cls
description: upgrade:dumpling-x/parallel/{0-cluster/start.yaml 1-dumpling-install/cuttlefish-dumpling.yaml
  2-workload/rados_api.yaml 3-upgrade-sequence/upgrade-all.yaml 4-final-upgrade/client.yaml
  5-final-workload/rados_mon_thrash.yaml distros/ubuntu_12.04.yaml}
duration: 2919.765758037567
failure_reason: 'Command failed on vpm112 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp
  && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
  CEPH_REF=e087862d5bd894572a6c223b45f4275cadd4b480 TESTDIR="/home/ubuntu/cephtest" 
  CEPH_ID="1" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage
  timeout 3h /home/ubuntu/cephtest/workunit.client.1/rados/test.sh'''
flavor: basic
owner: scheduled_teuthology@teuthology
success: false
Actions #1

Updated by Sage Weil over 9 years ago

  • Status changed from New to Resolved
Actions

Also available in: Atom PDF