Bug #9642: Errors in test_rbd.test_* tests in upgrade:dumpling-firefly-x:parallel-giant-distro-basic-multi run - rbd - Ceph

Actions

Copy link

Bug #9642

closed

Errors in test_rbd.test_* tests in upgrade:dumpling-firefly-x:parallel-giant-distro-basic-multi run

Added by Yuri Weinstein over 9 years ago. Updated over 9 years ago.

Status:

Resolved

Priority:

Urgent

Assignee:

Yuri Weinstein

Target version:

% Done:

Source:

Q/A

Tags:

Backport:

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

Logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-10-01_15:06:04-upgrade:dumpling-firefly-x:parallel-giant-distro-basic-multi/524210/

2014-10-02T00:16:33.706 INFO:tasks.workunit.client.0.plana58.stderr:test_rbd.test_create_defaults ... FAIL
2014-10-02T00:16:33.742 INFO:tasks.workunit.client.0.plana58.stderr:test_rbd.test_context_manager ... ERROR
2014-10-02T00:16:33.778 INFO:tasks.workunit.client.0.plana58.stderr:test_rbd.test_open_read_only ... ERROR
2014-10-02T00:16:41.621 INFO:tasks.workunit.client.0.plana58.stderr:test_rbd.test_open_dne ... ok
2014-10-02T00:16:44.128 INFO:tasks.workunit.client.0.plana58.stderr:test_rbd.test_open_readonly_dne ... ok
2014-10-02T00:16:44.263 INFO:tasks.workunit.client.0.plana58.stderr:test_rbd.test_remove_dne ... FAIL
2014-10-02T00:16:44.274 INFO:tasks.workunit.client.0.plana58.stderr:test_rbd.test_list_empty ... ok
2014-10-02T00:16:44.395 INFO:tasks.workunit.client.0.plana58.stderr:test_rbd.test_list ... ok
2014-10-02T00:16:44.672 INFO:tasks.workunit.client.0.plana58.stderr:test_rbd.test_rename ... ok
2014-10-02T00:16:44.677 INFO:tasks.workunit.client.0.plana58.stderr:
2014-10-02T00:16:44.677 INFO:tasks.workunit.client.0.plana58.stderr:======================================================================
2014-10-02T00:16:44.677 INFO:tasks.workunit.client.0.plana58.stderr:ERROR: test_rbd.test_context_manager
2014-10-02T00:16:44.677 INFO:tasks.workunit.client.0.plana58.stderr:----------------------------------------------------------------------
2014-10-02T00:16:44.677 INFO:tasks.workunit.client.0.plana58.stderr:Traceback (most recent call last):
2014-10-02T00:16:44.678 INFO:tasks.workunit.client.0.plana58.stderr:  File "/usr/lib/python2.7/dist-packages/nose/case.py", line 197, in runTest
2014-10-02T00:16:44.678 INFO:tasks.workunit.client.0.plana58.stderr:    self.test(*self.arg)
2014-10-02T00:16:44.678 INFO:tasks.workunit.client.0.plana58.stderr:  File "/home/ubuntu/cephtest/mnt.0/client.0/tmp/test_rbd.py", line 160, in test_context_manager
2014-10-02T00:16:44.678 INFO:tasks.workunit.client.0.plana58.stderr:    RBD().create(ioctx, IMG_NAME, IMG_SIZE)
2014-10-02T00:16:44.678 INFO:tasks.workunit.client.0.plana58.stderr:  File "/usr/lib/python2.7/dist-packages/rbd.py", line 219, in create
2014-10-02T00:16:44.678 INFO:tasks.workunit.client.0.plana58.stderr:    raise make_ex(ret, 'error creating image')
2014-10-02T00:16:44.678 INFO:tasks.workunit.client.0.plana58.stderr:ImageExists: error creating image
2014-10-02T00:16:44.678 INFO:tasks.workunit.client.0.plana58.stderr:
2014-10-02T00:16:44.679 INFO:tasks.workunit.client.0.plana58.stderr:======================================================================
2014-10-02T00:16:44.679 INFO:tasks.workunit.client.0.plana58.stderr:ERROR: test_rbd.test_open_read_only
2014-10-02T00:16:44.679 INFO:tasks.workunit.client.0.plana58.stderr:----------------------------------------------------------------------
2014-10-02T00:16:44.679 INFO:tasks.workunit.client.0.plana58.stderr:Traceback (most recent call last):
2014-10-02T00:16:44.679 INFO:tasks.workunit.client.0.plana58.stderr:  File "/usr/lib/python2.7/dist-packages/nose/case.py", line 197, in runTest
2014-10-02T00:16:44.679 INFO:tasks.workunit.client.0.plana58.stderr:    self.test(*self.arg)
2014-10-02T00:16:44.680 INFO:tasks.workunit.client.0.plana58.stderr:  File "/home/ubuntu/cephtest/mnt.0/client.0/tmp/test_rbd.py", line 171, in test_open_read_only
2014-10-02T00:16:44.680 INFO:tasks.workunit.client.0.plana58.stderr:    RBD().create(ioctx, IMG_NAME, IMG_SIZE)
2014-10-02T00:16:44.680 INFO:tasks.workunit.client.0.plana58.stderr:  File "/usr/lib/python2.7/dist-packages/rbd.py", line 219, in create
2014-10-02T00:16:44.680 INFO:tasks.workunit.client.0.plana58.stderr:    raise make_ex(ret, 'error creating image')
2014-10-02T00:16:44.680 INFO:tasks.workunit.client.0.plana58.stderr:ImageExists: error creating image
2014-10-02T00:16:44.680 INFO:tasks.workunit.client.0.plana58.stderr:
2014-10-02T00:16:44.680 INFO:tasks.workunit.client.0.plana58.stderr:======================================================================
2014-10-02T00:16:44.681 INFO:tasks.workunit.client.0.plana58.stderr:FAIL: test_rbd.test_create_defaults
2014-10-02T00:16:44.681 INFO:tasks.workunit.client.0.plana58.stderr:----------------------------------------------------------------------
2014-10-02T00:16:44.681 INFO:tasks.workunit.client.0.plana58.stderr:Traceback (most recent call last):
2014-10-02T00:16:44.681 INFO:tasks.workunit.client.0.plana58.stderr:  File "/usr/lib/python2.7/dist-packages/nose/case.py", line 197, in runTest
2014-10-02T00:16:44.681 INFO:tasks.workunit.client.0.plana58.stderr:    self.test(*self.arg)
2014-10-02T00:16:44.681 INFO:tasks.workunit.client.0.plana58.stderr:  File "/home/ubuntu/cephtest/mnt.0/client.0/tmp/test_rbd.py", line 149, in test_create_defaults
2014-10-02T00:16:44.681 INFO:tasks.workunit.client.0.plana58.stderr:    check_default_params(2, 20, RBD_FEATURE_STRIPINGV2, exception=InvalidArgument)
2014-10-02T00:16:44.681 INFO:tasks.workunit.client.0.plana58.stderr:  File "/home/ubuntu/cephtest/mnt.0/client.0/tmp/test_rbd.py", line 119, in check_default_params
2014-10-02T00:16:44.682 INFO:tasks.workunit.client.0.plana58.stderr:    assert_raises(exception, RBD().create, ioctx, IMG_NAME, IMG_SIZE)
2014-10-02T00:16:44.682 INFO:tasks.workunit.client.0.plana58.stderr:AssertionError: InvalidArgument not raised
2014-10-02T00:16:44.682 INFO:tasks.workunit.client.0.plana58.stderr:
2014-10-02T00:16:44.682 INFO:tasks.workunit.client.0.plana58.stderr:======================================================================
2014-10-02T00:16:44.682 INFO:tasks.workunit.client.0.plana58.stderr:FAIL: test_rbd.test_remove_dne
2014-10-02T00:16:44.682 INFO:tasks.workunit.client.0.plana58.stderr:----------------------------------------------------------------------
2014-10-02T00:16:44.682 INFO:tasks.workunit.client.0.plana58.stderr:Traceback (most recent call last):
2014-10-02T00:16:44.683 INFO:tasks.workunit.client.0.plana58.stderr:  File "/usr/lib/python2.7/dist-packages/nose/case.py", line 197, in runTest
2014-10-02T00:16:44.683 INFO:tasks.workunit.client.0.plana58.stderr:    self.test(*self.arg)
2014-10-02T00:16:44.683 INFO:tasks.workunit.client.0.plana58.stderr:  File "/home/ubuntu/cephtest/mnt.0/client.0/tmp/test_rbd.py", line 203, in test_remove_dne
2014-10-02T00:16:44.683 INFO:tasks.workunit.client.0.plana58.stderr:    assert_raises(ImageNotFound, remove_image)
2014-10-02T00:16:44.683 INFO:tasks.workunit.client.0.plana58.stderr:AssertionError: ImageNotFound not raised
2014-10-02T00:16:44.683 INFO:tasks.workunit.client.0.plana58.stderr:
2014-10-02T00:16:44.683 INFO:tasks.workunit.client.0.plana58.stderr:----------------------------------------------------------------------
2014-10-02T00:16:44.683 INFO:tasks.workunit.client.0.plana58.stderr:Ran 57 tests in 613.347s
2014-10-02T00:16:44.684 INFO:tasks.workunit.client.0.plana58.stderr:
2014-10-02T00:16:44.684 INFO:tasks.workunit.client.0.plana58.stderr:FAILED (SKIP=16, errors=2, failures=2)

archive_path: /var/lib/teuthworker/archive/teuthology-2014-10-01_15:06:04-upgrade:dumpling-firefly-x:parallel-giant-distro-basic-multi/524210
branch: giant
description: upgrade:dumpling-firefly-x:parallel/{0-cluster/start.yaml 1-dumpling-install/dumpling.yaml
  2-workload/{rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml}
  3-firefly-upgrade/firefly.yaml 4-workload/{rados_api.yaml rados_loadgenbig.yaml
  test_rbd_api.yaml test_rbd_python.yaml} 5-upgrade-sequence/upgrade-by-daemon.yaml
  6-final-workload/{ec-rados-plugin=jerasure-k=2-m=1.yaml ec-rados-plugin=jerasure-k=3-m=1.yaml
  rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml
  rbd_import_export.yaml rgw_s3tests.yaml rgw_swift.yaml} distros/ubuntu_12.04.yaml}
email: ceph-qa@ceph.com
job_id: '524210'
kernel: &id001
  kdb: true
  sha1: distro
last_in_suite: false
machine_type: plana,burnupi,mira
name: teuthology-2014-10-01_15:06:04-upgrade:dumpling-firefly-x:parallel-giant-distro-basic-multi
nuke-on-error: true
os_type: ubuntu
os_version: '12.04'
overrides:
  admin_socket:
    branch: giant
  ceph:
    conf:
      mon:
        debug mon: 20
        debug ms: 1
        debug paxos: 20
        mon warn on legacy crush tunables: false
      osd:
        debug filestore: 20
        debug journal: 20
        debug ms: 1
        debug osd: 20
    log-whitelist:
    - slow request
    - scrub mismatch
    - ScrubResult
    sha1: b1ca1f23ff47857a27f6196c5a050f83f3acc9fc
  ceph-deploy:
    branch:
      dev: giant
    conf:
      client:
        log file: /var/log/ceph/ceph-$name.$pid.log
      mon:
        debug mon: 1
        debug ms: 20
        debug paxos: 20
        osd default pool size: 2
  install:
    ceph:
      sha1: b1ca1f23ff47857a27f6196c5a050f83f3acc9fc
  s3tests:
    branch: giant
  workunit:
    sha1: b1ca1f23ff47857a27f6196c5a050f83f3acc9fc
owner: scheduled_teuthology@teuthology
priority: 100
roles:
- - mon.a
  - mds.a
  - osd.0
  - osd.1
- - mon.b
  - mon.c
  - osd.2
  - osd.3
- - client.0
  - client.1
suite: upgrade:dumpling-firefly-x:parallel
suite_branch: master
suite_path: /var/lib/teuthworker/src/ceph-qa-suite_master
targets:
  ubuntu@plana41.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC8wmSjYkK3No1H5yQZL9Yzl3M1nVtiLgScELyN3Duk71HaLRP8wr+Nq98Ylp8N3fK9oSdEtH5I92dEg9MhrEf+FAxyFDIffqpTSdokcJxMrlugALgz2/1OgONIpg15wHQXByJRE1gsecauIJmz+NcucGmfZubWex+/PsyDsDq6o26iXTvl7Bf/cEZ/ya5k7YNXF5LFx/ekcMkeF1bWHqk4eyQgJLAYPCewBhAZ2EQxBSUQoUJQtokXhe873yiS+Wtzuoo/Z8CX4tzrn+PdK56czySdw9lBTQIAB5V3bX+4aTTTpv9QfvgHKy/5frd9k2Y/LBSn2NIq7jutToRx1qGl
  ubuntu@plana58.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQingRKteHV641XBd2nFr9XehgercdQI5pXSigO0VqKUckA8HyCNOy62K6W+l3eGGF0A54M3YJGULd+cWNH2YeA4uK/O2VDLYsBbLKL5/2tX0WPp0a2BTRwHBWz+mTNBKJfB4YFb/27SoZKLHp9bij1LQW6tjDGkRCUoJUJ1hkOcVpmYVMH7XZXT/t55aYHoOCl7iyXEjOpB30XhpIzsYLISumDssk/hbVR03L5kiw9YKqA9Rr16sTN+ooTowRql5ktZU0lqCzxyRKs0mVv/rq5yorx91ZU6XUXvR63LfX/1sLwv5u/G2ix5BPd4ZlP5TevfABdUYB2hkwQNv5qe7D
  ubuntu@plana76.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDAO50YLaaEdpWepsvlLyKZjoOax0fdJdrAxCZVljnrvlQKCUfEjn2BwKnOiQ0MLKld7YHI5D36GOhMfcW+1y69XEWmQd0YGzWWlwoauYtmGaWlbSc58llpAebrD3QtWfJ/QP4NcDEZNUNcnFeC0kVp8sja8py/6lQNSnCTnRScrfCBLY01TEaCLcZqH26Qc2O3olKqnA0bnpMe76EUZsYEJ62kVtarNadILYCLHqC/eMsOy1KBzXg88nlquHx6ot/pniGrb3oP+drmbs8RXrlN9f6cu2Obu0MzlazKtxKnZkVoa0rJqpANF1VC3PFNc9wgxJKSSBJbMQ3Npe1tv1il
tasks:
- internal.lock_machines:
  - 3
  - plana,burnupi,mira
- internal.save_config: null
- internal.check_lock: null
- internal.connect: null
- internal.push_inventory: null
- internal.serialize_remote_roles: null
- internal.check_conflict: null
- internal.check_ceph_data: null
- internal.vm_setup: null
- kernel: *id001
- internal.base: null
- internal.archive: null
- internal.coredump: null
- internal.sudo: null
- internal.syslog: null
- internal.timer: null
- chef: null
- clock.check: null
- install:
    branch: dumpling
- print: '**** done dumpling install'
- ceph:
    fs: xfs
- parallel:
  - workload
- print: '**** done parallel'
- install.upgrade:
    client.0:
      branch: firefly
    mon.a:
      branch: firefly
    mon.b:
      branch: firefly
- print: '**** done install.upgrade'
- ceph.restart: null
- print: '**** done restart'
- parallel:
  - workload2
  - upgrade-sequence
- print: '**** done parallel'
- install.upgrade:
    client.0: null
- print: '**** done install.upgrade client.0 to the version from teuthology-suite
    arg'
- rados:
    clients:
    - client.0
    ec_pool: true
    erasure_code_profile:
      k: 2
      m: 1
      name: jerasure21profile
      plugin: jerasure
      ruleset-failure-domain: osd
      technique: reed_sol_van
    objects: 50
    op_weights:
      append: 100
      copy_from: 50
      delete: 50
      read: 100
      rmattr: 25
      rollback: 50
      setattr: 25
      snap_create: 50
      snap_remove: 50
      write: 0
    ops: 4000
- rados:
    clients:
    - client.0
    ec_pool: true
    erasure_code_profile:
      k: 3
      m: 1
      name: jerasure31profile
      plugin: jerasure
      ruleset-failure-domain: osd
      technique: reed_sol_van
    objects: 50
    op_weights:
      append: 100
      copy_from: 50
      delete: 50
      read: 100
      rmattr: 25
      rollback: 50
      setattr: 25
      snap_create: 50
      snap_remove: 50
      write: 0
    ops: 4000
- rados:
    clients:
    - client.1
    objects: 50
    op_weights:
      delete: 50
      read: 100
      rollback: 50
      snap_create: 50
      snap_remove: 50
      write: 100
    ops: 4000
- workunit:
    clients:
      client.1:
      - rados/load-gen-mix.sh
- sequential:
  - mon_thrash:
      revive_delay: 20
      thrash_delay: 1
  - workunit:
      clients:
        client.1:
        - rados/test.sh
  - print: '**** done rados/test.sh - 6-final-workload'
- workunit:
    clients:
      client.1:
      - cls/test_cls_rbd.sh
- workunit:
    clients:
      client.1:
      - rbd/import_export.sh
    env:
      RBD_CREATE_ARGS: --new-format
- rgw:
  - client.1
- s3tests:
    client.1:
      rgw_server: client.1
- swift:
    client.1:
      rgw_server: client.1
teuthology_branch: master
tube: multi
upgrade-sequence:
  sequential:
  - install.upgrade:
      mon.a: null
  - print: '**** done install.upgrade mon.a to the version from teuthology-suite arg'
  - ceph.restart:
      daemons:
      - mon.a
      wait-for-healthy: true
  - sleep:
      duration: 60
  - ceph.restart:
      daemons:
      - osd.0
      - osd.1
      wait-for-healthy: true
  - sleep:
      duration: 60
  - ceph.restart:
    - mds.a
  - sleep:
      duration: 60
  - print: '**** running mixed versions of osds and mons'
  - exec:
      mon.b:
      - ceph osd crush tunables firefly
  - install.upgrade:
      mon.b: null
  - print: '**** done install.upgrade mon.b to the version from teuthology-suite arg'
  - ceph.restart:
      daemons:
      - mon.b
      - mon.c
      wait-for-healthy: true
  - sleep:
      duration: 60
  - ceph.restart:
      daemons:
      - osd.2
      - osd.3
      wait-for-healthy: true
  - sleep:
      duration: 60
  - install.upgrade:
      client.0: null
  - print: '*** client.0 upgraded'
verbose: true
worker_log: /var/lib/teuthworker/archive/worker_logs/worker.multi.3173
workload:
  sequential:
  - workunit:
      branch: dumpling
      clients:
        client.0:
        - rados/test.sh
        - cls
  - print: '**** done rados/test.sh &  cls'
  - workunit:
      branch: dumpling
      clients:
        client.0:
        - rados/load-gen-big.sh
  - print: '**** done rados/load-gen-big.sh'
  - workunit:
      branch: dumpling
      clients:
        client.0:
        - rbd/test_librbd.sh
  - print: '**** done rbd/test_librbd.sh'
  - workunit:
      branch: dumpling
      clients:
        client.0:
        - rbd/test_librbd_python.sh
  - print: '**** done rbd/test_librbd_python.sh'
workload2:
  sequential:
  - workunit:
      branch: firefly
      clients:
        client.0:
        - rados/test.sh
        - cls
  - print: '**** done #rados/test.sh and cls 2'
  - workunit:
      branch: firefly
      clients:
        client.0:
        - rados/load-gen-big.sh
  - print: '**** done rados/load-gen-big.sh 2'
  - workunit:
      branch: firefly
      clients:
        client.0:
        - rbd/test_librbd.sh
  - print: '**** done rbd/test_librbd.sh 2'
  - workunit:
      branch: firefly
      clients:
        client.0:
        - rbd/test_librbd_python.sh
  - print: '**** done rbd/test_librbd_python.sh 2'

description: upgrade:dumpling-firefly-x:parallel/{0-cluster/start.yaml 1-dumpling-install/dumpling.yaml
  2-workload/{rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml}
  3-firefly-upgrade/firefly.yaml 4-workload/{rados_api.yaml rados_loadgenbig.yaml
  test_rbd_api.yaml test_rbd_python.yaml} 5-upgrade-sequence/upgrade-by-daemon.yaml
  6-final-workload/{ec-rados-plugin=jerasure-k=2-m=1.yaml ec-rados-plugin=jerasure-k=3-m=1.yaml
  rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml
  rbd_import_export.yaml rgw_s3tests.yaml rgw_swift.yaml} distros/ubuntu_12.04.yaml}
duration: 6840.346349954605
failure_reason: 'Command failed on plana58 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp
  && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
  CEPH_REF=firefly TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage
  /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.0/rbd/test_librbd_python.sh'''
flavor: basic
owner: scheduled_teuthology@teuthology
success: false

Related issues 1 (0 open — 1 closed)