Project

General

Profile

Bug #9729

"LibRadosMisc.Operate1PP" test failed in upgrade:dumpling-firefly-x:parallel-giant-distro-basic-vps run

Added by Yuri Weinstein over 9 years ago. Updated over 9 years ago.

Status:
Resolved
Priority:
Normal
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-10-10_08:19:51-upgrade:dumpling-firefly-x:parallel-giant-distro-basic-vps/536903/

2014-10-10T08:39:57.240 INFO:tasks.workunit.client.0.vpm156.stdout:[  FAILED  ] LibRadosMisc.Operate1PP (2344 ms)
2014-10-10T08:39:57.240 INFO:tasks.workunit.client.0.vpm156.stdout:[ RUN      ] LibRadosMisc.Operate2PP
2014-10-10T08:40:00.408 INFO:tasks.workunit.client.0.vpm156.stdout:[       OK ] LibRadosMisc.Operate2PP (3168 ms)
2014-10-10T08:40:00.408 INFO:tasks.workunit.client.0.vpm156.stdout:[ RUN      ] LibRadosMisc.BigObjectPP
2014-10-10T08:40:03.523 INFO:tasks.workunit.client.0.vpm156.stdout:[       OK ] LibRadosMisc.BigObjectPP (3115 ms)
2014-10-10T08:40:03.523 INFO:tasks.workunit.client.0.vpm156.stdout:[ RUN      ] LibRadosMisc.AioOperatePP
2014-10-10T08:40:06.631 INFO:tasks.workunit.client.0.vpm156.stdout:[       OK ] LibRadosMisc.AioOperatePP (3109 ms)
2014-10-10T08:40:06.632 INFO:tasks.workunit.client.0.vpm156.stdout:[ RUN      ] LibRadosMisc.CloneRangePP
2014-10-10T08:40:09.748 INFO:tasks.workunit.client.0.vpm156.stdout:[       OK ] LibRadosMisc.CloneRangePP (3116 ms)
2014-10-10T08:40:09.748 INFO:tasks.workunit.client.0.vpm156.stdout:[ RUN      ] LibRadosMisc.CloneRange
2014-10-10T08:40:12.883 INFO:tasks.workunit.client.0.vpm156.stdout:[       OK ] LibRadosMisc.CloneRange (3135 ms)
2014-10-10T08:40:12.884 INFO:tasks.workunit.client.0.vpm156.stdout:[ RUN      ] LibRadosMisc.AssertExistsPP
2014-10-10T08:40:16.090 INFO:tasks.workunit.client.0.vpm156.stdout:[       OK ] LibRadosMisc.AssertExistsPP (3207 ms)
2014-10-10T08:40:16.091 INFO:tasks.workunit.client.0.vpm156.stdout:[ RUN      ] LibRadosMisc.BigAttrPP
2014-10-10T08:40:18.201 INFO:tasks.workunit.client.0.vpm156.stdout:osd_max_attr_size == 0; skipping test
2014-10-10T08:40:27.564 INFO:tasks.workunit.client.0.vpm156.stdout:[       OK ] LibRadosMisc.BigAttrPP (11473 ms)
2014-10-10T08:40:27.564 INFO:tasks.workunit.client.0.vpm156.stdout:[----------] 16 tests from LibRadosMisc (50673 ms total)
2014-10-10T08:40:27.564 INFO:tasks.workunit.client.0.vpm156.stdout:
2014-10-10T08:40:27.564 INFO:tasks.workunit.client.0.vpm156.stdout:[----------] Global test environment tear-down
2014-10-10T08:40:27.565 INFO:tasks.workunit.client.0.vpm156.stdout:[==========] 16 tests from 1 test case ran. (50674 ms total)
2014-10-10T08:40:27.565 INFO:tasks.workunit.client.0.vpm156.stdout:[  PASSED  ] 15 tests.
2014-10-10T08:40:27.565 INFO:tasks.workunit.client.0.vpm156.stdout:[  FAILED  ] 1 test, listed below:
2014-10-10T08:40:27.566 INFO:tasks.workunit.client.0.vpm156.stdout:[  FAILED  ] LibRadosMisc.Operate1PP
2014-10-10T08:40:27.566 INFO:tasks.workunit.client.0.vpm156.stdout:
2014-10-10T08:40:27.566 INFO:tasks.workunit.client.0.vpm156.stdout: 1 FAILED TEST
archive_path: /var/lib/teuthworker/archive/teuthology-2014-10-10_08:19:51-upgrade:dumpling-firefly-x:parallel-giant-distro-basic-vps/536903
branch: giant
description: upgrade:dumpling-firefly-x:parallel/{0-cluster/start.yaml 1-dumpling-install/dumpling.yaml
  2-workload/{rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml}
  3-upgrade-sequence/upgrade-all.yaml 4-firefly-upgrade/firefly.yaml 5-workload/{rados_api.yaml
  rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 6-upgrade-sequence/upgrade-by-daemon.yaml
  7-final-workload/{ec-rados-plugin=jerasure-k=2-m=1.yaml ec-rados-plugin=jerasure-k=3-m=1.yaml
  rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml
  rbd_import_export.yaml rgw_s3tests.yaml rgw_swift.yaml} distros/ubuntu_12.04.yaml}
email: ceph-qa@ceph.com
job_id: '536903'
kernel: &id001
  kdb: true
  sha1: distro
last_in_suite: false
machine_type: vps
name: teuthology-2014-10-10_08:19:51-upgrade:dumpling-firefly-x:parallel-giant-distro-basic-vps
nuke-on-error: true
os_type: ubuntu
os_version: '12.04'
overrides:
  admin_socket:
    branch: giant
  ceph:
    conf:
      mon:
        debug mon: 20
        debug ms: 1
        debug paxos: 20
        mon warn on legacy crush tunables: false
      osd:
        debug filestore: 20
        debug journal: 20
        debug ms: 1
        debug osd: 20
    log-whitelist:
    - slow request
    - scrub mismatch
    - ScrubResult
    sha1: 75fc54bf9ee2afbfb8ade187edc6ca63768d6094
  ceph-deploy:
    branch:
      dev: giant
    conf:
      client:
        log file: /var/log/ceph/ceph-$name.$pid.log
      mon:
        debug mon: 1
        debug ms: 20
        debug paxos: 20
        osd default pool size: 2
  install:
    ceph:
      sha1: 75fc54bf9ee2afbfb8ade187edc6ca63768d6094
  s3tests:
    branch: giant
  workunit:
    sha1: 75fc54bf9ee2afbfb8ade187edc6ca63768d6094
owner: scheduled_teuthology@teuthology
priority: 1000
roles:
- - mon.a
  - mds.a
  - osd.0
  - osd.1
- - mon.b
  - mon.c
  - osd.2
  - osd.3
- - client.0
  - client.1
suite: upgrade:dumpling-firefly-x:parallel
suite_branch: fix_d-f-x_suite
suite_path: /var/lib/teuthworker/src/ceph-qa-suite_fix_d-f-x_suite
targets:
  ubuntu@vpm034.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCUxKgu1oSRwlfH2NxKtQS7wH8Yjml8aaldVmWfQyq7kDI37QO4jUHRtgmmDLrajTy4r7ZLNZcK5fvPG/XWXk9kRx4Maou80z/uGFjH+AUCOKZ4GckYpQvzBaGdqoUL6U5AzPSnZEizkmZyu0UZ0yYMJP/4iNXPQiyoYsmJRJIvPN0PPOF23orONWRk6hWZf4/9USXXC5ouAlKACcy4B+oSMEvs07SowjkqWAIVYmDy3n56p3t/shQNrLJHl2WMfQW++6spFWRVB+W2QWanv2V/PuPxXWZDpEYkswis7nnVrwh0otJdi0IyDE1XUIIOgNXM3AR4w7GLVgfr4OpXIAvD
  ubuntu@vpm079.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDtaFBepuzTHjpjLrrGOk8rN2gYkX3yj+nEWbshg2Ob8zEFKqZvaaNbk7FlzP3SP0NzAfTyOvFwvuZP41CqcG93RhI5Df/mwHG1CNCfm4AzLDO23CBzr9N3oYW8FBI+PnPxt7drh7gU8tcR9tLLqctAc4utYsLA3DNUjSLNVotACyJBL3WGXEib9hLavFL29+PQLoESYqFGZGEalzJhMuaVfCf6dVthzpHmTRKepJ0SG5llDTOc/7eMpj2uNQbrgi352jvEhjJXVxZat+/PlyWf3AsckhHzWx6aI1OJa0tOFsCbkOl43FVKkV1TLFCXVC09MobhJNF0GgbFiXfk/VNL
  ubuntu@vpm156.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDu5ZYY87Y2D9ZB9jalAq84jmcB/SL8fJod+xq9Q2lVhAHvherEoGN1nYBU928S1VfYcTrep83XPmkW/mWCQp/eGDGWGYW4I/i+qto9/OuU3xZTYROFdueOQRetca35IxU1r2pFfWXNRKRtheT6WrTtsOh6myzR9bwurdhqje3sAJq0Zg+ae+oopclniC2pSeJ55lNi2yHeDLhnm8LQL0XE1hDNGwN/3tALjYgLbb0IVjdNVQzBAkasUxK+puenYqJ2gSBzDSqjYQN9OW3Z21azxeR2OguvLZP8ZyrKEXyK/WyoOZGs+3xAzaypfWjNyKr9jdoH70Fwr7tQPnaEYJzl
tasks:
- internal.lock_machines:
  - 3
  - vps
- internal.save_config: null
- internal.check_lock: null
- internal.connect: null
- internal.push_inventory: null
- internal.serialize_remote_roles: null
- internal.check_conflict: null
- internal.check_ceph_data: null
- internal.vm_setup: null
- kernel: *id001
- internal.base: null
- internal.archive: null
- internal.coredump: null
- internal.sudo: null
- internal.syslog: null
- internal.timer: null
- chef: null
- clock.check: null
- install:
    branch: dumpling
- print: '**** done dumpling install'
- ceph:
    fs: xfs
- parallel:
  - workload
  - upgrade-sequence0
- print: '**** done parallel'
- parallel:
  - workload2
  - upgrade-sequence
- print: '**** done parallel'
- install.upgrade:
    client.0: null
- print: '**** done install.upgrade client.0 to the version from teuthology-suite
    arg'
- rados:
    clients:
    - client.0
    ec_pool: true
    erasure_code_profile:
      k: 2
      m: 1
      name: jerasure21profile
      plugin: jerasure
      ruleset-failure-domain: osd
      technique: reed_sol_van
    objects: 50
    op_weights:
      append: 100
      copy_from: 50
      delete: 50
      read: 100
      rmattr: 25
      rollback: 50
      setattr: 25
      snap_create: 50
      snap_remove: 50
      write: 0
    ops: 4000
- rados:
    clients:
    - client.0
    ec_pool: true
    erasure_code_profile:
      k: 3
      m: 1
      name: jerasure31profile
      plugin: jerasure
      ruleset-failure-domain: osd
      technique: reed_sol_van
    objects: 50
    op_weights:
      append: 100
      copy_from: 50
      delete: 50
      read: 100
      rmattr: 25
      rollback: 50
      setattr: 25
      snap_create: 50
      snap_remove: 50
      write: 0
    ops: 4000
- rados:
    clients:
    - client.1
    objects: 50
    op_weights:
      delete: 50
      read: 100
      rollback: 50
      snap_create: 50
      snap_remove: 50
      write: 100
    ops: 4000
- workunit:
    clients:
      client.1:
      - rados/load-gen-mix.sh
- sequential:
  - mon_thrash:
      revive_delay: 20
      thrash_delay: 1
  - workunit:
      clients:
        client.1:
        - rados/test.sh
  - print: '**** done rados/test.sh - 6-final-workload'
- workunit:
    clients:
      client.1:
      - cls/test_cls_rbd.sh
- workunit:
    clients:
      client.1:
      - rbd/import_export.sh
    env:
      RBD_CREATE_ARGS: --new-format
- rgw:
  - client.1
- s3tests:
    client.1:
      rgw_server: client.1
- swift:
    client.1:
      rgw_server: client.1
teuthology_branch: master
tube: vps
upgrade-sequence:
  sequential:
  - install.upgrade:
      mon.a: null
  - print: '**** done install.upgrade mon.a to the version from teuthology-suite arg'
  - ceph.restart:
      daemons:
      - mon.a
      wait-for-healthy: true
  - sleep:
      duration: 60
  - ceph.restart:
      daemons:
      - osd.0
      - osd.1
      wait-for-healthy: true
  - sleep:
      duration: 60
  - ceph.restart:
    - mds.a
  - sleep:
      duration: 60
  - print: '**** running mixed versions of osds and mons'
  - exec:
      mon.b:
      - ceph osd crush tunables firefly
  - install.upgrade:
      mon.b: null
  - print: '**** done install.upgrade mon.b to the version from teuthology-suite arg'
  - ceph.restart:
      daemons:
      - mon.b
      - mon.c
      wait-for-healthy: true
  - sleep:
      duration: 60
  - ceph.restart:
      daemons:
      - osd.2
      - osd.3
      wait-for-healthy: true
  - sleep:
      duration: 60
upgrade-sequence0:
  sequential:
  - install.upgrade:
      mon.a:
        branch: firefly
      mon.b:
        branch: firefly
  - print: '**** done install.upgrade firefly for mon.a and mon.b'
  - ceph.restart:
    - mon.a
    - mon.b
    - mon.c
    - mds.a
    - osd.0
    - osd.1
    - osd.2
    - osd.3
  - print: '**** done ceph.restart the cluster'
verbose: true
worker_log: /var/lib/teuthworker/archive/worker_logs/worker.vps.3069
workload:
  sequential:
  - workunit:
      branch: dumpling
      clients:
        client.0:
        - rados/test.sh
        - cls
  - print: '**** done rados/test.sh &  cls'
  - workunit:
      branch: dumpling
      clients:
        client.0:
        - rados/load-gen-big.sh
  - print: '**** done rados/load-gen-big.sh'
  - workunit:
      branch: dumpling
      clients:
        client.0:
        - rbd/test_librbd.sh
  - print: '**** done rbd/test_librbd.sh'
  - workunit:
      branch: dumpling
      clients:
        client.0:
        - rbd/test_librbd_python.sh
  - print: '**** done rbd/test_librbd_python.sh'
workload2:
  sequential:
  - workunit:
      branch: firefly
      clients:
        client.0:
        - rados/test.sh
        - cls
  - print: '**** done #rados/test.sh and cls 2'
  - workunit:
      branch: firefly
      clients:
        client.0:
        - rados/load-gen-big.sh
  - print: '**** done rados/load-gen-big.sh 2'
  - workunit:
      branch: firefly
      clients:
        client.0:
        - rbd/test_librbd.sh
  - print: '**** done rbd/test_librbd.sh 2'
  - workunit:
      branch: firefly
      clients:
        client.0:
        - rbd/test_librbd_python.sh
  - print: '**** done rbd/test_librbd_python.sh 2'
description: upgrade:dumpling-firefly-x:parallel/{0-cluster/start.yaml 1-dumpling-install/dumpling.yaml
  2-workload/{rados_api.yaml rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml}
  3-upgrade-sequence/upgrade-all.yaml 4-firefly-upgrade/firefly.yaml 5-workload/{rados_api.yaml
  rados_loadgenbig.yaml test_rbd_api.yaml test_rbd_python.yaml} 6-upgrade-sequence/upgrade-by-daemon.yaml
  7-final-workload/{ec-rados-plugin=jerasure-k=2-m=1.yaml ec-rados-plugin=jerasure-k=3-m=1.yaml
  rados-snaps-few-objects.yaml rados_loadgenmix.yaml rados_mon_thrash.yaml rbd_cls.yaml
  rbd_import_export.yaml rgw_s3tests.yaml rgw_swift.yaml} distros/ubuntu_12.04.yaml}
duration: 626.0009410381317
failure_reason: 'Command failed on vpm156 with status 1: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp
  && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
  CEPH_REF=dumpling TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage
  /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.0/rados/test.sh'''
flavor: basic
owner: scheduled_teuthology@teuthology
success: false

Associated revisions

Revision e45d0be1 (diff)
Added by Yuri Weinstein over 9 years ago

Fixes #9729, running incompatible tests while the cluster is mixed between firefly and dumpling
Changed to rados/test-upgrade-firefly.sh version

Signed-off-by: Yuri Weinstein <>

Revision cb186117 (diff)
Added by Yuri Weinstein over 9 years ago

Fixes #9729, running incompatible tests while the cluster is mixed between firefly and dumpling
Changed to rados/test-upgrade-firefly.sh version

Signed-off-by: Yuri Weinstein <>

History

#1 Updated by Yuri Weinstein over 9 years ago

  • Assignee set to David Zafman

David, is it related to some code you were working on? Pls take a look and reassigned if necessary.

#3 Updated by David Zafman over 9 years ago

  • Assignee changed from David Zafman to Yuri Weinstein

The corresponding line of code in master branch for test/librados/misc.cc was changed by Josh in Feb:
7a019b38 src/test/librados/misc.cc (Josh Durgin 2014-02-17 17:09:26 -0800 369) ASSERT_EQ(-ECANCELED, ioctx.operate("foo", &o2));

This failure has to do with the older line of code saying ASSERT_EQ(0, ioctx.operate("foo", &o2)); Also, the current code is at line 369 so we are clearly running older test code which has it at line 333.

#4 Updated by Yuri Weinstein over 9 years ago

  • Status changed from New to 7

Testing changes in https://github.com/ceph/ceph-qa-suite/pull/192

NOTE: this has to sync up with the test suite on master

#7 Updated by Yuri Weinstein over 9 years ago

  • Status changed from 7 to Fix Under Review

#8 Updated by Yuri Weinstein over 9 years ago

  • Status changed from Fix Under Review to Resolved

Also available in: Atom PDF