Project

General

Profile

Bug #9288

"Assertion `nlock == 0' failed" in upgrade:firefly-firefly-testing-basic-vps suite

Added by Yuri Weinstein over 9 years ago. Updated over 9 years ago.

Status:
Resolved
Priority:
High
Category:
-
Target version:
-
% Done:

100%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-08-28_19:00:01-upgrade:firefly-firefly-testing-basic-vps/459348/

014-08-28T19:48:44.257 INFO:tasks.workunit.client.0.vpm154.stderr:+ rbd export sparse /tmp/sparse
2014-08-28T19:48:44.257 INFO:tasks.workunit.client.0.vpm154.stderr:*** Caught signal (Segmentation fault) **
2014-08-28T19:48:44.257 INFO:tasks.workunit.client.0.vpm154.stderr: in thread 7f9495290780
2014-08-28T19:48:44.258 INFO:tasks.workunit.client.0.vpm154.stderr:rbd: ./common/Mutex.h:89: void Mutex::_post_lock(): Assertion `nlock == 0' failed.
2014-08-28T19:48:44.258 INFO:tasks.workunit.client.0.vpm154.stderr:*** Caught signal (Aborted) **
2014-08-28T19:48:44.258 INFO:tasks.workunit.client.0.vpm154.stderr: in thread 7f948e5fd700
2014-08-28T19:48:44.471 INFO:tasks.workunit.client.0.vpm154.stderr: ceph version 0.80.4 (7c241cfaa6c8c068bc9da8578ca00b9f4fc7567f)
2014-08-28T19:48:44.471 INFO:tasks.workunit.client.0.vpm154.stderr: 1: rbd() [0x420b52]
2014-08-28T19:48:44.471 INFO:tasks.workunit.client.0.vpm154.stderr: 2: (()+0xf030) [0x7f9493b55030]
2014-08-28T19:48:44.471 INFO:tasks.workunit.client.0.vpm154.stderr: 3: (std::_Rb_tree<std::string, std::pair<std::string const, ceph_mon_subscribe_item>, std::_Select1st<std::pair<std::string const, ceph_mon_subscribe_item> >, std::less<std::string>, std::allocator<std::pair<std::string const, ceph_mon_subscribe_item> > >::find(std::string const&) const+0x4f) [0x7f9494e2ebaf]
2014-08-28T19:48:44.471 INFO:tasks.workunit.client.0.vpm154.stderr: 4: (MonClient::_sub_want(std::string, unsigned long, unsigned int)+0x3f) [0x7f9494e32a1f]
2014-08-28T19:48:44.471 INFO:tasks.workunit.client.0.vpm154.stderr: 5: (MonClient::authenticate(double)+0x74) [0x7f9494112db4]
2014-08-28T19:48:44.471 INFO:tasks.workunit.client.0.vpm154.stderr: 6: (librados::RadosClient::connect()+0x5f4) [0x7f94940037b4]
2014-08-28T19:48:44.472 INFO:tasks.workunit.client.0.vpm154.stderr: 7: (main()+0x12c2) [0x410912]
2014-08-28T19:48:44.472 INFO:tasks.workunit.client.0.vpm154.stderr: 8: (__libc_start_main()+0xfd) [0x7f9492c8dead]
2014-08-28T19:48:44.472 INFO:tasks.workunit.client.0.vpm154.stderr: 9: rbd() [0x415c09]
2014-08-28T19:48:44.472 INFO:tasks.workunit.client.0.vpm154.stderr: ceph version 0.80.4 (7c241cfaa6c8c068bc9da8578ca00b9f4fc7567f)
2014-08-28T19:48:44.472 INFO:tasks.workunit.client.0.vpm154.stderr: 1: rbd() [0x420b52]
2014-08-28T19:48:44.472 INFO:tasks.workunit.client.0.vpm154.stderr: 2: (()+0xf030) [0x7f9493b55030]
2014-08-28T19:48:44.472 INFO:tasks.workunit.client.0.vpm154.stderr: 3: (gsignal()+0x35) [0x7f9492ca1475]
2014-08-28T19:48:44.472 INFO:tasks.workunit.client.0.vpm154.stderr: 4: (abort()+0x180) [0x7f9492ca46f0]
2014-08-28T19:48:44.473 INFO:tasks.workunit.client.0.vpm154.stderr: 5: (__assert_fail()+0xf1) [0x7f9492c9a621]
2014-08-28T19:48:44.473 INFO:tasks.workunit.client.0.vpm154.stderr: 6: (()+0x27fc54) [0x7f9493fe1c54]
2014-08-28T19:48:44.473 INFO:tasks.workunit.client.0.vpm154.stderr: 7: (()+0x32261c) [0x7f949408461c]
2014-08-28T19:48:44.473 INFO:tasks.workunit.client.0.vpm154.stderr: 8: (Finisher::finisher_thread_entry()+0x27) [0x7f94940a5747]
2014-08-28T19:48:44.473 INFO:tasks.workunit.client.0.vpm154.stderr: 9: (()+0x6b50) [0x7f9493b4cb50]
2014-08-28T19:48:44.473 INFO:tasks.workunit.client.0.vpm154.stderr: 10: (clone()+0x6d) [0x7f9492d49a7d]
2014-08-28T19:48:44.473 INFO:tasks.workunit.client.0.vpm154.stderr:2014-08-29 02:48:44.469294 7f9495290780 -1 *** Caught signal (Segmentation fault) **
2014-08-28T19:48:44.473 INFO:tasks.workunit.client.0.vpm154.stderr: in thread 7f9495290780
2014-08-28T19:48:44.474 INFO:tasks.workunit.client.0.vpm154.stderr:
2014-08-28T19:48:44.474 INFO:tasks.workunit.client.0.vpm154.stderr: ceph version 0.80.4 (7c241cfaa6c8c068bc9da8578ca00b9f4fc7567f)
2014-08-28T19:48:44.474 INFO:tasks.workunit.client.0.vpm154.stderr: 1: rbd() [0x420b52]
2014-08-28T19:48:44.474 INFO:tasks.workunit.client.0.vpm154.stderr: 2: (()+0xf030) [0x7f9493b55030]
2014-08-28T19:48:44.474 INFO:tasks.workunit.client.0.vpm154.stderr: 3: (std::_Rb_tree<std::string, std::pair<std::string const, ceph_mon_subscribe_item>, std::_Select1st<std::pair<std::string const, ceph_mon_subscribe_item> >, std::less<std::string>, std::allocator<std::pair<std::string const, ceph_mon_subscribe_item> > >::find(std::string const&) const+0x4f) [0x7f9494e2ebaf]
2014-08-28T19:48:44.474 INFO:tasks.workunit.client.0.vpm154.stderr: 4: (MonClient::_sub_want(std::string, unsigned long, unsigned int)+0x3f) [0x7f9494e32a1f]
2014-08-28T19:48:44.475 INFO:tasks.workunit.client.0.vpm154.stderr: 5: (MonClient::authenticate(double)+0x74) [0x7f9494112db4]
2014-08-28T19:48:44.475 INFO:tasks.workunit.client.0.vpm154.stderr: 6: (librados::RadosClient::connect()+0x5f4) [0x7f94940037b4]
2014-08-28T19:48:44.475 INFO:tasks.workunit.client.0.vpm154.stderr: 7: (main()+0x12c2) [0x410912]
2014-08-28T19:48:44.475 INFO:tasks.workunit.client.0.vpm154.stderr: 8: (__libc_start_main()+0xfd) [0x7f9492c8dead]
2014-08-28T19:48:44.475 INFO:tasks.workunit.client.0.vpm154.stderr: 9: rbd() [0x415c09]
archive_path: /var/lib/teuthworker/archive/teuthology-2014-08-28_19:00:01-upgrade:firefly-firefly-testing-basic-vps/459348
branch: firefly
description: upgrade:firefly/newer/{0-cluster/start.yaml 1-install/v0.80.4.yaml 2-workload/rbd.yaml
  3-upgrade-sequence/upgrade-osd-mon-mds.yaml 4-final/{monthrash.yaml osdthrash.yaml
  testrgw.yaml} distros/debian_7.0.yaml}
email: ceph-qa@ceph.com
job_id: '459348'
kernel: &id001
  kdb: true
  sha1: 4813f47b94a56d861ddd496ea54511d650bb1e32
last_in_suite: false
machine_type: vps
name: teuthology-2014-08-28_19:00:01-upgrade:firefly-firefly-testing-basic-vps
nuke-on-error: true
os_type: debian
os_version: '7.0'
overrides:
  admin_socket:
    branch: firefly
  ceph:
    conf:
      global:
        osd heartbeat grace: 100
      mon:
        debug mon: 20
        debug ms: 1
        debug paxos: 20
      osd:
        debug filestore: 20
        debug journal: 20
        debug ms: 1
        debug osd: 20
    fs: xfs
    log-whitelist:
    - slow request
    - scrub
    - wrongly marked me down
    - objects unfound and apparently lost
    - log bound mismatch
    sha1: db8d6e6e190de964ec3d5d1bbc87da2dcb3213f5
  ceph-deploy:
    branch:
      dev: firefly
    conf:
      client:
        log file: /var/log/ceph/ceph-$name.$pid.log
      mon:
        debug mon: 1
        debug ms: 20
        debug paxos: 20
        osd default pool size: 2
  install:
    ceph:
      sha1: db8d6e6e190de964ec3d5d1bbc87da2dcb3213f5
  rgw:
    default_idle_timeout: 1200
  s3tests:
    branch: firefly
    idle_timeout: 1200
  workunit:
    sha1: db8d6e6e190de964ec3d5d1bbc87da2dcb3213f5
owner: scheduled_teuthology@teuthology
priority: 1000
roles:
- - mon.a
  - mds.a
  - osd.0
  - osd.1
  - osd.2
- - mon.b
  - mon.c
  - osd.3
  - osd.4
  - osd.5
  - client.0
  - client.1
suite: upgrade:firefly
suite_branch: firefly
suite_path: /var/lib/teuthworker/src/ceph-qa-suite_firefly
targets:
  ubuntu@vpm107.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgHctJR1WLHsgxDgOJdsTmaZ6CsbMzxR2tvlJ5gBmZyGJDn7W4Jfz/4hiOs0o8ABnWdpzGRPiXZeRWU4kittedLmcDVIO47M00HrLLq4ijoJLq1dLSrcMDZ+tUCR/nTAX3/VjFI9MyDg9AS46cv1W8F6sI0Owo/C1o/WOnxjYrBkPy9gW/BoApcb8l2uEqaEZDfBugtakmGVPGp55q+SDRbg5tKqIeuDFTMsDbSnH0e2t4mQDzdBoN3lqQCjFHMb8T2o9qMVEO7DwQFjRnP7s39Ucvz3vGoNxbEkhkCMOo3eaux5gZJQfU9f87e8H8V+At1hQCdiIrdWPwoYjYEDk1
  ubuntu@vpm154.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQnv6KXPXpIvf+Hq3Bj5tV6JOnETbtmQ67cPeyl86s9aJOtb9+nwbKXQIiiljcuP0RQhkWwwkUWoFJd8OjaXL/7WMY8bsPfKUkShie724fRqh3QgUSHu96xsagr3EwAU1XgS5EMYtbJqxT0dA7GYHnXt+g6eGCLXETkYiiGM9+HUjvYdzM3RdB0vHdYOG+pVGAOShpte+9w/TPSIMZ5huEsZb+yko2XNYXWqJuahJMwO/90uLdDySfMZ0oK/EdsoptuBm+GG3ADNN/vf3QZZ5eFDW5p6yB2okH+92xKjShIM7Kma4w6f9z4MFaq58MuEShHOPNDv+e6Z9NoY5x+D1F
tasks:
- internal.lock_machines:
  - 2
  - vps
- internal.save_config: null
- internal.check_lock: null
- internal.connect: null
- internal.serialize_remote_roles: null
- internal.check_conflict: null
- internal.check_ceph_data: null
- internal.vm_setup: null
- kernel: *id001
- internal.base: null
- internal.archive: null
- internal.coredump: null
- internal.sudo: null
- internal.syslog: null
- internal.timer: null
- chef: null
- clock.check: null
- install:
    tag: v0.80.4
- ceph:
    log-whitelist:
    - scrub mismatch
    - ScrubResult
- parallel:
  - workload
  - upgrade-sequence
- sequential:
  - mon_thrash:
      revive_delay: 20
      thrash_delay: 1
  - ceph-fuse: null
  - workunit:
      clients:
        client.0:
        - suites/dbench.sh
- sequential:
  - thrashosds:
      chance_pgnum_grow: 1
      chance_pgpnum_fix: 1
      timeout: 1200
  - ceph-fuse:
    - client.0
  - workunit:
      clients:
        client.0:
        - suites/iogen.sh
- sequential:
  - rgw:
    - client.1
  - s3tests:
      client.1:
        rgw_server: client.1
teuthology_branch: master
tube: vps
upgrade-sequence:
  sequential:
  - install.upgrade:
      all:
        branch: firefly
  - ceph.restart:
    - osd.0
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.1
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.2
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.3
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.4
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.5
  - sleep:
      duration: 60
  - ceph.restart:
    - mon.a
  - sleep:
      duration: 60
  - ceph.restart:
    - mon.b
  - sleep:
      duration: 60
  - ceph.restart:
    - mon.c
  - sleep:
      duration: 60
  - ceph.restart:
    - mds.a
verbose: true
worker_log: /var/lib/teuthworker/archive/worker_logs/worker.vps.14183
workload:
  sequential:
  - workunit:
      clients:
        client.0:
        - rbd/import_export.sh
      env:
        RBD_CREATE_ARGS: --new-format
  - workunit:
      clients:
        client.0:
        - cls/test_cls_rbd.sh
description: upgrade:firefly/newer/{0-cluster/start.yaml 1-install/v0.80.4.yaml 2-workload/rbd.yaml
  3-upgrade-sequence/upgrade-osd-mon-mds.yaml 4-final/{monthrash.yaml osdthrash.yaml
  testrgw.yaml} distros/debian_7.0.yaml}
duration: 444.4962069988251
failure_reason: 'Command failed on vpm154 with status 134: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp
  && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
  CEPH_REF=db8d6e6e190de964ec3d5d1bbc87da2dcb3213f5 TESTDIR="/home/ubuntu/cephtest" 
  CEPH_ID="0" RBD_CREATE_ARGS=--new-format adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage
  timeout 3h /home/ubuntu/cephtest/workunit.client.0/rbd/import_export.sh'''
flavor: basic
mon.a-kernel-sha1: 4813f47b94a56d861ddd496ea54511d650bb1e32
mon.b-kernel-sha1: 4813f47b94a56d861ddd496ea54511d650bb1e32
owner: scheduled_teuthology@teuthology
success: false

Subtasks

Bug #9837: rbd crash when upgrading from v0.80.5 to fireflyDuplicateYuri Weinstein


Related issues

Related to Ceph - Bug #9040: clients can SEGV during package upgrade Won't Fix

History

#1 Updated by Sage Weil over 9 years ago

  • Priority changed from Normal to Urgent

#6 Updated by Yuri Weinstein over 9 years ago

  • Project changed from rbd to Ceph

#7 Updated by Sage Weil over 9 years ago

  • Assignee set to Josh Durgin

#8 Updated by Sage Weil over 9 years ago

  • Status changed from New to Duplicate

see #9040

#9 Updated by Tamilarasi muthamizhan over 9 years ago

  • Status changed from Duplicate to New

this seems to look different from bug # 9040.

#10 Updated by Tamilarasi muthamizhan over 9 years ago

logs: ubuntu@teuthology:/a/teuthology-2014-10-17_23:30:01-upgrade:firefly:newer-firefly-distro-basic-vps/555356

2014-10-19T03:27:28.473 INFO:tasks.workunit.client.0.vpm072.stderr:rbd: ./common/Mutex.h:89: void Mutex::_post_lock(): Assertion `nlock == 0' failed.
2014-10-19T03:27:28.473 INFO:tasks.workunit.client.0.vpm072.stderr:*** Caught signal (Aborted) **
2014-10-19T03:27:28.473 INFO:tasks.workunit.client.0.vpm072.stderr: in thread 7f6b793e7700
2014-10-19T03:27:29.164 INFO:tasks.workunit.client.0.vpm072.stderr: ceph version 0.80.4 (7c241cfaa6c8c068bc9da8578ca00b9f4fc7567f)
2014-10-19T03:27:29.165 INFO:tasks.workunit.client.0.vpm072.stderr: 1: rbd() [0x420d22]
2014-10-19T03:27:29.165 INFO:tasks.workunit.client.0.vpm072.stderr: 2: (()+0xf030) [0x7f6b7e93f030]
2014-10-19T03:27:29.165 INFO:tasks.workunit.client.0.vpm072.stderr: 3: (gsignal()+0x35) [0x7f6b7da8b475]
2014-10-19T03:27:29.165 INFO:tasks.workunit.client.0.vpm072.stderr: 4: (abort()+0x180) [0x7f6b7da8e6f0]
2014-10-19T03:27:29.165 INFO:tasks.workunit.client.0.vpm072.stderr: 5: (__assert_fail()+0xf1) [0x7f6b7da84621]
2014-10-19T03:27:29.165 INFO:tasks.workunit.client.0.vpm072.stderr: 6: (()+0x27fc54) [0x7f6b7edcbc54]
2014-10-19T03:27:29.165 INFO:tasks.workunit.client.0.vpm072.stderr: 7: (()+0x32261c) [0x7f6b7ee6e61c]
2014-10-19T03:27:29.166 INFO:tasks.workunit.client.0.vpm072.stderr: 8: (Finisher::finisher_thread_entry()+0x27) [0x7f6b7ee8f747]
2014-10-19T03:27:29.166 INFO:tasks.workunit.client.0.vpm072.stderr: 9: (()+0x6b50) [0x7f6b7e936b50]
2014-10-19T03:27:29.166 INFO:tasks.workunit.client.0.vpm072.stderr: 10: (clone()+0x6d) [0x7f6b7db33a7d]
2014-10-19T03:27:29.166 INFO:tasks.workunit.client.0.vpm072.stderr:2014-10-19 10:27:29.162549 7f6b793e7700 -1 *** Caught signal (Aborted) **
2014-10-19T03:27:29.166 INFO:tasks.workunit.client.0.vpm072.stderr: in thread 7f6b793e7700
2014-10-19T03:27:29.166 INFO:tasks.workunit.client.0.vpm072.stderr:
2014-10-19T03:27:29.167 INFO:tasks.workunit.client.0.vpm072.stderr: ceph version 0.80.4 (7c241cfaa6c8c068bc9da8578ca00b9f4fc7567f)
2014-10-19T03:27:29.167 INFO:tasks.workunit.client.0.vpm072.stderr: 1: rbd() [0x420d22]
2014-10-19T03:27:29.167 INFO:tasks.workunit.client.0.vpm072.stderr: 2: (()+0xf030) [0x7f6b7e93f030]
2014-10-19T03:27:29.167 INFO:tasks.workunit.client.0.vpm072.stderr: 3: (gsignal()+0x35) [0x7f6b7da8b475]
2014-10-19T03:27:29.167 INFO:tasks.workunit.client.0.vpm072.stderr: 4: (abort()+0x180) [0x7f6b7da8e6f0]
2014-10-19T03:27:29.168 INFO:tasks.workunit.client.0.vpm072.stderr: 5: (__assert_fail()+0xf1) [0x7f6b7da84621]
2014-10-19T03:27:29.168 INFO:tasks.workunit.client.0.vpm072.stderr: 6: (()+0x27fc54) [0x7f6b7edcbc54]
2014-10-19T03:27:29.168 INFO:tasks.workunit.client.0.vpm072.stderr: 7: (()+0x32261c) [0x7f6b7ee6e61c]
2014-10-19T03:27:29.168 INFO:tasks.workunit.client.0.vpm072.stderr: 8: (Finisher::finisher_thread_entry()+0x27) [0x7f6b7ee8f747]
2014-10-19T03:27:29.169 INFO:tasks.workunit.client.0.vpm072.stderr: 9: (()+0x6b50) [0x7f6b7e936b50]
2014-10-19T03:27:29.169 INFO:tasks.workunit.client.0.vpm072.stderr: 10: (clone()+0x6d) [0x7f6b7db33a7d]
2014-10-19T03:27:29.169 INFO:tasks.workunit.client.0.vpm072.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

config file:

ubuntu@teuthology:/a/teuthology-2014-10-17_23:30:01-upgrade:firefly:newer-firefly-distro-basic-vps/555356$ cat orig.config.yaml 
archive_path: /var/lib/teuthworker/archive/teuthology-2014-10-17_23:30:01-upgrade:firefly:newer-firefly-distro-basic-vps/555356
branch: firefly
description: upgrade:firefly:newer/{0-cluster/start.yaml 1-install/v0.80.4.yaml 2-workload/{blogbench.yaml
  rbd.yaml s3tests.yaml testrados.yaml} 3-upgrade-sequence/upgrade-mon-osd-mds.yaml
  4-final/{monthrash.yaml osdthrash.yaml testrgw.yaml} distros/debian_7.0.yaml}
email: ceph-qa@ceph.com
job_id: '555356'
kernel:
  kdb: true
  sha1: distro
last_in_suite: false
machine_type: vps
name: teuthology-2014-10-17_23:30:01-upgrade:firefly:newer-firefly-distro-basic-vps
nuke-on-error: true
os_type: debian
os_version: '7.0'
overrides:
  admin_socket:
    branch: firefly
  ceph:
    conf:
      global:
        osd heartbeat grace: 100
      mon:
        debug mon: 20
        debug ms: 1
        debug paxos: 20
      osd:
        debug filestore: 20
        debug journal: 20
        debug ms: 1
        debug osd: 20
    fs: xfs
    log-whitelist:
    - slow request
    - scrub
    - scrub mismatch
    - ScrubResult
    - wrongly marked me down
    - objects unfound and apparently lost
    - log bound mismatch
    sha1: 5a10b95f7968ecac1f2af4abf9fb91347a290544
  ceph-deploy:
    branch:
      dev: firefly
    conf:
      client:
        log file: /var/log/ceph/ceph-$name.$pid.log
      mon:
        debug mon: 1
        debug ms: 20
        debug paxos: 20
        osd default pool size: 2
  install:
    ceph:
      sha1: 5a10b95f7968ecac1f2af4abf9fb91347a290544
  rgw:
    default_idle_timeout: 1200
  s3tests:
    branch: firefly
    idle_timeout: 1200
  workunit:
    sha1: 5a10b95f7968ecac1f2af4abf9fb91347a290544
owner: scheduled_teuthology@teuthology
priority: 1000
roles:
- - mon.a
  - mds.a
  - osd.0
  - osd.1
  - osd.2
- - mon.b
  - mon.c
  - osd.3
  - osd.4
  - osd.5
- - client.0
  - client.1
suite: upgrade:firefly:newer
suite_branch: firefly
suite_path: /var/lib/teuthworker/src/ceph-qa-suite_firefly
tasks:
- chef: null
- clock.check: null
- install:
    tag: v0.80.4
- ceph: null
- parallel:
  - workload
  - upgrade-sequence
- sequential:
  - mon_thrash:
      revive_delay: 20
      thrash_delay: 1
  - ceph-fuse: null
  - workunit:
      clients:
        client.0:
        - suites/dbench.sh
- sequential:
  - thrashosds:
      chance_pgnum_grow: 1
      chance_pgpnum_fix: 1
      timeout: 1200
  - ceph-fuse:
    - client.0
  - workunit:
      clients:
        client.0:
        - suites/iogen.sh
- sequential:
  - rgw:
    - client.1
  - s3readwrite:
      client.0:
        readwrite:
          bucket: rwtest
          duration: 300
          files:
            num: 10
            size: 2000
            stddev: 500
          readers: 10
          writers: 3
        rgw_server: client.1
teuthology_branch: master
tube: vps
upgrade-sequence:
  sequential:
  - install.upgrade:
      all:
        branch: firefly
  - ceph.restart:
    - mon.a
  - sleep:
      duration: 60
  - ceph.restart:
    - mon.b
  - sleep:
      duration: 60
  - ceph.restart:
    - mon.c
  - sleep:
      duration: 60
  - ceph.restart:
    - osd.0
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.1
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.2
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.3
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.4
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.5
  - sleep:
      duration: 60
  - ceph.restart:
    - mds.a
verbose: true
worker_log: /var/lib/teuthworker/archive/worker_logs/worker.vps.3001
workload:
  sequential:
  - workunit:
      clients:
        client.0:
        - suites/blogbench.sh
  - workunit:
      clients:
        client.0:
        - rbd/import_export.sh
      env:
        RBD_CREATE_ARGS: --new-format
  - workunit:
      clients:
        client.0:
        - cls/test_cls_rbd.sh
  - rgw:
    - client.0
  - s3tests:
      client.0:
        force-branch: firefly-original
        rgw_server: client.0
  - rados:
      clients:
      - client.0
      objects: 50
      op_weights:
        delete: 50
        read: 100
        rollback: 50
        snap_create: 50
        snap_remove: 50
        write: 100
      ops: 2000

#11 Updated by Sage Weil over 9 years ago

  • Assignee changed from Josh Durgin to Tamilarasi muthamizhan

the job is upgrading client.0 (vpm072) in that test too.

i think

- install.upgrade:
all:
branch: firefly

should be

- install.upgrade:
mon.a:
branch: firefly
mon.b:
branch: firefly

#12 Updated by Tamilarasi muthamizhan over 9 years ago

  • Status changed from New to 7
  • Assignee changed from Tamilarasi muthamizhan to Yuri Weinstein

fixed it

commit 78066bd0af5c3fbd8eba7e2578fefdc6fbf841b5
Author: tamil <tamil.muthamizhan@inktank.com>
Date:   Tue Oct 21 13:14:54 2014 -0700

    fixed issue:9288 in firefly:older suite - avoid upgrading clients
    in paralllel to the workloads

    Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

commit a9c967b90b6cd8e01391666202cf59bb5ac2e7c9
Author: tamil <tamil.muthamizhan@inktank.com>
Date:   Tue Oct 21 12:59:04 2014 -0700

    fixing issue with bug:9288 - do not upgrade clients when workload is
    running in parallel

    Signed-off-by: tamil <tamil.muthamizhan@inktank.com>

#13 Updated by Yuri Weinstein over 9 years ago

  • Status changed from 7 to Resolved

Also available in: Atom PDF