Project

General

Profile

Actions
Copy link

Bug #9156

closed

SWIFT tests failed in upgrade:dumpling:rgw-dumpling-distro-basic-vps suite

Added by Yuri Weinstein over 9 years ago. Updated over 9 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Yuri Weinstein
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

12 tests total failed in http://pulpito.front.sepia.ceph.com/teuthology-2014-08-17_12:05:01-upgrade:dumpling:rgw-dumpling-distro-basic-vps/

One of them, logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-08-17_12:05:01-upgrade:dumpling:rgw-dumpling-distro-basic-vps/431148/

2014-08-18T04:06:24.495 INFO:teuthology.orchestra.run.vpm008.stderr:testStackedOverwrite (test.functional.tests.TestFileUTF8) ... ok
2014-08-18T04:06:24.501 INFO:teuthology.orchestra.run.vpm008.stderr:testTooLongName (test.functional.tests.TestFileUTF8) ... ok
2014-08-18T04:06:24.539 INFO:teuthology.orchestra.run.vpm008.stderr:testZeroByteFile (test.functional.tests.TestFileUTF8) ... ok
2014-08-18T04:06:24.539 INFO:teuthology.orchestra.run.vpm008.stderr:
2014-08-18T04:06:24.539 INFO:teuthology.orchestra.run.vpm008.stderr:======================================================================
2014-08-18T04:06:24.540 INFO:teuthology.orchestra.run.vpm008.stderr:ERROR: testContainerSerializedInfo (test.functional.tests.TestAccount)
2014-08-18T04:06:24.540 INFO:teuthology.orchestra.run.vpm008.stderr:----------------------------------------------------------------------
2014-08-18T04:06:24.540 INFO:teuthology.orchestra.run.vpm008.stderr:Traceback (most recent call last):
2014-08-18T04:06:24.540 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 219, in testContainerSerializedInfo
2014-08-18T04:06:24.541 INFO:teuthology.orchestra.run.vpm008.stderr:    file.write_random(bytes)
2014-08-18T04:06:24.541 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/swift.py", line 739, in write_random
2014-08-18T04:06:24.541 INFO:teuthology.orchestra.run.vpm008.stderr:    if not self.write(data, hdrs=hdrs, parms=parms, cfg=cfg):
2014-08-18T04:06:24.541 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/swift.py", line 731, in write
2014-08-18T04:06:24.541 INFO:teuthology.orchestra.run.vpm008.stderr:    raise ResponseError(self.conn.response)
2014-08-18T04:06:24.542 INFO:teuthology.orchestra.run.vpm008.stderr:ResponseError: 500: Internal Server Error
2014-08-18T04:06:24.542 INFO:teuthology.orchestra.run.vpm008.stderr:
2014-08-18T04:06:24.542 INFO:teuthology.orchestra.run.vpm008.stderr:======================================================================
2014-08-18T04:06:24.543 INFO:teuthology.orchestra.run.vpm008.stderr:ERROR: testGetRequest (test.functional.tests.TestAccountNoContainersUTF8)
2014-08-18T04:06:24.543 INFO:teuthology.orchestra.run.vpm008.stderr:----------------------------------------------------------------------
2014-08-18T04:06:24.543 INFO:teuthology.orchestra.run.vpm008.stderr:Traceback (most recent call last):
2014-08-18T04:06:24.543 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 122, in setUp
2014-08-18T04:06:24.544 INFO:teuthology.orchestra.run.vpm008.stderr:    super(Base2, self).setUp()
2014-08-18T04:06:24.544 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 104, in setUp
2014-08-18T04:06:24.544 INFO:teuthology.orchestra.run.vpm008.stderr:    cls.env.setUp()
2014-08-18T04:06:24.544 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 316, in setUp
2014-08-18T04:06:24.545 INFO:teuthology.orchestra.run.vpm008.stderr:    cls.account.delete_containers()
2014-08-18T04:06:24.545 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/swift.py", line 360, in delete_containers
2014-08-18T04:06:24.545 INFO:teuthology.orchestra.run.vpm008.stderr:    if not cont.delete_recursive():
2014-08-18T04:06:24.546 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/swift.py", line 404, in delete_recursive
2014-08-18T04:06:24.546 INFO:teuthology.orchestra.run.vpm008.stderr:    return self.delete_files() and self.delete()
2014-08-18T04:06:24.546 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/swift.py", line 398, in delete_files
2014-08-18T04:06:24.546 INFO:teuthology.orchestra.run.vpm008.stderr:    if not file.delete():
2014-08-18T04:06:24.547 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/swift.py", line 540, in delete
2014-08-18T04:06:24.547 INFO:teuthology.orchestra.run.vpm008.stderr:    raise ResponseError(self.conn.response)
2014-08-18T04:06:24.547 INFO:teuthology.orchestra.run.vpm008.stderr:ResponseError: 500: Internal Server Error
2014-08-18T04:06:24.547 INFO:teuthology.orchestra.run.vpm008.stderr:
2014-08-18T04:06:24.547 INFO:teuthology.orchestra.run.vpm008.stderr:======================================================================
2014-08-18T04:06:24.548 INFO:teuthology.orchestra.run.vpm008.stderr:ERROR: testAccountHead (test.functional.tests.TestAccountUTF8)
2014-08-18T04:06:24.548 INFO:teuthology.orchestra.run.vpm008.stderr:----------------------------------------------------------------------
2014-08-18T04:06:24.548 INFO:teuthology.orchestra.run.vpm008.stderr:Traceback (most recent call last):
2014-08-18T04:06:24.548 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 122, in setUp
2014-08-18T04:06:24.548 INFO:teuthology.orchestra.run.vpm008.stderr:    super(Base2, self).setUp()
2014-08-18T04:06:24.548 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 104, in setUp
2014-08-18T04:06:24.549 INFO:teuthology.orchestra.run.vpm008.stderr:    cls.env.setUp()
2014-08-18T04:06:24.549 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 134, in setUp
2014-08-18T04:06:24.549 INFO:teuthology.orchestra.run.vpm008.stderr:    cls.account.delete_containers()
2014-08-18T04:06:24.549 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/swift.py", line 358, in delete_containers
2014-08-18T04:06:24.549 INFO:teuthology.orchestra.run.vpm008.stderr:    for c in listing_items(self.containers):
2014-08-18T04:06:24.550 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/swift.py", line 70, in listing_items
2014-08-18T04:06:24.550 INFO:teuthology.orchestra.run.vpm008.stderr:    items = method()
2014-08-18T04:06:24.550 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/swift.py", line 355, in containers
2014-08-18T04:06:24.550 INFO:teuthology.orchestra.run.vpm008.stderr:    raise ResponseError(self.conn.response)
2014-08-18T04:06:24.550 INFO:teuthology.orchestra.run.vpm008.stderr:ResponseError: 500: Internal Server Error
2014-08-18T04:06:24.550 INFO:teuthology.orchestra.run.vpm008.stderr:
2014-08-18T04:06:24.551 INFO:teuthology.orchestra.run.vpm008.stderr:======================================================================
2014-08-18T04:06:24.551 INFO:teuthology.orchestra.run.vpm008.stderr:ERROR: testContainerListing (test.functional.tests.TestAccountUTF8)
2014-08-18T04:06:24.551 INFO:teuthology.orchestra.run.vpm008.stderr:----------------------------------------------------------------------
2014-08-18T04:06:24.551 INFO:teuthology.orchestra.run.vpm008.stderr:Traceback (most recent call last):
2014-08-18T04:06:24.551 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 122, in setUp
2014-08-18T04:06:24.552 INFO:teuthology.orchestra.run.vpm008.stderr:    super(Base2, self).setUp()
2014-08-18T04:06:24.552 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 104, in setUp
2014-08-18T04:06:24.552 INFO:teuthology.orchestra.run.vpm008.stderr:    cls.env.setUp()
2014-08-18T04:06:24.552 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 134, in setUp
2014-08-18T04:06:24.552 INFO:teuthology.orchestra.run.vpm008.stderr:    cls.account.delete_containers()
2014-08-18T04:06:24.552 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/swift.py", line 358, in delete_containers
2014-08-18T04:06:24.553 INFO:teuthology.orchestra.run.vpm008.stderr:    for c in listing_items(self.containers):
2014-08-18T04:06:24.553 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/swift.py", line 70, in listing_items
2014-08-18T04:06:24.553 INFO:teuthology.orchestra.run.vpm008.stderr:    items = method()
2014-08-18T04:06:24.554 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/swift.py", line 355, in containers
2014-08-18T04:06:24.554 INFO:teuthology.orchestra.run.vpm008.stderr:    raise ResponseError(self.conn.response)
2014-08-18T04:06:24.555 INFO:teuthology.orchestra.run.vpm008.stderr:ResponseError: 500: Internal Server Error
2014-08-18T04:06:24.555 INFO:teuthology.orchestra.run.vpm008.stderr:
2014-08-18T04:06:24.555 INFO:teuthology.orchestra.run.vpm008.stderr:======================================================================
2014-08-18T04:06:24.555 INFO:teuthology.orchestra.run.vpm008.stderr:ERROR: testContainerSerializedInfo (test.functional.tests.TestAccountUTF8)
2014-08-18T04:06:24.556 INFO:teuthology.orchestra.run.vpm008.stderr:----------------------------------------------------------------------
2014-08-18T04:06:24.556 INFO:teuthology.orchestra.run.vpm008.stderr:Traceback (most recent call last):
2014-08-18T04:06:24.556 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 219, in testContainerSerializedInfo
2014-08-18T04:06:24.556 INFO:teuthology.orchestra.run.vpm008.stderr:    file.write_random(bytes)
2014-08-18T04:06:24.557 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/swift.py", line 739, in write_random
2014-08-18T04:06:24.557 INFO:teuthology.orchestra.run.vpm008.stderr:    if not self.write(data, hdrs=hdrs, parms=parms, cfg=cfg):
2014-08-18T04:06:24.557 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/swift.py", line 731, in write
2014-08-18T04:06:24.557 INFO:teuthology.orchestra.run.vpm008.stderr:    raise ResponseError(self.conn.response)
2014-08-18T04:06:24.558 INFO:teuthology.orchestra.run.vpm008.stderr:ResponseError: 500: Internal Server Error
2014-08-18T04:06:24.558 INFO:teuthology.orchestra.run.vpm008.stderr:
2014-08-18T04:06:24.558 INFO:teuthology.orchestra.run.vpm008.stderr:======================================================================
2014-08-18T04:06:24.558 INFO:teuthology.orchestra.run.vpm008.stderr:FAIL: testGetRequest (test.functional.tests.TestAccountNoContainers)
2014-08-18T04:06:24.559 INFO:teuthology.orchestra.run.vpm008.stderr:----------------------------------------------------------------------
2014-08-18T04:06:24.559 INFO:teuthology.orchestra.run.vpm008.stderr:Traceback (most recent call last):
2014-08-18T04:06:24.559 INFO:teuthology.orchestra.run.vpm008.stderr:  File "/home/ubuntu/cephtest/swift/test/functional/tests.py", line 325, in testGetRequest
2014-08-18T04:06:24.560 INFO:teuthology.orchestra.run.vpm008.stderr:    parms={'format':format}))
2014-08-18T04:06:24.560 INFO:teuthology.orchestra.run.vpm008.stderr:AssertionError: False is not true
2014-08-18T04:06:24.560 INFO:teuthology.orchestra.run.vpm008.stderr:
2014-08-18T04:06:24.560 INFO:teuthology.orchestra.run.vpm008.stderr:----------------------------------------------------------------------
2014-08-18T04:06:24.561 INFO:teuthology.orchestra.run.vpm008.stderr:Ran 137 tests in 355.431s
2014-08-18T04:06:24.561 INFO:teuthology.orchestra.run.vpm008.stderr:
2014-08-18T04:06:24.561 INFO:teuthology.orchestra.run.vpm008.stderr:FAILED (errors=5, failures=1)
2014-08-18T04:06:24.571 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/contextutil.py", line 27, in nested
    vars.append(enter())
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/teuthology_master/teuthology/task/swift.py", line 175, in run_tests
    args=args,
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 114, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 401, in run
    r.wait()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 102, in wait
    exitstatus=status, node=self.hostname)
CommandFailedError: Command failed on vpm008 with status 1: "SWIFT_TEST_CONFIG_FILE=/home/ubuntu/cephtest/archive/testswift.client.0.conf /home/ubuntu/cephtest/swift/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/swift/test/functional -v -a '!fails_on_rgw'" 
2014-08-18T04:06:24.598 INFO:teuthology.orchestra.run.vpm008:Running: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data'
2014-08-18T04:06:26.156 INFO:teuthology.orchestra.run.vpm008:Running: 'adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid bar.client.0 --purge-data'
2014-08-18T04:06:26.324 INFO:teuthology.task.swift:Removing swift...
2014-08-18T04:06:26.324 INFO:teuthology.orchestra.run.vpm008:Running: 'rm -rf /home/ubuntu/cephtest/swift'
2014-08-18T04:06:26.424 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/run_tasks.py", line 53, in run_tasks
    manager.__enter__()
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/teuthology_master/teuthology/task/swift.py", line 255, in task
    lambda: run_tests(ctx=ctx, config=config),
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/teuthology_master/teuthology/contextutil.py", line 27, in nested
    vars.append(enter())
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/teuthworker/src/teuthology_master/teuthology/task/swift.py", line 175, in run_tests
    args=args,
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/cluster.py", line 64, in run
    return [remote.run(**kwargs) for remote in remotes]
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 114, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 401, in run
    r.wait()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 102, in wait
    exitstatus=status, node=self.hostname)
CommandFailedError: Command failed on vpm008 with status 1: "SWIFT_TEST_CONFIG_FILE=/home/ubuntu/cephtest/archive/testswift.client.0.conf /home/ubuntu/cephtest/swift/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/swift/test/functional -v -a '!fails_on_rgw'" 

archive_path: /var/lib/teuthworker/archive/teuthology-2014-08-17_12:05:01-upgrade:dumpling:rgw-dumpling-distro-basic-vps/431148
branch: dumpling
description: upgrade:dumpling:rgw/{0-cluster/start.yaml 1-dumpling-install/cuttlefish.v0.67.1.yaml
  2-workload/testrgw.yaml 3-upgrade-sequence/upgrade-osd-mon-mds.yaml 4-final/osdthrash.yaml}
email: ceph-qa@ceph.com
job_id: '431148'
kernel: &id001
  kdb: true
  sha1: distro
last_in_suite: false
machine_type: vps
name: teuthology-2014-08-17_12:05:01-upgrade:dumpling:rgw-dumpling-distro-basic-vps
nuke-on-error: true
os_type: ubuntu
overrides:
  admin_socket:
    branch: dumpling
  ceph:
    conf:
      global:
        osd heartbeat grace: 100
      mon:
        debug mon: 20
        debug ms: 1
        debug paxos: 20
      osd:
        debug filestore: 20
        debug journal: 20
        debug ms: 1
        debug osd: 20
    fs: xfs
    log-whitelist:
    - slow request
    - scrub
    - wrongly marked me down
    - objects unfound and apparently lost
    - log bound mismatch
    sha1: aaeebceb2189336f5f957f2a797d0448c2754b15
  ceph-deploy:
    branch:
      dev: dumpling
    conf:
      client:
        log file: /var/log/ceph/ceph-$name.$pid.log
      mon:
        debug mon: 1
        debug ms: 20
        debug paxos: 20
        osd default pool size: 2
  install:
    ceph:
      sha1: aaeebceb2189336f5f957f2a797d0448c2754b15
  rgw:
    default_idle_timeout: 1200
  s3tests:
    branch: dumpling
  workunit:
    sha1: aaeebceb2189336f5f957f2a797d0448c2754b15
owner: scheduled_teuthology@teuthology
priority: 1000
roles:
- - mon.a
  - mds.a
  - osd.0
  - osd.1
  - osd.2
- - mon.b
  - mon.c
  - osd.3
  - osd.4
  - osd.5
  - client.0
suite: upgrade:dumpling:rgw
suite_branch: dumpling
suite_path: /var/lib/teuthworker/src/ceph-qa-suite_dumpling
targets:
  ubuntu@vpm008.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCmp158QNmNH21PylF8WShAQiyUP0V0U6ucbn6DGnbNBC0jSbIpihxzS7EFa2lehOjhFz7HBLnlQOGSHm+ZmyQaofmV1uog276rFYvtik2X7LL1zLvb1oxkUHlTDaWr+YIFR2OOlIVL5UIhcLqaKOXN5KnAK9wcPuucswzNvXAd0KTRrHZ+9zFdKIXhxmRxhUWa0eTGefuvOiD5C29PWk0sAKb9odtxxz6C1HN4oJMpzKkmQ8AjKoyNtxPNwZUvof7BSSENCZCpB0tbe3DRn2NVvmEHlOPvdNmwbzuwZbtDVoe+3DCZr80fw6HitEKenXxRcLAX2ZT3fQjUKla0qAtL
  ubuntu@vpm082.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDGJtbdJQBuknuYwzrRvEOpxEpqxkUeRZbkGA97zhdY5BIy30pFTkqpJ1vrPbJyBcIl12iyEK4r7Q5E79Tlt2VosmcPAJPUvzfXwnhpMcp1x90i2YLXMXMEwnmO1OjRITCpvv6kE7VDZOeN88jan3Bmx6fH3pinP2VESIxDpMwBWXYOvuO2VP7XBlGRi3hT8XjRu3IIPMF1yL1/Oi37tfTW3J3Aiajqs8ReDOuAyqTdir8yb8YS5BBbP7iloQ0iaV5PCRGDAaf/RVzofusQl3NT/PUv+wvXiu2H6Cz9BkKpCp/sMmhpQjGcb+QUnGqV1z3mnEHhxTmRqBSdD1Dfzh6B
tasks:
- internal.lock_machines:
  - 2
  - vps
- internal.save_config: null
- internal.check_lock: null
- internal.connect: null
- internal.serialize_remote_roles: null
- internal.check_conflict: null
- internal.check_ceph_data: null
- internal.vm_setup: null
- kernel: *id001
- internal.base: null
- internal.archive: null
- internal.coredump: null
- internal.sudo: null
- internal.syslog: null
- internal.timer: null
- chef: null
- clock.check: null
- install:
    branch: cuttlefish
- ceph: null
- install.upgrade:
    all:
      tag: v0.67.1
- ceph.restart: null
- install.upgrade:
    all:
      branch: dumpling
- rgw:
  - client.0
- parallel:
  - workload
  - upgrade-sequence
- thrashosds:
    chance_pgnum_grow: 1
    chance_pgpnum_fix: 1
    thrash_primary_affinity: false
    timeout: 1200
- swift:
    client.0:
      rgw_server: client.0
teuthology_branch: master
tube: vps
upgrade-sequence:
  sequential:
  - ceph.restart:
    - osd.0
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.1
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.2
  - sleep:
      duration: 30
  - ceph.restart:
    - rgw.client.0
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.3
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.4
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.5
  - sleep:
      duration: 60
  - ceph.restart:
    - mon.a
  - sleep:
      duration: 60
  - ceph.restart:
    - mon.b
  - sleep:
      duration: 60
  - ceph.restart:
    - mon.c
  - sleep:
      duration: 60
  - ceph.restart:
    - mds.a
  - sleep:
      duration: 60
verbose: true
worker_log: /var/lib/teuthworker/archive/worker_logs/worker.vps.4652
workload:
  sequential:
  - s3tests:
      client.0:
        rgw_server: client.0
Actions
Copy link
 #1

Updated by Yuri Weinstein over 9 years ago

  • Project changed from rgw to Ceph
Actions
Copy link
 #2

Updated by Yuri Weinstein over 9 years ago

Suspected backport apache 2.4 issue, test branch wip-rgw-dumpling for ceph-qa-suite

Running now 

http://pulpito.front.sepia.ceph.com/teuthology-2014-08-18_09:40:01-upgrade:dumpling:rgw-dumpling-distro-basic-vps/

Actions
Copy link
 #3

Updated by Yuri Weinstein over 9 years ago

Further analyzes and chants with Loic and Yehuda revealed that in apache access log we indeed have 30 sec not 1200 sec as expected by override.

ubuntu@teuthology:/a/teuthology-2014-08-17_12:05:01-upgrade:dumpling:rgw-dumpling-distro-basic-vps/431148/remote/vpm008$ grep -w 500 apache.client.0/access.log
..........
10.214.138.80 l - [18/Aug/2014:11:02:57 +0000] "GET /swift/v1 HTTP/1.1" 500 538 "{Referer}i" "-" 
10.214.138.80 l - [18/Aug/2014:11:03:27 +0000] "GET /swift/v1 HTTP/1.1" 500 538 "{Referer}i" "-" 
..........

Now the question is why teuthology code does not work for the override as expected.

Actions
Copy link
 #4

Updated by Sage Weil over 9 years ago

  • Assignee set to Yuri Weinstein

confirm the thrashing has been removed from the test

Actions
Copy link
 #5

Updated by Yuri Weinstein over 9 years ago

  • Status changed from New to 7

Thrashing was removed - https://github.com/ceph/ceph-qa-suite/pull/108/
Now testing.

Actions
Copy link

Also available in: Atom PDF