Project

General

Profile

Bug #8848

"adjust-ulimits: command not found" in upgrade:firefly-firefly-testing-basic-plana suite

Added by Yuri Weinstein over 9 years ago. Updated over 9 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-07-15_19:12:01-upgrade:firefly-firefly-testing-basic-plana/363977/

2014-07-15T23:45:26.950 INFO:teuthology.task.workunit.client.0.err:[10.214.131.2]: bash: adjust-ulimits: command not found
2014-07-15T23:45:26.952 INFO:teuthology.task.workunit:Stopping suites/blogbench.sh on client.0...
2014-07-15T23:45:26.952 DEBUG:teuthology.orchestra.run:Running [10.214.131.2]: 'rm -rf -- /home/ubuntu/cephtest/workunits.list /home/ubuntu/cephtest/workunit.client.0'
2014-07-15T23:45:27.032 ERROR:teuthology.parallel:Exception in parallel execution
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_firefly/teuthology/parallel.py", line 82, in __exit__
    for result in self:
  File "/home/teuthworker/src/teuthology_firefly/teuthology/parallel.py", line 101, in next
    resurrect_traceback(result)
  File "/home/teuthworker/src/teuthology_firefly/teuthology/parallel.py", line 19, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/teuthology_firefly/teuthology/task/workunit.py", line 359, in _run_tests
    args=args,
  File "/home/teuthworker/src/teuthology_firefly/teuthology/orchestra/remote.py", line 106, in run
    r = self._runner(client=self.ssh, **kwargs)
  File "/home/teuthworker/src/teuthology_firefly/teuthology/orchestra/run.py", line 330, in run
    r.exitstatus = _check_status(r.exitstatus)
  File "/home/teuthworker/src/teuthology_firefly/teuthology/orchestra/run.py", line 326, in _check_status
    raise CommandFailedError(command=r.command, exitstatus=status, node=host)
CommandFailedError: Command failed on 10.214.131.2 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=67b5193f73a2c9ec9e503ad3431473998217375d TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.0/suites/blogbench.sh'
2014-07-15T23:45:27.034 ERROR:teuthology.parallel:Exception in parallel execution
Traceback (most recent call last):
archive_path: /var/lib/teuthworker/archive/teuthology-2014-07-15_19:12:01-upgrade:firefly-firefly-testing-basic-plana/363977
branch: firefly
description: upgrade:firefly/{0-cluster/start.yaml 1-install/v0.80.3.yaml 2-workload/blogbench.yaml
  3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-final/{monthrash.yaml osdthrash.yaml
  testrgw.yaml}}
email: ceph-qa@ceph.com
job_id: '363977'
kernel: &id001
  kdb: true
  sha1: 20bdcbcb52ac95397901581086368dd79c06091f
last_in_suite: false
machine_type: plana
name: teuthology-2014-07-15_19:12:01-upgrade:firefly-firefly-testing-basic-plana
nuke-on-error: true
os_type: ubuntu
overrides:
  admin_socket:
    branch: firefly
  ceph:
    conf:
      mon:
        debug mon: 20
        debug ms: 1
        debug paxos: 20
      osd:
        debug filestore: 20
        debug journal: 20
        debug ms: 1
        debug osd: 20
    fs: xfs
    log-whitelist:
    - slow request
    - scrub
    - wrongly marked me down
    - objects unfound and apparently lost
    - log bound mismatch
    sha1: 67b5193f73a2c9ec9e503ad3431473998217375d
  ceph-deploy:
    branch:
      dev: firefly
    conf:
      client:
        log file: /var/log/ceph/ceph-$name.$pid.log
      mon:
        debug mon: 1
        debug ms: 20
        debug paxos: 20
        osd default pool size: 2
  install:
    ceph:
      sha1: 67b5193f73a2c9ec9e503ad3431473998217375d
  s3tests:
    branch: firefly
  workunit:
    sha1: 67b5193f73a2c9ec9e503ad3431473998217375d
owner: scheduled_teuthology@teuthology
priority: 1000
roles:
- - mon.a
  - mds.a
  - osd.0
  - osd.1
  - osd.2
- - mon.b
  - mon.c
  - osd.3
  - osd.4
  - osd.5
  - client.0
suite: upgrade:firefly
suite_branch: firefly
targets:
  ubuntu@plana07.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCq+3SwRGoWpVwyqApVRi3WdgCS7y8P0cTFmPKGBuyQ+83S7pBqZXam49inu9GuU/o1c6XdhjX180KAjQGpFP/bnm1ktuIZ16j0Ro+Ib+Tf43b9Y4rv20jEBlTvJurLwy7/RYfi+Na3E2wWx2VPLxdww4wuRteM0/QvTs6/kfDtwrZclLrs2EaQxidFi+cyB696/AJ4T5uv3xSKHiSL9F2arLYL/i2PqpuX3hqElqBCi+zRkhMtcYWT3wG+ojU1/nywZJSo8tGfDE28b4C0gSXUoZftz0nk/hxLTJfOQ2Ge3Sibt4AfaMBn8+x6BOjxXkbfcBzp+/s6roCtkR9WEwGx
  ubuntu@plana38.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9Ewdl9truCgjUHR8aoWHkgba6XY/ALrJ5REJ5C0/jTp0Lb3OXEuk91u0Xoyon8KuHyBqjg0GNPSg3KNl2KWsa1C0SDL6A8b1Vu+mNmY6i/xkvxQwto7fgfo/mXzmQGUG80YkzkumMG+4ih63tVkqXXP1uBvP3/B2ui5RN51T3vA9QPTitoKxZipNGpi2xyWUXFXnyfXKwKJlz4E7zymSzEfgSLDAGnxuHOIxy5GZWwPhQW9mphjUH9vcWB/xYmBGl7NRQWrOwktkj/k96KTmRhgWe3ULIyQDzZxiloUxRY+/f/Rko1mdwFYSPCgitraCFseCwl/Jk6TKsJYApC8CF
tasks:
- internal.lock_machines:
  - 2
  - plana
- internal.save_config: null
- internal.check_lock: null
- internal.connect: null
- internal.serialize_remote_roles: null
- internal.check_conflict: null
- internal.check_ceph_data: null
- internal.vm_setup: null
- kernel: *id001
- internal.base: null
- internal.archive: null
- internal.coredump: null
- internal.sudo: null
- internal.syslog: null
- internal.timer: null
- chef: null
- clock.check: null
- install:
    tag: v0.80.3
- parallel:
  - workload
  - upgrade-sequence
- sequential:
  - mon_thrash:
      revive_delay: 20
      thrash_delay: 1
  - ceph-fuse: null
  - workunit:
      clients:
        client.0:
        - suites/dbench.sh
- sequential:
  - thrashosds:
      chance_pgnum_grow: 1
      chance_pgpnum_fix: 1
      timeout: 1200
  - ceph-fuse: null
  - workunit:
      clients:
        all:
        - suites/iogen.sh
- sequential:
  - rgw:
    - client.0
  - s3tests:
      client.0:
        rgw_server: client.0
teuthology_branch: firefly
tube: plana
upgrade-sequence:
  sequential:
  - install.upgrade:
      all:
        branch: firefly
  - ceph.restart:
    - mon.a
  - sleep:
      duration: 60
  - ceph.restart:
    - mon.b
  - sleep:
      duration: 60
  - ceph.restart:
    - mon.c
  - sleep:
      duration: 60
  - ceph.restart:
    - mds.a
  - sleep:
      duration: 60
  - ceph.restart:
    - osd.0
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.1
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.2
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.3
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.4
  - sleep:
      duration: 30
  - ceph.restart:
    - osd.5
verbose: true
worker_log: /var/lib/teuthworker/archive/worker_logs/worker.plana.4991
workload:
  workunit:
    clients:
      all:
      - suites/blogbench.sh
description: upgrade:firefly/{0-cluster/start.yaml 1-install/v0.80.3.yaml 2-workload/blogbench.yaml
  3-upgrade-sequence/upgrade-mon-osd-mds.yaml 4-final/{monthrash.yaml osdthrash.yaml
  testrgw.yaml}}
duration: 217.68520283699036
failure_reason: 'Command failed on 10.214.131.2 with status 127: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp
  && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
  CEPH_REF=67b5193f73a2c9ec9e503ad3431473998217375d TESTDIR="/home/ubuntu/cephtest" 
  CEPH_ID="0" adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage
  timeout 3h /home/ubuntu/cephtest/workunit.client.0/suites/blogbench.sh'''
flavor: basic
mon.a-kernel-sha1: 20bdcbcb52ac95397901581086368dd79c06091f
mon.b-kernel-sha1: 20bdcbcb52ac95397901581086368dd79c06091f
owner: scheduled_teuthology@teuthology
success: false

History

#1 Updated by Yuri Weinstein over 9 years ago

  • Project changed from Ceph to rgw

#2 Updated by Sage Weil over 9 years ago

  • Status changed from New to Resolved

Also available in: Atom PDF