Tools » teuthology

When some commands fail, it appears that teuthology removes shipped files before going to an interactive prompt when interactive-on-error is set true. This makes debugging annoying.

CommandFailedError: Command failed on 10.214.134.12 with status 1: '/tmp/cephtest/adjust-ulimits ceph-coverage /tmp/cephtest/archive/coverage osdmaptool -c /etc/ceph/ceph.conf --clobber --createsimple 0 /tmp/cephtest/osdmap --pg_bits 2 --pgp_bits 4'
INFO:teuthology.task.ceph:Checking for errors in any valgrind logs...
INFO:teuthology.orchestra.run.out:[10.214.135.22]: osdmaptool: osdmap file '/tmp/cephtest/osdmap'
INFO:teuthology.orchestra.run.err:[10.214.135.22]: osdmaptool: osd count must be > 0
INFO:teuthology.orchestra.run.err:[10.214.134.12]: gzip: /var/log/ceph/valgrind/*.gz: No such file or directory
INFO:teuthology.orchestra.run.err:[10.214.135.22]: gzip: /var/log/ceph/valgrind/*.gz: No such file or directory
INFO:teuthology.orchestra.run.err:[10.214.135.20]: gzip: /var/log/ceph/valgrind/*.gz: No such file or directory
INFO:teuthology.task.ceph:Removing shipped files: daemon-helper adjust-ulimits chdir-coredump valgrind.supp kcon_most...
ERROR:teuthology.run_tasks:Saw exception from tasks
Traceback (most recent call last):
  File "/home/nhm/src/teuthology/teuthology/run_tasks.py", line 27, in run_tasks
    manager.__enter__()
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/nhm/src/teuthology/teuthology/task/ceph.py", line 1154, in task
    lambda: run_daemon(ctx=ctx, config=config, type_='mds'),
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/nhm/src/teuthology/teuthology/contextutil.py", line 25, in nested
    vars.append(enter())
  File "/usr/lib/python2.7/contextlib.py", line 17, in __enter__
    return self.gen.next()
  File "/home/nhm/src/teuthology/teuthology/task/ceph.py", line 494, in cluster
    wait=False,
  File "/home/nhm/src/teuthology/teuthology/orchestra/run.py", line 282, in wait
    proc.exitstatus.get()
  File "/home/nhm/src/teuthology/virtualenv/local/lib/python2.7/site-packages/gevent/event.py", line 207, in get
    raise self._exception
CommandFailedError: Command failed on 10.214.134.12 with status 1: '/tmp/cephtest/adjust-ulimits ceph-coverage /tmp/cephtest/archive/coverage osdmaptool -c /etc/ceph/ceph.conf --clobber --createsimple 0 /tmp/cephtest/osdmap --pg_bits 2 --pgp_bits 4'
WARNING:teuthology.run_tasks:Saw failure, going into interactive mode...
Ceph test interactive mode, use ctx to interact with the cluster, press control-D to exit...
>>>