Ceph

log: ubuntu@teuthology:/a/teuthology-2013-01-05_22:28:52-regression-next-testing-basic/35949

35949: (190s) collection:kernel-cephfs clusters:fixed-3.yaml fs:btrfs.yaml tasks:kclient_workunit_suites_fsync.yaml
Command failed with status 1: 'mkdir p - /tmp/cephtest/mnt.0/client.0/tmp && cd -- /tmp/cephtest/mnt.0/client.0/tmp && CEPH_REF=ce49968938ca3636f48fe543111aa219f36914d8 PATH="$PATH:/tmp/cephtest/binary/usr/local/bin" LD_LIBRARY_PATH="$LD_LIBRARY_PATH:/tmp/cephtest/binary/usr/local/lib" CEPH_CONF="/tmp/cephtest/ceph.conf" CEPH_SECRET_FILE="/tmp/cephtest/data/client.0.secret" CEPH_ID="0" PYTHONPATH="$PYTHONPATH:/tmp/cephtest/binary/usr/local/lib/python2.7/dist-packages:/tmp/cephtest/binary/usr/local/lib/python2.6/dist-packages" /tmp/cephtest/enable-coredump /tmp/cephtest/binary/usr/local/bin/ceph-coverage /tmp/cephtest/archive/coverage /tmp/cephtest/workunit.client.0/suites/fsync-tester.sh'

2013-01-06T04:31:01.782 INFO:teuthology.task.workunit.client.0.err:+ ./fsync-tester
2013-01-06T04:31:01.785 INFO:teuthology.task.workunit.client.0.err:open: Permission denied
2013-01-06T04:31:01.786 INFO:teuthology.task.workunit:Stopping suites/fsync-tester.sh on client.0...
2013-01-06T04:31:01.787 DEBUG:teuthology.orchestra.run:Running: 'rm -rf -- /tmp/cephtest/workunits.list /tmp/cephtest/workunit.client.0'
2013-01-06T04:31:01.805 ERROR:teuthology.run_tasks:Saw exception from tasks
Traceback (most recent call last):
  File "/var/lib/teuthworker/teuthology-next/teuthology/run_tasks.py", line 25, in run_tasks
    manager = _run_one_task(taskname, ctx=ctx, config=config)
  File "/var/lib/teuthworker/teuthology-next/teuthology/run_tasks.py", line 14, in _run_one_task
    return fn(**kwargs)
  File "/var/lib/teuthworker/teuthology-next/teuthology/task/workunit.py", line 90, in task
    _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), config.get('subdir'))
  File "/var/lib/teuthworker/teuthology-next/teuthology/task/workunit.py", line 130, in _spawn_on_all_clients
    p.spawn(_run_tests, ctx, refspec, role, [unit], env, subdir)
  File "/var/lib/teuthworker/teuthology-next/teuthology/parallel.py", line 83, in __exit__
    for result in self:
  File "/var/lib/teuthworker/teuthology-next/teuthology/parallel.py", line 100, in next
    resurrect_traceback(result)
  File "/var/lib/teuthworker/teuthology-next/teuthology/parallel.py", line 19, in capture_traceback
    return func(*args, **kwargs)
  File "/var/lib/teuthworker/teuthology-next/teuthology/task/workunit.py", line 222, in _run_tests
    args=args,
  File "/var/lib/teuthworker/teuthology-next/teuthology/orchestra/remote.py", line 40, in run
    r = self._runner(client=self.ssh, **kwargs)
  File "/var/lib/teuthworker/teuthology-next/teuthology/orchestra/run.py", line 257, in run
    r.exitstatus = _check_status(r.exitstatus)
  File "/var/lib/teuthworker/teuthology-next/teuthology/orchestra/run.py", line 253, in _check_status
    raise CommandFailedError(command=r.command, exitstatus=status)
CommandFailedError: Command failed with status 1: 'mkdir -p -- /tmp/cephtest/mnt.0/client.0/tmp && cd -- /tmp/cephtest/mnt.0/client.0/tmp && CEPH_REF=ce49968938ca3636f48fe543111aa219f36914d8 PATH="$PATH:/tmp/cephtest/binary/usr/local/bin" LD_LIBRARY_PATH="$LD_LIBRARY_PATH:/tmp/cephtest/binary/usr/local/lib" CEPH_CONF="/tmp/cephtest/ceph.conf" CEPH_SECRET_FILE="/tmp/cephtest/data/client.0.secret" CEPH_ID="0" PYTHONPATH="$PYTHONPATH:/tmp/cephtest/binary/usr/local/lib/python2.7/dist-packages:/tmp/cephtest/binary/usr/local/lib/python2.6/dist-packages" /tmp/cephtest/enable-coredump /tmp/cephtest/binary/usr/local/bin/ceph-coverage /tmp/cephtest/archive/coverage /tmp/cephtest/workunit.client.0/suites/fsync-tester.sh'
2013-01-06T04:31:01.807 DEBUG:teuthology.run_tasks:Unwinding manager <contextlib.GeneratorContextManager object at 0x1af6210>
2013-01-06T04:31:01.807 INFO:teuthology.task.kclient:Unmounting kernel clients...
2013-01-06T04:31:01.807 DEBUG:teuthology.task.kclient:Unmounting client client.0...
2013-01-06T04:31:01.808 DEBUG:teuthology.orchestra.run:Running: 'sudo umount /tmp/cephtest/mnt.0'
2013-01-06T04:31:04.485 DEBUG:teuthology.orchestra.run:Running: 'rmdir -- /tmp/cephtest/mnt.0'
2013-01-06T04:31:04.493 DEBUG:teuthology.run_tasks:Unwinding manager <contextlib.GeneratorContextManager object at 0x1a36a90>
2013-01-06T04:31:04.493 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
  File "/var/lib/teuthworker/teuthology-next/teuthology/contextutil.py", line 27, in nested
    yield vars
  File "/var/lib/teuthworker/teuthology-next/teuthology/task/ceph.py", line 1091, in task
    yield
  File "/var/lib/teuthworker/teuthology-next/teuthology/run_tasks.py", line 25, in run_tasks
    manager = _run_one_task(taskname, ctx=ctx, config=config)
  File "/var/lib/teuthworker/teuthology-next/teuthology/run_tasks.py", line 14, in _run_one_task
    return fn(**kwargs)
  File "/var/lib/teuthworker/teuthology-next/teuthology/task/workunit.py", line 90, in task
    _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), config.get('subdir'))
  File "/var/lib/teuthworker/teuthology-next/teuthology/task/workunit.py", line 130, in _spawn_on_all_clients
    p.spawn(_run_tests, ctx, refspec, role, [unit], env, subdir)
  File "/var/lib/teuthworker/teuthology-next/teuthology/parallel.py", line 83, in __exit__
    for result in self:
  File "/var/lib/teuthworker/teuthology-next/teuthology/parallel.py", line 100, in next
    resurrect_traceback(result)
  File "/var/lib/teuthworker/teuthology-next/teuthology/parallel.py", line 19, in capture_traceback
    return func(*args, **kwargs)
  File "/var/lib/teuthworker/teuthology-next/teuthology/task/workunit.py", line 222, in _run_tests
    args=args,
  File "/var/lib/teuthworker/teuthology-next/teuthology/orchestra/remote.py", line 40, in run
    r = self._runner(client=self.ssh, **kwargs)
  File "/var/lib/teuthworker/teuthology-next/teuthology/orchestra/run.py", line 257, in run
    r.exitstatus = _check_status(r.exitstatus)
  File "/var/lib/teuthworker/teuthology-next/teuthology/orchestra/run.py", line 253, in _check_status
    raise CommandFailedError(command=r.command, exitstatus=status)
CommandFailedError: Command failed with status 1: 'mkdir -p -- /tmp/cephtest/mnt.0/client.0/tmp && cd -- /tmp/cephtest/mnt.0/client.0/tmp && CEPH_REF=ce49968938ca3636f48fe543111aa219f36914d8 PATH="$PATH:/tmp/cephtest/binary/usr/local/bin" LD_LIBRARY_PATH="$LD_LIBRARY_PATH:/tmp/cephtest/binary/usr/local/lib" CEPH_CONF="/tmp/cephtest/ceph.conf" CEPH_SECRET_FILE="/tmp/cephtest/data/client.0.secret" CEPH_ID="0" PYTHONPATH="$PYTHONPATH:/tmp/cephtest/binary/usr/local/lib/python2.7/dist-packages:/tmp/cephtest/binary/usr/local/lib/python2.6/dist-packages" /tmp/cephtest/enable-coredump /tmp/cephtest/binary/usr/local/bin/ceph-coverage /tmp/cephtest/archive/coverage /tmp/cephtest/workunit.client.0/suites/fsync-tester.sh'