Ceph » devops

Logs are in http://qa-proxy.ceph.com/teuthology/teuthology-2014-12-12_19:13:02-upgrade:dumpling-x-firefly-distro-basic-vps/653397/

2014-12-13T02:50:19.954 INFO:teuthology.orchestra.run.vpm143.stdout:[2014-12-13T10:50:19+00:00] ERROR: Running exception handlers
2014-12-13T02:50:19.954 INFO:teuthology.orchestra.run.vpm143.stdout:[2014-12-13T10:50:19+00:00] ERROR: Exception handlers complete
2014-12-13T02:50:19.954 INFO:teuthology.orchestra.run.vpm143.stdout:[2014-12-13T10:50:19+00:00] FATAL: Stacktrace dumped to /tmp/solo-from-scratch.t8GneeoTvHmo/solo/chef-stacktrace.out
2014-12-13T02:50:19.954 INFO:teuthology.orchestra.run.vpm143.stdout:[2014-12-13T10:50:19+00:00] ERROR: package[mpich2] (ceph-qa::ubuntu line 278) had an error: Mixlib::ShellOut::CommandTimeout: Command timed out after 600s:

........

2014-12-13T02:50:20.346 INFO:teuthology.orchestra.run.vpm143.stdout:---- End output of apt-get -q -y install mpich2=3.0.4-6ubuntu1 ----
2014-12-13T02:50:20.346 INFO:teuthology.orchestra.run.vpm143.stdout:Ran apt-get -q -y install mpich2=3.0.4-6ubuntu1 returned
2014-12-13T02:50:20.346 INFO:teuthology.orchestra.run.vpm143.stdout:[2014-12-13T10:50:20+00:00] FATAL: Chef::Exceptions::ChildConvergeError: Chef run process exited unsuccessfully (exit code 1)
2014-12-13T02:50:20.346 ERROR:teuthology.parallel:Exception in parallel execution
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 82, in __exit__
    for result in self:
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 101, in next
    resurrect_traceback(result)
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 19, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/task/internal.py", line 623, in _download_and_run_chef
    'sh',
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 128, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 368, in run
    r.wait()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 106, in wait
    exitstatus=status, node=self.hostname)
CommandFailedError: Command failed on vpm143 with status 1: "wget -q -O- 'http://ceph.com/git/?p=ceph-qa-chef.git;a=blob_plain;f=solo/solo-from-scratch;hb=HEAD' | sh" 
2014-12-13T02:50:20.347 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/run_tasks.py", line 53, in run_tasks
    manager = run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/teuthology_master/teuthology/run_tasks.py", line 41, in run_one_task
    return fn(**kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/task/internal.py", line 613, in vm_setup
    p.spawn(_download_and_run_chef, rem)
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 89, in __exit__
    raise
CommandFailedError: Command failed on vpm143 with status 1: "wget -q -O- 'http://ceph.com/git/?p=ceph-qa-chef.git;a=blob_plain;f=solo/solo-from-scratch;hb=HEAD' | sh" 
2014-12-13T02:50:20.347 DEBUG:teuthology.run_tasks:Unwinding manager internal.lock_machines
2014-12-13T02:50:20.348 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on vpm143 with status 1: "wget -q -O- 'http://ceph.com/git/?p=ceph-qa-chef.git;a=blob_plain;f=solo/solo-from-scratch;hb=HEAD' | sh" 
2014-12-13T02:50:20.348 INFO:teuthology.nuke:Checking targets against current locks
2014-12-13T02:50:20.351 INFO:teuthology.orchestra.run.vpm169.stdout:
2014-12-13T02:50:20.352 INFO:teuthology.orchestra.run.vpm169.stdout:================================================================================
2014-12-13T02:50:20.352 INFO:teuthology.orchestra.run.vpm169.stdout:Error executing action `install` on resource 'package[mpich2]'
2014-12-13T02:50:20.352 INFO:teuthology.orchestra.run.vpm169.stdout:================================================================================