Actions
Bug #15098
closed"stop ceph-all" no longer stops ceph
Status:
Resolved
Priority:
Urgent
Assignee:
-
Category:
-
Target version:
-
% Done:
0%
Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
2 - major
Reviewed:
Affected Versions:
ceph-qa-suite:
ceph-deploy
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
on Trusty only
Run: http://pulpito.ceph.com/teuthology-2016-03-10_21:13:02-ceph-deploy-jewel-distro-basic-vps/
Jobs: ['52029', '52031', '52034']
Logs: http://qa-proxy.ceph.com/teuthology/teuthology-2016-03-10_21:13:02-ceph-deploy-jewel-distro-basic-vps/52031/teuthology.log
2016-03-10T21:32:04.228 INFO:teuthology.orchestra.run.vpm036:Running: "python -c 'import os; import tempfile; import sys;(fd,fname) = tempfile.mkstemp();os.close(fd);sys.stdout.write(fname.rstrip());sys.stdout.flush()'"
2016-03-10T21:32:04.250 INFO:teuthology.orchestra.run.vpm036:Running: 'sudo tar cz -f /tmp/tmpqamrX6 -C /var/lib/ceph/mon -- .'
2016-03-10T21:32:04.367 INFO:teuthology.orchestra.run.vpm036:Running: 'sudo chmod 0666 /tmp/tmpqamrX6'
2016-03-10T21:32:04.500 INFO:teuthology.orchestra.run.vpm036:Running: 'rm -fr /tmp/tmpqamrX6'
2016-03-10T21:32:04.507 DEBUG:teuthology.misc:Transferring archived files from vpm115:/var/lib/ceph/mon to /var/lib/teuthworker/archive/teuthology-2016-03-10_21:13:02-ceph-deploy-jewel-distro-basic-vps/52031/data/mon.vpm115.tgz
2016-03-10T21:32:04.508 INFO:teuthology.orchestra.run.vpm115:Running: "python -c 'import os; import tempfile; import sys;(fd,fname) = tempfile.mkstemp();os.close(fd);sys.stdout.write(fname.rstrip());sys.stdout.flush()'"
2016-03-10T21:32:04.533 INFO:teuthology.orchestra.run.vpm115:Running: 'sudo tar cz -f /tmp/tmpBs3gcz -C /var/lib/ceph/mon -- .'
2016-03-10T21:32:04.683 INFO:teuthology.orchestra.run.vpm115.stderr:tar: ./ceph-vpm115/store.db/000006.log: file changed as we read it
2016-03-10T21:32:04.686 INFO:tasks.ceph_deploy:Removing ceph-deploy ...
2016-03-10T21:32:04.686 INFO:teuthology.orchestra.run.vpm115:Running: 'rm -rf /home/ubuntu/cephtest/ceph-deploy'
2016-03-10T21:32:04.716 INFO:teuthology.task.install:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits...
2016-03-10T21:32:04.717 INFO:teuthology.orchestra.run.vpm036:Running: 'sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits'
2016-03-10T21:32:04.721 INFO:teuthology.orchestra.run.vpm115:Running: 'sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits'
2016-03-10T21:32:04.768 ERROR:teuthology.run_tasks:Manager failed: ceph-deploy
Traceback (most recent call last):
File "/home/teuthworker/src/teuthology_master/teuthology/run_tasks.py", line 139, in run_tasks
suppress = manager.__exit__(*exc_info)
File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
self.gen.next()
File "/var/lib/teuthworker/src/ceph-qa-suite_jewel/tasks/ceph_deploy.py", line 664, in task
yield
File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
self.gen.next()
File "/home/teuthworker/src/teuthology_master/teuthology/contextutil.py", line 44, in nested
if exit(*exc):
File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
self.gen.next()
File "/var/lib/teuthworker/src/ceph-qa-suite_jewel/tasks/ceph_deploy.py", line 408, in build_ceph_cluster
path + '/' + role + '.tgz')
File "/home/teuthworker/src/teuthology_master/teuthology/misc.py", line 772, in pull_directory_tarball
remote.get_tar(remotedir, localfile, sudo=True)
File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 348, in get_tar
self.run(args=args)
File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 196, in run
r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 378, in run
r.wait()
File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 114, in wait
label=self.label)
CommandFailedError: Command failed on vpm115 with status 1: 'sudo tar cz -f /tmp/tmpBs3gcz -C /var/lib/ceph/mon -- .'
2016-03-10T21:32:04.772 DEBUG:teuthology.run_tasks:Unwinding manager ssh_keys
2016-03-10T21:32:04.799 ERROR:teuthology.contextutil:Saw exception from nested tasks
Traceback (most recent call last):
File "/home/teuthworker/src/teuthology_master/teuthology/contextutil.py", line 30, in nested
yield vars
File "/home/teuthworker/src/teuthology_master/teuthology/task/ssh_keys.py", line 206, in task
yield
File "/home/teuthworker/src/teuthology_master/teuthology/run_tasks.py", line 139, in run_tasks
suppress = manager.__exit__(*exc_info)
File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
self.gen.next()
File "/var/lib/teuthworker/src/ceph-qa-suite_jewel/tasks/ceph_deploy.py", line 664, in task
yield
File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
self.gen.next()
File "/home/teuthworker/src/teuthology_master/teuthology/contextutil.py", line 44, in nested
if exit(*exc):
File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__
self.gen.next()
File "/var/lib/teuthworker/src/ceph-qa-suite_jewel/tasks/ceph_deploy.py", line 408, in build_ceph_cluster
path + '/' + role + '.tgz')
File "/home/teuthworker/src/teuthology_master/teuthology/misc.py", line 772, in pull_directory_tarball
remote.get_tar(remotedir, localfile, sudo=True)
File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 348, in get_tar
self.run(args=args)
File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 196, in run
r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 378, in run
r.wait()
File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 114, in wait
label=self.label)
CommandFailedError: Command failed on vpm115 with status 1: 'sudo tar cz -f /tmp/tmpBs3gcz -C /var/lib/ceph/mon -- .'
Actions