Actions
Bug #12975
closedhang on Running: 'rm -fr /tmp/tmp9MT118'
Status:
Closed
Priority:
Urgent
Assignee:
-
Category:
-
% Done:
0%
Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):
Description
2015-09-06T07:06:21.158 INFO:teuthology.orchestra.run.burnupi55.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2015-09-06T07:06:21.164 INFO:tasks.ceph:Compressing logs... 2015-09-06T07:06:21.165 INFO:teuthology.orchestra.run.burnupi54:Running: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" 2015-09-06T07:06:21.204 INFO:teuthology.orchestra.run.burnupi55:Running: "sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip --" 2015-09-06T07:07:47.078 INFO:tasks.ceph:Archiving logs... 2015-09-06T07:07:48.980 DEBUG:teuthology.misc:Transferring archived files from burnupi54:/var/log/ceph to /var/lib/teuthworker/archive/sage-2015-09-06_05:36:07-rados-wip-sage-testing---basic-multi/1044666/remote/burnupi54/log 2015-09-06T07:07:49.108 INFO:teuthology.orchestra.run.burnupi54:Running: "python -c 'import os; import tempfile; import sys;(fd,fname) = tempfile.mkstemp();os.close(fd);sys.stdout.write(fname.rstrip());sys.stdout.flush()'" 2015-09-06T07:07:49.136 INFO:teuthology.orchestra.run.burnupi54:Running: 'sudo tar cz -f /tmp/tmp9MT118 -C /var/log/ceph -- .' 2015-09-06T07:08:08.675 INFO:teuthology.orchestra.run.burnupi54:Running: 'sudo chmod 0666 /tmp/tmp9MT118' 2015-09-06T07:08:35.214 INFO:teuthology.orchestra.run.burnupi54:Running: 'rm -fr /tmp/tmp9MT118'
/a/sage-2015-09-06_05:36:07-rados-wip-sage-testing---basic-multi/1044666
/a/sage-2015-09-06_05:36:07-rados-wip-sage-testing---basic-multi/1044615
/a/sage-2015-09-06_05:36:07-rados-wip-sage-testing---basic-multi/1044687
On the host, I see nothing of interest...
1182 ? Ss 0:00 /usr/sbin/sshd -D 11609 ? Ss 0:00 \_ sshd: ubuntu [priv] 11614 ? S 0:21 | \_ sshd: ubuntu@notty 27861 ? Ss 0:00 \_ sshd: ubuntu [priv] 27864 ? S 0:00 \_ sshd: ubuntu@pts/0 27865 pts/0 Ss 0:00 \_ -bash 27914 pts/0 R+ 0:00 \_ ps axf
and that tmp file doesn't exist in /tmp.
Updated by Sage Weil over 8 years ago
a similar failure.. the task hung on
2015-09-06T07:09:34.411 INFO:teuthology.orchestra.run.mira097:Running: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-3' 2015-09-06T07:09:34.614 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@mira097.front.sepia.ceph.com 2015-09-06T07:09:34.614 INFO:teuthology.orchestra.run.mira097:Running: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-4' 2015-09-06T07:09:34.807 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@mira097.front.sepia.ceph.com 2015-09-06T07:09:34.808 INFO:teuthology.orchestra.run.mira097:Running: 'sync && sudo umount -f /var/lib/ceph/osd/ceph-5' 2015-09-06T07:09:35.004 INFO:tasks.ceph:Archiving mon data... 2015-09-06T07:09:35.128 DEBUG:teuthology.misc:Transferring archived files from plana69:/var/lib/ceph/mon to /var/lib/teuthworker/archive/sage-2015-09-06_05:36:07-rados-wip-sage-testing---basic-multi/1044730/data/mon.a.tgz 2015-09-06T07:09:35.128 INFO:teuthology.orchestra.run.plana69:Running: "python -c 'import os; import tempfile; import sys;(fd,fname) = tempfile.mkstemp();os.close(fd);sys.stdout.write(fname.rstrip());sys.stdout.flush()'" 2015-09-06T07:09:35.201 INFO:teuthology.orchestra.run.plana69:Running: 'sudo tar cz -f /tmp/tmpWMZqL6 -C /var/lib/ceph/mon -- .' 2015-09-06T07:09:35.780 INFO:teuthology.orchestra.run.plana69:Running: 'sudo chmod 0666 /tmp/tmpWMZqL6'
and on the host,
1089 ? Ss 0:00 /usr/sbin/sshd -D 24018 ? Ss 0:00 \_ sshd: ubuntu [priv] 24036 ? S 0:00 | \_ sshd: ubuntu@notty 5373 ? Ss 0:00 | \_ /usr/lib/openssh/sftp-server 6390 ? Ss 0:00 \_ sshd: ubuntu [priv] 6408 ? S 0:00 \_ sshd: ubuntu@pts/0 6409 pts/0 Ss 0:00 \_ -bash 6426 pts/0 S 0:00 \_ sudo bash 6427 pts/0 S 0:00 \_ bash 6445 pts/0 R+ 0:00 \_ ps axf root@plana69:~# lsof | grep /tmp sftp-serv 5373 ubuntu 3r REG 8,1 551723 28311569 /tmp/tmpWMZqL6 sshd 6408 ubuntu 11u unix 0xffff880139c70a80 0t0 686189 /tmp/ssh-uZ8IoQzWvI/agent.6408
/a/sage-2015-09-06_05:36:07-rados-wip-sage-testing---basic-multi/1044730
Updated by Dan Mick over 8 years ago
Did you discover anything about this, andrewschoen?
Updated by Zack Cerza almost 8 years ago
- Status changed from New to Closed
- Assignee deleted (
Andrew Schoen)
Actions