Bug #13658: "Caught an exception deleting dir" does not fail a job - teuthology - Ceph

Actions

Copy link

Bug #13658

closed

"Caught an exception deleting dir" does not fail a job

Added by Yuri Weinstein over 8 years ago. Updated over 8 years ago.

Status:

Resolved

Priority:

Normal

Assignee:

Zack Cerza

Category:

% Done:

Source:

Q/A

Tags:

Backport:

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

kcephfs

Crash signature (v1):

Crash signature (v2):

Description

Run: http://pulpito.ceph.com/teuthology-2015-10-30_10:48:34-kcephfs-firefly-testing-basic-multi/
Jobs: 1131547, 1131548
Logs: http://qa-proxy.ceph.com/teuthology/teuthology-2015-10-30_10:48:34-kcephfs-firefly-testing-basic-multi/1131547/teuthology.log

Yet both jobs have this trace but both marked as "pass"

Zack, is it normal?

2015-10-30T15:45:26.842 INFO:teuthology.orchestra.run.plana90:Running: 'rm -rf -- /home/ubuntu/cephtest/workunits.list /home/ubuntu/cephtest/workunit.client.0'
2015-10-30T15:45:26.891 DEBUG:teuthology.parallel:result is None
2015-10-30T15:45:26.891 INFO:teuthology.orchestra.run.plana90:Running: 'rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0'
2015-10-30T15:45:26.927 INFO:teuthology.orchestra.run.plana90.stderr:rm: cannot remove â€˜/home/ubuntu/cephtest/mnt.0/client.0â€™: Permission denied
2015-10-30T15:45:26.928 ERROR:tasks.workunit:Caught an exception deleting dir /home/ubuntu/cephtest/mnt.0/client.0
Traceback (most recent call last):
  File "/var/lib/teuthworker/src/ceph-qa-suite_firefly/tasks/workunit.py", line 140, in _delete_dir
    client,
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 156, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 378, in run
    r.wait()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 114, in wait
    label=self.label)
CommandFailedError: Command failed on plana90 with status 1: 'rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0'
2015-10-30T15:45:27.001 INFO:teuthology.orchestra.run.plana90:Running: 'rmdir -- /home/ubuntu/cephtest/mnt.0'
2015-10-30T15:45:27.022 INFO:teuthology.orchestra.run.plana90.stderr:rmdir: failed to remove â€˜/home/ubuntu/cephtest/mnt.0â€™: Device or resource busy
2015-10-30T15:45:27.022 ERROR:tasks.workunit:Caught an exception deleting dir /home/ubuntu/cephtest/mnt.0
Traceback (most recent call last):
  File "/var/lib/teuthworker/src/ceph-qa-suite_firefly/tasks/workunit.py", line 152, in _delete_dir
    mnt,
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 156, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 378, in run
    r.wait()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 114, in wait
    label=self.label)
CommandFailedError: Command failed on plana90 with status 1: 'rmdir -- /home/ubuntu/cephtest/mnt.0'
2015-10-30T15:45:27.022 DEBUG:teuthology.run_tasks:Unwinding manager kclient

Actions

Copy link

Updated by Yuri Weinstein over 8 years ago

Description updated (diff)

Actions

Copy link

Updated by Yuri Weinstein over 8 years ago

Description updated (diff)

Actions

Copy link

Updated by Tamilarasi muthamizhan over 8 years ago

Assignee set to Zack Cerza

maybe this is something to do with sudo access being removed for those commands? not sure why sudo was removed for them though. zack- anything on this?

this happens when trying to remove the test directories after the test execution, definitely not a ceph issue.

Actions

Copy link

Updated by Greg Farnum over 8 years ago

This behavior is only present in Firefly, not in master. Looks like it got removed, but it happened before the ceph-qa-suite/teuthology split and tracking the git history got annoying so I'm not sure how.

Actions

Copy link