Bug #65766: qa: perm denied for runing find on cephtest dir - CephFS - Ceph

Actions

Copy link

Bug #65766

open

« Previous | Next »

qa: perm denied for runing find on cephtest dir

Added by Rishabh Dave 17 days ago. Updated 7 days ago.

Status:

New

Priority:

High

Assignee:

Rishabh Dave

Category:

Testing

Target version:

Ceph - v20.0.0

% Done:

Source:

Tags:

Backport:

quincy,reef,squid

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Component(FS):

qa-suite

Labels (FS):

qa, qa-failure

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

After the test suite finishes running, during teardown/unwinding running find /home/ubuntu/cephtest unexpectedly prints Permission denied.

https://pulpito.ceph.com/rishabh-2024-05-01_05:12:28-fs-rishabh-main-26apr-4a05c14-2-testing-default-smithi/7682548

2024-05-01T12:20:19.816 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload
2024-05-01T12:20:19.828 INFO:teuthology.task.internal:Not uploading archives.
2024-05-01T12:20:19.828 DEBUG:teuthology.run_tasks:Unwinding manager internal.base
2024-05-01T12:20:19.849 INFO:teuthology.task.internal:Tidying up after the test...
2024-05-01T12:20:19.850 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest
2024-05-01T12:20:19.856 DEBUG:teuthology.orchestra.run.smithi195:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest
2024-05-01T12:20:19.905 INFO:teuthology.orchestra.run.smithi088.stdout:   393580      4 drwxr-xr-x   3 ubuntu   ubuntu       4096 May  1 12:20 /home/ubuntu/cephtest
2024-05-01T12:20:19.905 INFO:teuthology.orchestra.run.smithi088.stdout:   527347      4 d---------   2 ubuntu   ubuntu       4096 May  1 12:15 /home/ubuntu/cephtest/mnt.0
2024-05-01T12:20:19.905 INFO:teuthology.orchestra.run.smithi088.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied
2024-05-01T12:20:19.908 DEBUG:teuthology.orchestra.run:got remote process result: 1
2024-05-01T12:20:19.908 INFO:teuthology.orchestra.run.smithi088.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty
2024-05-01T12:20:19.909 ERROR:teuthology.run_tasks:Manager failed: internal.base
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/run_tasks.py", line 154, in run_tasks
    suppress = manager.__exit__(*exc_info)
  File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__
    next(self.gen)
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/task/internal/__init__.py", line 53, in base
    run.wait(
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 479, in wait
    proc.wait()
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 161, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/run.py", line 181, in _raise_for_status
    raise CommandFailedError(
teuthology.exceptions.CommandFailedError: Command failed on smithi088 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest'
2024-05-01T12:20:19.910 DEBUG:teuthology.run_tasks:Unwinding manager kernel
2024-05-01T12:20:19.922 DEBUG:teuthology.run_tasks:Unwinding manager console_log
2024-05-01T12:20:19.950 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: CommandFailedError: Command failed on smithi088 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest'
2024-05-01T12:20:19.950 INFO:teuthology.nuke:Checking targets against current locks

Actions

Copy link

Updated by Rishabh Dave 17 days ago

Description updated (diff)

Actions

Copy link

Updated by Rishabh Dave 17 days ago

Component(FS) qa-suite added
Labels (FS) qa, qa-failure added

Actions

Copy link

Updated by Venky Shankar 14 days ago

The error starts right after generic/099 finishes.

2024-05-01T05:59:02.523 DEBUG:teuthology.orchestra.run.smithi164:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.dzlgQDISvdxfstests-dev/results)
2024-05-01T05:59:02.576 INFO:teuthology.orchestra.run.smithi164.stderr:bash: line 1: cd: /home/ubuntu/cephtest/mnt.0: Permission denied
2024-05-01T05:59:02.577 DEBUG:teuthology.orchestra.run:got remote process result: 1

I bet it's generic/099 that's changing perm for root, but, question is why have we started seeing this now?

Actions

Copy link