Project

General

Profile

Actions

Bug #65807

open

qa failure: test_adding_multiple_caps (tasks.cephfs.test_admin.TestFsAuthorize)

Added by Rishabh Dave 13 days ago. Updated 13 days ago.

Status:
New
Priority:
Normal
Assignee:
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
qa-suite
Labels (FS):
qa, qa-failure
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

From https://pulpito.ceph.com/vshankar-2024-05-01_17:34:00-fs-wip-vshankar-testing-20240430.111407-debug-testing-default-smithi/7683594/ -

2024-05-01T06:09:31.131 INFO:teuthology.orchestra.run.smithi079.stdout:keyring.get_secret failed
2024-05-01T06:09:31.138 INFO:teuthology.orchestra.run.smithi079.stderr:mount error 13 = Permission denied
...
2024-05-01T18:42:16.294 DEBUG:teuthology.orchestra.run:got remote process result: 32
2024-05-01T18:42:16.294 INFO:tasks.cephfs.kernel_mount:mount command failed
2024-05-01T18:42:23.823 INFO:tasks.cephfs_test_runner:Test that the command "ceph fs authorize" is successful in updating ... ERROR
2024-05-01T18:42:23.823 INFO:tasks.cephfs_test_runner:
2024-05-01T18:42:23.823 INFO:tasks.cephfs_test_runner:======================================================================
2024-05-01T18:42:23.823 INFO:tasks.cephfs_test_runner:ERROR: test_adding_multiple_caps (tasks.cephfs.test_admin.TestFsAuthorize)
2024-05-01T18:42:23.823 INFO:tasks.cephfs_test_runner:Test that the command "ceph fs authorize" is successful in updating
2024-05-01T18:42:23.823 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2024-05-01T18:42:23.823 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2024-05-01T18:42:23.823 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_5ef2baf9bfba0061cb137abe5d8fc74e1acd4bd8/qa/tasks/cephfs/test_admin.py", line 1601, in test_adding_multiple_caps
2024-05-01T18:42:23.824 INFO:tasks.cephfs_test_runner:    self._remount_and_run_tests(FS_AUTH_CAPS, keyring)
2024-05-01T18:42:23.824 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_5ef2baf9bfba0061cb137abe5d8fc74e1acd4bd8/qa/tasks/cephfs/test_admin.py", line 1618, in _remount_and_run_tests
2024-05-01T18:42:23.824 INFO:tasks.cephfs_test_runner:    self._remount(keyring, PATH)
2024-05-01T18:42:23.824 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_5ef2baf9bfba0061cb137abe5d8fc74e1acd4bd8/qa/tasks/cephfs/test_admin.py", line 1625, in _remount
2024-05-01T18:42:23.824 INFO:tasks.cephfs_test_runner:    self.mount_a.remount(client_id=self.client_id,
2024-05-01T18:42:23.824 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_5ef2baf9bfba0061cb137abe5d8fc74e1acd4bd8/qa/tasks/cephfs/mount.py", line 593, in remount
2024-05-01T18:42:23.824 INFO:tasks.cephfs_test_runner:    retval = self.mount(mntopts=mntopts, check_status=check_status)
2024-05-01T18:42:23.824 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_5ef2baf9bfba0061cb137abe5d8fc74e1acd4bd8/qa/tasks/cephfs/kernel_mount.py", line 59, in mount
2024-05-01T18:42:23.824 INFO:tasks.cephfs_test_runner:    retval = self._run_mount_cmd(mntopts, check_status)
2024-05-01T18:42:23.824 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_5ef2baf9bfba0061cb137abe5d8fc74e1acd4bd8/qa/tasks/cephfs/kernel_mount.py", line 86, in _run_mount_cmd
2024-05-01T18:42:23.824 INFO:tasks.cephfs_test_runner:    self.client_remote.run(args=mount_cmd, timeout=300,
2024-05-01T18:42:23.824 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/remote.py", line 523, in run
2024-05-01T18:42:23.824 INFO:tasks.cephfs_test_runner:    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
2024-05-01T18:42:23.824 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 455, in run
2024-05-01T18:42:23.824 INFO:tasks.cephfs_test_runner:    r.wait()
2024-05-01T18:42:23.824 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 161, in wait
2024-05-01T18:42:23.824 INFO:tasks.cephfs_test_runner:    self._raise_for_status()
2024-05-01T18:42:23.824 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/orchestra/run.py", line 181, in _raise_for_status
2024-05-01T18:42:23.824 INFO:tasks.cephfs_test_runner:    raise CommandFailedError(
2024-05-01T18:42:23.825 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi079 with status 32: 'sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph testuser@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,secret=AQAFjTJm4xeVNxAAoJPoX91/LaphrD1bJ/Ju7g==,conf=/etc/ceph/ceph.conf,norbytes,nofallback'

7682550/remote/smithi116/log/ceph-mds.d.log.gz -

  -477> 2024-05-01T06:09:31.131+0000 7fe61c34d640 10 mds.0.293 send_message_client client.17667 v1:192.168.0.1:0/3719722136 client_session(reject)
  -476> 2024-05-01T06:09:31.131+0000 7fe61c34d640  1 -- [v2:172.21.15.116:6833/1390372059,v1:172.21.15.116:6834/1390372059] --> v1:192.168.0.1:0/3719722136 -- client_session(reject) -- 0x55e94bdf3440 con 0x55e94ae0ac00
  -475> 2024-05-01T06:09:31.131+0000 7fe61c34d640  2 mds.0.server New client session: addr="v1:192.168.0.1:0/3719722136",elapsed=0.000079,throttled=0.000012,status="REJECTED",error="client lacks CEPHFS_FEATURE_MDS_AUTH_CAPS_CHECK needed to enforce 'root_squash' MDS auth caps",root="/" 
  -474> 2024-05-01T06:09:31.131+0000 7fe61c34d640  0 log_channel(cluster) log [WRN] : client session (client.17667 v1:192.168.0.1:0/3719722136) lacks CEPHFS_FEATURE_MDS_AUTH_CAPS_CHECK  needed to enforce 'root_squash' MDS auth caps

Can't be reproduced with FUSE and can be reproduced with kclient, whether using teuthology or vstart_runner.py

Actions #1

Updated by Rishabh Dave 13 days ago

  • Description updated (diff)
  • Assignee set to Rishabh Dave
Actions #2

Updated by Rishabh Dave 13 days ago

  • Description updated (diff)
Actions

Also available in: Atom PDF