Bug #59348: qa: ERROR: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) - CephFS - Ceph

Actions

Copy link

Bug #59348

closed

Bug #59344: qa: workunit test fs/quota/quota.sh failed with "setfattr: .: Invalid argument"

qa: ERROR: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota)

Added by Xiubo Li about 1 year ago. Updated 8 months ago.

Status:

Duplicate

Priority:

Normal

Assignee:

Xiubo Li

Category:

Target version:

% Done:

Source:

Tags:

Backport:

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Component(FS):

Labels (FS):

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

https://pulpito.ceph.com/yuriw-2023-04-05_14:51:06-fs-wip-yuri5-testing-2023-04-04-0814-distro-default-smithi/7232817/

2023-04-05T19:47:02.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-04-05T19:47:02.775+0000 7f904edc0700  1 -- 172.21.15.123:0/128464308 shutdown_connections
2023-04-05T19:47:02.778 INFO:teuthology.orchestra.run.smithi123.stderr:2023-04-05T19:47:02.775+0000 7f904edc0700  1 -- 172.21.15.123:0/128464308 wait complete.
2023-04-05T19:47:02.789 INFO:tasks.cephfs_test_runner:test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota) ... ERROR
2023-04-05T19:47:02.789 INFO:tasks.cephfs_test_runner:
2023-04-05T19:47:02.789 INFO:tasks.cephfs_test_runner:======================================================================
2023-04-05T19:47:02.790 INFO:tasks.cephfs_test_runner:ERROR: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota)
2023-04-05T19:47:02.790 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2023-04-05T19:47:02.790 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2023-04-05T19:47:02.790 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_adb401e638b5b52544c2d2c3633d8d6b2f1425f5/qa/tasks/cephfs/test_quota.py", line 157, in test_disable_enable_human_readable_quota_values
2023-04-05T19:47:02.791 INFO:tasks.cephfs_test_runner:    self.mount_a.setfattr("./subdir", "ceph.quota.max_bytes", "1K")
2023-04-05T19:47:02.791 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_adb401e638b5b52544c2d2c3633d8d6b2f1425f5/qa/tasks/cephfs/mount.py", line 1448, in setfattr
2023-04-05T19:47:02.791 INFO:tasks.cephfs_test_runner:    self.run_shell(**kwargs)
2023-04-05T19:47:02.791 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_adb401e638b5b52544c2d2c3633d8d6b2f1425f5/qa/tasks/cephfs/mount.py", line 780, in run_shell
2023-04-05T19:47:02.791 INFO:tasks.cephfs_test_runner:    return self.client_remote.run(args=args, cwd=cwd, timeout=timeout,
2023-04-05T19:47:02.791 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/orchestra/remote.py", line 525, in run
2023-04-05T19:47:02.792 INFO:tasks.cephfs_test_runner:    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
2023-04-05T19:47:02.792 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/orchestra/run.py", line 455, in run
2023-04-05T19:47:02.792 INFO:tasks.cephfs_test_runner:    r.wait()
2023-04-05T19:47:02.792 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/orchestra/run.py", line 161, in wait
2023-04-05T19:47:02.792 INFO:tasks.cephfs_test_runner:    self._raise_for_status()
2023-04-05T19:47:02.793 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/orchestra/run.py", line 181, in _raise_for_status
2023-04-05T19:47:02.793 INFO:tasks.cephfs_test_runner:    raise CommandFailedError(
2023-04-05T19:47:02.793 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi123 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1K ./subdir)'
2023-04-05T19:47:02.793 INFO:tasks.cephfs_test_runner:
2023-04-05T19:47:02.794 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2023-04-05T19:47:02.794 INFO:tasks.cephfs_test_runner:Ran 1 test in 55.837s
2023-04-05T19:47:02.794 INFO:tasks.cephfs_test_runner:
2023-04-05T19:47:02.794 INFO:tasks.cephfs_test_runner:FAILED (errors=1)
2023-04-05T19:47:02.795 INFO:tasks.cephfs_test_runner:
2023-04-05T19:47:02.795 INFO:tasks.cephfs_test_runner:======================================================================
2023-04-05T19:47:02.795 INFO:tasks.cephfs_test_runner:ERROR: test_disable_enable_human_readable_quota_values (tasks.cephfs.test_quota.TestQuota)
2023-04-05T19:47:02.795 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2023-04-05T19:47:02.795 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2023-04-05T19:47:02.796 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_adb401e638b5b52544c2d2c3633d8d6b2f1425f5/qa/tasks/cephfs/test_quota.py", line 157, in test_disable_enable_human_readable_quota_values
2023-04-05T19:47:02.796 INFO:tasks.cephfs_test_runner:    self.mount_a.setfattr("./subdir", "ceph.quota.max_bytes", "1K")
2023-04-05T19:47:02.796 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_adb401e638b5b52544c2d2c3633d8d6b2f1425f5/qa/tasks/cephfs/mount.py", line 1448, in setfattr
2023-04-05T19:47:02.796 INFO:tasks.cephfs_test_runner:    self.run_shell(**kwargs)
2023-04-05T19:47:02.796 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/github.com_ceph_ceph-c_adb401e638b5b52544c2d2c3633d8d6b2f1425f5/qa/tasks/cephfs/mount.py", line 780, in run_shell
2023-04-05T19:47:02.796 INFO:tasks.cephfs_test_runner:    return self.client_remote.run(args=args, cwd=cwd, timeout=timeout,
2023-04-05T19:47:02.797 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/orchestra/remote.py", line 525, in run
2023-04-05T19:47:02.797 INFO:tasks.cephfs_test_runner:    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
2023-04-05T19:47:02.797 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/orchestra/run.py", line 455, in run
2023-04-05T19:47:02.797 INFO:tasks.cephfs_test_runner:    r.wait()
2023-04-05T19:47:02.797 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/orchestra/run.py", line 161, in wait
2023-04-05T19:47:02.798 INFO:tasks.cephfs_test_runner:    self._raise_for_status()
2023-04-05T19:47:02.798 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_teuthology_8d156aede5efdae00b53d8d3b8d127082980e7ec/teuthology/orchestra/run.py", line 181, in _raise_for_status
2023-04-05T19:47:02.798 INFO:tasks.cephfs_test_runner:    raise CommandFailedError(
2023-04-05T19:47:02.798 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi123 with status 1: '(cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1K ./subdir)'
2023-04-05T19:47:02.798 INFO:tasks.cephfs_test_runner:

Related issues 1 (1 open — 0 closed)

Actions

Copy link

Updated by Dhairya Parmar about 1 year ago

from teuthology log

2023-04-05T19:46:48.865 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir subdir)
2023-04-05T19:46:48.891 INFO:teuthology.orchestra.run:Running command with timeout 300
2023-04-05T19:46:48.892 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 0 ./subdir)
2023-04-05T19:46:48.953 INFO:teuthology.orchestra.run:Running command with timeout 300
2023-04-05T19:46:48.954 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes ./subdir)
2023-04-05T19:46:49.014 DEBUG:teuthology.orchestra.run:got remote process result: 1
2023-04-05T19:46:49.014 INFO:teuthology.orchestra.run.smithi123.stderr:./subdir: ceph.quota.max_bytes: No such attribute
2023-04-05T19:46:49.015 INFO:teuthology.orchestra.run:Running command with timeout 300
2023-04-05T19:46:49.015 DEBUG:teuthology.orchestra.run.smithi123:> (cd /home/ubuntu/cephtest/mnt.0 && exec setfattr -n ceph.quota.max_bytes -v 1K ./subdir)
2023-04-05T19:46:49.075 DEBUG:teuthology.orchestra.run:got remote process result: 1
2023-04-05T19:46:49.076 INFO:teuthology.orchestra.run.smithi123.stderr:setfattr: ./subdir: Invalid argument

Haven't seen this before. Will dig into the logs sometime later

Actions

Copy link

Updated by Dhairya Parmar about 1 year ago

Reason is this commit: https://github.com/ceph/ceph/commit/8679e0c2eb624efa3ab66f2238546629a3e3a339.

Because this test case sets quota.max_bytes to 1K which doesn't align with 4KB or 4MB, it fails and returns -CEPHFS_EINVAL. This can be confirmed by checking the MDS log

2023-04-06T08:41:44.492+0000 7fecb3018700 20 mds.0.server parse_quota_vxattr name quota.max_bytes value '1K'
2023-04-06T08:41:44.492+0000 7fecb3018700 10 mds.0.server parse_quota_vxattr:  failed to parse quota.max_bytes: 
2023-04-06T08:41:44.492+0000 7fecb3018700  7 mds.0.server reply_client_request -22 ((22) Invalid argument) client_request(client.5790:8 setxattr #0x10000000000 ceph.quota.max_bytes 2023-04-06T08:41:44.497599+0000 caller_uid=1000, caller_gid=1267{6,27,108,1267,10102,}) v6

I'll have to make changes to the test cases I wrote to align with this change

Actions

Copy link