2023-06-23T20:12:36.457 INFO:tasks.workunit:Running workunit fs/quota/quota.sh...
2023-06-23T20:12:36.457 DEBUG:teuthology.orchestra.run.smithi121:workunit test fs/quota/quota.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=40464acdd8735105ba505dacc5bf9acb29b6dcab TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/quota/quota.sh
2023-06-23T20:12:36.526 INFO:tasks.workunit.client.0.smithi121.stderr:+ mkdir quota-test
2023-06-23T20:12:36.529 INFO:tasks.workunit.client.0.smithi121.stderr:+ cd quota-test
2023-06-23T20:12:36.530 INFO:tasks.workunit.client.0.smithi121.stderr:+ setfattr . -n ceph.quota.max_bytes -v 100000000
2023-06-23T20:12:36.536 INFO:tasks.workunit.client.0.smithi121.stderr:+ expect_false write_file big 1000
2023-06-23T20:12:36.536 INFO:tasks.workunit.client.0.smithi121.stderr:+ set -x
2023-06-23T20:12:36.536 INFO:tasks.workunit.client.0.smithi121.stderr:+ write_file big 1000
2023-06-23T20:12:36.536 INFO:tasks.workunit.client.0.smithi121.stderr:+ set +x
2023-06-23T20:12:38.805 INFO:tasks.workunit.client.1.smithi184.stdout:Try to write 100663296
2023-06-23T20:12:38.806 INFO:tasks.workunit.client.1.smithi184.stderr:+ return 1
2023-06-23T20:12:38.806 INFO:tasks.workunit.client.1.smithi184.stderr:+ return 0
2023-06-23T20:12:38.806 INFO:tasks.workunit.client.1.smithi184.stderr:+ expect_false write_file second 10
2023-06-23T20:12:38.807 INFO:tasks.workunit.client.1.smithi184.stderr:+ set -x
2023-06-23T20:12:38.807 INFO:tasks.workunit.client.1.smithi184.stderr:+ write_file second 10
2023-06-23T20:12:38.807 INFO:tasks.workunit.client.1.smithi184.stderr:+ set +x
2023-06-23T20:12:38.807 INFO:tasks.workunit.client.1.smithi184.stdout:Try to write 1048576
2023-06-23T20:12:38.808 INFO:tasks.workunit.client.1.smithi184.stderr:+ return 1
2023-06-23T20:12:38.808 INFO:tasks.workunit.client.1.smithi184.stderr:+ return 0
2023-06-23T20:12:38.808 INFO:tasks.workunit.client.1.smithi184.stderr:+ setfattr . -n ceph.quota.max_bytes -v 0
2023-06-23T20:12:38.813 INFO:tasks.workunit.client.1.smithi184.stderr:+ dd if=/dev/zero of=third bs=1M count=10
2023-06-23T20:12:38.836 INFO:tasks.workunit.client.1.smithi184.stderr:10+0 records in
2023-06-23T20:12:38.837 INFO:tasks.workunit.client.1.smithi184.stderr:10+0 records out
2023-06-23T20:12:38.837 INFO:tasks.workunit.client.1.smithi184.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0205328 s, 511 MB/s
2023-06-23T20:12:38.837 INFO:tasks.workunit.client.1.smithi184.stderr:+ dd if=/dev/zero of=big2 bs=1M count=100
2023-06-23T20:12:39.078 INFO:tasks.workunit.client.1.smithi184.stderr:100+0 records in
2023-06-23T20:12:39.078 INFO:tasks.workunit.client.1.smithi184.stderr:100+0 records out
2023-06-23T20:12:39.078 INFO:tasks.workunit.client.1.smithi184.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.23875 s, 439 MB/s
2023-06-23T20:12:39.086 INFO:tasks.workunit.client.1.smithi184.stderr:+ rm -rf big big2 second third
2023-06-23T20:12:39.112 INFO:tasks.workunit.client.1.smithi184.stderr:+ setfattr . -n ceph.quota.max_files -v 5
2023-06-23T20:12:39.117 INFO:tasks.workunit.client.1.smithi184.stderr:+ mkdir ok
2023-06-23T20:12:39.119 INFO:tasks.workunit.client.1.smithi184.stderr:+ touch ok/1
2023-06-23T20:12:39.122 INFO:tasks.workunit.client.1.smithi184.stderr:+ touch ok/2
2023-06-23T20:12:39.124 INFO:tasks.workunit.client.1.smithi184.stderr:+ touch 3
2023-06-23T20:12:39.126 INFO:tasks.workunit.client.1.smithi184.stderr:+ expect_false touch shouldbefail
2023-06-23T20:12:39.126 INFO:tasks.workunit.client.1.smithi184.stderr:+ set -x
2023-06-23T20:12:39.126 INFO:tasks.workunit.client.1.smithi184.stderr:+ touch shouldbefail
2023-06-23T20:12:39.127 INFO:tasks.workunit.client.1.smithi184.stderr:touch: cannot touch 'shouldbefail': Disk quota exceeded
2023-06-23T20:12:39.127 INFO:tasks.workunit.client.1.smithi184.stderr:+ return 0
2023-06-23T20:12:39.127 INFO:tasks.workunit.client.1.smithi184.stderr:+ expect_false touch ok/shouldbefail
2023-06-23T20:12:39.128 INFO:tasks.workunit.client.1.smithi184.stderr:+ set -x
2023-06-23T20:12:39.128 INFO:tasks.workunit.client.1.smithi184.stderr:+ touch ok/shouldbefail
2023-06-23T20:12:39.128 INFO:tasks.workunit.client.1.smithi184.stderr:touch: cannot touch 'ok/shouldbefail': Disk quota exceeded
2023-06-23T20:12:39.129 INFO:tasks.workunit.client.1.smithi184.stderr:+ return 0
2023-06-23T20:12:39.129 INFO:tasks.workunit.client.1.smithi184.stderr:+ setfattr . -n ceph.quota.max_files -v 0
2023-06-23T20:12:39.134 INFO:tasks.workunit.client.1.smithi184.stderr:+ touch shouldbecreated
2023-06-23T20:12:39.136 INFO:tasks.workunit.client.1.smithi184.stderr:+ touch shouldbecreated2
2023-06-23T20:12:39.144 INFO:tasks.workunit.client.1.smithi184.stderr:+ rm -rf 3 ok shouldbecreated shouldbecreated2
2023-06-23T20:12:39.165 INFO:tasks.workunit.client.1.smithi184.stderr:+ mkdir bytes bytes/files
2023-06-23T20:12:39.169 INFO:tasks.workunit.client.1.smithi184.stderr:+ setfattr bytes -n ceph.quota.max_bytes -v 10000000
2023-06-23T20:12:39.174 INFO:tasks.workunit.client.1.smithi184.stderr:+ setfattr bytes/files -n ceph.quota.max_files -v 5
2023-06-23T20:12:39.177 INFO:tasks.workunit.client.1.smithi184.stderr:+ dd if=/dev/zero of=bytes/files/1 bs=1M count=4
2023-06-23T20:12:39.186 INFO:tasks.workunit.client.1.smithi184.stderr:4+0 records in
2023-06-23T20:12:39.186 INFO:tasks.workunit.client.1.smithi184.stderr:4+0 records out
2023-06-23T20:12:39.187 INFO:tasks.workunit.client.1.smithi184.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00663262 s, 632 MB/s
2023-06-23T20:12:39.187 INFO:tasks.workunit.client.1.smithi184.stderr:+ dd if=/dev/zero of=bytes/files/2 bs=1M count=4
2023-06-23T20:12:39.199 INFO:tasks.workunit.client.1.smithi184.stderr:4+0 records in
2023-06-23T20:12:39.199 INFO:tasks.workunit.client.1.smithi184.stderr:4+0 records out
2023-06-23T20:12:39.199 INFO:tasks.workunit.client.1.smithi184.stderr:4194304 bytes (4.2 MB, 4.0 MiB) copied, 0.00994787 s, 422 MB/s
2023-06-23T20:12:39.200 INFO:tasks.workunit.client.1.smithi184.stderr:+ expect_false write_file bytes/files/3 1000
2023-06-23T20:12:39.200 INFO:tasks.workunit.client.1.smithi184.stderr:+ set -x
2023-06-23T20:12:39.200 INFO:tasks.workunit.client.1.smithi184.stderr:+ write_file bytes/files/3 1000
2023-06-23T20:12:39.200 INFO:tasks.workunit.client.1.smithi184.stderr:+ set +x
2023-06-23T20:12:40.185 INFO:tasks.workunit.client.1.smithi184.stdout:Try to write 19922944
2023-06-23T20:12:40.186 INFO:tasks.workunit.client.1.smithi184.stderr:+ return 1
2023-06-23T20:12:40.186 INFO:tasks.workunit.client.1.smithi184.stderr:+ return 0
2023-06-23T20:12:40.186 INFO:tasks.workunit.client.1.smithi184.stderr:+ expect_false write_file bytes/files/4 1000
2023-06-23T20:12:40.186 INFO:tasks.workunit.client.1.smithi184.stderr:+ set -x
2023-06-23T20:12:40.186 INFO:tasks.workunit.client.1.smithi184.stderr:+ write_file bytes/files/4 1000
2023-06-23T20:12:40.186 INFO:tasks.workunit.client.1.smithi184.stderr:+ set +x
2023-06-23T20:12:40.189 INFO:tasks.workunit.client.1.smithi184.stdout:Try to write 1048576
2023-06-23T20:12:40.189 INFO:tasks.workunit.client.1.smithi184.stderr:+ return 1
2023-06-23T20:12:40.190 INFO:tasks.workunit.client.1.smithi184.stderr:+ return 0
2023-06-23T20:12:40.190 INFO:tasks.workunit.client.1.smithi184.stderr:+ expect_false write_file bytes/files/5 1000
2023-06-23T20:12:40.190 INFO:tasks.workunit.client.1.smithi184.stderr:+ set -x
2023-06-23T20:12:40.190 INFO:tasks.workunit.client.1.smithi184.stderr:+ write_file bytes/files/5 1000
2023-06-23T20:12:40.190 INFO:tasks.workunit.client.1.smithi184.stderr:+ set +x
2023-06-23T20:12:40.191 INFO:tasks.workunit.client.1.smithi184.stdout:Try to write 1048576
2023-06-23T20:12:40.191 INFO:tasks.workunit.client.1.smithi184.stderr:+ return 1
2023-06-23T20:12:40.191 INFO:tasks.workunit.client.1.smithi184.stderr:+ return 0
2023-06-23T20:12:40.191 INFO:tasks.workunit.client.1.smithi184.stderr:+ stat '--printf=%n %s\n' bytes/files/1
2023-06-23T20:12:40.192 INFO:tasks.workunit.client.1.smithi184.stdout:bytes/files/1 4194304
2023-06-23T20:12:40.192 INFO:tasks.workunit.client.1.smithi184.stderr:+ stat '--printf=%n %s\n' bytes/files/2
2023-06-23T20:12:40.193 INFO:tasks.workunit.client.1.smithi184.stdout:bytes/files/2 4194304
2023-06-23T20:12:40.193 INFO:tasks.workunit.client.1.smithi184.stderr:+ stat '--printf=%n %s\n' bytes/files/3
2023-06-23T20:12:40.194 INFO:tasks.workunit.client.1.smithi184.stdout:bytes/files/3 19136512
2023-06-23T20:12:40.194 INFO:tasks.workunit.client.1.smithi184.stderr:+ stat '--printf=%n %s\n' bytes/files/4
2023-06-23T20:12:40.195 INFO:tasks.workunit.client.1.smithi184.stdout:bytes/files/4 0
2023-06-23T20:12:40.195 INFO:tasks.workunit.client.1.smithi184.stderr:+ expect_false stat bytes/files/5
2023-06-23T20:12:40.196 INFO:tasks.workunit.client.1.smithi184.stderr:+ set -x
2023-06-23T20:12:40.196 INFO:tasks.workunit.client.1.smithi184.stderr:+ stat bytes/files/5
2023-06-23T20:12:40.196 INFO:tasks.workunit.client.1.smithi184.stderr:stat: cannot statx 'bytes/files/5': No such file or directory
2023-06-23T20:12:40.196 INFO:tasks.workunit.client.1.smithi184.stderr:+ return 0
2023-06-23T20:12:40.199 INFO:tasks.workunit.client.1.smithi184.stderr:+ rm -rf bytes
2023-06-23T20:12:40.231 INFO:tasks.workunit.client.1.smithi184.stderr:+ mkdir files limit
2023-06-23T20:12:40.234 INFO:tasks.workunit.client.1.smithi184.stderr:+ truncate files/file -s 10G
2023-06-23T20:12:40.248 INFO:tasks.workunit.client.1.smithi184.stderr:+ setfattr limit -n ceph.quota.max_bytes -v 1000000
2023-06-23T20:12:40.253 INFO:tasks.workunit.client.1.smithi184.stderr:+ expect_false mv files limit/
2023-06-23T20:12:40.254 INFO:tasks.workunit.client.1.smithi184.stderr:+ set -x
2023-06-23T20:12:40.254 INFO:tasks.workunit.client.1.smithi184.stderr:+ mv files limit/
2023-06-23T20:12:40.260 DEBUG:teuthology.orchestra.run:got remote process result: 1
2023-06-23T20:12:40.261 INFO:tasks.workunit.client.1.smithi184.stderr:+ return 1
2023-06-23T20:12:40.261 INFO:tasks.workunit:Stopping ['fs/quota'] on client.1...
2023-06-23T20:12:40.261 DEBUG:teuthology.orchestra.run.smithi184:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1
2023-06-23T20:12:40.311 INFO:tasks.workunit.client.3.smithi184.stdout:Try to write 100663296
2023-06-23T20:12:40.312 INFO:tasks.workunit.client.3.smithi184.stderr:+ return 1
2023-06-23T20:12:40.312 INFO:tasks.workunit.client.3.smithi184.stderr:+ return 0
2023-06-23T20:12:40.313 INFO:tasks.workunit.client.3.smithi184.stderr:+ expect_false write_file second 10
2023-06-23T20:12:40.313 INFO:tasks.workunit.client.3.smithi184.stderr:+ set -x
2023-06-23T20:12:40.313 INFO:tasks.workunit.client.3.smithi184.stderr:+ write_file second 10
2023-06-23T20:12:40.314 INFO:tasks.workunit.client.3.smithi184.stderr:+ set +x
2023-06-23T20:12:40.314 INFO:tasks.workunit.client.3.smithi184.stdout:Try to write 1048576
2023-06-23T20:12:40.314 INFO:tasks.workunit.client.3.smithi184.stderr:+ return 1
2023-06-23T20:12:40.315 INFO:tasks.workunit.client.3.smithi184.stderr:+ return 0
2023-06-23T20:12:40.315 INFO:tasks.workunit.client.3.smithi184.stderr:+ setfattr . -n ceph.quota.max_bytes -v 0
2023-06-23T20:12:40.321 INFO:tasks.workunit.client.3.smithi184.stderr:+ dd if=/dev/zero of=third bs=1M count=10
2023-06-23T20:12:40.341 INFO:tasks.workunit.client.3.smithi184.stderr:10+0 records in
2023-06-23T20:12:40.342 INFO:tasks.workunit.client.3.smithi184.stderr:10+0 records out
2023-06-23T20:12:40.342 INFO:tasks.workunit.client.3.smithi184.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0184122 s, 570 MB/s
2023-06-23T20:12:40.342 INFO:tasks.workunit.client.3.smithi184.stderr:+ dd if=/dev/zero of=big2 bs=1M count=100
2023-06-23T20:12:40.593 INFO:tasks.workunit.client.3.smithi184.stderr:100+0 records in
2023-06-23T20:12:40.594 INFO:tasks.workunit.client.3.smithi184.stderr:100+0 records out
2023-06-23T20:12:40.594 INFO:tasks.workunit.client.3.smithi184.stderr:104857600 bytes (105 MB, 100 MiB) copied, 0.249509 s, 420 MB/s
2023-06-23T20:12:40.600 INFO:tasks.workunit.client.3.smithi184.stderr:+ rm -rf big big2 second third
2023-06-23T20:12:40.627 INFO:tasks.workunit.client.3.smithi184.stderr:+ setfattr . -n ceph.quota.max_files -v 5
2023-06-23T20:12:40.632 INFO:tasks.workunit.client.3.smithi184.stderr:+ mkdir ok
2023-06-23T20:12:40.634 INFO:tasks.workunit.client.3.smithi184.stderr:+ touch ok/1
2023-06-23T20:12:40.637 INFO:tasks.workunit.client.3.smithi184.stderr:+ touch ok/2
2023-06-23T20:12:40.639 INFO:tasks.workunit.client.3.smithi184.stderr:+ touch 3
2023-06-23T20:12:40.641 INFO:tasks.workunit.client.3.smithi184.stderr:+ expect_false touch shouldbefail
2023-06-23T20:12:40.641 INFO:tasks.workunit.client.3.smithi184.stderr:+ set -x
2023-06-23T20:12:40.641 INFO:tasks.workunit.client.3.smithi184.stderr:+ touch shouldbefail
2023-06-23T20:12:40.642 INFO:tasks.workunit.client.3.smithi184.stderr:touch: cannot touch 'shouldbefail': Disk quota exceeded
2023-06-23T20:12:40.642 INFO:tasks.workunit.client.3.smithi184.stderr:+ return 0
2023-06-23T20:12:40.643 INFO:tasks.workunit.client.3.smithi184.stderr:+ expect_false touch ok/shouldbefail
2023-06-23T20:12:40.643 INFO:tasks.workunit.client.3.smithi184.stderr:+ set -x
2023-06-23T20:12:40.643 INFO:tasks.workunit.client.3.smithi184.stderr:+ touch ok/shouldbefail
2023-06-23T20:12:40.643 INFO:tasks.workunit.client.3.smithi184.stderr:touch: cannot touch 'ok/shouldbefail': Disk quota exceeded
2023-06-23T20:12:40.644 INFO:tasks.workunit.client.3.smithi184.stderr:+ return 0
2023-06-23T20:12:40.644 INFO:tasks.workunit.client.3.smithi184.stderr:+ setfattr . -n ceph.quota.max_files -v 0
2023-06-23T20:12:40.659 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/run_tasks.py", line 105, in run_tasks
manager = run_one_task(taskname, ctx=ctx, config=config)
File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/run_tasks.py", line 84, in run_one_task
return task(**kwargs)
File "/home/teuthworker/src/github.com_ceph_ceph-c_40464acdd8735105ba505dacc5bf9acb29b6dcab/qa/tasks/workunit.py", line 145, in task
_spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'),
File "/home/teuthworker/src/github.com_ceph_ceph-c_40464acdd8735105ba505dacc5bf9acb29b6dcab/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients
p.spawn(_run_tests, ctx, refspec, role, [unit], env,
File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 84, in __exit__
for result in self:
File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 98, in __next__
resurrect_traceback(result)
File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 30, in resurrect_traceback
raise exc.exc_info[1]
File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/parallel.py", line 23, in capture_traceback
return func(*args, **kwargs)
File "/home/teuthworker/src/github.com_ceph_ceph-c_40464acdd8735105ba505dacc5bf9acb29b6dcab/qa/tasks/workunit.py", line 424, in _run_tests
remote.run(
File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/remote.py", line 525, in run
r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 455, in run
r.wait()
File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 161, in wait
self._raise_for_status()
File "/home/teuthworker/src/git.ceph.com_teuthology_076bbebc42a14f7d568aaa78eabb0038327bcb23/teuthology/orchestra/run.py", line 181, in _raise_for_status
raise CommandFailedError(
teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/quota/quota.sh) on smithi184 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=40464acdd8735105ba505dacc5bf9acb29b6dcab TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/fs/quota/quota.sh'
2023-06-23T20:12:40.725 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=fd5030c25f2048a98a66e8bc17af4c34
reef:
http://pulpito.front.sepia.ceph.com/yuriw-2023-06-23_16:20:29-fs-wip-yuri11-testing-2023-06-19-1232-reef-distro-default-smithi/7313676