Bug #57087
Updated by Kotresh Hiremath Ravishankar over 1 year ago
Seen in https://pulpito.ceph.com/yuriw-2022-08-04_20:54:08-fs-wip-yuri6-testing-2022-08-04-0617-pacific-distro-default-smithi/6959187
Looks like the data scan has not recovered the file
<pre>
2022-08-05T01:56:30.914 INFO:teuthology.orchestra.run:Running command with timeout 900
2022-08-05T01:56:30.915 DEBUG:teuthology.orchestra.run.smithi087:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo bash -c 'cat subdir/21')
2022-08-05T01:56:30.941 DEBUG:teuthology.orchestra.run:got remote process result: 1
2022-08-05T01:56:30.943 INFO:teuthology.orchestra.run.smithi087.stderr:cat: subdir/21: No such file or directory
2022-08-05T01:56:30.944 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules...
</pre>
Traceback
<pre>
2022-08-05T01:56:40.301 INFO:tasks.cephfs_test_runner:test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan) ... ERROR
2022-08-05T01:56:40.302 INFO:tasks.cephfs_test_runner:
2022-08-05T01:56:40.302 INFO:tasks.cephfs_test_runner:======================================================================
2022-08-05T01:56:40.303 INFO:tasks.cephfs_test_runner:ERROR: test_fragmented_injection (tasks.cephfs.test_data_scan.TestDataScan)
2022-08-05T01:56:40.303 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2022-08-05T01:56:40.304 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2022-08-05T01:56:40.304 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_cee46c3e5b9015d27983e08f8ebddfb22d21d78e/qa/tasks/cephfs/test_data_scan.py", line 495, in test_fragmented_injection
2022-08-05T01:56:40.306 INFO:tasks.cephfs_test_runner: out = self.mount_a.run_shell_payload(f"cat subdir/{victim_dentry}", sudo=True).stdout.getvalue().strip()
2022-08-05T01:56:40.306 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_cee46c3e5b9015d27983e08f8ebddfb22d21d78e/qa/tasks/cephfs/mount.py", line 675, in run_shell_payload
2022-08-05T01:56:40.307 INFO:tasks.cephfs_test_runner: return self.run_shell(["bash", "-c", Raw(f"'{payload}'")], **kwargs)
2022-08-05T01:56:40.308 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_ceph_ceph-c_cee46c3e5b9015d27983e08f8ebddfb22d21d78e/qa/tasks/cephfs/mount.py", line 672, in run_shell
2022-08-05T01:56:40.309 INFO:tasks.cephfs_test_runner: return self.client_remote.run(args=args, cwd=cwd, timeout=timeout, stdout=stdout, stderr=stderr, **kwargs)
2022-08-05T01:56:40.309 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/remote.py", line 510, in run
2022-08-05T01:56:40.310 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
2022-08-05T01:56:40.310 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 455, in run
2022-08-05T01:56:40.311 INFO:tasks.cephfs_test_runner: r.wait()
2022-08-05T01:56:40.311 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 161, in wait
2022-08-05T01:56:40.312 INFO:tasks.cephfs_test_runner: self._raise_for_status()
2022-08-05T01:56:40.312 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_git_teuthology_9e4bf63f00ab3f82a26635c2779f4c3f1b73fb53/teuthology/orchestra/run.py", line 183, in _raise_for_status
2022-08-05T01:56:40.313 INFO:tasks.cephfs_test_runner: node=self.hostname, label=self.label
2022-08-05T01:56:40.313 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi087 with status 1: "(cd /home/ubuntu/cephtest/mnt.0 && exec sudo bash -c 'cat subdir/21')"
</pre>