Ceph » CephFS

Run the qa test locally:

(venv) [build]$ python3 ../qa/tasks/vstart_runner.py tasks.cephfs.test_data_scan.TestDataScan.test_pg_files
Using guessed paths /data/ceph/build/lib/ ['/data/ceph/qa', '/data/ceph/build/lib/cython_modules/lib.3', '/data/ceph/src/pybind']
Using guessed paths /data/ceph/build/lib/ ['/data/ceph/qa', '/data/ceph/build/lib/cython_modules/lib.3', '/data/ceph/src/pybind']
Cannot find device "ceph-brx" 
2021-05-14 13:05:04,959.959 WARNING:__main__:Killing stray process  330852 pts/1    00:00:00 ceph-mds
2021-05-14 13:05:04,959.959 WARNING:__main__:Killing stray process  330877 pts/1    00:00:00 ceph-mds
2021-05-14 13:05:04,959.959 WARNING:__main__:Killing stray process  333156 pts/1    00:00:00 ceph-mds
2021-05-14 13:05:05,201.201 INFO:__main__:Starting test: test_pg_files (tasks.cephfs.test_data_scan.TestDataScan)
That the pg files command tells us which files are associated with
2021-05-14 13:05:06,174.174 INFO:tasks.cephfs.cephfs_test_case:[<tasks.cephfs.cephfs_test_case.MountDetails object at 0x7f07154ec760>]
2021-05-14 13:05:15,416.416 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster
2021-05-14 13:05:15,416.416 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None -
2021-05-14 13:05:15,416.416 INFO:tasks.cephfs.mount:self.client_remote.hostname = localhost
2021-05-14 13:05:15,416.416 INFO:tasks.cephfs.mount:self.client.name = client.0
2021-05-14 13:05:15,416.416 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/tmpnr6o5q06/mnt.0
2021-05-14 13:05:15,416.416 INFO:tasks.cephfs.mount:self.cephfs_name = None
2021-05-14 13:05:15,416.416 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None
2021-05-14 13:05:15,416.416 INFO:tasks.cephfs.mount:self.client_keyring_path = None
2021-05-14 13:05:15,416.416 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {}
mount: /sys/fs/fuse/connections: must be superuser to use mount.
2021-05-14 13:05:15,429.429 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [59, 61]
mount: /sys/fs/fuse/connections: must be superuser to use mount.
mount: /sys/fs/fuse/connections: must be superuser to use mount.
2021-05-14 13:05:16,453.453 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [59, 60, 61]
2021-05-14 13:05:16,483.483 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /tmp/ceph-asok.W4CXfX/client.0.334099.asok
2021-05-14 13:05:16,513.513 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /tmp/ceph-asok.W4CXfX/client.0.334099.asok
2021-05-14 13:05:16,634.634 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /tmp/tmpnr6o5q06/mnt.0
2021-05-14 13:05:17,134.134 INFO:tasks.cephfs.test_data_scan:mydir/myfile_0: 49.7
2021-05-14 13:05:17,482.482 INFO:tasks.cephfs.test_data_scan:mydir/myfile_1: 49.a
2021-05-14 13:05:17,849.849 INFO:tasks.cephfs.test_data_scan:mydir/myfile_2: 49.16
2021-05-14 13:05:18,187.187 INFO:tasks.cephfs.test_data_scan:mydir/myfile_3: 49.19
2021-05-14 13:05:18,534.534 INFO:tasks.cephfs.test_data_scan:mydir/myfile_4: 49.16
2021-05-14 13:05:18,871.871 INFO:tasks.cephfs.test_data_scan:mydir/myfile_5: 49.1f
2021-05-14 13:05:19,206.206 INFO:tasks.cephfs.test_data_scan:mydir/myfile_6: 49.13
2021-05-14 13:05:19,538.538 INFO:tasks.cephfs.test_data_scan:mydir/myfile_7: 49.c
2021-05-14 13:05:19,919.919 INFO:tasks.cephfs.test_data_scan:mydir/myfile_8: 49.10
2021-05-14 13:05:20,253.253 INFO:tasks.cephfs.test_data_scan:mydir/myfile_9: 49.1b
2021-05-14 13:05:20,590.590 INFO:tasks.cephfs.test_data_scan:mydir/myfile_10: 49.6
2021-05-14 13:05:20,933.933 INFO:tasks.cephfs.test_data_scan:mydir/myfile_11: 49.19
2021-05-14 13:05:21,268.268 INFO:tasks.cephfs.test_data_scan:mydir/myfile_12: 49.8
2021-05-14 13:05:21,608.608 INFO:tasks.cephfs.test_data_scan:mydir/myfile_13: 49.8
2021-05-14 13:05:21,963.963 INFO:tasks.cephfs.test_data_scan:mydir/myfile_14: 49.b
2021-05-14 13:05:22,305.305 INFO:tasks.cephfs.test_data_scan:mydir/myfile_15: 49.5
2021-05-14 13:05:22,652.652 INFO:tasks.cephfs.test_data_scan:mydir/myfile_16: 49.1d
2021-05-14 13:05:23,000.000 INFO:tasks.cephfs.test_data_scan:mydir/myfile_17: 49.0
2021-05-14 13:05:23,348.348 INFO:tasks.cephfs.test_data_scan:mydir/myfile_18: 49.7
2021-05-14 13:05:23,689.689 INFO:tasks.cephfs.test_data_scan:mydir/myfile_19: 49.7
2021-05-14 13:05:34,120.120 INFO:tasks.cephfs.test_data_scan:49.0: mydir/myfile_17
2021-05-14 13:05:34,262.262 INFO:tasks.cephfs.test_data_scan:49.1: 
2021-05-14 13:05:34,403.403 INFO:tasks.cephfs.test_data_scan:49.2: 
2021-05-14 13:05:34,544.544 INFO:tasks.cephfs.test_data_scan:49.3: 
2021-05-14 13:05:34,683.683 INFO:tasks.cephfs.test_data_scan:49.4: 
2021-05-14 13:05:34,825.825 INFO:tasks.cephfs.test_data_scan:49.5: mydir/myfile_15
2021-05-14 13:05:34,976.976 INFO:tasks.cephfs.test_data_scan:49.6: mydir/myfile_10
2021-05-14 13:05:35,114.114 INFO:tasks.cephfs.test_data_scan:49.7: mydir/myfile_18
mydir/myfile_19
mydir/myfile_0
2021-05-14 13:05:35,254.254 INFO:tasks.cephfs.test_data_scan:49.8: mydir/myfile_13
mydir/myfile_12
2021-05-14 13:05:35,396.396 INFO:tasks.cephfs.test_data_scan:49.9: 
2021-05-14 13:05:35,536.536 INFO:tasks.cephfs.test_data_scan:49.10: mydir/myfile_8
2021-05-14 13:05:35,677.677 INFO:tasks.cephfs.test_data_scan:49.11: 
2021-05-14 13:05:35,814.814 INFO:tasks.cephfs.test_data_scan:49.12: 
2021-05-14 13:05:35,965.965 INFO:tasks.cephfs.test_data_scan:49.13: mydir/myfile_6
2021-05-14 13:05:36,134.134 INFO:tasks.cephfs.test_data_scan:49.14: 
2021-05-14 13:05:36,273.273 INFO:tasks.cephfs.test_data_scan:49.15: 
2021-05-14 13:05:36,411.411 INFO:tasks.cephfs.test_data_scan:49.16: 
2021-05-14 13:05:36,411.411 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on local...
2021-05-14 13:05:36,424.424 INFO:tasks.cephfs.mount:Cleaning up mount local
2021-05-14 13:05:37,534.534 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools
2021-05-14 13:05:43,162.162 INFO:__main__:Stopped test: test_pg_files (tasks.cephfs.test_data_scan.TestDataScan)
That the pg files command tells us which files are associated with in 37.960756s
2021-05-14 13:05:43,162.162 INFO:__main__:test_pg_files (tasks.cephfs.test_data_scan.TestDataScan)
2021-05-14 13:05:43,162.162 INFO:__main__:That the pg files command tells us which files are associated with ... FAIL
2021-05-14 13:05:43,162.162 INFO:__main__:
2021-05-14 13:05:43,162.162 INFO:__main__:======================================================================
2021-05-14 13:05:43,162.162 INFO:__main__:FAIL: test_pg_files (tasks.cephfs.test_data_scan.TestDataScan)
2021-05-14 13:05:43,162.162 INFO:__main__:That the pg files command tells us which files are associated with
2021-05-14 13:05:43,162.162 INFO:__main__:
2021-05-14 13:05:43,162.162 INFO:__main__:----------------------------------------------------------------------
2021-05-14 13:05:43,163.163 INFO:__main__:Traceback (most recent call last):
2021-05-14 13:05:43,163.163 INFO:__main__:  File "/data/ceph/qa/tasks/cephfs/test_data_scan.py", line 554, in test_pg_files
2021-05-14 13:05:43,163.163 INFO:__main__:    self.assertSetEqual(set(lines), set(pgs_to_files[pg_str]))
2021-05-14 13:05:43,163.163 INFO:__main__:AssertionError: Items in the second set but not the first:
2021-05-14 13:05:43,163.163 INFO:__main__:'mydir/myfile_2'
2021-05-14 13:05:43,163.163 INFO:__main__:'mydir/myfile_4'
2021-05-14 13:05:43,163.163 INFO:__main__:
Cannot find device "ceph-brx" 
2021-05-14 13:05:43,181.181 INFO:__main__:
2021-05-14 13:05:43,181.181 INFO:__main__:----------------------------------------------------------------------
2021-05-14 13:05:43,181.181 INFO:__main__:Ran 1 test in 37.961s
2021-05-14 13:05:43,181.181 INFO:__main__:
2021-05-14 13:05:43,181.181 INFO:__main__:FAILED (failures=1)
2021-05-14 13:05:43,181.181 INFO:__main__:
2021-05-14 13:05:43,181.181 INFO:__main__:
2021-05-14 13:05:43,181.181 INFO:__main__:======================================================================
2021-05-14 13:05:43,181.181 INFO:__main__:FAIL: test_pg_files (tasks.cephfs.test_data_scan.TestDataScan)
2021-05-14 13:05:43,181.181 INFO:__main__:That the pg files command tells us which files are associated with
2021-05-14 13:05:43,181.181 INFO:__main__:----------------------------------------------------------------------
2021-05-14 13:05:43,181.181 INFO:__main__:Traceback (most recent call last):
2021-05-14 13:05:43,181.181 INFO:__main__:  File "/data/ceph/qa/tasks/cephfs/test_data_scan.py", line 554, in test_pg_files
2021-05-14 13:05:43,182.182 INFO:__main__:    self.assertSetEqual(set(lines), set(pgs_to_files[pg_str]))
2021-05-14 13:05:43,182.182 INFO:__main__:AssertionError: Items in the second set but not the first:
2021-05-14 13:05:43,182.182 INFO:__main__:'mydir/myfile_2'
2021-05-14 13:05:43,182.182 INFO:__main__:'mydir/myfile_4'
2021-05-14 13:05:43,182.182 INFO:__main__:
2021-05-14 13:05:43,202.202 INFO:__main__:
2021-05-14 13:05:43,202.202 INFO:__main__: