Ceph » CephFS

Found in [1], which was failed due to this error.

[1] http://qa-proxy.ceph.com/teuthology/yuriw-2021-07-13_17:37:59-fs-wip-yuri-testing-2021-07-13-0812-pacific-distro-basic-smithi/6268693/teuthology.log

2021-07-13T23:18:15.225 INFO:tasks.ceph.osd.5.smithi172.stderr:2021-07-13T23:18:15.221+0000 7f73df33c700 -1 log_channel(cluster) log [ERR] : 5.7s0 deep-scrub : stat mismatch, got 0/1 objects, 0/0 clones, 0/1 dirty, 0/0 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts\
, 0/1459 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes.
2021-07-13T23:18:15.225 INFO:tasks.ceph.osd.5.smithi172.stderr:2021-07-13T23:18:15.221+0000 7f73df33c700 -1 log_channel(cluster) log [ERR] : 5.7 deep-scrub 1 errors
2021-07-13T23:18:17.088 INFO:tasks.ceph.mon.a.smithi019.stderr:2021-07-13T23:18:17.084+0000 7f0fbb38f700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 scrub errors (OSD_SCRUB_ERRORS)
2021-07-13T23:18:17.088 INFO:tasks.ceph.mon.a.smithi019.stderr:2021-07-13T23:18:17.084+0000 7f0fbb38f700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg inconsistent (PG_DAMAGED)

2021-07-13T23:18:58.756 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log
2021-07-13T23:18:58.757 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\\
(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGR\
ADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' |\
 egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v MDS_SLOW_METADATA_IO | head -n 1
2021-07-13T23:18:58.791 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\\
(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGR\
ADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v 'overall HEALTH_' |\
 egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v MDS_SLOW_METADATA_IO | head -n 1
2021-07-13T23:18:58.864 INFO:teuthology.orchestra.run.smithi019.stdout:2021-07-13T23:18:15.223172+0000 osd.5 (osd.5) 33 : cluster [ERR] 5.7s0 deep-scrub : stat mismatch, got 0/1 objects, 0/0 clones, 0/1 dirty, 0/0 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts, 0/1\
459 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes.