Bug #50222
Updated by Patrick Donnelly about 3 years ago
<pre> 2021-04-07T05:00:34.818 INFO:tasks.ceph.osd.6.smithi066.stderr:2021-04-07T05:00:34.811+0000 7fe23d3a4700 -1 log_channel(cluster) log [ERR] : 5.2s0 deep-scrub : stat mismatch, got 0/1 objects, 0/0 clones, 0/1 dirty, 0/0 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts, 0/4194304 bytes, 0/0 manifest objects, 0/0 hit_set_archive bytes. 2021-04-07T05:00:34.819 INFO:tasks.ceph.osd.6.smithi066.stderr:2021-04-07T05:00:34.811+0000 7fe23d3a4700 -1 log_channel(cluster) log [ERR] : 5.2 deep-scrub 1 errors 2021-04-07T05:00:39.489 INFO:tasks.ceph.mon.a.smithi049.stderr:2021-04-07T05:00:39.481+0000 7fa8e20b9700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 scrub errors (OSD_SCRUB_ERRORS) 2021-04-07T05:00:39.490 INFO:tasks.ceph.mon.a.smithi049.stderr:2021-04-07T05:00:39.481+0000 7fa8e20b9700 -1 log_channel(cluster) log [ERR] : Health check failed: Possible data damage: 1 pg inconsistent (PG_DAMAGED) </pre> From: /ceph/teuthology-archive/pdonnell-2021-04-07_02:12:41-fs-wip-pdonnell-testing-20210406.213012-distro-basic-smithi/6025668/teuthology.log With osd thrashing, thrashing and osd-mds msgr delays/failures, and EC pools. delays.