Bug #48503: scrub stat mismatch on bytes - RADOS - Ceph

Actions

Copy link

Bug #48503

open

scrub stat mismatch on bytes

Added by Neha Ojha over 3 years ago. Updated about 3 years ago.

Status:

New

Priority:

Normal

Assignee:

Category:

Target version:

% Done:

Source:

Tags:

Backport:

nautilus

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

upgrade/nautilus-x

Component(RADOS):

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

2020-12-07T13:07:24.871 INFO:teuthology.orchestra.run.smithi150.stdout:2020-12-07T13:05:47.529058+0000 osd.6 (osd.6) 485 : cluster [ERR] 5.a deep-scrub : stat mismatch, got 4/4 objects, 0/0 clones, 0/0 dirty, 0/0 omap, 0/0 pinned, 4/4 hit_set_archive, 0/0 whiteouts, 6651/0 bytes, 0/0 manifest objects, 6651/6651 hit_set_archive bytes.

/a/teuthology-2020-12-06_07:01:02-rados-master-distro-basic-smithi/5684999

Related issues 1 (1 open — 0 closed)

Actions

Copy link

Updated by Neha Ojha over 3 years ago

ceph-qa-suite upgrade/nautilus-x added

Neha Ojha wrote:

[...]

/a/teuthology-2020-12-06_07:01:02-rados-master-distro-basic-smithi/5684999

rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_latest}

Actions

Copy link

Updated by Greg Farnum over 3 years ago

http://pulpito.front.sepia.ceph.com:80/gregf-2021-01-09_02:02:11-rados-wip-stretch-updates-108-2-distro-basic-smithi/5768449

2021-01-09T06:14:39.822 INFO:tasks.ceph.osd.6.smithi198.stderr:2021-01-09T06:14:39.561+0000 7ff808bfa700 -1 log_channel(cluster) log [ERR] : scrub 59.11 59:8ca46d4c:test-rados-api-smithi051-22101-74::foo:24 : size 0 != clone_size 10
2021-01-09T06:14:39.822 INFO:tasks.ceph.osd.6.smithi198.stderr:2021-01-09T06:14:39.561+0000 7ff808bfa700 -1 log_channel(cluster) log [ERR] : scrub 59.11 59:8ca46d4c:test-rados-api-smithi051-22101-74::foo:23 : size 0 != clone_size 10
2021-01-09T06:14:39.823 INFO:tasks.ceph.osd.6.smithi198.stderr:2021-01-09T06:14:39.565+0000 7ff808bfa700 -1 log_channel(cluster) log [ERR] : 59.11 scrub : stat mismatch, got 10/10 objects, 2/2 clones, 10/10 dirty, 0/0 omap, 0/0 pinned, 0/0 hit_set_archive, 0/0 whiteouts, 81/61 bytes, 4/4 manifest objects, 0/0 hit_set_archive bytes.
2021-01-09T06:14:39.823 INFO:tasks.ceph.osd.6.smithi198.stderr:2021-01-09T06:14:39.565+0000 7ff808bfa700 -1 log_channel(cluster) log [ERR] : 59.11 scrub 3 errors

Actions

Copy link

Updated by Deepika Upadhyay about 3 years ago

Backport set to pacific, octopus, nautilus

description: rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay
  objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_16.04}
  thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
duration: 1511.814947128296
failure_reason: '"2021-04-08 19:44:58.046249 osd.1 (osd.1) 267 : cluster [ERR] 2.4s0
  scrub : stat mismatch, got 15/15 objects, 11/11 clones, 15/15 dirty, 0/0 omap, 0/0
  pinned, 0/0 hit_set_archive, 1/1 whiteouts, 30900224/1867776 bytes, 0/0 manifest
  objects, 0/0 hit_set_archive bytes." in cluster log'

/ceph/teuthology-archive/yuriw-2021-04-08_16:54:12-rados-wip-yuri3-testing-2021-04-07-1408-nautilus-distro-basic-smithi/6029180/teuthology.log

Actions

Copy link