Project

General

Profile

Bug #55866

[rgw-ms][dbr]:Observing bucket stats issue after performing 20M workload on versioned bucket.

Added by Vidushi Mishra 8 months ago. Updated 8 months ago.

Status:
New
Priority:
Normal
Assignee:
Target version:
-
% Done:

0%

Source:
Tags:
reshard
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

1. Description:

We observed bucket stats reporting incorrect objects on both sites when performing a 20M object workload on a versioned bucket.

2. ceph version:
ceph version 17.0.0-12762-g63f84c50

3. Steps to reproduce:

a. create a bucket 'version-2'. Enable bucket versioning.
b. Ensure the bucket is synced on both sites.
c. Write a 20M object workload [10M current + 10M non-current].
d. The workload is bi-directional, written from both sites simultaneously.

Multisite configuration used:

Multisite Configuration = LB for ms-sync
Total RGW daemons per zone = 14
sync endpoints = 4 rgws behind 1 Load balancer per zone.
IO via = Haproxy ( client IO for 10 rgws)
Object size = small size( 1- 10KB)
Object PUT = bi-directional on same bucket
objects per bucket = 20M (10M from each site simultaneously)
Cluster utilization < 40% total cluster size
IO tool = Cosbench
Configs set on all rgws
rgw_data_notify_interval_msec=0
debug_ms 0
debug_rgw 5
debug_rgw_sync 20

History

#1 Updated by Casey Bodley 8 months ago

  • Assignee set to Mark Kogan
  • Tags set to reshard

Also available in: Atom PDF