Project

General

Profile

Actions

Bug #53199

closed

bucket stats inconsistency from racing multipart completions

Added by Casey Bodley over 2 years ago. Updated about 1 year ago.

Status:
Resolved
Priority:
High
Assignee:
Target version:
-
% Done:

100%

Source:
Development
Tags:
stats multipart backport_processed
Backport:
octopus pacific
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

steps to reproduce:

1. create a fresh bucket

$ s3cmd mb s3://testbucket
Bucket 's3://testbucket/' created

2. create a 32MB object (any size over 15MB multipart threshold)

$ truncate -s 32M 32m.iso

3. perform 8 concurrent multipart uploads to the same object

$ for i in {0..7}; do s3cmd put 32m.iso s3://testbucket & done
...
[8]+  Done                    s3cmd put 32m.iso s3://testbucket

4. check 'bucket stats'


$ radosgw-admin bucket stats --bucket testbucket
...
    "usage": {                                                                                                                                                
        "rgw.main": {                                                                                                                                         
            "size": 134217728,                                                                                                                                
            "size_actual": 134217728,                                                                                                                         
            "size_utilized": 134217728,                                                                                                                       
            "size_kb": 131072,                                                                                                                                
            "size_kb_actual": 131072,                                                                                                                         
            "size_kb_utilized": 131072,                                                                                                                       
            "num_objects": 10                                                                                                                                 
        },

expected stats: 1 object of size=33554432


Related issues 2 (0 open2 closed)

Copied to rgw - Backport #53285: pacific: bucket stats inconsistency from racing multipart completionsResolvedCasey BodleyActions
Copied to rgw - Backport #53286: octopus: bucket stats inconsistency from racing multipart completionsRejectedActions
Actions

Also available in: Atom PDF