Project

General

Profile

Actions
Copy link

Bug #21565

open

rgw:Multipart upload may failed when object size is large and near quota byte limit

Added by SIBEI GAO over 6 years ago. Updated over 6 years ago.

Status:
Fix Under Review
Priority:
Normal
Assignee:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
Ceph - v13.0.0
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

I put one 1000M object through multipart upload.
bucket quota: max-size is 2000M and max-objects is 10.
Then, I expect the upload is success.
but the upload is failed with error

first, create a new bucket: bbb, then

s3cmd put 1000M s3://bbb
upload: '1000M' -> 's3://bbb/1000M' [part 1 of 67, 15MB] [1 of 1]
15728640 of 15728640 100% in 0s 19.62 MB/s done
upload: '1000M' -> 's3://bbb/1000M' [part 2 of 67, 15MB] [1 of 1]
15728640 of 15728640 100% in 0s 32.13 MB/s done
upload: '1000M' -> 's3://bbb/1000M' [part 3 of 67, 15MB] [1 of 1]
15728640 of 15728640 100% in 0s 21.99 MB/s done
upload: '1000M' -> 's3://bbb/1000M' [part 4 of 67, 15MB] [1 of 1]
15728640 of 15728640 100% in 0s 22.28 MB/s done
upload: '1000M' -> 's3://bbb/1000M' [part 5 of 67, 15MB] [1 of 1]
15728640 of 15728640 100% in 0s 22.25 MB/s done
upload: '1000M' -> 's3://bbb/1000M' [part 6 of 67, 15MB] [1 of 1]
15728640 of 15728640 100% in 0s 28.17 MB/s done
upload: '1000M' -> 's3://bbb/1000M' [part 7 of 67, 15MB] [1 of 1]
15728640 of 15728640 100% in 0s 27.72 MB/s done
upload: '1000M' -> 's3://bbb/1000M' [part 8 of 67, 15MB] [1 of 1]
15728640 of 15728640 100% in 0s 21.21 MB/s done
upload: '1000M' -> 's3://bbb/1000M' [part 9 of 67, 15MB] [1 of 1]
15728640 of 15728640 100% in 0s 22.24 MB/s done
upload: '1000M' -> 's3://bbb/1000M' [part 10 of 67, 15MB] [1 of 1]
15728640 of 15728640 100% in 0s 102.98 MB/s done
ERROR:
Upload of '1000M' part 10 failed. Use
/usr/bin/s3cmd abortmp s3://bbb/1000M 2~ooSh-nkike2j9e1l8UvUeWIJOeDtiO6
to abort the upload, or
/usr/bin/s3cmd --upload-id 2~ooSh-nkike2j9e1l8UvUeWIJOeDtiO6 put ...
to continue the upload.
ERROR: S3 error: 403 (QuotaExceeded)

Actions
Copy link
 #1

Updated by SIBEI GAO over 6 years ago

rgw:Multipart upload may failed when object size is large

Actions
Copy link
 #3

Updated by Marcus Watts over 6 years ago

I have a revised PR here, https://github.com/ceph/ceph/pull/18123

Actions
Copy link
 #4

Updated by Matt Benjamin over 6 years ago

  • Subject changed from rgw:Multipart upload may failed when object size is large to rgw:Multipart upload may failed when object size is large and near quota byte limit
Actions
Copy link
 #5

Updated by SIBEI GAO over 6 years ago

I give a new method to fix this bug here, https://github.com/ceph/ceph/pull/17960

Actions
Copy link
 #6

Updated by Matt Benjamin over 6 years ago

  • Status changed from New to Pending Backport
Actions
Copy link
 #7

Updated by Nathan Cutler over 6 years ago

  • Status changed from Pending Backport to Fix Under Review

@Matt Li - this bug appears to have two competing fixes, neither of which have been merged. Also, the backport field is not filled out. Changing status to "Need Review" accordingly.

Actions
Copy link

Also available in: Atom PDF