Project

General

Profile

Bug #44008

multi-part upload will lost part data when you abort and resume a multipart upload request by using aws java Signature Version 4 api

Added by bangmin chen about 2 months ago. Updated 3 days ago.

Status:
Fix Under Review
Priority:
Normal
Assignee:
-
Target version:
% Done:

0%

Source:
Community (user)
Tags:
Backport:
octopus, nautilus, mimic
Regression:
No
Severity:
1 - critical
Reviewed:
Affected Versions:
ceph-qa-suite:
rgw
Pull request ID:
Crash signature:

Description

There is a bug when you abort and resume a multipart upload request by using aws java Signature Version 4 api. the abort part will lost you can see the result in the following:
root@node-10:~/s3cmd-2.0.1# s3cmd info s3://6010102/444562 de-v10.15.3-x64.msi
s3://6010102/444562 de-v10.15.3-x64.msi (object):
File size: 8720384
Last mod: Thu, 24 Oct 2019 11:50:29 GMT
MIME type: binary/octet-stream
Storage: STANDARD
MD5 sum: 9afe88c2ac1d7f33c65d2760d9521436-3
SSE: none
Policy: none
CORS: none
ACL: ddstest01: FULL_CONTROL
x-amz-meta-md5: acd333508ec4a8bad8eb3777e436f498
root@node-10:~/s3cmd-2.0.1# history | grep node | grep info^C
root@node-10:~/s3cmd-2.0.1# s3cmd ls s3://6010102/444562/dev10.15.3-x64.msi
2019-10-24 11:50 17108992 s3://6010102/444562/dev10.15.3-x64.msi
root@node-10:~/s3cmd-2.0.1# rados ls -p default.rgw.buckets.data | grep node-v10.15.3-x64 | grep 444562 | grep Z1jURXLla-YMnsaJySH
34fd6a4f-6c36-462f-9cbb-20e32bba2b5b.1423084.4__shadow_444562.dev10.15.3-x64.msi.2~S82AQ6TYk0Z-Z1jURXLla-YMnsaJySH.2_1
34fd6a4f-6c36-462f-9cbb-20e32bba2b5b.1423084.4__multipart_444562.dev10.15.3-x64.msi.2~S82AQ6TYk0Z-Z1jURXLla-YMnsaJySH.3
34fd6a4f-6c36-462f-9cbb-20e32bba2b5b.1423084.4__multipart_444562.dev10.15.3-x64.msi.2~S82AQ6TYk0Z-Z1jURXLla-YMnsaJySH.2
34fd6a4f-6c36-462f-9cbb-20e32bba2b5b.1423084.4__multipart_444562.dev10.15.3-x64.msi.2~S82AQ6TYk0Z-Z1jURXLla-YMnsaJySH.1

This can cause the big file multipart upload is unconsistent .

History

#1 Updated by bangmin chen about 2 months ago

the last Pull request ID is https://github.com/ceph/ceph/pull/33225

#2 Updated by bangmin chen about 1 month ago

the Affected Versions also include 12.2.12

#3 Updated by bangmin chen 11 days ago

I am working on this issue

#4 Updated by bangmin chen 11 days ago

bangmin chen wrote:

I am working on this issue

PR: https://github.com/ceph/ceph/pull/34073

#5 Updated by Nathan Cutler 3 days ago

  • Project changed from Ceph to rgw
  • Category deleted (java)
  • Status changed from New to Fix Under Review
  • Backport changed from nautilus, mimic, luminous to octopus, nautilus, mimic
  • Pull request ID set to 34073

Also available in: Atom PDF