Bug #44008
openmulti-part upload will lost part data when you abort and resume a multipart upload request by using aws java Signature Version 4 api
0%
Description
There is a bug when you abort and resume a multipart upload request by using aws java Signature Version 4 api. the abort part will lost you can see the result in the following:
root@node-10:~/s3cmd-2.0.1# s3cmd info s3://6010102/444562 de-v10.15.3-x64.msi
s3://6010102/444562 de-v10.15.3-x64.msi (object):
File size: 8720384
Last mod: Thu, 24 Oct 2019 11:50:29 GMT
MIME type: binary/octet-stream
Storage: STANDARD
MD5 sum: 9afe88c2ac1d7f33c65d2760d9521436-3
SSE: none
Policy: none
CORS: none
ACL: ddstest01: FULL_CONTROL
x-amz-meta-md5: acd333508ec4a8bad8eb3777e436f498
root@node-10:~/s3cmd-2.0.1# history | grep node | grep info^C
root@node-10:~/s3cmd-2.0.1# s3cmd ls s3://6010102/444562/dev10.15.3-x64.msi
2019-10-24 11:50 17108992 s3://6010102/444562/dev10.15.3-x64.msi
root@node-10:~/s3cmd-2.0.1# rados ls -p default.rgw.buckets.data | grep node-v10.15.3-x64 | grep 444562 | grep Z1jURXLla-YMnsaJySH
34fd6a4f-6c36-462f-9cbb-20e32bba2b5b.1423084.4__shadow_444562.dev10.15.3-x64.msi.2~S82AQ6TYk0Z-Z1jURXLla-YMnsaJySH.2_1
34fd6a4f-6c36-462f-9cbb-20e32bba2b5b.1423084.4__multipart_444562.dev10.15.3-x64.msi.2~S82AQ6TYk0Z-Z1jURXLla-YMnsaJySH.3
34fd6a4f-6c36-462f-9cbb-20e32bba2b5b.1423084.4__multipart_444562.dev10.15.3-x64.msi.2~S82AQ6TYk0Z-Z1jURXLla-YMnsaJySH.2
34fd6a4f-6c36-462f-9cbb-20e32bba2b5b.1423084.4__multipart_444562.dev10.15.3-x64.msi.2~S82AQ6TYk0Z-Z1jURXLla-YMnsaJySH.1
This can cause the big file multipart upload is unconsistent .
Updated by bangmin chen about 4 years ago
the last Pull request ID is https://github.com/ceph/ceph/pull/33225
Updated by bangmin chen about 4 years ago
the Affected Versions also include 12.2.12
Updated by bangmin chen about 4 years ago
Updated by Nathan Cutler about 4 years ago
- Project changed from Ceph to rgw
- Category deleted (
java) - Status changed from New to Fix Under Review
- Backport changed from nautilus, mimic, luminous to octopus, nautilus, mimic
- Pull request ID set to 34073