Project

General

Profile

Actions

Bug #44008

open

multi-part upload will lost part data when you abort and resume a multipart upload request by using aws java Signature Version 4 api

Added by bangmin chen about 4 years ago. Updated about 4 years ago.

Status:
Fix Under Review
Priority:
Normal
Assignee:
-
Target version:
% Done:

0%

Source:
Community (user)
Tags:
Backport:
octopus, nautilus, mimic
Regression:
No
Severity:
1 - critical
Reviewed:
Affected Versions:
ceph-qa-suite:
rgw
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

There is a bug when you abort and resume a multipart upload request by using aws java Signature Version 4 api. the abort part will lost you can see the result in the following:
root@node-10:~/s3cmd-2.0.1# s3cmd info s3://6010102/444562 de-v10.15.3-x64.msi
s3://6010102/444562 de-v10.15.3-x64.msi (object):
File size: 8720384
Last mod: Thu, 24 Oct 2019 11:50:29 GMT
MIME type: binary/octet-stream
Storage: STANDARD
MD5 sum: 9afe88c2ac1d7f33c65d2760d9521436-3
SSE: none
Policy: none
CORS: none
ACL: ddstest01: FULL_CONTROL
x-amz-meta-md5: acd333508ec4a8bad8eb3777e436f498
root@node-10:~/s3cmd-2.0.1# history | grep node | grep info^C
root@node-10:~/s3cmd-2.0.1# s3cmd ls s3://6010102/444562/dev10.15.3-x64.msi
2019-10-24 11:50 17108992 s3://6010102/444562/dev10.15.3-x64.msi
root@node-10:~/s3cmd-2.0.1# rados ls -p default.rgw.buckets.data | grep node-v10.15.3-x64 | grep 444562 | grep Z1jURXLla-YMnsaJySH
34fd6a4f-6c36-462f-9cbb-20e32bba2b5b.1423084.4__shadow_444562.dev10.15.3-x64.msi.2~S82AQ6TYk0Z-Z1jURXLla-YMnsaJySH.2_1
34fd6a4f-6c36-462f-9cbb-20e32bba2b5b.1423084.4__multipart_444562.dev10.15.3-x64.msi.2~S82AQ6TYk0Z-Z1jURXLla-YMnsaJySH.3
34fd6a4f-6c36-462f-9cbb-20e32bba2b5b.1423084.4__multipart_444562.dev10.15.3-x64.msi.2~S82AQ6TYk0Z-Z1jURXLla-YMnsaJySH.2
34fd6a4f-6c36-462f-9cbb-20e32bba2b5b.1423084.4__multipart_444562.dev10.15.3-x64.msi.2~S82AQ6TYk0Z-Z1jURXLla-YMnsaJySH.1

This can cause the big file multipart upload is unconsistent .

Actions #1

Updated by bangmin chen about 4 years ago

the last Pull request ID is https://github.com/ceph/ceph/pull/33225

Actions #2

Updated by bangmin chen about 4 years ago

the Affected Versions also include 12.2.12

Actions #3

Updated by bangmin chen about 4 years ago

I am working on this issue

Actions #4

Updated by bangmin chen about 4 years ago

bangmin chen wrote:

I am working on this issue

PR: https://github.com/ceph/ceph/pull/34073

Actions #5

Updated by Nathan Cutler about 4 years ago

  • Project changed from Ceph to rgw
  • Category deleted (java)
  • Status changed from New to Fix Under Review
  • Backport changed from nautilus, mimic, luminous to octopus, nautilus, mimic
  • Pull request ID set to 34073
Actions

Also available in: Atom PDF