Project

General

Profile

Bug #21000

rgw: s3 v4 auth fails during chunked file uploads when object size = 0

Added by Marcus Watts over 1 year ago. Updated over 1 year ago.

Status:
New
Priority:
Normal
Assignee:
Target version:
-
Start date:
08/15/2017
Due date:
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:

Description

Chunked file transfers of object size 0 fail. Chunked file transfers of larger objects work fine.

In the logs (with a suitable rgw debug level), this message appears when signature verification happens,
NOTICE: call to do_aws4_auth_completion
On successful verifications, this message appears just before,
parsed new chunk; signature=0b32543586406d29be2
a36c61ca83bb13559f0526d0181e0aedb444ceb6dc4ca, data_length=2048, data_starts_in_stream=86
(numbers may vary). On the failing transfers, this message does not appear.

This is possibly only an aws4 issue. It definitely breaks many hadoop tests.

History

#1 Updated by Marcus Watts over 1 year ago

  • Assignee set to Marcus Watts

#2 Updated by Marcus Watts over 1 year ago

I have a possible fix for this, but it's failing on "16 byte" objects - which I think is a different problem also reported in http://tracker.ceph.com/issues/21003

#3 Updated by Marcus Watts over 1 year ago

I have a possible fix for this problem in:
https://github.com/ceph/ceph/pull/17040
This also contains a fix for small sized chunks, and a "space/plus" fix.

Also available in: Atom PDF