Bug #21000
openrgw: s3 v4 auth fails during chunked file uploads when object size = 0
0%
Description
Chunked file transfers of object size 0 fail. Chunked file transfers of larger objects work fine.
In the logs (with a suitable rgw debug level), this message appears when signature verification happens,
NOTICE: call to do_aws4_auth_completion
On successful verifications, this message appears just before,
parsed new chunk; signature=0b32543586406d29be2
a36c61ca83bb13559f0526d0181e0aedb444ceb6dc4ca, data_length=2048, data_starts_in_stream=86
(numbers may vary). On the failing transfers, this message does not appear.
This is possibly only an aws4 issue. It definitely breaks many hadoop tests.
Updated by Marcus Watts over 6 years ago
I have a possible fix for this, but it's failing on "16 byte" objects - which I think is a different problem also reported in http://tracker.ceph.com/issues/21003
Updated by Marcus Watts over 6 years ago
I have a possible fix for this problem in:
https://github.com/ceph/ceph/pull/17040
This also contains a fix for small sized chunks, and a "space/plus" fix.