Bug #22529
closed
rgw: copy_object doubles leading underscore on object names.
Added by Marcus Watts over 6 years ago.
Updated about 6 years ago.
Description
swift and s3 have server-side copy functions. When these are applied to an object whose name starts with a leading _, the _ is doubled.
for s3, the following copies testix/bar.txt to testix/__bar62.txt . Then s3cmd emits a bogus warning.
s3cmd cp s3://testix/bar.txt s3://testix/_bar62.txt
the warning is "WARNING: Key not found s3://testix/bar.txt". This actually means it couldn't set acls on testix/_bar62.txt .
for swift, the following results in copying container1/_file1 to container2/__file1
swift copy -d /container2 container1 _file1
This behavior does not happen if if the destination is "under" some folders. Most likely destination folders starting with _ would be wonky too, but I didn't specifically test that.
This bug is present in both master & jewel.
After tracing the code, I believe the problem is that when RGWRados::copy_obj_data()
creates an instance of RGWPutObjProcessor_Atomic, it is passing dest_obj.get_oid() - that then gets used to construct a new object key inside later logic. Logically, that's a "get_oid(get_oid( object_name ) - and each call to get_oid prefixes a _ when the name starts with a _. I have an experimental patch that removes the doubled _. This seems to behave correctly. I'll post that as a PR shortly.
- Status changed from New to 17
- Assignee set to Marcus Watts
- Status changed from 17 to Pending Backport
- Backport set to jewel, luminous
If I understand this correctly, this bug is fixed in master by https://github.com/ceph/ceph/pull/18662 and this PR was backported to luminous (and merged). The jewel backport uses a different fix and is still open.
- Copied to Backport #22708: luminous: rgw: copy_object doubles leading underscore on object names. added
- Copied to Backport #22709: jewel: rgw: copy_object doubles leading underscore on object names. added
- Status changed from Pending Backport to Resolved
Also available in: Atom
PDF