Feature #19644
closed
Add custom user data support in bucket index
Added by Pavan Rallabhandi about 7 years ago.
Updated over 6 years ago.
Description
One of our big data use cases was to fetch all segments' size of a swift DLO manifest without having to go through each segment file. This feature addresses such requirements by having a 'user data' field in the bucket index structure 'rgw_bucket_dir_entry_meta', which would be populated via a custom http header passed in by the user and returned as appropriate.
- Status changed from New to Fix Under Review
can you take a example to explain this feature detailedly? Or
is there existing some docs about this feature? Thanks!
This feature enables us to have a meta field (which is generic in nature to store any user defined data) in the bucket index. We are presently using this put/get all segments' size for a swift DLO object. Without this, to know the size of all segments that are part of swift DLO manifest, we have to loop through all segment parts and return the size as part of content length on the DLO manifest object. This operation was pretty heavy for our big data clients to perform, which we now solve by having this user defined field in the bucket index.
- Backport set to kraken, jewel
- Status changed from Fix Under Review to Pending Backport
- Copied to Backport #19843: kraken: Add custom user data support in bucket index added
- Copied to Backport #19844: jewel: Add custom user data support in bucket index added
- Status changed from Pending Backport to Resolved
Also available in: Atom
PDF