Feature #1544
closedrgw: explicit bucket index
0%
Description
maintain an explicit index for bucket contents, in a separate object, that is sorted (yay!). we can use tmap for this. and eventually improve the osd tmap implementation to perform for very large maps.
something like this?
- the key would be the object name, the value would be the <tag,timestamp,proposed> (where proposed is a bool).
on put, do something like
- insert tmap entry with proposed+$tag
- complete the put
- update tmap value to just $tag
on list,
- return committed records
- on proposed records, stat the object, and clean up if it dne and the attempt is sufficiently old.
on delete,
- set tmap value to proposed+$tag
- remove object
- remove tmap value (if == proposed+$tag)
etc. it's more complicated than that because you can have racing puts and deletes. but, generally speaking, do any rollback/cleanup during list-objects...
Files
Updated by Sage Weil over 12 years ago
- Target version changed from v0.36 to v0.37
Updated by Sage Weil over 12 years ago
- Translation missing: en.field_position set to 52
Updated by Sage Weil over 12 years ago
- Translation missing: en.field_position deleted (
55) - Translation missing: en.field_position set to 35
Updated by Sage Weil over 12 years ago
- Translation missing: en.field_story_points set to 13
- Translation missing: en.field_position deleted (
36) - Translation missing: en.field_position set to 36
Updated by Greg Farnum over 12 years ago
- File rgw_doc.txt rgw_doc.txt added
I've attached our current design doc, such as it is.
Updated by Greg Farnum over 12 years ago
- Status changed from New to Resolved
We have a bucket index. Other tickets exist for doing the cleanup, etc.
Updated by John Spray over 6 years ago
- Project changed from Ceph to rgw
- Category deleted (
22) - Target version deleted (
v0.37)
Bulk reassign of radosgw category to RGW project.