Feature #1419
rados export: parallelize to be faster
% Done:
0%
Source:
Tags:
Backport:
Reviewed:
Affected Versions:
Pull request ID:
Description
Currently, buckets with lots of small objects take a long time to backup with rados export.
To saturate the network connection, make "rados export" take a --workers=N option and create a thread pool of that size. Feed the names of objects in the pool to a queue that is emptied by all the threads. Then wait for all threads to complete successfully. (Or use async operations, but that sounds more complex.)
History
#1 Updated by Sage Weil over 12 years ago
- Target version set to v0.36
- translation missing: en.field_position set to 3
#2 Updated by Sage Weil over 12 years ago
- Target version changed from v0.36 to v0.35
- translation missing: en.field_position deleted (
22) - translation missing: en.field_position set to 832
#3 Updated by Sage Weil over 12 years ago
- translation missing: en.field_story_points set to 3
- translation missing: en.field_position deleted (
832) - translation missing: en.field_position set to 832
#4 Updated by Sage Weil over 12 years ago
- Assignee set to Colin McCabe
#5 Updated by Colin McCabe over 12 years ago
- Status changed from New to Resolved