Actions
Feature #1419
closedrados export: parallelize to be faster
% Done:
0%
Source:
Tags:
Backport:
Reviewed:
Affected Versions:
Pull request ID:
Description
Currently, buckets with lots of small objects take a long time to backup with rados export.
To saturate the network connection, make "rados export" take a --workers=N option and create a thread pool of that size. Feed the names of objects in the pool to a queue that is emptied by all the threads. Then wait for all threads to complete successfully. (Or use async operations, but that sounds more complex.)
Actions