Project

General

Profile

Actions

Feature #1419

closed

rados export: parallelize to be faster

Added by Anonymous over 12 years ago. Updated over 12 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
-
Target version:
% Done:

0%

Source:
Tags:
Backport:
Reviewed:
Affected Versions:
Pull request ID:

Description

Currently, buckets with lots of small objects take a long time to backup with rados export.

To saturate the network connection, make "rados export" take a --workers=N option and create a thread pool of that size. Feed the names of objects in the pool to a queue that is emptied by all the threads. Then wait for all threads to complete successfully. (Or use async operations, but that sounds more complex.)

Actions

Also available in: Atom PDF