Project

General

Profile

Feature #1419

rados export: parallelize to be faster

Added by Anonymous over 12 years ago. Updated over 12 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
-
Target version:
% Done:

0%

Source:
Tags:
Backport:
Reviewed:
Affected Versions:
Pull request ID:

Description

Currently, buckets with lots of small objects take a long time to backup with rados export.

To saturate the network connection, make "rados export" take a --workers=N option and create a thread pool of that size. Feed the names of objects in the pool to a queue that is emptied by all the threads. Then wait for all threads to complete successfully. (Or use async operations, but that sounds more complex.)

History

#1 Updated by Sage Weil over 12 years ago

  • Target version set to v0.36
  • translation missing: en.field_position set to 3

#2 Updated by Sage Weil over 12 years ago

  • Target version changed from v0.36 to v0.35
  • translation missing: en.field_position deleted (22)
  • translation missing: en.field_position set to 832

#3 Updated by Sage Weil over 12 years ago

  • translation missing: en.field_story_points set to 3
  • translation missing: en.field_position deleted (832)
  • translation missing: en.field_position set to 832

#4 Updated by Sage Weil over 12 years ago

  • Assignee set to Colin McCabe

#5 Updated by Colin McCabe over 12 years ago

  • Status changed from New to Resolved

Also available in: Atom PDF