Project

General

Profile

Actions

Feature #9902

closed

Tool for RADOS import/export pool to file

Added by John Spray over 9 years ago. Updated almost 9 years ago.

Status:
Duplicate
Priority:
Normal
Assignee:
Category:
-
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
Reviewed:
Affected Versions:
Pull request ID:

Description

To assist with CephFS disaster recovery, provide the ability to dump an entire pool (the cephfs metadata pool) to a file, and subsequently restore that to an empty pool. This should include all attrs and omaps as well as object data.

This should come with a test that stops a running filesystem, dumps the pool, wipes the pool, restores it, and checks that filesystem comes up again cleanly as if nothing happened.

I expect some issuing of requests in parallel will be needed here to get a sensible level of throughput.

Clearly this is only practical for pools containing somewhat small amounts of metadata: should probably try to make it clear in any docs that this is not meant to be a general purpose way of backing things up!

Possible extension: optionally stream backup to another RADOS pool (or another ceph cluster) instead of a file.


Related issues 2 (0 open2 closed)

Related to Ceph - Feature #9403: Make rados import/export fully functional and re-enableDuplicateDavid Zafman09/09/2014

Actions
Is duplicate of Ceph - Feature #9964: rados: new export [range] to pipe/fileResolvedJohn Spray

Actions
Actions #1

Updated by David Zafman about 9 years ago

  • Assignee set to David Zafman
Actions #2

Updated by John Spray about 9 years ago

David: check out what I've done so far on wip-9964, just today I refactored the objectstore-tool code so that we can use the same import/export format for "rados export" dumps. Very happy to hand this over if you're already in progress. I haven't familiarized myself so far with what we'll have to do to get snapshots properly handled in the import/export.

Actions #3

Updated by David Zafman almost 9 years ago

  • Status changed from New to Duplicate
  • Assignee changed from David Zafman to John Spray

I marked this as duplicate and assigned to John Spray in case some of the items in this feature haven't been addressed yet and he wants to reopen.

Actions

Also available in: Atom PDF