Project

General

Profile

Feature #9902

Tool for RADOS import/export pool to file

Added by John Spray almost 5 years ago. Updated over 4 years ago.

Status:
Duplicate
Priority:
Normal
Assignee:
Category:
-
Target version:
-
Start date:
10/27/2014
Due date:
% Done:

0%

Source:
other
Tags:
Backport:
Reviewed:
Affected Versions:
Pull request ID:

Description

To assist with CephFS disaster recovery, provide the ability to dump an entire pool (the cephfs metadata pool) to a file, and subsequently restore that to an empty pool. This should include all attrs and omaps as well as object data.

This should come with a test that stops a running filesystem, dumps the pool, wipes the pool, restores it, and checks that filesystem comes up again cleanly as if nothing happened.

I expect some issuing of requests in parallel will be needed here to get a sensible level of throughput.

Clearly this is only practical for pools containing somewhat small amounts of metadata: should probably try to make it clear in any docs that this is not meant to be a general purpose way of backing things up!

Possible extension: optionally stream backup to another RADOS pool (or another ceph cluster) instead of a file.


Related issues

Related to Ceph - Feature #9403: Make rados import/export fully functional and re-enable Duplicate 09/09/2014
Duplicates Ceph - Feature #9964: rados: new export [range] to pipe/file Resolved

History

#1 Updated by David Zafman over 4 years ago

  • Assignee set to David Zafman

#2 Updated by John Spray over 4 years ago

David: check out what I've done so far on wip-9964, just today I refactored the objectstore-tool code so that we can use the same import/export format for "rados export" dumps. Very happy to hand this over if you're already in progress. I haven't familiarized myself so far with what we'll have to do to get snapshots properly handled in the import/export.

#3 Updated by David Zafman over 4 years ago

  • Status changed from New to Duplicate
  • Assignee changed from David Zafman to John Spray

I marked this as duplicate and assigned to John Spray in case some of the items in this feature haven't been addressed yet and he wants to reopen.

Also available in: Atom PDF