Project

General

Profile

Rados - metadata-only journal mode » History » Version 3

Li Wang, 06/10/2015 09:17 AM

1 1 Li Wang
h1. Rados - metadata-only journal mode
2 2 Li Wang
3
*Summary*
4 3 Li Wang
This is for metadata-only journal mode. An important usage of Ceph is to 
5
integrate with cloud computing platform to provide the storage for VM 
6
images and instances. In such scenario, qemu maps RBD as virtual block 
7
devices, i.e., disks to a VM, and the guest operating system will format 
8
the disks and create file systems on them. In this case, RBD mostly 
9
resembles a 'dumb' disk.  In other words, it is enough for RBD to 
10
implement exactly the semantics of a disk controller driver. Typically, 
11
the disk controller itself does
12
not provide a transactional mechanism to ensure a write operation done
13
atomically. Instead, it is up to the file system, who manages the disk,
14
to adopt some techniques such as journaling to prevent inconsistency,
15
if necessary. Consequently, RBD does not need to provide the
16
atomic mechanism to ensure a data write operation done atomically,
17
since the guest file system will guarantee that its write operations to
18
RBD will remain consistent by using journaling if needed. Another
19
scenario is for the cache tiering, while cache pool has already
20
provided the durability, when dirty objects are written back, they
21
theoretically need not go through the journaling process of base pool,
22
since the flusher could replay the write operation. These motivate us
23
to implement a new journal mode, metadata-only journal mode, which
24
resembles the data=ordered journal mode in ext4. With such journal mode
25
is on, object data are written directly to their ultimate location,
26
when data written finished, metadata are written into the journal, then
27
the write returns to caller. This will avoid the double-write penalty
28
of object data due to the WRITE-AHEAD-LOGGING, potentially greatly
29
improve the RBD and cache tiering performance. 
30 2 Li Wang
31
*Owners*
32
33
Li Wang (liwang@ubuntukylin.com)
34
Name (Affiliation)
35
Name
36
37
*Interested Parties*
38
If you are interested in contributing to this blueprint, or want to be a "speaker" during the Summit session, list your name here.
39
Name (Affiliation)
40
Name (Affiliation)
41
Name
42
43
*Current Status*
44
Please describe the current status of Ceph as it relates to this blueprint.  Is there something that this replaces?  Are there current features that are related?
45
46
*Detailed Description*
47
This is the big one!  Please provide a detailed description for the proposed change.  Where appropriate, include your architectural approach, a list of systems involved, important consequences, and issues that are still unresolved.
48
49
*Work items*
50
This section should contain a list of work tasks created by this blueprint.  Please include engineering tasks as well as related build/release and documentation work.  If this blueprint requires cleanup of deprecated features, please list those tasks as well.
51
52
*Coding tasks*
53
Task 1
54
Task 2
55
Task 3
56
57
*Build / release tasks*
58
Task 1
59
Task 2
60
Task 3
61
62
*Documentation tasks*
63
Task 1
64
Task 2
65
Task 3
66
67
*Deprecation tasks*
68
Task 1
69
Task 2
70
Task 3