Project

General

Profile

Osd - rados io hints improvements » History » Version 1

Jessica Mack, 08/12/2015 05:11 AM

1 1 Jessica Mack
h1. Osd - rados io hints improvements
2 1 Jessica Mack
3 1 Jessica Mack
h3. Summary
4 1 Jessica Mack
5 1 Jessica Mack
I/O hints should be used more widely in Ceph [link]. With this feature, OSD is able to use more flexible policy to control the memory usage. E.g, rados client would tell OSD to cache some hot objects that might be re-read later, while the cold objects might be got kicked out of the memory. This would get better response time for the clients also a lower load in OSD server side. We feel this is a good feature for Ceph and we'd like to make more clients to support I/O hints.
6 1 Jessica Mack
 
7 1 Jessica Mack
See the progress: #11046
8 1 Jessica Mack
9 1 Jessica Mack
h3. Owners
10 1 Jessica Mack
11 1 Jessica Mack
* Jianpeng Ma (jianpeng.ma@intel.com)
12 1 Jessica Mack
* Jian Zhang (jian.zhang@intel.com)
13 1 Jessica Mack
* Name
14 1 Jessica Mack
15 1 Jessica Mack
h3. Interested Parties
16 1 Jessica Mack
17 1 Jessica Mack
* Guang Yang (Yahoo!)
18 1 Jessica Mack
* Danny Al-Gaaf (Deutsche Telekom)
19 1 Jessica Mack
* Name
20 1 Jessica Mack
21 1 Jessica Mack
h3. Current Status
22 1 Jessica Mack
23 1 Jessica Mack
Currently rados I/O was added to Ceph in Hammer. It's already supported in librbd/librados. We plan to add more supports in libcephfs. In a cache tier setup, I/O hints need to inserted  be more precisely .
24 1 Jessica Mack
25 1 Jessica Mack
h3. Detailed Description
26 1 Jessica Mack
27 1 Jessica Mack
1. More clients support. There're many client use cases with Ceph. It's interesting to give some example I/O hints usage in different clients. We'll try to add supports to libcephfs
28 1 Jessica Mack
2. I/O hints in cache tier. There're some optimization points when setup a cache tier Ceph cluster using I/O hints. E,g., one object cached in CT might be get cached in memory of BT again. This is quite unnecessary usually. With  I/O hints we could let BT to drop the cache.
29 1 Jessica Mack
     
30 1 Jessica Mack
h3. Work items
31 1 Jessica Mack
32 1 Jessica Mack
h4. Coding tasks
33 1 Jessica Mack
34 1 Jessica Mack
# Task 1
35 1 Jessica Mack
# Task 2
36 1 Jessica Mack
# Task 3
37 1 Jessica Mack
38 1 Jessica Mack
h4. Build / release tasks
39 1 Jessica Mack
40 1 Jessica Mack
# Task 1
41 1 Jessica Mack
# Task 2
42 1 Jessica Mack
# Task 3
43 1 Jessica Mack
44 1 Jessica Mack
h4. Documentation tasks
45 1 Jessica Mack
46 1 Jessica Mack
# Task 1
47 1 Jessica Mack
# Task 2
48 1 Jessica Mack
# Task 3
49 1 Jessica Mack
50 1 Jessica Mack
h4. Deprecation tasks
51 1 Jessica Mack
52 1 Jessica Mack
# Task 1
53 1 Jessica Mack
# Task 2
54 1 Jessica Mack
# Task 3