Accelio xio integration with kernel RBD client for RDMA support » History » Version 1
Jessica Mack, 07/06/2015 08:51 PM
| 1 | 1 | Jessica Mack | h1. Accelio xio integration with kernel RBD client for RDMA support |
|---|---|---|---|
| 2 | |||
| 3 | h3. Summary |
||
| 4 | |||
| 5 | Add accelio xio transport to kernel libceph messenger and integrate the new messenger with kernel RBD. |
||
| 6 | Accelio xio is a transport-independent messaging abstraction and currently runs over RDMA (infiniband or ethernet) |
||
| 7 | |||
| 8 | h3. Owners |
||
| 9 | |||
| 10 | * Raju Kurunkad (SanDisk Inc.) |
||
| 11 | |||
| 12 | h3. Interested Parties |
||
| 13 | |||
| 14 | * Raju Kurunkad (SanDisk Inc.) |
||
| 15 | * Vijayendra Shamanna (SanDisk Inc.) |
||
| 16 | |||
| 17 | h3. Current Status |
||
| 18 | |||
| 19 | Currently ceph kernel RBD client uses the kernel libceph messenger. This messenger uses kernel sockets using TCP as transport to communicate with a ceph cluster. |
||
| 20 | Ceph support for using xio to communicate over RDMA is being tracked by [[Accelio RDMA Messenger|blueprint]]. We are adding support in kernel RBD to communicate with ceph clusters that support xio. |
||
| 21 | Development of prototype libceph messenger to use xio for talking to a xio enabled ceph cluster is in progress. |
||
| 22 | |||
| 23 | h3. Detailed Description |
||
| 24 | |||
| 25 | Add following changes to linux kernel libceph module: |
||
| 26 | * Interface with the xio kernel module for accelio session and connection creation(inprogress) |
||
| 27 | * Seperate libceph messenger and the actual transport(TCP, xio) |
||
| 28 | * Refactor existing libcepf kernel messenger to function in request-response fashion(TBD) |
||
| 29 | * RBD config and Interface to request use of accelio xio transport for communication with xio enabled ceph cluster(TBD) |
||
| 30 | * Measure performance with xio enabled libceph/kernel RBD talking to xio enabled ceph cluster(TBD) |
||
| 31 | * Verify all supported kernel RBD operations using xio transport in kernel libceph messenger(TBD) |
||
| 32 | * Verify basic kernel cephfs operations using xio transport in kernel libceph messenger(TBD) |
||
| 33 | |||
| 34 | h3. Work items |
||
| 35 | |||
| 36 | h4. Coding tasks |
||
| 37 | |||
| 38 | # Task 1 |
||
| 39 | # Task 2 |
||
| 40 | # Task 3 |
||
| 41 | |||
| 42 | h4. Build / release tasks |
||
| 43 | |||
| 44 | # Task 1 |
||
| 45 | # Task 2 |
||
| 46 | # Task 3 |
||
| 47 | |||
| 48 | h4. Documentation tasks |
||
| 49 | |||
| 50 | # Task 1 |
||
| 51 | # Task 2 |
||
| 52 | # Task 3 |
||
| 53 | |||
| 54 | h4. Deprecation tasks |
||
| 55 | |||
| 56 | # Task 1 |
||
| 57 | # Task 2 |
||
| 58 | # Task 3 |