Project

General

Profile

Rbd - Database performance » History » Version 1

Jessica Mack, 07/01/2015 12:07 AM

1 1 Jessica Mack
h1. Rbd - Database performance
2 1 Jessica Mack
3 1 Jessica Mack
h3. Summary
4 1 Jessica Mack
5 1 Jessica Mack
This blueprint aims at understanding various types of databases performances running over Ceph RBD either via kernel device and/or librbd (via libvirt/qemu). Best practices, fine-tuning guides for performance tradeoffs, features tradeoffs for various types of databases are expected to be some of the outcomes.
6 1 Jessica Mack
7 1 Jessica Mack
h3. Owners
8 1 Jessica Mack
9 1 Jessica Mack
* JY Luke (MIMOS)
10 1 Jessica Mack
* Mohd Bazli Ab Karim (MIMOS)
11 1 Jessica Mack
* MT Wong (MIMOS)
12 1 Jessica Mack
* HH Ong (MIMOS)
13 1 Jessica Mack
14 1 Jessica Mack
h3. Interested Parties
15 1 Jessica Mack
16 1 Jessica Mack
* Danny Al-Gaaf
17 1 Jessica Mack
* Name (Affiliation)
18 1 Jessica Mack
* Name
19 1 Jessica Mack
20 1 Jessica Mack
h3. Current Status
21 1 Jessica Mack
22 1 Jessica Mack
Initial evaluation using HammerDB on PostgreSQL in VM with RBD (via libvirt) however performance is not sactisfactory.
23 1 Jessica Mack
24 1 Jessica Mack
h3. Detailed Description
25 1 Jessica Mack
26 1 Jessica Mack
Simple benchmark run using HammerDB on PostgreSQL showed serious lack of performance as do some other discussions over the ceph-users and ceph-devel mailing list recently. The idea here is to study/evaluate several popular open source databases and their IO patterns that will lead to better configuration for both the databases and Ceph to provide the best possible performance. The outcome can be in the form of FAQ/Guidelines on what is the best practices, options, etc.
27 1 Jessica Mack
 
28 1 Jessica Mack
Currently, we are planning to run more performance tests using the following tools:
29 1 Jessica Mack
* Hammerdb for PostgreSQL, MySQL - http://hammerora.sourceforge.net/
30 1 Jessica Mack
* YCSB for Cassandra - https://github.com/brianfrankcooper/YCSB/wiki
31 1 Jessica Mack
32 1 Jessica Mack
h3. Pad
33 1 Jessica Mack
34 1 Jessica Mack
http://pad.ceph.com/p/GH-rbd-database-performance
35 1 Jessica Mack
36 1 Jessica Mack
h3. Work items
37 1 Jessica Mack
38 1 Jessica Mack
h4. Coding tasks
39 1 Jessica Mack
40 1 Jessica Mack
# Task 1
41 1 Jessica Mack
# Task 2
42 1 Jessica Mack
# Task 3
43 1 Jessica Mack
44 1 Jessica Mack
h4. Build / release tasks
45 1 Jessica Mack
46 1 Jessica Mack
# Task 1
47 1 Jessica Mack
# Task 2
48 1 Jessica Mack
# Task 3
49 1 Jessica Mack
50 1 Jessica Mack
h4. Documentation tasks
51 1 Jessica Mack
52 1 Jessica Mack
# Task 1
53 1 Jessica Mack
# Task 2
54 1 Jessica Mack
# Task 3
55 1 Jessica Mack
56 1 Jessica Mack
h4. Deprecation tasks
57 1 Jessica Mack
58 1 Jessica Mack
# Task 1
59 1 Jessica Mack
# Task 2
60 1 Jessica Mack
# Task 3