Project

General

Profile

Actions

Documentation #62837

open

Add support for read_from_replica=localize for cephfs similar to krbd

Added by Rakshith R 8 months ago. Updated 3 months ago.

Status:
In Progress
Priority:
Normal
Assignee:
Category:
-
Target version:
-
% Done:

0%

Tags:
Backport:
Reviewed:
Affected Versions:

Description

KRBD supports serving reads from the OSD nearest to the client.
Refer to krbd-options1 read_from_replica & crush_location.
After this feature was implemented in CephCSI2 and Rook3, improvements in iops(increased by ~25%) and latency(decreased by ~90%) were seen on performance tests(Internal Rook deployed Ceph Cluster).
(memory usage of OSDs increased too as a side affect)

It'll be great to have the support for similar feature in CephFS.

references:
[1] https://docs.ceph.com/en/latest/man/8/rbd/#kernel-rbd-krbd-options
[2] https://github.com/ceph/ceph-csi/blob/907c4f38f6d68bd9701ebb7e12745ed919db17c7/docs/deploy-rbd.md#read-affinity-using-crush-locations-for-rbd-volumes
[3] https://github.com/rook/rook/blob/master/Documentation/Storage-Configuration/Ceph-CSI/ceph-csi-drivers.md#enable-read-affinity-for-rbd-volumes

Actions

Also available in: Atom PDF