Project

General

Profile

Feature #36253

cephfs: clients should send usage metadata to MDSs for administration/monitoring

Added by Patrick Donnelly 3 months ago. Updated about 1 month ago.

Status:
In Progress
Priority:
High
Assignee:
Category:
Performance/Resource Usage
Target version:
Start date:
Due date:
% Done:

0%

Source:
Development
Tags:
Backport:
Reviewed:
Affected Versions:
Component(FS):
Client, MDS, kceph
Labels (FS):
Pull request ID:

Description

In particular:

  • The capability "cache hits" by clients to provide introspection on the effectiveness of client capability caching. (Slightly different from #26996, this provides aggregate information for all caps from the client.)
  • OSDC cache hits.
  • OSDC readahead utilization (?); i.e. if the client reads ahead, does its workload actually use those buffers?
  • data write/read ops/bandwidth

In terms of implementation, this will be a new message sent to one of the ranks the client has a session with. It is probably not important which rank it sends the message to or that the same rank gets the sequential messages. Periodically, the ranks will forward these messages in a reduced form to rank 0. Rank 0, in a separate thread, can then aggregate all session metadata and send statistics to the mgr. This will probably include a snapshot of all sessions with various per-session statistics (#24285). (It's probably a good idea to send all of the sessions statistics to the mgr even if that is potentially ~1000 sessions. The user of `ceph fs top` may want to search for a particular session.)


Related issues

Related to fs - Feature #26996: cephfs: get capability cache hits by clients to provide introspection on effectiveness of client caching New 08/21/2018
Related to fs - Feature #24285: mgr: add module which displays current usage of file system (`fs top`) New

History

#1 Updated by Patrick Donnelly 3 months ago

  • Related to Feature #26996: cephfs: get capability cache hits by clients to provide introspection on effectiveness of client caching added

#2 Updated by Patrick Donnelly 3 months ago

  • Related to Feature #24285: mgr: add module which displays current usage of file system (`fs top`) added

#3 Updated by Patrick Donnelly 3 months ago

  • Description updated (diff)

#4 Updated by Venky Shankar about 1 month ago

  • Status changed from New to In Progress
  • Assignee set to Venky Shankar

Also available in: Atom PDF