https://tracker.ceph.com/
https://tracker.ceph.com/favicon.ico
2019-12-09T18:52:22Z
Ceph
Linux kernel client - Feature #43215: kclient: send usage metrics to MDS
https://tracker.ceph.com/issues/43215?journal_id=153944
2019-12-09T18:52:22Z
Patrick Donnelly
pdonnell@redhat.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-2 status-3 priority-5 priority-high3 closed" href="/issues/36253">Feature #36253</a>: cephfs: clients should send usage metadata to MDSs for administration/monitoring</i> added</li></ul>
Linux kernel client - Feature #43215: kclient: send usage metrics to MDS
https://tracker.ceph.com/issues/43215?journal_id=153946
2019-12-09T18:52:46Z
Patrick Donnelly
pdonnell@redhat.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-2 status-3 priority-5 priority-high3 closed" href="/issues/24285">Feature #24285</a>: mgr: add module which displays current usage of file system (`fs top`)</i> added</li></ul>
Linux kernel client - Feature #43215: kclient: send usage metrics to MDS
https://tracker.ceph.com/issues/43215?journal_id=154400
2019-12-14T00:52:26Z
Xiubo Li
xiubli@redhat.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>In Progress</i></li></ul>
Linux kernel client - Feature #43215: kclient: send usage metrics to MDS
https://tracker.ceph.com/issues/43215?journal_id=154460
2019-12-16T12:01:41Z
Xiubo Li
xiubli@redhat.com
<ul></ul><p>For both dentry lease and caps perf metric we will only count the hit/miss info triggered from the vfs calls, for the cases like request reply handling and perodically ceph_trim_dentries() we will ignore them.</p>
<p>Currently only the debugfs is support and next will fulfill sending the mertic data to MDS.</p>
<p>The output will be:</p>
<pre><code class="c syntaxhl"><span class="CodeRay"><span class="preprocessor"># cat</span> /sys/kernel/debug/ceph/<span class="integer">536</span>b8f9c-<span class="integer">0</span>d78-<span class="integer">46</span>bc-bbe9-c2ceb61c82a0.client4275/metric
item hit miss
---------------------------------------
d_lease <span class="integer">19</span> <span class="integer">0</span>
i_caps <span class="integer">168</span> <span class="integer">1</span>
</span></code></pre>
Linux kernel client - Feature #43215: kclient: send usage metrics to MDS
https://tracker.ceph.com/issues/43215?journal_id=154552
2019-12-17T12:21:28Z
Xiubo Li
xiubli@redhat.com
<ul></ul><p>Will add the entry count and cap count support:</p>
<pre><code class="c syntaxhl"><span class="CodeRay"> The output will be:
item total hit miss
----------------------------------------------------
d_lease <span class="integer">11</span> <span class="integer">141</span> <span class="integer">7</span>
i_caps <span class="integer">10</span> <span class="integer">28995740</span> <span class="integer">13</span>
</span></code></pre>
Linux kernel client - Feature #43215: kclient: send usage metrics to MDS
https://tracker.ceph.com/issues/43215?journal_id=154818
2019-12-26T06:16:50Z
Xiubo Li
xiubli@redhat.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-2 status-3 priority-5 priority-high3 closed" href="/issues/43423">Feature #43423</a>: mds: collect and show the dentry lease metric</i> added</li></ul>
Linux kernel client - Feature #43215: kclient: send usage metrics to MDS
https://tracker.ceph.com/issues/43215?journal_id=154819
2019-12-26T06:21:09Z
Xiubo Li
xiubli@redhat.com
<ul></ul><p>The output will be:</p>
<pre><code class="c syntaxhl"><span class="CodeRay">
<span class="preprocessor"># cat</span> /sys/kernel/debug/ceph/<span class="octal">02</span>a220c4-e4c6-<span class="integer">43</span>cd-<span class="integer">9</span>a84-<span class="integer">993</span>a020d2ffb.client4273/metrics
item total miss hit
-------------------------------------------------
d_lease <span class="integer">125</span> <span class="integer">120</span> <span class="integer">2184</span>
session caps miss hit
-------------------------------------------------
<span class="integer">0</span> <span class="integer">63</span> <span class="integer">692</span> <span class="integer">7100</span>
<span class="integer">1</span> <span class="integer">58</span> <span class="integer">0</span> <span class="integer">113</span>
<span class="integer">2</span> <span class="integer">66</span> <span class="integer">0</span> <span class="integer">109</span>
<span class="preprocessor"># </span>./bin/ceph fs perf stats | python -m json.tool
{
<span class="string"><span class="delimiter">"</span><span class="content">client_metadata</span><span class="delimiter">"</span></span>: {
<span class="string"><span class="delimiter">"</span><span class="content">client.4273</span><span class="delimiter">"</span></span>: {
<span class="string"><span class="delimiter">"</span><span class="content">IP</span><span class="delimiter">"</span></span>: <span class="string"><span class="delimiter">"</span><span class="content">v1:192.168.195.165</span><span class="delimiter">"</span></span>,
<span class="string"><span class="delimiter">"</span><span class="content">hostname</span><span class="delimiter">"</span></span>: <span class="string"><span class="delimiter">"</span><span class="content">fedora1</span><span class="delimiter">"</span></span>,
<span class="string"><span class="delimiter">"</span><span class="content">mount_point</span><span class="delimiter">"</span></span>: <span class="string"><span class="delimiter">"</span><span class="content">N/A</span><span class="delimiter">"</span></span>,
<span class="string"><span class="delimiter">"</span><span class="content">root</span><span class="delimiter">"</span></span>: <span class="string"><span class="delimiter">"</span><span class="content">/</span><span class="delimiter">"</span></span>
}
},
<span class="string"><span class="delimiter">"</span><span class="content">counters</span><span class="delimiter">"</span></span>: [
<span class="string"><span class="delimiter">"</span><span class="content">cap_hit</span><span class="delimiter">"</span></span>
],
<span class="string"><span class="delimiter">"</span><span class="content">global_counters</span><span class="delimiter">"</span></span>: [
<span class="string"><span class="delimiter">"</span><span class="content">read_latency</span><span class="delimiter">"</span></span>,
<span class="string"><span class="delimiter">"</span><span class="content">write_latency</span><span class="delimiter">"</span></span>,
<span class="string"><span class="delimiter">"</span><span class="content">metadata_latency</span><span class="delimiter">"</span></span>,
<span class="string"><span class="delimiter">"</span><span class="content">dentry_lease_hit</span><span class="delimiter">"</span></span>
],
<span class="string"><span class="delimiter">"</span><span class="content">global_metrics</span><span class="delimiter">"</span></span>: {
<span class="string"><span class="delimiter">"</span><span class="content">client.4273</span><span class="delimiter">"</span></span>: [
[
<span class="integer">0</span>,
<span class="integer">0</span>
],
[
<span class="integer">0</span>,
<span class="integer">0</span>
],
[
<span class="integer">0</span>,
<span class="integer">0</span>
],
[
<span class="integer">2184</span>,
<span class="integer">120</span>
]
]
},
<span class="string"><span class="delimiter">"</span><span class="content">metrics</span><span class="delimiter">"</span></span>: {
<span class="string"><span class="delimiter">"</span><span class="content">delayed_ranks</span><span class="delimiter">"</span></span>: [],
<span class="string"><span class="delimiter">"</span><span class="content">mds.0</span><span class="delimiter">"</span></span>: {
<span class="string"><span class="delimiter">"</span><span class="content">client.4273</span><span class="delimiter">"</span></span>: [
[
<span class="integer">7100</span>,
<span class="integer">692</span>
]
]
},
<span class="string"><span class="delimiter">"</span><span class="content">mds.1</span><span class="delimiter">"</span></span>: {
<span class="string"><span class="delimiter">"</span><span class="content">client.4273</span><span class="delimiter">"</span></span>: [
[
<span class="integer">113</span>,
<span class="integer">0</span>
]
]
},
<span class="string"><span class="delimiter">"</span><span class="content">mds.2</span><span class="delimiter">"</span></span>: {
<span class="string"><span class="delimiter">"</span><span class="content">client.4273</span><span class="delimiter">"</span></span>: [
[
<span class="integer">109</span>,
<span class="integer">0</span>
]
]
}
}
}
</span></code></pre>
Linux kernel client - Feature #43215: kclient: send usage metrics to MDS
https://tracker.ceph.com/issues/43215?journal_id=154839
2019-12-30T01:57:56Z
Xiubo Li
xiubli@redhat.com
<ul><li><strong>Status</strong> changed from <i>In Progress</i> to <i>Fix Under Review</i></li></ul>
Linux kernel client - Feature #43215: kclient: send usage metrics to MDS
https://tracker.ceph.com/issues/43215?journal_id=154845
2019-12-30T05:44:14Z
Xiubo Li
xiubli@redhat.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-2 status-3 priority-5 priority-high3 closed" href="/issues/43435">Feature #43435</a>: kclient:send client provided metric flags in client metadata</i> added</li></ul>
Linux kernel client - Feature #43215: kclient: send usage metrics to MDS
https://tracker.ceph.com/issues/43215?journal_id=154848
2019-12-30T05:44:58Z
Xiubo Li
xiubli@redhat.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-1 status-3 priority-6 priority-high2 closed" href="/issues/24823">Bug #24823</a>: mds: deadlock when setting config value via admin socket</i> added</li></ul>
Linux kernel client - Feature #43215: kclient: send usage metrics to MDS
https://tracker.ceph.com/issues/43215?journal_id=154850
2019-12-30T05:47:19Z
Xiubo Li
xiubli@redhat.com
<ul><li><strong>Related to</strong> deleted (<i><a class="issue tracker-1 status-3 priority-6 priority-high2 closed" href="/issues/24823">Bug #24823</a>: mds: deadlock when setting config value via admin socket</i>)</li></ul>
Linux kernel client - Feature #43215: kclient: send usage metrics to MDS
https://tracker.ceph.com/issues/43215?journal_id=154852
2019-12-30T05:47:34Z
Xiubo Li
xiubli@redhat.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-2 status-3 priority-5 priority-high3 closed" href="/issues/43435">Feature #43435</a>: kclient:send client provided metric flags in client metadata</i> added</li></ul>
Linux kernel client - Feature #43215: kclient: send usage metrics to MDS
https://tracker.ceph.com/issues/43215?journal_id=154854
2019-12-30T05:47:41Z
Xiubo Li
xiubli@redhat.com
<ul><li><strong>Related to</strong> deleted (<i><a class="issue tracker-2 status-3 priority-5 priority-high3 closed" href="/issues/43435">Feature #43435</a>: kclient:send client provided metric flags in client metadata</i>)</li></ul>
Linux kernel client - Feature #43215: kclient: send usage metrics to MDS
https://tracker.ceph.com/issues/43215?journal_id=154967
2020-01-06T09:51:21Z
Xiubo Li
xiubli@redhat.com
<ul></ul><p>Add read/write latency support:</p>
<pre><code class="c syntaxhl"><span class="CodeRay"><span class="preprocessor"># </span>./bin/ceph fs perf stats | python -m json.tool
{
<span class="string"><span class="delimiter">"</span><span class="content">client_metadata</span><span class="delimiter">"</span></span>: {
<span class="string"><span class="delimiter">"</span><span class="content">client.4836</span><span class="delimiter">"</span></span>: {
<span class="string"><span class="delimiter">"</span><span class="content">IP</span><span class="delimiter">"</span></span>: <span class="string"><span class="delimiter">"</span><span class="content">v1:192.168.195.165</span><span class="delimiter">"</span></span>,
<span class="string"><span class="delimiter">"</span><span class="content">hostname</span><span class="delimiter">"</span></span>: <span class="string"><span class="delimiter">"</span><span class="content">fedora1</span><span class="delimiter">"</span></span>,
<span class="string"><span class="delimiter">"</span><span class="content">mount_point</span><span class="delimiter">"</span></span>: <span class="string"><span class="delimiter">"</span><span class="content">N/A</span><span class="delimiter">"</span></span>,
<span class="string"><span class="delimiter">"</span><span class="content">root</span><span class="delimiter">"</span></span>: <span class="string"><span class="delimiter">"</span><span class="content">/</span><span class="delimiter">"</span></span>
}
},
<span class="string"><span class="delimiter">"</span><span class="content">counters</span><span class="delimiter">"</span></span>: [
<span class="string"><span class="delimiter">"</span><span class="content">cap_hit</span><span class="delimiter">"</span></span>
],
<span class="string"><span class="delimiter">"</span><span class="content">global_counters</span><span class="delimiter">"</span></span>: [
<span class="string"><span class="delimiter">"</span><span class="content">read_latency</span><span class="delimiter">"</span></span>,
<span class="string"><span class="delimiter">"</span><span class="content">write_latency</span><span class="delimiter">"</span></span>,
<span class="string"><span class="delimiter">"</span><span class="content">metadata_latency</span><span class="delimiter">"</span></span>,
<span class="string"><span class="delimiter">"</span><span class="content">dentry_lease_hit</span><span class="delimiter">"</span></span>
],
<span class="string"><span class="delimiter">"</span><span class="content">global_metrics</span><span class="delimiter">"</span></span>: {
<span class="string"><span class="delimiter">"</span><span class="content">client.4836</span><span class="delimiter">"</span></span>: [
[
<span class="integer">0</span>,
<span class="integer">15000000</span>
],
[
<span class="integer">13</span>,
<span class="integer">77000000</span>
],
[
<span class="integer">0</span>,
<span class="integer">0</span>
],
[
<span class="integer">6</span>,
<span class="integer">0</span>
]
]
},
<span class="string"><span class="delimiter">"</span><span class="content">metrics</span><span class="delimiter">"</span></span>: {
<span class="string"><span class="delimiter">"</span><span class="content">delayed_ranks</span><span class="delimiter">"</span></span>: [],
<span class="string"><span class="delimiter">"</span><span class="content">mds.0</span><span class="delimiter">"</span></span>: {
<span class="string"><span class="delimiter">"</span><span class="content">client.4836</span><span class="delimiter">"</span></span>: [
[
<span class="integer">1222</span>,
<span class="integer">9</span>
]
]
},
<span class="string"><span class="delimiter">"</span><span class="content">mds.1</span><span class="delimiter">"</span></span>: {
<span class="string"><span class="delimiter">"</span><span class="content">client.4836</span><span class="delimiter">"</span></span>: [
[
<span class="integer">4</span>,
<span class="integer">0</span>
]
]
}
}
}
</span></code></pre>
Linux kernel client - Feature #43215: kclient: send usage metrics to MDS
https://tracker.ceph.com/issues/43215?journal_id=159003
2020-02-18T21:55:58Z
Patrick Donnelly
pdonnell@redhat.com
<ul><li><strong>Target version</strong> changed from <i>v15.0.0</i> to <i>v16.0.0</i></li></ul>
Linux kernel client - Feature #43215: kclient: send usage metrics to MDS
https://tracker.ceph.com/issues/43215?journal_id=160692
2020-03-10T00:51:31Z
Xiubo Li
xiubli@redhat.com
<ul></ul><p>For the patch series [1] it only support the debugfs showing, will add sending the metric to ceph stuff after the depending ceph PR [2] get merged.</p>
<p>[1]: <a class="external" href="https://patchwork.kernel.org/project/ceph-devel/list/?series=253159">https://patchwork.kernel.org/project/ceph-devel/list/?series=253159</a><br />[2]: <a class="external" href="https://github.com/ceph/ceph/pull/26004">https://github.com/ceph/ceph/pull/26004</a></p>
<p>Thanks</p>
Linux kernel client - Feature #43215: kclient: send usage metrics to MDS
https://tracker.ceph.com/issues/43215?journal_id=168401
2020-06-18T09:18:39Z
Xiubo Li
xiubli@redhat.com
<ul></ul><p>V1: <a class="external" href="https://patchwork.kernel.org/project/ceph-devel/list/?series=303647">https://patchwork.kernel.org/project/ceph-devel/list/?series=303647</a></p>
Linux kernel client - Feature #43215: kclient: send usage metrics to MDS
https://tracker.ceph.com/issues/43215?journal_id=171469
2020-07-23T10:45:17Z
Xiubo Li
xiubli@redhat.com
<ul><li><strong>Project</strong> changed from <i>CephFS</i> to <i>Linux kernel client</i></li><li><strong>Category</strong> deleted (<del><i>Performance/Resource Usage</i></del>)</li><li><strong>Status</strong> changed from <i>Fix Under Review</i> to <i>Resolved</i></li></ul><p><a class="external" href="https://patchwork.kernel.org/project/ceph-devel/list/?series=319465">https://patchwork.kernel.org/project/ceph-devel/list/?series=319465</a></p>
<p>Merged, closing it.</p>