https://tracker.ceph.com/
https://tracker.ceph.com/favicon.ico
2017-12-18T14:49:35Z
Ceph
CephFS - Bug #22428: mds: don't report slow request for blocked filelock request
https://tracker.ceph.com/issues/22428?journal_id=103864
2017-12-18T14:49:35Z
Patrick Donnelly
pdonnell@redhat.com
<ul><li><strong>Assignee</strong> set to <i>Zheng Yan</i></li></ul><p>Perhaps reclassify the slow requests blocked by locks as "clients not releasing file locks" or similar to be different from "slow requestS".</p>
CephFS - Bug #22428: mds: don't report slow request for blocked filelock request
https://tracker.ceph.com/issues/22428?journal_id=104940
2018-01-16T19:28:40Z
John Spray
jcspray@gmail.com
<ul></ul><p>Here's a recent example from someone in #ceph:</p>
<pre>
2018-01-16 17:47:05.910681 mon.0 [INF] mon.5 192.168.193.73:6789/0
2018-01-16 17:49:14.095764 mon.0 [WRN] MDS health message (mds.1): 1 slow requests are blocked > 30 sec
2018-01-16 17:49:14.095812 mon.0 [INF] daemon mds.manager02 is now active in filesystem cephfs as rank 1
2018-01-16 17:49:14.276275 mon.0 [WRN] Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST)
2018-01-16 17:49:10.248891 mds.1 [WRN] 1 slow requests, 1 included below; oldest blocked for > 31.623102 secs
2018-01-16 17:49:10.248906 mds.1 [WRN] slow request 31.623102 seconds old, received at 2018-01-16 17:48:38.625681: client_request(client.434194:1157564 setfilelockrule 2, type 2, owner 10101539253148314382, pid 14917, start 0, length 0, wait 1 #0x20000001809 2018-01-16 17:48:38.513624 caller_uid=101, caller_gid=102{}) currently acquired locks
2018-01-16 17:49:40.249814 mds.1 [WRN] 1 slow requests, 1 included below; oldest blocked for > 61.624025 secs
2018-01-16 17:49:40.249825 mds.1 [WRN] slow request 61.624025 seconds old, received at 2018-01-16 17:48:38.625681: client_request(client.434194:1157564 setfilelockrule 2, type 2, owner 10101539253148314382, pid 14917, start 0, length 0, wait 1 #0x20000001809 2018-01-16 17:48:38.513624 caller_uid=101, caller_gid=102{}) currently acquired locks
2018-01-16 17:49:58.098323 mon.0 [INF] MDS health message cleared (mds.1): 1 slow requests are blocked > 30 sec
2018-01-16 17:49:58.098366 mon.0 [INF] daemon mds.manager02 is now active in filesystem cephfs as rank 1
2018-01-16 17:49:58.336035 mon.0 [INF] Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests)
2018-01-16 17:49:58.336158 mon.0 [INF] Cluster is now healthy
</pre>
CephFS - Bug #22428: mds: don't report slow request for blocked filelock request
https://tracker.ceph.com/issues/22428?journal_id=111785
2018-04-25T08:33:45Z
Dan van der Ster
<ul></ul><p>In case you need more examples, we're seeing this recently on 12.2.4:</p>
<pre>
2018-04-25 10:23:29.964959 mds.cephdwightmds1 [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.144366 secs
2018-04-25 10:23:29.964964 mds.cephdwightmds1 [WRN] slow request 30.144366 seconds old, received at 2018-04-25 10:22:59.820554: client_request(client.575739618:75133749 setfilelockrule 1, type 2, owner 17575622701090626199, pid 27476, start 0, length 0, wait 1 #0x2000309a73f 2018-04-25 10:22:59.819251 caller_uid=0, caller_gid=0{}) currently acquired locks
2018-04-25 10:23:30.965128 mds.cephdwightmds1 [WRN] 3 slow requests, 2 included below; oldest blocked for > 31.144517 secs
2018-04-25 10:23:30.965133 mds.cephdwightmds1 [WRN] slow request 30.891629 seconds old, received at 2018-04-25 10:23:00.073442: client_request(client.575739618:75134492 setfilelockrule 1, type 2, owner 11650441161165249951, pid 9990, start 0, length 0, wait 1 #0x2000309a73f 2018-04-25 10:23:00.072054 caller_uid=0, caller_gid=0{}) currently acquired locks
2018-04-25 10:23:30.965136 mds.cephdwightmds1 [WRN] slow request 30.829593 seconds old, received at 2018-04-25 10:23:00.135478: client_request(client.575739618:75134657 setfilelockrule 1, type 2, owner 11876786896114809271, pid 39172, start 0, length 0, wait 1 #0x2000309a73f 2018-04-25 10:23:00.134047 caller_uid=0, caller_gid=0{}) currently acquired locks
2018-04-25 10:23:33.396905 mon.cephdwight-mon-1633994557 [WRN] MDS health message (mds.1): 3 slow requests are blocked > 30 sec
2018-04-25 10:23:33.752354 mon.cephdwight-mon-1633994557 [WRN] Health check failed: 1 MDSs report slow requests (MDS_SLOW_REQUEST)
2018-04-25 10:23:37.396863 mon.cephdwight-mon-1633994557 [INF] MDS health message cleared (mds.1): 3 slow requests are blocked > 30 sec
2018-04-25 10:23:37.805466 mon.cephdwight-mon-1633994557 [INF] Health check cleared: MDS_SLOW_REQUEST (was: 1 MDSs report slow requests)
2018-04-25 10:23:37.805522 mon.cephdwight-mon-1633994557 [INF] Cluster is now healthy
</pre>
CephFS - Bug #22428: mds: don't report slow request for blocked filelock request
https://tracker.ceph.com/issues/22428?journal_id=111853
2018-04-25T18:40:42Z
Patrick Donnelly
pdonnell@redhat.com
<ul><li><strong>Category</strong> set to <i>Administration/Usability</i></li><li><strong>Priority</strong> changed from <i>Normal</i> to <i>High</i></li><li><strong>Target version</strong> set to <i>v13.0.0</i></li><li><strong>Source</strong> set to <i>other</i></li><li><strong>Backport</strong> set to <i>luminous</i></li><li><strong>Component(FS)</strong> <i>MDS, MDSMonitor</i> added</li></ul>
CephFS - Bug #22428: mds: don't report slow request for blocked filelock request
https://tracker.ceph.com/issues/22428?journal_id=112229
2018-04-28T10:34:14Z
Zheng Yan
ukernel@gmail.com
<ul><li><strong>Status</strong> changed from <i>New</i> to <i>Fix Under Review</i></li></ul><p><a class="external" href="https://github.com/ceph/ceph/pull/21715">https://github.com/ceph/ceph/pull/21715</a></p>
CephFS - Bug #22428: mds: don't report slow request for blocked filelock request
https://tracker.ceph.com/issues/22428?journal_id=112465
2018-05-02T14:20:17Z
Patrick Donnelly
pdonnell@redhat.com
<ul><li><strong>Status</strong> changed from <i>Fix Under Review</i> to <i>Pending Backport</i></li></ul>
CephFS - Bug #22428: mds: don't report slow request for blocked filelock request
https://tracker.ceph.com/issues/22428?journal_id=112541
2018-05-03T10:28:49Z
Nathan Cutler
ncutler@suse.cz
<ul><li><strong>Copied to</strong> <i><a class="issue tracker-9 status-3 priority-4 priority-default closed" href="/issues/23989">Backport #23989</a>: luminous: mds: don't report slow request for blocked filelock request</i> added</li></ul>
CephFS - Bug #22428: mds: don't report slow request for blocked filelock request
https://tracker.ceph.com/issues/22428?journal_id=118087
2018-07-30T20:55:28Z
Nathan Cutler
ncutler@suse.cz
<ul><li><strong>Status</strong> changed from <i>Pending Backport</i> to <i>Resolved</i></li></ul>