https://tracker.ceph.com/https://tracker.ceph.com/favicon.ico2020-06-30T15:14:27ZCeph CephFS - Bug #46273: mds: deleting a large number of files in a directory causes the file system to read onlyhttps://tracker.ceph.com/issues/46273?journal_id=1693592020-06-30T15:14:27ZPatrick Donnellypdonnell@redhat.com
<ul><li><strong>Project</strong> changed from <i>Calamari</i> to <i>CephFS</i></li><li><strong>Subject</strong> changed from <i>Deleting a large number of files in a directory causes the file system to read only</i> to <i>mds: deleting a large number of files in a directory causes the file system to read only</i></li><li><strong>Description</strong> updated (<a title="View differences" href="/journals/169359/diff?detail_id=174321">diff</a>)</li><li><strong>Status</strong> changed from <i>New</i> to <i>Fix Under Review</i></li><li><strong>Assignee</strong> set to <i>wei qiaomiao</i></li><li><strong>Target version</strong> set to <i>v16.0.0</i></li><li><strong>Source</strong> set to <i>Community (dev)</i></li><li><strong>Backport</strong> set to <i>octopus,nautilus</i></li><li><strong>Pull request ID</strong> set to <i>35848</i></li><li><strong>Component(FS)</strong> <i>MDS</i> added</li></ul> CephFS - Bug #46273: mds: deleting a large number of files in a directory causes the file system to read onlyhttps://tracker.ceph.com/issues/46273?journal_id=1695892020-07-02T13:00:53ZZheng Yanukernel@gmail.com
<ul><li><strong>Component(FS)</strong> <i>MDSMonitor</i> added</li></ul> CephFS - Bug #46273: mds: deleting a large number of files in a directory causes the file system to read onlyhttps://tracker.ceph.com/issues/46273?journal_id=1696312020-07-03T01:51:39Zwei qiaomiaowei.qiaomiao@zte.com.cn
<ul></ul><p>The origin dirfrag is closed through close_dirfrag,and then the mergeed basedirfrag commits it.</p>
<p>More detailed log: <br />2020-06-18 15:32:20.135905 7f1feef5e700 1 mds.2.bal merging [dir 0x2000255af08.100110111* /test227/test227-3/#test-dir.0-0/mdtest_tree.0/mdtest_tree.1/mdtest_tree.3/ [2,head] auth{0=1} v=1247462 cv=1241630/1241630 state=1610612738|complete f(v1074951 m2020-06-18 15:32:15.683728) n(v11815 rc2020-06-18 15:32:15.683728) hs=0+2908,ss=0+0 dirty=2908 | child=1 frozen=0 subtree=0 importing=0 importbound=0 sticky=0 replicated=1 dirty=1 authpin=0 0x555aad539800]<br />2020-06-18 15:32:20.135932 7f1feef5e700 1 mds.2.bal all sibs under 100110110* 0x555a568e5500 should merge<br />2020-06-18 15:32:20.135935 7f1feef5e700 1 mds.2.bal all sibs under 10011010* 0x555a1ce35100 should merge<br />2020-06-18 15:32:20.135938 7f1feef5e700 1 mds.2.bal all sibs under 1001100* 0x555a4d9ffc00 should merge<br />2020-06-18 15:32:20.135945 7f1feef5e700 1 mds.2.bal all sibs under 100111* 0x555a1ce32000,0x555a1ce32700,0x555a9c00aa00,0x555a57ab6a00,0x555a568e5c00,0x555a568e6300,0x555a568e6a00,0x555a1ce32e00 should merge<br />2020-06-18 15:32:20.135951 7f1feef5e700 1 mds.2.bal all sibs under 10010* 0x555a9a267500 should merge<br />2020-06-18 15:32:20.135953 7f1feef5e700 1 mds.2.bal all sibs under 1000* 0x555a8c4f1100 should merge<br />2020-06-18 15:32:20.136005 7f1feef5e700 1 mds.2.bal not all sibs under 101* in cache (have 0x555a568e7100,0x555ab01c2000,0x555a30cbb800,0x555a30cc0000,0x555a30cc0700,0x555a30cb5500)</p>
<p>2020-06-18 15:32:20.388226 7f1ff1763700 1 mds.2.cache.dir(0x2000255af08.100*) merge 0x555a8c4f1100,0x555a9a267500,0x555a4d9ffc00,0x555a1ce35100,0x555a568e5500,0x555aad539800,0x555a1ce32000,0x555a1ce32700,0x555a9c00aa00,0x555a57ab6a00,0x555a568e5c00,0x555a568e6300,0x555a568e6a00,0x555a1ce32e00</p>
<p>2020-06-18 15:32:20.416342 7f1fe9f54700 1 mds.2.cache.dir(0x2000255af08.100*) _commit want 1248554 on [dir 0x2000255af08.100* /test227/test227-3/#test-dir.0-0/mdtest_tree.0/mdtest_tree.1/mdtest_tree.3/ [2,head] auth{0=2,1=2} v=1248554 cv=0/0 ap=2+0+0 state=1610629138|complete|frozendir|fragmenting f(v1074951)/f(v1074951 m2020-06-18 15:32:17.361970) n(v11815)/n(v11815 rc2020-06-18 15:32:17.361970) hs=0+27460,ss=0+0 dirty=27460 | child=1 frozen=1 replicated=1 dirty=1 authpin=1 0x555a30cb5c00]<br />2020-06-18 15:32:20.416354 7f1fe9f54700 1 mds.2.cache.dir(0x2000255af08.100*) marking committing<br />2020-06-18 15:32:20.416357 7f1fe9f54700 1 mds.2.cache.dir(0x2000255af08.100*) _omap_commit<br />2020-06-18 15:32:20.416364 7f1fe9f54700 1 mds.2.cache.dir(0x2000255af08.100*) rm file.mdtest.0.34113490 [dentry #0x1/test227/test227-3/#test-dir.0-0/mdtest_tree.0/mdtest_tree.1/mdtest_tree.3/file.mdtest.0.34113490 [2,head] auth NULL (dversion lock) v=1240786 inode=0 state=1610612802|bottomlru | request=0 lock=0 fragmenting=1 inodepin=0 replicated=0 dirty=1 authpin=0 clientlease=0 0x555a5d1de780]<br />2020-06-18 15:32:20.416377 7f1fe9f54700 1 mds.2.cache.dir(0x2000255af08.100*) rm file.mdtest.0.33947990 [dentry #0x1/test227/test227-3/#test-dir.0-0/mdtest_tree.0/mdtest_tree.1/mdtest_tree.3/file.mdtest.0.33947990 [2,head] auth NULL (dversion lock) v=1240166 inode=0 state=1610612802|bottomlru | fragmenting=1 replicated=0 dirty=1 0x555a5d1dfa40]</p> CephFS - Bug #46273: mds: deleting a large number of files in a directory causes the file system to read onlyhttps://tracker.ceph.com/issues/46273?journal_id=1704302020-07-13T18:13:08ZPatrick Donnellypdonnell@redhat.com
<ul><li><strong>Status</strong> changed from <i>Fix Under Review</i> to <i>Pending Backport</i></li></ul> CephFS - Bug #46273: mds: deleting a large number of files in a directory causes the file system to read onlyhttps://tracker.ceph.com/issues/46273?journal_id=1704652020-07-13T20:07:22ZNathan Cutlerncutler@suse.cz
<ul><li><strong>Copied to</strong> <i><a class="issue tracker-9 status-3 priority-4 priority-default closed" href="/issues/46520">Backport #46520</a>: octopus: mds: deleting a large number of files in a directory causes the file system to read only</i> added</li></ul> CephFS - Bug #46273: mds: deleting a large number of files in a directory causes the file system to read onlyhttps://tracker.ceph.com/issues/46273?journal_id=1704672020-07-13T20:07:29ZNathan Cutlerncutler@suse.cz
<ul><li><strong>Copied to</strong> <i><a class="issue tracker-9 status-3 priority-4 priority-default closed" href="/issues/46521">Backport #46521</a>: nautilus: mds: deleting a large number of files in a directory causes the file system to read only</i> added</li></ul> CephFS - Bug #46273: mds: deleting a large number of files in a directory causes the file system to read onlyhttps://tracker.ceph.com/issues/46273?journal_id=1740432020-08-29T00:20:29ZPatrick Donnellypdonnell@redhat.com
<ul><li><strong>Related to</strong> <i><a class="issue tracker-1 status-3 priority-5 priority-high3 closed" href="/issues/47201">Bug #47201</a>: mds: CDir::_omap_commit(int): Assertion `committed_version == 0' failed.</i> added</li></ul> CephFS - Bug #46273: mds: deleting a large number of files in a directory causes the file system to read onlyhttps://tracker.ceph.com/issues/46273?journal_id=1769362020-10-08T13:35:50ZNathan Cutlerncutler@suse.cz
<ul><li><strong>Status</strong> changed from <i>Pending Backport</i> to <i>Resolved</i></li></ul><p>While running with --resolve-parent, the script "backport-create-issue" noticed that all backports of this issue are in status "Resolved" or "Rejected".</p>