Project

General

Profile

Actions

Bug #40606

closed

the mount point of cephfs rise up permission denied

Added by Hughen X almost 5 years ago. Updated almost 5 years ago.

Status:
Rejected
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
1 - critical
Reviewed:
Affected Versions:
ceph-qa-suite:
Crash signature (v1):
Crash signature (v2):

Description

I mount a directory from cephfs to local filesystem.

mount -t ceph -o rw,relatime,seclabel,name=admin,secret=<hidden>,acl,mds_namespace=myfs,wsize=16777216 10.99.226.165:6790,10.99.238.119:6790,10.99.227.59:6790:/users/arch-admin /mnt/data-storage

And I can change directory to /mnt/data-storage, as follow:
[root@33e9b5337f0f data-storage]# cd /mnt/data-storage
[root@33e9b5337f0f data-storage]# ll -alh
drwxr-xr-x.  5 root root  13G Jun 21 12:50 .
drwxr-xr-x.  1 root root 4.0K Jun 21 12:47 ..
drwxr-xr-x.  2 root root  13G Jun 19 08:42 test-data

All is well before a long interrupted time between ceph client and ceph mon, mds, osd.
Since the failed network, I try to resume it in ceph client, mon, mds and osd, the mount point of /mnt/data-storage has been failed, and I can not cd to there, as follow:

[root@33e9b5337f0f data-storage]# ll -alh
drwxr-xr-x.  5 root root 4.0K Jun 21 14:43 .
drwxr-xr-x.  1 root root 4.0K Jun 21 12:08 ..
d?????????? ? ?    ?       ?            ? test-data

There exist a trouble shooting in http://docs.ceph.com/docs/master/cephfs/troubleshooting/#disconnected-remounted-fs, as you see the it ascribes mds reject a old session to mount point losted.
I want to remount the directory, like this:

mount -t ceph -o remount,rw

But nothings happen after remount, remount interface is not implemented by libceph, quote from libceph source code of linux kernel:
static int ceph_remount(struct super_block *sb, int *flags, char *data)
{
    sync_filesystem(sb);
    return 0;
}

But the user mode's ceph-fuse can be automatically resume permission denied point.

MY QUESTION IS:
why the kernel mode's libceph not unabridged implement the function of remount? Just like ceph-fuse, flushing all dirty data after the collapsed network.

Actions #1

Updated by Greg Farnum almost 5 years ago

  • Project changed from Ceph to Linux kernel client
Actions #2

Updated by Patrick Donnelly almost 5 years ago

  • Status changed from New to Rejected
  • Affected Versions deleted (v12.2.7)

This question is more appropriate for ceph-users.

In short: the kernel client does not handle being blacklisted well. There is on-going work to improve this.

Actions #3

Updated by Hughen X almost 5 years ago

Patrick Donnelly wrote:

This question is more appropriate for ceph-users.

In short: the kernel client does not handle being blacklisted well. There is on-going work to improve this.

Hi Patrick Donnelly, can you tell me how it will improve this situation? Will the kernel client flush the dirty cache?

Actions

Also available in: Atom PDF