Ceph » CephFS

In an Ubuntu 20.04 environment with Ceph Nautilus (ceph version 14.2.11-99-gaf0268dc91 (af0268dc910f84b47655e83a83ca54b6fb92dbaf) nautilus (stable)) I get a "Cannot send after transport endpoint shutdown" when the access mode for a volume is changed.

Steps to reproduce:
- Create subvolume
- Mount subvolume
- Grant RW access to the subvolume
- Write some data
- Change RW access to RO access to the subvolume
- Try to access the subvolume

Expected output:
- Access the subvolume and read written data. Try to write data and get a operation forbidden error

Actual output:

manila@ubuntu:~$ sudo ceph-fuse ~/mnt --id=vkmc --conf=ceph.conf --keyring=vkmc.keyring --client-mountpoint=/volumes/_nogroup/59c7a611-6c43-4633-b919-500cd043941f
2020-08-31T22:17:10.512+0000 7f8f21b52080 -1 init, newargv = 0x5605c2d7eb40 newargc=9
ceph-fuse[604]: starting ceph client
ceph-fuse[604]: starting fuse
manila@ubuntu:~$ cd mnt/
manila@ubuntu:~/mnt$ sudo touch x
manila@ubuntu:~/mnt$ sudo touch y
manila@ubuntu:~/mnt$ sudo touch z
manila@ubuntu:~/mnt$ ls
x  y  z
manila@ubuntu:~/mnt$ sudo vim x
manila@ubuntu:~/mnt$ sudo vim y 
manila@ubuntu:~/mnt$ sudo vim z
manila@ubuntu:~/mnt$ cat x
foo
manila@ubuntu:~/mnt$ cat y
bar
manila@ubuntu:~/mnt$ cat z
foobar
manila@ubuntu:~/mnt$ cd ..
manila@ubuntu:~$ ls
ls: cannot access 'mnt': No such file or directory
another-mnt  ceph.conf  mnt  vkmc.keyring
manila@ubuntu:~$ ls
ls: cannot access 'mnt': No such file or directory
another-mnt  ceph.conf  mnt  vkmc.keyring
manila@ubuntu:~$ cd mnt 
manila@ubuntu:~/mnt$ ls
ls: cannot open directory '.': Cannot send after transport endpoint shutdown
manila@ubuntu:~/mnt$ cd ,,
-bash: cd: ,,: Cannot send after transport endpoint shutdown
manila@ubuntu:~/mnt$ cd ..
manila@ubuntu:~$ ls
ls: cannot access 'mnt': No such file or directory
another-mnt  ceph.conf  mnt  vkmc.keyring
manila@ubuntu:~$ ls -la
ls: cannot access 'mnt': No such file or directory
total 44
drwxr-xr-x 6 manila manila 4096 Aug 31 22:16 .
drwxr-xr-x 3 root   root   4096 Aug 17 17:47 ..
-rw-r--r-- 1 manila manila  220 Feb 25  2020 .bash_logout
-rw-r--r-- 1 manila manila 3771 Feb 25  2020 .bashrc
drwx------ 2 manila manila 4096 Aug 31 22:06 .cache
-rw-r--r-- 1 manila manila  807 Feb 25  2020 .profile
drwx------ 2 manila manila 4096 Aug 31 22:05 .ssh
-rw------- 1 manila manila 1614 Aug 31 22:16 .viminfo
drwxrwxr-x 2 manila manila 4096 Aug 31 22:11 another-mnt
-rw-rw-r-- 1 manila manila   76 Aug 31 22:16 ceph.conf
d????????? ? ?      ?         ?            ? mnt
-rw-rw-r-- 1 manila manila   69 Aug 31 22:08 vkmc.keyring

manila@ubuntu:~$ cat vkmc.keyring 
[client.vkmc]
        key = AQAwdE1f7FV/NRAAEBrHgLVr6a84D0mkm0qlcA==

manila@ubuntu:~$ ls -la
ls: cannot access 'mnt': No such file or directory
total 44
drwxr-xr-x 6 manila manila 4096 Aug 31 22:28 .
drwxr-xr-x 3 root   root   4096 Aug 17 17:47 ..
-rw-r--r-- 1 manila manila  220 Feb 25  2020 .bash_logout
-rw-r--r-- 1 manila manila 3771 Feb 25  2020 .bashrc
drwx------ 2 manila manila 4096 Aug 31 22:06 .cache
-rw-r--r-- 1 manila manila  807 Feb 25  2020 .profile
drwx------ 2 manila manila 4096 Aug 31 22:05 .ssh
-rw------- 1 manila manila 2039 Aug 31 22:28 .viminfo
drwxrwxr-x 2 manila manila 4096 Aug 31 22:11 another-mnt
-rw-rw-r-- 1 manila manila   76 Aug 31 22:16 ceph.conf
d????????? ? ?      ?         ?            ? mnt
-rw-rw-r-- 1 manila manila   69 Aug 31 22:28 vkmc.keyring
manila@ubuntu:~$ cd mnt 
manila@ubuntu:~/mnt$ ls
ls: cannot open directory '.': Cannot send after transport endpoint shutdown
manila@ubuntu:~/mnt$ cd ..
manila@ubuntu:~$ umount mnt 
umount: mnt: No such file or directory
manila@ubuntu:~$ sudo ceph-fuse ~/mnt --id=vkmc --conf=ceph.conf --keyring=vkmc.keyring --client-mountpoint=/volumes/_nogroup/59c7a611-6c43-4633-b919-500cd043941f
2020-08-31T22:28:31.932+0000 7fb3789fc080 -1 init, newargv = 0x55ec8baeb7a0 newargc=9
fuse: bad mount point `/home/manila/mnt': No such file or directory
2020-08-31T22:28:31.936+0000 7fb3789fc080 -1 fuse_parse_cmdline failed.
ceph-fuse[690]: fuse failed to initialize