Ceph » CephFS

2019-11-26T13:31:25.436 INFO:tasks.cephfs_test_runner:======================================================================
2019-11-26T13:31:25.436 INFO:tasks.cephfs_test_runner:ERROR: test_subvolume_create_with_desired_uid_gid (tasks.cephfs.test_volumes.TestVolumes)
2019-11-26T13:31:25.436 INFO:tasks.cephfs_test_runner:----------------------------------------------------------------------
2019-11-26T13:31:25.436 INFO:tasks.cephfs_test_runner:Traceback (most recent call last):
2019-11-26T13:31:25.437 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191126.005014/qa/tasks/cephfs/test_volumes.py", line 756, in test_subvolume_create_with_desired_uid_gid
2019-11-26T13:31:25.437 INFO:tasks.cephfs_test_runner:    self._fs_cmd("subvolume", "create", self.volname, subvolname, "--uid", str(uid), "--gid", str(gid))
2019-11-26T13:31:25.437 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191126.005014/qa/tasks/cephfs/test_volumes.py", line 28, in _fs_cmd
2019-11-26T13:31:25.437 INFO:tasks.cephfs_test_runner:    return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args)
2019-11-26T13:31:25.437 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20191126.005014/qa/tasks/ceph_manager.py", line 1272, in raw_cluster_cmd
2019-11-26T13:31:25.437 INFO:tasks.cephfs_test_runner:    stdout=StringIO(),
2019-11-26T13:31:25.437 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run
2019-11-26T13:31:25.437 INFO:tasks.cephfs_test_runner:    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
2019-11-26T13:31:25.438 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 433, in run
2019-11-26T13:31:25.438 INFO:tasks.cephfs_test_runner:    r.wait()
2019-11-26T13:31:25.438 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 158, in wait
2019-11-26T13:31:25.438 INFO:tasks.cephfs_test_runner:    self._raise_for_status()
2019-11-26T13:31:25.438 INFO:tasks.cephfs_test_runner:  File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 180, in _raise_for_status
2019-11-26T13:31:25.438 INFO:tasks.cephfs_test_runner:    node=self.hostname, label=self.label
2019-11-26T13:31:25.438 INFO:tasks.cephfs_test_runner:CommandFailedError: Command failed on smithi065 with status 124: u'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_3607 --uid 1000 --gid 1000'

From: /ceph/teuthology-archive/pdonnell-2019-11-26_04:58:35-fs-wip-pdonnell-testing-20191126.005014-distro-basic-smithi/4543972/teuthology.log

Seems the command is dispatched but never run:

2019-11-26T13:28:49.316+0000 7f740e12f700  1 -- [v2:172.21.15.65:6800/9371,v1:172.21.15.65:6801/9371] <== client.7013 172.21.15.65:0/3407215606 1 ==== mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_3607", "uid": 1000, "gid": 1000, "target": ["mon-mgr", ""]}) v1 ==== 162+0+0 (crc 0 0 0) 0x55e7d11a1e00 con 0x55e7d0b47c00
2019-11-26T13:28:49.316+0000 7f740e12f700 10 mgr.server _handle_command decoded-size=6 prefix=fs subvolume create
2019-11-26T13:28:49.317+0000 7f740e12f700 20 is_capable service=py module=volumes command=fs subvolume create read write addr - on cap allow *
2019-11-26T13:28:49.317+0000 7f740e12f700 20  allow so far , doing grant allow *
2019-11-26T13:28:49.317+0000 7f740e12f700 20  allow all
2019-11-26T13:28:49.317+0000 7f740e12f700 10 mgr.server _allowed_command  client.admin capable
2019-11-26T13:28:49.317+0000 7f740e12f700  0 log_channel(audit) log [DBG] : from='client.7013 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_3607", "uid": 1000, "gid": 1000, "target": ["mon-mgr", ""]}]: dispatch
2019-11-26T13:28:49.317+0000 7f740e12f700 10 mgr.server _handle_command passing through 6
2019-11-26T13:28:49.317+0000 7f740e930700 20 mgr Gil Switched to new thread state 0x55e7d15a91e0

From: /ceph/teuthology-archive/pdonnell-2019-11-26_04:58:35-fs-wip-pdonnell-testing-20191126.005014-distro-basic-smithi/4543972/remote/smithi065/log/ceph-mgr.y.log.gz

Not sure what's going on.