Ceph » CephFS

Part of the problem is that the pipe character wasn't trimmed from output while extracting the path -

$ sysctl -n kernel.core_pattern
|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h %e

This is easy to fix; I've raised a PR for that - https://github.com/ceph/ceph/pull/31619.

But next part of the issue is that the assert in following code (it's from qa/tasks/cephfs/cephfs_test_case.py) fails -

    def delete_mds_coredump(self, daemon_id):
        # delete coredump file, otherwise teuthology.internal.coredump will
        # catch it later and treat it as a failure.
        path = self.mds_cluster.mds_daemons[daemon_id].remote.run(args=[
            "sudo", "sysctl", "-n", "kernel.core_pattern"],
            stdout=StringIO()).stdout.getvalue().strip()
        if path[0] == '|':
            path = path[1:]
        core_dir = os.path.dirname(path)

        if core_dir:  # Non-default core_pattern with a directory in it
            # We have seen a core_pattern that looks like it's from teuthology's coredump
            # task, so proceed to clear out the core file
            log.info("Clearing core from directory: {0}".format(core_dir))

            # Verify that we see the expected single coredump
            ls_proc = self.mds_cluster.mds_daemons[daemon_id].remote.run(args=[
                "cd", core_dir, run.Raw('&&'),
                "sudo", "ls", run.Raw('|'), "sudo", "xargs", "file" 
            ], stdout=StringIO())
            cores = [l.partition(":")[0]
                     for l in ls_proc.stdout.getvalue().strip().split("\n")
                     if re.match(r'.*ceph-mds.* -i +{0}'.format(daemon_id), l)]

            log.info("Enumerated cores: {0}".format(cores))
            self.assertEqual(len(cores), 1)

There's no "ceph-mds" in the ls_proc. I've got no idea about the significance of core file. @Patrick @Zheng any suggestions/hints you can give?

I talked with Zheng. He told me that many tests cannot be executed successfully with vstart cluster and this is one of them.