Project

General

Profile

Actions

Bug #62228

closed

"Segmentation fault" (['libcephfs/test.sh']) in smoke on reef

Added by Yuri Weinstein 10 months ago. Updated 10 months ago.

Status:
Resolved
Priority:
Urgent
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
Labels (FS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

This is for 18.2.0

Run: https://pulpito.ceph.com/yuriw-2023-07-28_18:16:55-smoke-reef-release-distro-default-smithi/
Job: 7355812
Logs: http://qa-proxy.ceph.com/teuthology/yuriw-2023-07-28_18:16:55-smoke-reef-release-distro-default-smithi/7355812/teuthology.log

2023-07-28T18:49:55.846 INFO:tasks.workunit.client.0.smithi123.stdout:[ RUN      ] AccessTest.User
2023-07-28T18:49:55.907 INFO:tasks.workunit.client.0.smithi123.stdout:out: [{"entity":"client.libcephfs_user_test.196407252","key":"AQDTDcRklEsHNRAAvmRVvbCXrIniG2ajcEwimg==","caps":{"mds":"allow rw uid=123 gids=456,789","mon":"allow *","osd":"allow rw"}}]
2023-07-28T18:49:55.907 INFO:tasks.workunit.client.0.smithi123.stdout:key: AQDTDcRklEsHNRAAvmRVvbCXrIniG2ajcEwimg==
2023-07-28T18:49:56.154 INFO:tasks.workunit.client.0.smithi123.stdout:[       OK ] AccessTest.User (309 ms)
2023-07-28T18:49:56.155 INFO:tasks.workunit.client.0.smithi123.stdout:[----------] 4 tests from AccessTest (3763 ms total)
2023-07-28T18:49:56.155 INFO:tasks.workunit.client.0.smithi123.stdout:
2023-07-28T18:49:56.155 INFO:tasks.workunit.client.0.smithi123.stdout:[----------] Global test environment tear-down
2023-07-28T18:49:56.155 INFO:tasks.workunit.client.0.smithi123.stdout:[==========] 98 tests from 2 test suites ran. (84718 ms total)
2023-07-28T18:49:56.155 INFO:tasks.workunit.client.0.smithi123.stdout:[  PASSED  ] 98 tests.
2023-07-28T18:49:56.201 DEBUG:teuthology.orchestra.run:got remote process result: 139
2023-07-28T18:49:56.202 INFO:tasks.workunit.client.0.smithi123.stderr:Segmentation fault (core dumped)
2023-07-28T18:49:56.202 INFO:tasks.workunit:Stopping ['libcephfs/test.sh'] on client.0...
2023-07-28T18:49:56.203 DEBUG:teuthology.orchestra.run.smithi123:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0
2023-07-28T18:49:56.460 ERROR:teuthology.run_tasks:Saw exception from tasks.
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/run_tasks.py", line 105, in run_tasks
    manager = run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/run_tasks.py", line 84, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/workunit.py", line 129, in task
    p.spawn(_run_tests, ctx, refspec, role, tests,
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/workunit.py", line 424, in _run_tests
    remote.run(
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/orchestra/remote.py", line 522, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/orchestra/run.py", line 455, in run
    r.wait()
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/orchestra/run.py", line 161, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/orchestra/run.py", line 181, in _raise_for_status
    raise CommandFailedError(
teuthology.exceptions.CommandFailedError: Command failed (workunit test libcephfs/test.sh) on smithi123 with status 139: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0484097b0572e96f42cf6402cbe0ac8dcb046577 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh'
2023-07-28T18:49:56.526 ERROR:teuthology.run_tasks: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=c403dc67ee2849faae3b85e41e47d669
Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/run_tasks.py", line 105, in run_tasks
    manager = run_one_task(taskname, ctx=ctx, config=config)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/run_tasks.py", line 84, in run_one_task
    return task(**kwargs)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/workunit.py", line 129, in task
    p.spawn(_run_tests, ctx, refspec, role, tests,
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 84, in __exit__
    for result in self:
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 98, in __next__
    resurrect_traceback(result)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 30, in resurrect_traceback
    raise exc.exc_info[1]
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/parallel.py", line 23, in capture_traceback
    return func(*args, **kwargs)
  File "/home/teuthworker/src/github.com_ceph_ceph-c_0484097b0572e96f42cf6402cbe0ac8dcb046577/qa/tasks/workunit.py", line 424, in _run_tests
    remote.run(
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/orchestra/remote.py", line 522, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/orchestra/run.py", line 455, in run
    r.wait()
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/orchestra/run.py", line 161, in wait
    self._raise_for_status()
  File "/home/teuthworker/src/git.ceph.com_teuthology_3117e89c1b049bcc0726b9aaa0facf3451bd8045/teuthology/orchestra/run.py", line 181, in _raise_for_status
    raise CommandFailedError(
teuthology.exceptions.CommandFailedError: Command failed (workunit test libcephfs/test.sh) on smithi123 with status 139: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0484097b0572e96f42cf6402cbe0ac8dcb046577 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/libcephfs/test.sh'
2023-07-28T18:49:56.529 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse

Related issues 2 (0 open2 closed)

Related to CephFS - Bug #57206: ceph_test_libcephfs_reclaim crashes during testResolvedVenky Shankar

Actions
Related to rgw - Bug #57050: Crash on startup of radosgw in librbd::rbd_features_from_string()ResolvedCasey Bodley

Actions
Actions

Also available in: Atom PDF