Project

General

Profile

Actions

Bug #10016

closed

"Segmentation fault" in upgrade:giant-giant-distro-basic-multi run

Added by Yuri Weinstein over 9 years ago. Updated over 9 years ago.

Status:
Resolved
Priority:
Urgent
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

In a new suite all jobs failed.
http://pulpito.front.sepia.ceph.com/teuthology-2014-11-05_11:35:26-upgrade:giant-giant-distro-basic-multi/

Exporting image: 99% complete...
Exporting image: 100% complete...done.
2014-11-05T14:40:10.915 INFO:tasks.workunit.client.0.plana49.stderr:+ rbd rm testimg
2014-11-05T14:40:10.928 INFO:tasks.workunit.client.0.plana49.stderr:*** Caught signal (Segmentation fault) **
2014-11-05T14:40:10.928 INFO:tasks.workunit.client.0.plana49.stderr: in thread 7f7fe4178780
2014-11-05T14:40:10.928 INFO:tasks.workunit.client.0.plana49.stderr:rbd: symbol lookup error: rbd: undefined symbol: _ZN4ceph3log3Log18is_inside_log_lockEv
2014-11-05T14:40:10.930 INFO:tasks.workunit:Stopping ['rbd/import_export.sh'] on client.0...
2014-11-05T14:40:10.930 INFO:teuthology.orchestra.run.plana49:Running: 'rm -rf -- /home/ubuntu/cephtest/workunits.list /home/ubuntu/cephtest/workunit.client.0'

The suite actually passed a week ago http://pulpito.front.sepia.ceph.com/teuthology-2014-10-31_14:44:10-upgrade:giant-giant-distro-basic-vps/

Actions #1

Updated by Yuri Weinstein over 9 years ago

  • Assignee deleted (Josh Durgin)
Actions #2

Updated by Sage Weil over 9 years ago

  • Status changed from New to 12
  • Assignee set to Yuri Weinstein
  • Priority changed from Normal to Urgent
roles:
- - mon.a
  - mds.a
  - osd.0
  - osd.1
  - osd.2
- - mon.b
  - mon.c
  - osd.3
  - osd.4
  - osd.5
  - client.0
  - client.1


the client host is getting upgraded while the test is running
Actions #3

Updated by Yuri Weinstein over 9 years ago

  • Status changed from 12 to 7

Moved client.0 to a separate node, testing now
https://github.com/ceph/ceph-qa-suite/pull/232

Actions #4

Updated by Yuri Weinstein over 9 years ago

Still failed - http://pulpito.front.sepia.ceph.com/teuthology-2014-11-10_10:56:16-upgrade:giant-giant-distro-basic-multi/

Exporting image: 99% complete...
Exporting image: 100% complete...done.
2014-11-10T11:42:45.762 INFO:tasks.workunit.client.0.plana78.stderr:+ rbd export testimg -
2014-11-10T11:42:45.780 INFO:tasks.workunit.client.0.plana78.stderr:*** Caught signal (Segmentation fault) **
2014-11-10T11:42:45.781 INFO:tasks.workunit.client.0.plana78.stderr: in thread 7f271f4d7780
2014-11-10T11:42:45.781 INFO:tasks.workunit.client.0.plana78.stderr:rbd: symbol lookup error: rbd: undefined symbol: _ZN4ceph3log3Log18is_inside_log_lockEv
2014-11-10T11:42:45.782 INFO:tasks.workunit:Stopping ['rbd/import_export.sh'] on client.0...
2014-11-10T11:42:45.783 INFO:teuthology.orchestra.run.plana78:Running: 'rm -rf -- /home/ubuntu/cephtest/workunits.list /home/ubuntu/cephtest/workunit.client.0'
2014-11-10T11:42:45.907 ERROR:teuthology.parallel:Exception in parallel execution
Traceback (most recent call last):
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 82, in __exit__
    for result in self:
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 101, in next
    resurrect_traceback(result)
  File "/home/teuthworker/src/teuthology_master/teuthology/parallel.py", line 19, in capture_traceback
    return func(*args, **kwargs)
  File "/var/lib/teuthworker/src/ceph-qa-suite_giant/tasks/workunit.py", line 359, in _run_tests
    args=args,
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/remote.py", line 128, in run
    r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 365, in run
    r.wait()
  File "/home/teuthworker/src/teuthology_master/teuthology/orchestra/run.py", line 106, in wait
    exitstatus=status, node=self.hostname)
CommandFailedError: Command failed on plana78 with status 127: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=9680613141b3eef62f35a6728e654efa5f6ba8e8 TESTDIR="/home/ubuntu/cephtest" CEPH_ID="0" RBD_CREATE_ARGS=--new-format adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/workunit.client.0/rbd/import_export.sh'
Actions #5

Updated by Sage Weil over 9 years ago

- install.upgrade:
all:
branch: giant

is upgrading all roles

Actions #7

Updated by Yuri Weinstein over 9 years ago

  • Status changed from 7 to Resolved

tests passed.

Actions

Also available in: Atom PDF