Project

General

Profile

Bug #8996

"Segmentation fault" in upgrade:dumpling-x-firefly---basic-vps suite

Added by Yuri Weinstein over 9 years ago. Updated over 9 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
2 - major
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

There are lots of these errors in:
http://pulpito.front.sepia.ceph.com/teuthology-2014-08-02_08:50:33-upgrade:dumpling-x-firefly---basic-vps/
http://pulpito.front.sepia.ceph.com/teuthology-2014-08-02_09:30:01-upgrade:firefly-firefly-testing-basic-vps/
upgrade suites.

2014-08-02T09:48:11.157 INFO:teuthology.orchestra.run.err:[10.214.138.66]: *** Caught signal (Segmentation fault) **
2014-08-02T09:48:11.157 INFO:teuthology.orchestra.run.err:[10.214.138.66]:  in thread 7f74da233760
2014-08-02T09:48:11.173 INFO:teuthology.orchestra.run.err:[10.214.138.66]:  ceph version 0.80.5-7-g4983aa3 (4983aa32fe8c64c78957b921f5d31ab07be9f850)
2014-08-02T09:48:11.173 INFO:teuthology.orchestra.run.err:[10.214.138.66]:  1: rados() [0x4429d1]
2014-08-02T09:48:11.173 INFO:teuthology.orchestra.run.err:[10.214.138.66]:  2: (()+0xf710) [0x7f74d8e35710]
2014-08-02T09:48:11.173 INFO:teuthology.orchestra.run.err:[10.214.138.66]:  3: (librados::IoCtx::get_id()+0x3) [0x7f74d91d2133]
2014-08-02T09:48:11.173 INFO:teuthology.orchestra.run.err:[10.214.138.66]:  4: (librados::IoCtx::pool_requires_alignment()+0x9) [0x7f74d91d3c09]
2014-08-02T09:48:11.174 INFO:teuthology.orchestra.run.err:[10.214.138.66]:  5: rados() [0x415a50]
2014-08-02T09:48:11.174 INFO:teuthology.orchestra.run.err:[10.214.138.66]:  6: (main()+0xdf8) [0x4245d8]
2014-08-02T09:48:11.174 INFO:teuthology.orchestra.run.err:[10.214.138.66]:  7: (__libc_start_main()+0xfd) [0x7f74d8310d1d]
2014-08-02T09:48:11.174 INFO:teuthology.orchestra.run.err:[10.214.138.66]:  8: rados() [0x40fdd9]
2014-08-02T09:48:11.174 INFO:teuthology.orchestra.run.err:[10.214.138.66]: 2014-08-02 12:48:11.170397 7f74da233760 -1 *** Caught signal (Segmentation fault) **
2014-08-02T09:48:11.174 INFO:teuthology.orchestra.run.err:[10.214.138.66]:  in thread 7f74da233760
2014-08-02T09:48:11.174 INFO:teuthology.orchestra.run.err:[10.214.138.66]: 
2014-08-02T09:48:11.175 INFO:teuthology.orchestra.run.err:[10.214.138.66]:  ceph version 0.80.5-7-g4983aa3 (4983aa32fe8c64c78957b921f5d31ab07be9f850)
2014-08-02T09:48:11.175 INFO:teuthology.orchestra.run.err:[10.214.138.66]:  1: rados() [0x4429d1]
2014-08-02T09:48:11.175 INFO:teuthology.orchestra.run.err:[10.214.138.66]:  2: (()+0xf710) [0x7f74d8e35710]
2014-08-02T09:48:11.175 INFO:teuthology.orchestra.run.err:[10.214.138.66]:  3: (librados::IoCtx::get_id()+0x3) [0x7f74d91d2133]
2014-08-02T09:48:11.175 INFO:teuthology.orchestra.run.err:[10.214.138.66]:  4: (librados::IoCtx::pool_requires_alignment()+0x9) [0x7f74d91d3c09]
2014-08-02T09:48:11.175 INFO:teuthology.orchestra.run.err:[10.214.138.66]:  5: rados() [0x415a50]
2014-08-02T09:48:11.175 INFO:teuthology.orchestra.run.err:[10.214.138.66]:  6: (main()+0xdf8) [0x4245d8]
2014-08-02T09:48:11.175 INFO:teuthology.orchestra.run.err:[10.214.138.66]:  7: (__libc_start_main()+0xfd) [0x7f74d8310d1d]
2014-08-02T09:48:11.176 INFO:teuthology.orchestra.run.err:[10.214.138.66]:  8: rados() [0x40fdd9]
2014-08-02T09:48:11.176 INFO:teuthology.orchestra.run.err:[10.214.138.66]:  NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2014-08-02T09:48:11.176 INFO:teuthology.orchestra.run.err:[10.214.138.66]: 
archive_path: /var/lib/teuthworker/archive/teuthology-2014-08-02_08:50:33-upgrade:dumpling-x-firefly---basic-vps/394226
branch: firefly
description: upgrade:dumpling-x/parallel/{0-cluster/start.yaml 1-dumpling-install/cuttlefish-dumpling.yaml
  2-workload/rados_api.yaml 3-upgrade-sequence/upgrade-all.yaml 4-final-upgrade/client.yaml
  5-final-workload/rados-snaps-few-objects.yaml centos_6.5.yaml}
email: ceph-qa@ceph.com
job_id: '394226'
last_in_suite: false
machine_type: vps
name: teuthology-2014-08-02_08:50:33-upgrade:dumpling-x-firefly---basic-vps
nuke-on-error: true
os_type: centos
os_version: '6.5'
overrides:
  admin_socket:
    branch: firefly
  ceph:
    conf:
      global:
        osd heartbeat grace: 40
      mon:
        debug mon: 20
        debug ms: 1
        debug paxos: 20
        mon warn on legacy crush tunables: false
      osd:
        debug filestore: 20
        debug journal: 20
        debug ms: 1
        debug osd: 20
    log-whitelist:
    - slow request
    - scrub mismatch
    - ScrubResult
    sha1: 4983aa32fe8c64c78957b921f5d31ab07be9f850
  ceph-deploy:
    branch:
      dev: firefly
    conf:
      client:
        log file: /var/log/ceph/ceph-$name.$pid.log
      mon:
        debug mon: 1
        debug ms: 20
        debug paxos: 20
        osd default pool size: 2
  install:
    ceph:
      sha1: 4983aa32fe8c64c78957b921f5d31ab07be9f850
  s3tests:
    branch: firefly
  workunit:
    sha1: 4983aa32fe8c64c78957b921f5d31ab07be9f850
owner: scheduled_yuriw
priority: 1000
roles:
- - mon.a
  - mds.a
  - osd.0
  - osd.1
- - mon.b
  - mon.c
  - osd.2
  - osd.3
- - client.0
  - client.1
suite: upgrade:dumpling-x
suite_branch: firefly
targets:
  ubuntu@vpm006.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA6JMC4PhXI7FABftSb+ANkdvvssHqr74pP9Az6U5q2AzS1BpKtRpxJcUoaiPWMHTy5458pKjrtSdBUEwnZCzkTKnf91IKiWdSaXkoMGSlKz4eOIErCwLrb4576333rBnIC0hyxp0Zbz1ck2yOu3tdPDVktKVzFSy0gAa7qlV0ZIadtSNrXzKMKuQAY4TIZtz50XyWUMSMHV3p7fezjJ23KZ030u87oEKPlGUsI2OM4+oHxmCEDvXIPfWZetAsrBF4p5tXWZU9LAb6oHyjKYcfHJv3egCqX4iqvvaoZFwcAhTSsHN84Ou0QRPY1VBre1FQu3YRtDWJztg4X82x7McB6Q==
  ubuntu@vpm016.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAvgoOa1AZgw2KFA/pkYgaZW1tLCV1qRwX3QHt8+GRGWBDinDpqkk2i2tA/gav3gXg7C+efFMCwrcpvgASPsag40NEOyd/9fHzO8/+k43ygBd5MFg+I7KBGgMVlPmgRElWgUUCxCEnCixDivDPWGoIlErYoZzHMFZGqocU7MaVuz7BFeGZLGV66NNEX5n6NpaTT2XLv541whU6a6x3rdGOzyY0ExGMVr/A+ATIfRIstsLbo2jOquXg1sFwm7GO5sJ8IJqOZAtpJykjdknMgQtBjnMOYI2Iph+XXLDuQh6krmuvafsfYCC/UfI03q+tjdKIh+yB1c4xfAc0jV74Q3Je1w==
  ubuntu@vpm031.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAvWylvYt0q8pj/5una6Kkm2gJY+RlzgXSZZGm4xzSbXBhJfhR+cqrUMlzrXFosJiPRkpooESkb6dWE5C40lbDJwQKZZqXKt6GO9y3BtVUv0nb5b/10QWy6BKCd/w9ijw36UEKq+KBqsX/CqQfVn7ARMcy5WgJKRytPg1aV307qF4hJ6pkWhwbvhebeZ0eyzya7+ZHdXo5tX+AVq5ceJXM1CgbtHeUj/B+82pu9OTMdW7Xf2ylex4sgtF+9XexESmcrfRjfA7gcBrPJVbPVLgAi7VkvjTJtEQqpKm7HrkLye7G9GdSzV1uwwMYgwCrtKfV1ks+mIYavbjuQ0wqd4R56w==
tasks:
- internal.lock_machines:
  - 3
  - vps
- internal.save_config: null
- internal.check_lock: null
- internal.connect: null
- internal.serialize_remote_roles: null
- internal.check_conflict: null
- internal.check_ceph_data: null
- internal.vm_setup: null
- internal.base: null
- internal.archive: null
- internal.coredump: null
- internal.sudo: null
- internal.syslog: null
- internal.timer: null
- chef: null
- clock.check: null
- install:
    branch: cuttlefish
- print: '**** done cuttlefish install'
- ceph:
    fs: xfs
- print: '**** done ceph'
- install.upgrade:
    all:
      branch: dumpling
- ceph.restart: null
- parallel:
  - workload
  - upgrade-sequence
- print: '**** done parallel'
- install.upgrade:
    client.0: null
- print: '**** done install.upgrade'
- rados:
    clients:
    - client.1
    objects: 50
    op_weights:
      delete: 50
      read: 100
      rollback: 50
      snap_create: 50
      snap_remove: 50
      write: 100
    ops: 4000
teuthology_branch: firefly
tube: vps
upgrade-sequence:
  sequential:
  - install.upgrade:
      mon.a: null
      mon.b: null
  - ceph.restart:
    - mon.a
    - mon.b
    - mon.c
    - mds.a
    - osd.0
    - osd.1
    - osd.2
    - osd.3
verbose: true
worker_log: /var/lib/teuthworker/archive/worker_logs/worker.vps.20196
workload:
  sequential:
  - workunit:
      branch: dumpling
      clients:
        client.0:
        - rados/test-upgrade-firefly.sh
        - cls
description: upgrade:dumpling-x/parallel/{0-cluster/start.yaml 1-dumpling-install/cuttlefish-dumpling.yaml
  2-workload/rados_api.yaml 3-upgrade-sequence/upgrade-all.yaml 4-final-upgrade/client.yaml
  5-final-workload/rados-snaps-few-objects.yaml centos_6.5.yaml}
duration: 2910.962641954422
failure_reason: 'Command crashed: ''adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage
  rados rmpool unique_pool_0 unique_pool_0 --yes-i-really-really-mean-it'''
flavor: basic
owner: scheduled_yuriw
success: false

Associated revisions

Revision 4e03d5b5 (diff)
Added by Sage Weil over 9 years ago

Revert "enforce rados put aligment"

This reverts commit 7a58da53ebfcaaf385c21403b654d1d2f1508e1a.

This was alread backported in dece65064d949b5afcc359cd408615883b5e002a.

Fixes: #8996
Signed-off-by: Sage Weil <>

History

#1 Updated by Sage Weil over 9 years ago

  • Status changed from New to Resolved

botched (double) backport, fixed by 4e03d5b512c8d2f7fa51dda95c6132e676529f9b

Also available in: Atom PDF