Project

General

Profile

Actions

Bug #14652

closed

"Segmentation fault" (radosgw-admin()) in upgrade:hammer-hammer-distro-basic-openstack

Added by Yuri Weinstein about 8 years ago. Updated about 8 years ago.

Status:
Resolved
Priority:
Urgent
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
upgrade/hammer
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Run: http://pulpito.ovh.sepia.ceph.com:8081/teuthology-2016-02-03_20:05:02-upgrade:hammer-hammer-distro-basic-openstack/
Jobs: ['16505', '16547']
Logs: http://teuthology.ovh.sepia.ceph.com/teuthology/teuthology-2016-02-03_20:05:02-upgrade:hammer-hammer-distro-basic-openstack/16547/teuthology.log

2016-02-03T21:23:37.460 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0
2016-02-03T21:23:37.461 INFO:teuthology.orchestra.run.target089143:Running: "adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --access-key SEEDTSPDGYAQGUXYFVNE --secret QxPrP/YHKk3UTr5f8taqGpydtNvV66wHIcMpUGCAawpTatZbjVQx/w== --email foo.client.0+test@test.test" 
2016-02-03T21:23:37.952 INFO:teuthology.orchestra.run.target089143.stderr:*** Caught signal (Segmentation fault) **
2016-02-03T21:23:37.952 INFO:teuthology.orchestra.run.target089143.stderr: in thread 7f5ca4528880
2016-02-03T21:23:37.957 INFO:teuthology.orchestra.run.target089143.stderr: ceph version 0.94.2 (5fb85614ca8f354284c713a2f9c610860720bbf3)
2016-02-03T21:23:37.958 INFO:teuthology.orchestra.run.target089143.stderr: 1: radosgw-admin() [0x61ca62]
2016-02-03T21:23:37.958 INFO:teuthology.orchestra.run.target089143.stderr: 2: (()+0xf100) [0x7f5ca0d87100]
2016-02-03T21:23:37.958 INFO:teuthology.orchestra.run.target089143.stderr: 3: (()+0x178a53) [0x7f5ca1f1da53]
2016-02-03T21:23:37.959 INFO:teuthology.orchestra.run.target089143.stderr: 4: (()+0x143639) [0x7f5ca1ee8639]
2016-02-03T21:23:37.959 INFO:teuthology.orchestra.run.target089143.stderr: 5: (()+0x140960) [0x7f5ca1ee5960]
2016-02-03T21:23:37.959 INFO:teuthology.orchestra.run.target089143.stderr: 6: (()+0x6c712) [0x7f5ca1e11712]
2016-02-03T21:23:37.959 INFO:teuthology.orchestra.run.target089143.stderr: 7: (RGWRados::init_rados()+0x69) [0x56c669]
2016-02-03T21:23:37.960 INFO:teuthology.orchestra.run.target089143.stderr: 8: (RGWCache<RGWRados>::init_rados()+0x33) [0x59b683]
2016-02-03T21:23:37.960 INFO:teuthology.orchestra.run.target089143.stderr: 9: (RGWRados::initialize()+0xa) [0x5752fa]
2016-02-03T21:23:37.960 INFO:teuthology.orchestra.run.target089143.stderr: 10: (RGWStoreManager::init_storage_provider(CephContext*, bool, bool)+0x51) [0x567901]
2016-02-03T21:23:37.960 INFO:teuthology.orchestra.run.target089143.stderr: 11: (main()+0x19bb) [0x4f1a1b]
2016-02-03T21:23:37.961 INFO:teuthology.orchestra.run.target089143.stderr: 12: (__libc_start_main()+0xf5) [0x7f5c9fdabb15]
2016-02-03T21:23:37.961 INFO:teuthology.orchestra.run.target089143.stderr: 13: radosgw-admin() [0x500c79]

Actions #1

Updated by Sage Weil about 8 years ago

  • Project changed from Ceph to rgw
  • Priority changed from Normal to Urgent
Actions #2

Updated by Yehuda Sadeh about 8 years ago

This is a bogus test. The upgrade is done while spawning radosgw-admin. We can see librados being upgraded through that, and it seems like a crash due to inconsistent packages versions. We need to wait for the packages to be upgraded before spawning any new process.

Actions #3

Updated by Yehuda Sadeh about 8 years ago

The s3test task both creates users, and run the s3-tests suite. We need to split the different actions so that the upgrade test only happens when we run the s3-tests suite. Same applies to other tests as well (e.g., swift).

Actions #4

Updated by Sage Weil about 8 years ago

  • Status changed from New to 12
  • Assignee set to Yuri Weinstein

easiest fix is to run teh rgw test from client.2, and exclusive it from the concurrently running upgrade.

need to make sure this gets fixed on newer versions of this test.

Actions #6

Updated by Yuri Weinstein about 8 years ago

  • Status changed from 12 to 7
Actions #8

Updated by Yuri Weinstein about 8 years ago

  • Status changed from 7 to Resolved
Actions #9

Updated by Yuri Weinstein about 8 years ago

  • Status changed from Resolved to New

I was wrong above the fix above, it did not apply to rgw test, so reopening.

Actions #11

Updated by Yuri Weinstein about 8 years ago

  • Status changed from 7 to Resolved
Actions

Also available in: Atom PDF