Project

General

Profile

Bug #13239

Seg fault 9.0.3-1845-gf1ead76 : RGWRESTSimpleRequest::forward_request(RGWAccessKey&, req_info&, unsigned long, ceph::buffer::list*, ceph::buffer::list*)+0x74)

Added by Vasu Kulkarni over 8 years ago. Updated over 7 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
-
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
hammer,infernalis
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Right after :s3tests.functional.test_s3.check_can_test_multiregion ..

http://qa-proxy.ceph.com/teuthology/teuthology-2015-09-22_23:02:02-rgw-master---basic-multi/1066226/teuthology.log

2015-09-25T00:09:44.263 INFO:teuthology.orchestra.run.burnupi10.stderr:s3tests.functional.test_s3.check_can_test_multiregion ... ok
2015-09-25T00:09:44.702 INFO:tasks.rgw.client.1.burnupi33.stdout:*** Caught signal (Segmentation fault) **
2015-09-25T00:09:44.702 INFO:tasks.rgw.client.1.burnupi33.stdout: in thread 2ce9a700
2015-09-25T00:09:44.774 INFO:tasks.rgw.client.1.burnupi33.stdout: ceph version 9.0.3-1845-gf1ead76 (f1ead76f80cc3d078778080c35a6427256874062)
2015-09-25T00:09:44.774 INFO:tasks.rgw.client.1.burnupi33.stdout: 1: (()+0x2fb59a) [0x40359a]
2015-09-25T00:09:44.774 INFO:tasks.rgw.client.1.burnupi33.stdout: 2: (()+0x10340) [0x836f340]
2015-09-25T00:09:44.774 INFO:tasks.rgw.client.1.burnupi33.stdout: 3: (_vgr20070ZU_libcZdsoZa_strlen()+0x2) [0x4c2e0e2]
2015-09-25T00:09:44.774 INFO:tasks.rgw.client.1.burnupi33.stdout: 4: (req_info::req_info(CephContext*, RGWEnv*)+0x253) [0x382cb3]
2015-09-25T00:09:44.775 INFO:tasks.rgw.client.1.burnupi33.stdout: 5: (RGWRESTSimpleRequest::forward_request(RGWAccessKey&, req_info&, unsigned long, ceph::buffer::list*, ceph::buffer::list*)+0x74) [0x3bd7a4]
2015-09-25T00:09:44.775 INFO:tasks.rgw.client.1.burnupi33.stdout: 6: (RGWRESTConn::forward(std::string const&, req_info&, obj_version*, unsigned long, ceph::buffer::list*, ceph::buffer::list*)+0x5ac) [0x3603dc]
2015-09-25T00:09:44.775 INFO:tasks.rgw.client.1.burnupi33.stdout: 7: (()+0x25d0d5) [0x3650d5]
2015-09-25T00:09:44.775 INFO:tasks.rgw.client.1.burnupi33.stdout: 8: (RGWCreateBucket::execute()+0xaad) [0x37983d]
2015-09-25T00:09:44.775 INFO:tasks.rgw.client.1.burnupi33.stdout: 9: (()+0x1b0210) [0x2b8210]
2015-09-25T00:09:44.776 INFO:tasks.rgw.client.1.burnupi33.stdout: 10: (()+0x1b0e28) [0x2b8e28]
2015-09-25T00:09:44.776 INFO:tasks.rgw.client.1.burnupi33.stdout: 11: (()+0x2bfabf) [0x3c7abf]
2015-09-25T00:09:44.776 INFO:tasks.rgw.client.1.burnupi33.stdout: 12: (()+0x2c1a8e) [0x3c9a8e]
2015-09-25T00:09:44.776 INFO:tasks.rgw.client.1.burnupi33.stdout: 13: (()+0x8182) [0x8367182]
2015-09-25T00:09:44.777 INFO:tasks.rgw.client.1.burnupi33.stdout: 14: (clone()+0x6d) [0x9a4647d]
2015-09-25T00:09:44.779 INFO:tasks.rgw.client.1.burnupi33.stdout:2015-09-25 00:09:44.778599 2ce9a700 -1 *** Caught signal (Segmentation fault) **
2015-09-25T00:09:44.779 INFO:tasks.rgw.client.1.burnupi33.stdout: in thread 2ce9a700
2015-09-25T00:09:44.779 INFO:tasks.rgw.client.1.burnupi33.stdout:
2015-09-25T00:09:44.780 INFO:tasks.rgw.client.1.burnupi33.stdout: ceph version 9.0.3-1845-gf1ead76 (f1ead76f80cc3d078778080c35a6427256874062)
2015-09-25T00:09:44.780 INFO:tasks.rgw.client.1.burnupi33.stdout: 1: (()+0x2fb59a) [0x40359a]
2015-09-25T00:09:44.780 INFO:tasks.rgw.client.1.burnupi33.stdout: 2: (()+0x10340) [0x836f340]
2015-09-25T00:09:44.780 INFO:tasks.rgw.client.1.burnupi33.stdout: 3: (_vgr20070ZU_libcZdsoZa_strlen()+0x2) [0x4c2e0e2]
2015-09-25T00:09:44.780 INFO:tasks.rgw.client.1.burnupi33.stdout: 4: (req_info::req_info(CephContext*, RGWEnv*)+0x253) [0x382cb3]
2015-09-25T00:09:44.781 INFO:tasks.rgw.client.1.burnupi33.stdout: 5: (RGWRESTSimpleRequest::forward_request(RGWAccessKey&, req_info&, unsigned long, ceph::buffer::list*, ceph::buffer::list*)+0x74) [0x3bd7a4]
2015-09-25T00:09:44.781 INFO:tasks.rgw.client.1.burnupi33.stdout: 6: (RGWRESTConn::forward(std::string const&, req_info&, obj_version*, unsigned long, ceph::buffer::list*, ceph::buffer::list*)+0x5ac) [0x3603dc]
2015-09-25T00:09:44.781 INFO:tasks.rgw.client.1.burnupi33.stdout: 7: (()+0x25d0d5) [0x3650d5]
2015-09-25T00:09:44.781 INFO:tasks.rgw.client.1.burnupi33.stdout: 8: (RGWCreateBucket::execute()+0xaad) [0x37983d]
2015-09-25T00:09:44.781 INFO:tasks.rgw.client.1.burnupi33.stdout: 9: (()+0x1b0210) [0x2b8210]
2015-09-25T00:09:44.782 INFO:tasks.rgw.client.1.burnupi33.stdout: 10: (()+0x1b0e28) [0x2b8e28]
2015-09-25T00:09:44.782 INFO:tasks.rgw.client.1.burnupi33.stdout: 11: (()+0x2bfabf) [0x3c7abf]
2015-09-25T00:09:44.782 INFO:tasks.rgw.client.1.burnupi33.stdout: 12: (()+0x2c1a8e) [0x3c9a8e]
2015-09-25T00:09:44.782 INFO:tasks.rgw.client.1.burnupi33.stdout: 13: (()+0x8182) [0x8367182]
2015-09-25T00:09:44.782 INFO:tasks.rgw.client.1.burnupi33.stdout: 14: (clone()+0x6d) [0x9a4647d]
2015-09-25T00:09:44.783 INFO:tasks.rgw.client.1.burnupi33.stdout: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2015-09-25T00:09:44.783 INFO:tasks.rgw.client.1.burnupi33.stdout:
2015-09-25T00:09:45.515 INFO:tasks.rgw.client.1.burnupi33.stdout:     0> 2015-09-25 00:09:44.778599 2ce9a700 -1 *** Caught signal (Segmentation fault) **
2015-09-25T00:09:45.515 INFO:tasks.rgw.client.1.burnupi33.stdout: in thread 2ce9a700
2015-09-25T00:09:45.515 INFO:tasks.rgw.client.1.burnupi33.stdout:
2015-09-25T00:09:45.515 INFO:tasks.rgw.client.1.burnupi33.stdout: ceph version 9.0.3-1845-gf1ead76 (f1ead76f80cc3d078778080c35a6427256874062)
2015-09-25T00:09:45.515 INFO:tasks.rgw.client.1.burnupi33.stdout: 1: (()+0x2fb59a) [0x40359a]
2015-09-25T00:09:45.515 INFO:tasks.rgw.client.1.burnupi33.stdout: 2: (()+0x10340) [0x836f340]
2015-09-25T00:09:45.516 INFO:tasks.rgw.client.1.burnupi33.stdout: 3: (_vgr20070ZU_libcZdsoZa_strlen()+0x2) [0x4c2e0e2]
2015-09-25T00:09:45.516 INFO:tasks.rgw.client.1.burnupi33.stdout: 4: (req_info::req_info(CephContext*, RGWEnv*)+0x253) [0x382cb3]
2015-09-25T00:09:45.516 INFO:tasks.rgw.client.1.burnupi33.stdout: 5: (RGWRESTSimpleRequest::forward_request(RGWAccessKey&, req_info&, unsigned long, ceph::buffer::list*, ceph::buffer::list*)+0x74) [0x3bd7a4]
2015-09-25T00:09:45.516 INFO:tasks.rgw.client.1.burnupi33.stdout: 6: (RGWRESTConn::forward(std::string const&, req_info&, obj_version*, unsigned long, ceph::buffer::list*, ceph::buffer::list*)+0x5ac) [0x3603dc]
2015-09-25T00:09:45.516 INFO:tasks.rgw.client.1.burnupi33.stdout: 7: (()+0x25d0d5) [0x3650d5]
2015-09-25T00:09:45.516 INFO:tasks.rgw.client.1.burnupi33.stdout: 8: (RGWCreateBucket::execute()+0xaad) [0x37983d]
2015-09-25T00:09:45.516 INFO:tasks.rgw.client.1.burnupi33.stdout: 9: (()+0x1b0210) [0x2b8210]
2015-09-25T00:09:45.517 INFO:tasks.rgw.client.1.burnupi33.stdout: 10: (()+0x1b0e28) [0x2b8e28]
2015-09-25T00:09:45.517 INFO:tasks.rgw.client.1.burnupi33.stdout: 11: (()+0x2bfabf) [0x3c7abf]
2015-09-25T00:09:45.517 INFO:tasks.rgw.client.1.burnupi33.stdout: 12: (()+0x2c1a8e) [0x3c9a8e]
2015-09-25T00:09:45.517 INFO:tasks.rgw.client.1.burnupi33.stdout: 13: (()+0x8182) [0x8367182]
2015-09-25T00:09:45.517 INFO:tasks.rgw.client.1.burnupi33.stdout: 14: (clone()+0x6d) [0x9a4647d]
2015-09-25T00:09:45.517 INFO:tasks.rgw.client.1.burnupi33.stdout: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
# 2015-09-25T00:09:45.517 INFO:tasks.rgw.client.1.burnupi33.stdout:

Related issues

Copied to rgw - Backport #13537: Seg fault 9.0.3-1845-gf1ead76 : RGWRESTSimpleRequest::forward_request(RGWAccessKey&, req_info&, unsigned long, ceph::buffer::list*, ceph::buffer::list*)+0x74) Resolved
Copied to rgw - Backport #14691: infernalis: Seg fault 9.0.3-1845-gf1ead76 : RGWRESTSimpleRequest::forward_request(RGWAccessKey&, req_info&, unsigned long, ceph::buffer::list*, ceph::buffer::list*)+0x74) Rejected

Associated revisions

Revision 424fc1cc (diff)
Added by Yehuda Sadeh over 8 years ago

rgw: set default value for env->get() call

Fixes: #13239

This fixes a regression introduced at commit abe4ec293d08b0314bf5c081ace2456073f3a22c.
The host var is a string, env->get() returns a char pointer, shouldn't
pass in NULL.

Signed-off-by: Yehuda Sadeh <>
(cherry picked from commit 0d5730efc0054334897315dc23ba04f30548e36e)
Signed-off-by: Robin H. Johnson <>

Revision 3f000421 (diff)
Added by Yehuda Sadeh over 8 years ago

rgw: set default value for env->get() call

Fixes: #13239

This fixes a regression introduced at commit abe4ec293d08b0314bf5c081ace2456073f3a22c.
The host var is a string, env->get() returns a char pointer, shouldn't
pass in NULL.

Signed-off-by: Yehuda Sadeh <>

History

#1 Updated by Yehuda Sadeh over 8 years ago

Yeah, I think I know what's happening and I see the issue. Something in the environment changed and it doesn't send the HTTP_HOST header, and it triggers rgw issue when forwarding operations to the master.

#2 Updated by Yehuda Sadeh over 8 years ago

actually, the culprit is the following commit: abe4ec293d08b0314bf5c081ace2456073f3a22c

#3 Updated by Robin Johnson over 8 years ago

The failure is in s3tests.functional.test_s3.test_region_bucket_create_secondary_access_remove_master actually, but I don't see why, at least based solely on Sage's commit. That the test-suite doesn't send any Host header either in the test output is interesting, but shouldn't impact anything.

#4 Updated by Yehuda Sadeh over 8 years ago

Robin, see my fix at wip-13239.

#5 Updated by Sage Weil over 8 years ago

  • Status changed from New to Pending Backport
  • Priority changed from High to Urgent
  • Backport set to hammer

#7 Updated by Nathan Cutler over 8 years ago

  • Status changed from Pending Backport to Resolved

#8 Updated by Loïc Dachary about 8 years ago

  • Status changed from Resolved to Pending Backport
  • Backport changed from hammer to hammer,infernalis

#10 Updated by Loïc Dachary about 8 years ago

  • Copied to Backport #14691: infernalis: Seg fault 9.0.3-1845-gf1ead76 : RGWRESTSimpleRequest::forward_request(RGWAccessKey&, req_info&, unsigned long, ceph::buffer::list*, ceph::buffer::list*)+0x74) added

#11 Updated by Loïc Dachary over 7 years ago

  • Status changed from Pending Backport to Resolved

Also available in: Atom PDF