Project

General

Profile

Actions

Subtask #45535

closed

crimson: crimson-osd failure in ceph-container

Added by Deepika Upadhyay almost 4 years ago. Updated 24 days ago.

Status:
Closed
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Reviewed:
Affected Versions:
Pull request ID:

Description

testing demo cluster of ceph-container with crimson osd errors out with following backtrace + command failure

$ crimson-osd --conf /etc/ceph/test.conf --osd-data /var/lib/ceph/osd/test-0 --mkfs -i osd.0 '--smp 2 --cpuset 0 --debug'

failure backtrace: 
*** longjmp causes uninitialized stack frame ***: crimson-osd terminated
Aborting on shard 0.

# seastar/scripts/seastar-addr2line -e bin/crimson-osd
bin/crimson-osd: ELF 64-bit LSB shared object, x86-64, version 1 (GNU/Linux), dynamically linked, interpreter /lib64/ld-linux-x86-64.so.2, for GNU/Linux 3.2.0, BuildID[sha1]=475f520f48c8d180fe907a08417fcba02e9ba6ad, stripped, too many notes (256)

 0x0000000000e3448c
  0x0000000000df8df0
  0x0000000000df8eb8
  0x0000000000df8f85
  /lib64/libpthread.so.0+0x0000000000012dbf
  /lib64/libc.so.6+0x00000000000378de
  /lib64/libc.so.6+0x0000000000021cf4
  /lib64/libc.so.6+0x000000000007ac16
  /lib64/libc.so.6+0x000000000010db64
  /lib64/libc.so.6+0x000000000010db96
  /lib64/libc.so.6+0x000000000010da10
  /lib64/libc.so.6+0x000000000010d96e
  0x0000000000e6a5df
  0x00000000005a6bd5
  0x0000000000df5630
  0x0000000000df5983
  0x0000000000e1f8dd
  0x0000000000dcae34
  0x000000000055d0cd
  /lib64/libc.so.6+0x0000000000023872
  0x000000000058da5d

[Backtrace #0]
std::filesystem::__cxx11::path::path(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&&, std::filesystem::__cxx11::path::format) at ??:?
seastar::metrics::impl::metric_family_metadata* std::__uninitialized_copy<false>::__uninit_copy<std::move_iterator<seastar::metrics::impl::metric_family_metadata*>, seastar::metrics::impl::metric_family_metadata*>(std::move_iterator<seastar::metrics::impl::metric_family_metadata*>, std::move_iterator<seastar::metrics::impl::metric_family_metadata*>, seastar::metrics::impl::metric_family_metadata*) at ??:?
seastar::metrics::impl::metric_family_metadata* std::__uninitialized_copy<false>::__uninit_copy<std::move_iterator<seastar::metrics::impl::metric_family_metadata*>, seastar::metrics::impl::metric_family_metadata*>(std::move_iterator<seastar::metrics::impl::metric_family_metadata*>, std::move_iterator<seastar::metrics::impl::metric_family_metadata*>, seastar::metrics::impl::metric_family_metadata*) at ??:?
seastar::metrics::impl::metric_family_metadata* std::__uninitialized_copy<false>::__uninit_copy<std::move_iterator<seastar::metrics::impl::metric_family_metadata*>, seastar::metrics::impl::metric_family_metadata*>(std::move_iterator<seastar::metrics::impl::metric_family_metadata*>, std::move_iterator<seastar::metrics::impl::metric_family_metadata*>, seastar::metrics::impl::metric_family_metadata*) at ??:?
.annobin_sigaction.c at sigaction.c:?
__GI_raise at :?
__GI_abort at :?
__libc_message at :?
__GI___fortify_fail_abort at :?
__GI___fortify_fail at :?
____longjmp_chk at :?
__longjmp_chk at ??:?
std::_Function_base::_Base_manager<seastar::metrics::impl::make_function<double, void>(double&, seastar::metrics::impl::data_type)::{lambda()#1}>::_M_manager(std::_Any_data&, std::_Function_base::_Base_manager<seastar::metrics::impl::make_function<double, void>(double&, seastar::metrics::impl::data_type)::{lambda()#1}> const&, std::_Manager_operation) at ??:?
seastar::smp_message_queue::async_work_item<seastar::sharded<crimson::common::ConfigProxy>::start<EntityName&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&>(EntityName&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> >&)::{lambda(unsigned int)#1}::operator()(unsigned int)::{lambda()#1}>::~async_work_item() at ??:?
seastar::metrics::impl::metric_family_metadata* std::__uninitialized_copy<false>::__uninit_copy<std::move_iterator<seastar::metrics::impl::metric_family_metadata*>, seastar::metrics::impl::metric_family_metadata*>(std::move_iterator<seastar::metrics::impl::metric_family_metadata*>, std::move_iterator<seastar::metrics::impl::metric_family_metadata*>, seastar::metrics::impl::metric_family_metadata*) at ??:?
seastar::metrics::impl::metric_family_metadata* std::__uninitialized_copy<false>::__uninit_copy<std::move_iterator<seastar::metrics::impl::metric_family_metadata*>, seastar::metrics::impl::metric_family_metadata*>(std::move_iterator<seastar::metrics::impl::metric_family_metadata*>, std::move_iterator<seastar::metrics::impl::metric_family_metadata*>, seastar::metrics::impl::metric_family_metadata*) at ??:?
seastar::metrics::impl::metric_family_metadata* std::__uninitialized_copy<false>::__uninit_copy<std::move_iterator<seastar::metrics::impl::metric_family_metadata*>, seastar::metrics::impl::metric_family_metadata*>(std::move_iterator<seastar::metrics::impl::metric_family_metadata*>, std::move_iterator<seastar::metrics::impl::metric_family_metadata*>, seastar::metrics::impl::metric_family_metadata*) at ??:?
std::system_error::system_error(std::error_code, char const*) at ??:?
main at ??:?
__libc_start_main at ??:?
_start at ??:?

complete backtrace: https://gist.github.com/ideepika/ee9c40d248bccb46479807097b6ab55f#gistcomment-3302463


Related issues 3 (1 open2 closed)

Related to crimson - Bug #41818: crimson run error due to ___longjmp_chk()ResolvedKefu Chai

Actions
Related to RADOS - Bug #45611: crimson: centos 8 vstart failureNew

Actions
Related to crimson - Bug #45634: v15.2.1 vstart.sh:failed run crimson-osd on ARMClosed

Actions
Actions #1

Updated by Deepika Upadhyay almost 4 years ago

  • Description updated (diff)
Actions #2

Updated by Deepika Upadhyay almost 4 years ago

${cluster}.conf

[global]
fsid = 73b7a050-b5f8-42a8-8545-984fc128fa95
mon initial members = 9a661970247b
mon host = v2:127.0.0.1:3300/0
osd crush chooseleaf type = 0
osd journal size = 100
public network = 0.0.0.0/0
cluster network = 0.0.0.0/0
osd pool default size = 1
mon warn on pool no redundancy = false
osd_memory_target = 4242538496
osd_memory_base = 2147483648
osd_memory_cache_min = 3195011072
osd objectstore = bluestore

[osd.0]
osd data = /var/lib/ceph/osd/test-0
Actions #3

Updated by Deepika Upadhyay almost 4 years ago

  • Description updated (diff)

Deepika Upadhyay wrote:

[...]

Actions #4

Updated by Radoslaw Zarzynski almost 4 years ago

  • Related to Bug #41818: crimson run error due to ___longjmp_chk() added
Actions #5

Updated by Deepika Upadhyay almost 4 years ago

  • Related to Bug #45611: crimson: centos 8 vstart failure added
Actions #6

Updated by Deepika Upadhyay almost 4 years ago

  • Related to Bug #45634: v15.2.1 vstart.sh:failed run crimson-osd on ARM added
Actions #7

Updated by Greg Farnum almost 3 years ago

  • Project changed from Ceph to crimson
Actions #8

Updated by Matan Breizman 24 days ago

  • Status changed from New to Closed

Please re-open if still relevant.

Actions

Also available in: Atom PDF