Project

General

Profile

Actions

Bug #58391

open

crimson-osd can't finish "mkfs" under RelWithDebInfo build type

Added by Xuehan Xu over 1 year ago. Updated 10 days ago.

Status:
Need More Info
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Community (dev)
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

INFO  2023-01-06 09:03:17,751 seastar - Reactor backend: linux-aio
WARN  2023-01-06 09:03:17,751 [shard 0] seastar - Creation of perf_event based stall detector failed, falling back to posix timer: std::system_error (error system:13, perf_event_open() failed: Permission denied)
INFO  2023-01-06 09:03:17,752 [shard 0] seastar - Created fair group io-queue-0, capacity rate 2147483:2147483, limit 12582912, rate 16777216 (factor 1), threshold 2000
INFO  2023-01-06 09:03:17,752 [shard 0] seastar - IO queue uses 0.75ms latency goal for device 0
INFO  2023-01-06 09:03:17,752 [shard 0] seastar - Created io group dev(0), length limit 4194304:4194304, rate 2147483647:2147483647
INFO  2023-01-06 09:03:17,752 [shard 0] seastar - Created io queue dev(0) capacities: 512:2000:2000 1024:3000:3000 2048:5000:5000 4096:9000:9000 8192:17000:17000 16384:33000:33000 32768:65000:65000 65536:129000:129000 131072:257000:257000
Segmentation fault on shard 0.
Backtrace:
Reactor stalled for 185 ms on shard 0. Backtrace: 0x209e6f8 0x209da83 0x209ef01 0x4251f 0xeabc6 0xea9fb 0x149d50e 0x149d2ee 0x149c97d 0x149c686 0x149c249 0x149bcd8 0x149af3a 0x149ae1e 0x4251f 0x206ce32 0x1aca83 0x29c4c29e1892 0x1bd82b 0x99f67 0x1c24dc 0x1bf292 0x16ce46 0x16d80c 0x119f01 0x1bea9f 0x99f67 0x1c24dc 0x1bf505 0x29c4c29d89dc 0x194e57 0x19561e 0x172a987 0x172a4d9 0x17079d4 0x17068b1 0x1707cc8 0x20af765 0x20b0b77 0x20afd79 0x204f494 0x204e8ce 0xe94029 0x29d8f 0x29e3f 0xe67114
Reactor stalled for 329 ms on shard 0. Backtrace: 0x209e6f8 0x209da83 0x209ef01 0x4251f 0xeabc6 0xea9fb 0x149d50e 0x149d2ee 0x149c97d 0x149c686 0x149c249 0x149bcd8 0x149af3a 0x149ae1e 0x4251f 0x206ce32 0x1aca83 0x29c4c29e1892 0x1bd82b 0x99f67 0x1c24dc 0x1bf292 0x16ce46 0x16d80c 0x119f01 0x1bea9f 0x99f67 0x1c24dc 0x1bf505 0x29c4c29d89dc 0x194e57 0x19561e 0x172a987 0x172a4d9 0x17079d4 0x17068b1 0x1707cc8 0x20af765 0x20b0b77 0x20afd79 0x204f494 0x204e8ce 0xe94029 0x29d8f 0x29e3f 0xe67114
Reactor stalled for 669 ms on shard 0. Backtrace: 0x209e6f8 0x209da83 0x209ef01 0x4251f 0xeabc6 0xea9fb 0x149d50e 0x149d2ee 0x149cb9f 0x149cb4e 0x149c8a2 0x149c3cf 0x149c249 0x149bcd8 0x149af3a 0x149ae1e 0x4251f 0x206ce32 0x1aca83 0x29c4c29e1892 0x1bd82b 0x99f67 0x1c24dc 0x1bf292 0x16ce46 0x16d80c 0x119f01 0x1bea9f 0x99f67 0x1c24dc 0x1bf505 0x29c4c29d89dc 0x194e57 0x19561e 0x172a987 0x172a4d9 0x17079d4 0x17068b1 0x1707cc8 0x20af765 0x20b0b77 0x20afd79 0x204f494 0x204e8ce 0xe94029 0x29d8f 0x29e3f 0xe67114
Reactor stalled for 1496 ms on shard 0. Backtrace: 0x209e6f8 0x209da83 0x209ef01 0x4251f 0xeaafa 0x149d50e 0x149d2ee 0x149c97d 0x149c686 0x149c249 0x149bcd8 0x149af3a 0x149ae1e 0x4251f 0x206ce32 0x1aca83 0x29c4c29e1892 0x1bd82b 0x99f67 0x1c24dc 0x1bf292 0x16ce46 0x16d80c 0x119f01 0x1bea9f 0x99f67 0x1c24dc 0x1bf505 0x29c4c29d89dc 0x194e57 0x19561e 0x172a987 0x172a4d9 0x17079d4 0x17068b1 0x1707cc8 0x20af765 0x20b0b77 0x20afd79 0x204f494 0x204e8ce 0xe94029 0x29d8f 0x29e3f 0xe67114
 0# realloc in /home/xuxuehan/src/ceph/build/bin/crimson-osd
 1# OPENSSL_LH_insert in /lib/x86_64-linux-gnu/libcrypto.so.3
 2# 0x00007FCFC094C893 in /lib/x86_64-linux-gnu/libcrypto.so.3
 3# 0x00007FCFC086D82C in /lib/x86_64-linux-gnu/libcrypto.so.3
 4# 0x00007FCFBFB86F68 in /lib/x86_64-linux-gnu/libc.so.6
 5# CRYPTO_THREAD_run_once in /lib/x86_64-linux-gnu/libcrypto.so.3
 6# OPENSSL_init_crypto in /lib/x86_64-linux-gnu/libcrypto.so.3
 7# 0x00007FCFC081CE47 in /lib/x86_64-linux-gnu/libcrypto.so.3
 8# ERR_set_mark in /lib/x86_64-linux-gnu/libcrypto.so.3
 9# CONF_modules_load_file_ex in /lib/x86_64-linux-gnu/libcrypto.so.3
10# 0x00007FCFC086EAA0 in /lib/x86_64-linux-gnu/libcrypto.so.3
11# 0x00007FCFBFB86F68 in /lib/x86_64-linux-gnu/libc.so.6
12# CRYPTO_THREAD_run_once in /lib/x86_64-linux-gnu/libcrypto.so.3
13# OPENSSL_init_crypto in /lib/x86_64-linux-gnu/libcrypto.so.3
14# 0x00007FCFC09439DD in /lib/x86_64-linux-gnu/libcrypto.so.3
15# 0x00007FCFC0844E58 in /lib/x86_64-linux-gnu/libcrypto.so.3
16# EVP_CipherInit_ex in /lib/x86_64-linux-gnu/libcrypto.so.3
17# ceph::crypto::onwire::AES128GCM_OnWireRxHandler::AES128GCM_OnWireRxHandler(crimson::common::CephContext*, std::array<unsigned char, 16ul> const&, ceph::crypto::onwire::nonce_t const&, bool) in /home/xuxuehan/src/ceph/build/bin/crimson-osd
18# ceph::crypto::onwire::rxtx_t::create_handler_pair(crimson::common::CephContext*, AuthConnectionMeta const&, bool, bool) in /home/xuxuehan/src/ceph/build/bin/crimson-osd
19# 0x0000560AFF6729D5 in /home/xuxuehan/src/ceph/build/bin/crimson-osd
20# 0x0000560AFF6718B2 in /home/xuxuehan/src/ceph/build/bin/crimson-osd
21# 0x0000560AFF672CC9 in /home/xuxuehan/src/ceph/build/bin/crimson-osd
22# 0x0000560B0001A766 in /home/xuxuehan/src/ceph/build/bin/crimson-osd
23# 0x0000560B0001BB78 in /home/xuxuehan/src/ceph/build/bin/crimson-osd
24# 0x0000560B0001AD7A in /home/xuxuehan/src/ceph/build/bin/crimson-osd
25# 0x0000560AFFFBA495 in /home/xuxuehan/src/ceph/build/bin/crimson-osd
26# 0x0000560AFFFB98CF in /home/xuxuehan/src/ceph/build/bin/crimson-osd
27# main in /home/xuxuehan/src/ceph/build/bin/crimson-osd
28# 0x00007FCFBFB16D90 in /lib/x86_64-linux-gnu/libc.so.6
29# __libc_start_main in /lib/x86_64-linux-gnu/libc.so.6
30# _start in /home/xuxuehan/src/ceph/build/bin/crimson-osd
Dump of siginfo:
  si_signo: 11
  si_errno: 0
  si_code: 1
  si_pid: 16
  si_uid: 0
  si_status: 0
  si_utime: 0
  si_stime: 0
  si_int: 0
  si_ptr: 0
  si_overrun: 0
  si_timerid: 16
  si_addr: 0x10
  si_band: 16
  si_fd: 0
  si_addr_lsb: 0
  si_lower: 0
  si_upper: 0
  si_pkey: 0
  si_call_addr: 0x10
  si_syscall: 0
  si_arch: 0


Related issues 1 (1 open0 closed)

Related to crimson - Bug #57629: crimson: segfault during mkfsNewSamuel Just

Actions
Actions #1

Updated by Nitzan Mordechai over 1 year ago

  • Related to Bug #57629: crimson: segfault during mkfs added
Actions #2

Updated by Matan Breizman 10 days ago

  • Status changed from New to Need More Info

@Xuehan Xu
Is this still relevant?

Actions

Also available in: Atom PDF