Project

General

Profile

Actions
Copy link

Bug #21945

closed

MDSCache::gen_default_file_layout segv on rados/upgrade

Added by Sage Weil over 6 years ago. Updated over 6 years ago.

Status:
Resolved
Priority:
Immediate
Assignee:
Patrick Donnelly
Category:
-
Target version:
-
% Done:

0%

Source:
Development
Tags:
Backport:
luminous
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(FS):
MDS
Labels (FS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2017-10-27T05:58:09.938 INFO:tasks.ceph.mds.a.smithi020.stderr: ceph version 13.0.0-2487-g6f54378 (6f54378830d6b33bf2381d97462f2a53a3fcdcdc) mimic (dev)
2017-10-27T05:58:09.938 INFO:tasks.ceph.mds.a.smithi020.stderr: 1: (()+0x5969a1) [0x5587fa52f9a1]
2017-10-27T05:58:09.938 INFO:tasks.ceph.mds.a.smithi020.stderr: 2: (()+0xf5e0) [0x7f1d8cee85e0]
2017-10-27T05:58:09.938 INFO:tasks.ceph.mds.a.smithi020.stderr: 3: (MDCache::gen_default_file_layout(MDSMap const&)+0x32) [0x5587fa3025e2]
2017-10-27T05:58:09.938 INFO:tasks.ceph.mds.a.smithi020.stderr: 4: (MDCache::init_layouts()+0x32) [0x5587fa302682]
2017-10-27T05:58:09.939 INFO:tasks.ceph.mds.a.smithi020.stderr: 5: (MDSRank::boot_start(MDSRank::BootStep, int)+0xd7) [0x5587fa26b1b7]
2017-10-27T05:58:09.939 INFO:tasks.ceph.mds.a.smithi020.stderr: 6: (MDSInternalContextBase::complete(int)+0x1eb) [0x5587fa4bd08b]
2017-10-27T05:58:09.939 INFO:tasks.ceph.mds.a.smithi020.stderr: 7: (C_IO_Wrapper::finish(int)+0xe) [0x5587fa4bd9de]
2017-10-27T05:58:09.939 INFO:tasks.ceph.mds.a.smithi020.stderr: 8: (MDSIOContextBase::complete(int)+0xa4) [0x5587fa4bd1c4]
2017-10-27T05:58:09.942 INFO:tasks.ceph.mds.a.smithi020.stderr: 9: (C_IO_Wrapper::complete(int)+0x2d) [0x5587fa4bd7ed]
2017-10-27T05:58:09.943 INFO:tasks.ceph.mds.a.smithi020.stderr: 10: (Finisher::finisher_thread_entry()+0x198) [0x5587fa56f268]
2017-10-27T05:58:09.943 INFO:tasks.ceph.mds.a.smithi020.stderr: 11: (()+0x7e25) [0x7f1d8cee0e25]
2017-10-27T05:58:09.943 INFO:tasks.ceph.mds.a.smithi020.stderr: 12: (clone()+0x6d) [0x7f1d8bfc334d]
2017-10-27T05:58:09.944 INFO:tasks.ceph.mds.a.smithi020.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

/a/sage-2017-10-27_01:26:32-rados-wip-sage2-testing-2017-10-26-1750-distro-basic-smithi/1778936

Related issues 1 (0 open — 1 closed)

Blocks CephFS - Backport #21953: luminous: MDSMonitor commands crashing on cluster upgraded from Hammer (nonexistent pool?)ResolvedPatrick DonnellyActions
Actions
Copy link
 #1

Updated by Sage Weil over 6 years ago 

(gdb) bt
#0  0x00007f1d8cee84ab in raise () from /lib64/libpthread.so.0
#1  0x00005587fa52fa76 in reraise_fatal (signum=11) at /usr/src/debug/ceph-13.0.0-2487-g6f54378/src/global/signal_handler.cc:74
#2  handle_fatal_signal (signum=11) at /usr/src/debug/ceph-13.0.0-2487-g6f54378/src/global/signal_handler.cc:138
#3  <signal handler called>
#4  0x00005587fa3025e2 in get_first_data_pool (this=0x558804213180)
    at /usr/src/debug/ceph-13.0.0-2487-g6f54378/src/mds/MDSMap.h:320
#5  MDCache::gen_default_file_layout (mdsmap=...) at /usr/src/debug/ceph-13.0.0-2487-g6f54378/src/mds/MDCache.cc:336
#6  0x00005587fa302682 in MDCache::init_layouts (this=0x5588044aa000)
    at /usr/src/debug/ceph-13.0.0-2487-g6f54378/src/mds/MDCache.cc:353
#7  0x00005587fa26b1b7 in MDSRank::boot_start (this=0x5588044a2000, step=MDSRank::MDS_BOOT_INITIAL, r=<optimized out>)
    at /usr/src/debug/ceph-13.0.0-2487-g6f54378/src/mds/MDSRank.cc:1043
#8  0x00005587fa4bd08b in complete (r=0, this=0x558804417c80) at /usr/src/debug/ceph-13.0.0-2487-g6f54378/src/include/Context.h:70
#9  MDSInternalContextBase::complete (this=0x558804417c80, r=0)
    at /usr/src/debug/ceph-13.0.0-2487-g6f54378/src/mds/MDSContext.cc:30
#10 0x00005587fa4bd9de in C_IO_Wrapper::finish (this=0x558804417760, r=<optimized out>)
    at /usr/src/debug/ceph-13.0.0-2487-g6f54378/src/mds/MDSContext.h:153
#11 0x00005587fa4bd1c4 in complete (r=0, this=0x558804417760) at /usr/src/debug/ceph-13.0.0-2487-g6f54378/src/include/Context.h:70
#12 MDSIOContextBase::complete (this=this@entry=0x558804417760, r=r@entry=0)
    at /usr/src/debug/ceph-13.0.0-2487-g6f54378/src/mds/MDSContext.cc:64
#13 0x00005587fa4bd7ed in C_IO_Wrapper::complete (this=0x558804417760, r=0)
    at /usr/src/debug/ceph-13.0.0-2487-g6f54378/src/mds/MDSContext.cc:96
#14 0x00005587fa56f268 in Finisher::finisher_thread_entry (this=0x55880422f600)
    at /usr/src/debug/ceph-13.0.0-2487-g6f54378/src/common/Finisher.cc:72
#15 0x00007f1d8cee0e25 in start_thread () from /lib64/libpthread.so.0
#16 0x00007f1d8bfc334d in clone () from /lib64/libc.so.6
(gdb) f 5
#5  MDCache::gen_default_file_layout (mdsmap=...) at /usr/src/debug/ceph-13.0.0-2487-g6f54378/src/mds/MDCache.cc:336
336      result.pool_id = mdsmap.get_first_data_pool();
(gdb) p data_pools
No symbol "data_pools" in current context.
(gdb) p mdsmap.data_pools
$4 = std::vector of length 0, capacity 0
Actions
Copy link
 #2

Updated by Sage Weil over 6 years ago

  • Assignee set to Patrick Donnelly

Presumably 7adf0fb819cc98702cd97214192770472eab5d27

Actions
Copy link
 #3

Updated by Patrick Donnelly over 6 years ago

  • Blocks Backport #21953: luminous: MDSMonitor commands crashing on cluster upgraded from Hammer (nonexistent pool?) added
Actions
Copy link
 #4

Updated by Patrick Donnelly over 6 years ago

  • Status changed from New to In Progress
Actions
Copy link
 #5

Updated by Kefu Chai over 6 years ago

/a/kchai-2017-10-29_15:49:18-rados-wip-kefu-testing-2017-10-28-2157-distro-basic-mira/1788809

Actions
Copy link
 #6

Updated by Patrick Donnelly over 6 years ago

  • Project changed from Ceph to CephFS
  • Source set to Development
  • Backport set to luminous
  • Component(FS) MDS added
Actions
Copy link
 #7

Updated by Sage Weil over 6 years ago

  • Status changed from In Progress to Resolved
Actions
Copy link

Also available in: Atom PDF