Project

General

Profile

Bug #19743

mgr: segv in Mgr::shutdown() in PyThread_acquire_lock()

Added by Sage Weil 4 months ago. Updated 3 months ago.

Status:
Resolved
Priority:
Immediate
Assignee:
Category:
-
Target version:
-
Start date:
04/21/2017
Due date:
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Release:
Needs Doc:
No

Description

2017-04-21T06:40:53.826 INFO:tasks.ceph.mon.f.smithi080.stderr:2017-04-21 06:41:03.602776 7f3d18d9d700 -1 mon.f@5(peon).paxos(paxos active c 1..51) lease_expire from mon.0 172.21.15.51:6789/0 is 4.777944 seconds in the past; mons are probably laggy (or possibly clocks are too skewed)
2017-04-21T06:40:56.826 INFO:tasks.ceph.mon.b.smithi080.stderr:2017-04-21 06:41:06.602786 7f0d2d45e700 -1 mon.b@1(peon).paxos(paxos active c 1..51) lease_expire from mon.0 172.21.15.51:6789/0 is 4.777832 seconds in the past; mons are probably laggy (or possibly clocks are too skewed)
2017-04-21T06:40:56.826 INFO:tasks.ceph.mon.d.smithi080.stderr:2017-04-21 06:41:06.602831 7f39e0ee9700 -1 mon.d@3(peon).paxos(paxos active c 1..51) lease_expire from mon.0 172.21.15.51:6789/0 is 4.777877 seconds in the past; mons are probably laggy (or possibly clocks are too skewed)
2017-04-21T06:40:56.826 INFO:tasks.ceph.mon.f.smithi080.stderr:2017-04-21 06:41:06.602832 7f3d18d9d700 -1 mon.f@5(peon).paxos(paxos active c 1..51) lease_expire from mon.0 172.21.15.51:6789/0 is 4.777878 seconds in the past; mons are probably laggy (or possibly clocks are too skewed)
2017-04-21T06:40:57.564 INFO:tasks.ceph.mgr.y.smithi080.stderr:2017-04-21 06:41:07.328501 7f3170ab9700 -1 mgr handle_mgr_map I was active but no longer am
2017-04-21T06:40:57.564 INFO:tasks.ceph.mgr.y.smithi080.stderr:*** Caught signal (Segmentation fault) **
2017-04-21T06:40:57.565 INFO:tasks.ceph.mgr.y.smithi080.stderr: in thread 7f3170ab9700 thread_name:ms_dispatch
2017-04-21T06:40:57.569 INFO:tasks.ceph.mgr.y.smithi080.stderr: ceph version 12.0.1-1252-gfc32356 (fc3235649273967d76678eb3723e7701867c5707)
2017-04-21T06:40:57.569 INFO:tasks.ceph.mgr.y.smithi080.stderr: 1: (()+0x2919f2) [0x55a8cc7c29f2]
2017-04-21T06:40:57.569 INFO:tasks.ceph.mgr.y.smithi080.stderr: 2: (()+0x113e0) [0x7f3174f733e0]
2017-04-21T06:40:57.569 INFO:tasks.ceph.mgr.y.smithi080.stderr: 3: (sem_wait()+0x4) [0x7f3174f71994]
2017-04-21T06:40:57.569 INFO:tasks.ceph.mgr.y.smithi080.stderr: 4: (PyThread_acquire_lock()+0x78) [0x7f3176070f98]
2017-04-21T06:40:57.569 INFO:tasks.ceph.mgr.y.smithi080.stderr: 5: (PyThreadState_New()+0x102) [0x7f31760deba2]
2017-04-21T06:40:57.569 INFO:tasks.ceph.mgr.y.smithi080.stderr: 6: (PyGILState_Ensure()+0x3c) [0x7f31760c0c0c]
2017-04-21T06:40:57.569 INFO:tasks.ceph.mgr.y.smithi080.stderr: 7: (PyModules::shutdown()+0x2bf) [0x55a8cc755f4f]
2017-04-21T06:40:57.569 INFO:tasks.ceph.mgr.y.smithi080.stderr: 8: (Mgr::shutdown()+0x2f) [0x55a8cc76cc0f]
2017-04-21T06:40:57.570 INFO:tasks.ceph.mgr.y.smithi080.stderr: 9: (MgrStandby::handle_mgr_map(MMgrMap*)+0x3bb) [0x55a8cc765fcb]
2017-04-21T06:40:57.570 INFO:tasks.ceph.mgr.y.smithi080.stderr: 10: (MgrStandby::ms_dispatch(Message*)+0x216) [0x55a8cc766846]
2017-04-21T06:40:57.570 INFO:tasks.ceph.mgr.y.smithi080.stderr: 11: (DispatchQueue::entry()+0xf4a) [0x55a8cca3b20a]
2017-04-21T06:40:57.570 INFO:tasks.ceph.mgr.y.smithi080.stderr: 12: (DispatchQueue::DispatchThread::entry()+0xd) [0x55a8cc8d18cd]
2017-04-21T06:40:57.570 INFO:tasks.ceph.mgr.y.smithi080.stderr: 13: (()+0x770a) [0x7f3174f6970a]
2017-04-21T06:40:57.570 INFO:tasks.ceph.mgr.y.smithi080.stderr: 14: (clone()+0x6d) [0x7f3173fd582d]
2017-04-21T06:40:57.570 INFO:tasks.ceph.mgr.y.smithi080.stderr:2017-04-21 06:41:07.346115 7f3170ab9700 -1 *** Caught signal (Segmentation fault) **

/a/sage-2017-04-21_02:10:47-rados-wip-sage-testing2---basic-smithi/1051021

approx master is 0486c633543b74b6221275e7c117ad2bfe576b6a


Related issues

Duplicated by mgr - Bug #17738: Deadlock when shutdown() is called while still in init() Duplicate 10/28/2016

History

#1 Updated by Sage Weil 4 months ago

/a/sage-2017-04-25_02:25:56-rados-wip-sage-testing---basic-smithi/1066035

#2 Updated by Kefu Chai 4 months ago

  • Assignee set to Kefu Chai

#3 Updated by Kefu Chai 4 months ago

  • Status changed from New to Need Review

#4 Updated by Yuri Weinstein 4 months ago

merged

#5 Updated by Kefu Chai 4 months ago

  • Status changed from Need Review to Resolved

#6 Updated by Kefu Chai 3 months ago

  • Project changed from Ceph to mgr

#7 Updated by Kefu Chai 3 months ago

  • Duplicated by Bug #17738: Deadlock when shutdown() is called while still in init() added

Also available in: Atom PDF