Project

General

Profile

Bug #37808

osd: osdmap cache weak_refs assert during shutdown

Added by Patrick Donnelly 9 days ago. Updated 7 days ago.

Status:
New
Priority:
High
Assignee:
-
Category:
Correctness/Safety
Target version:
Start date:
Due date:
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
OSD
Pull request ID:

Description

2019-01-07T06:03:50.666 INFO:tasks.ceph.osd.2.smithi103.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/14.0.1-2336-g6e9ba79/rpm/el7/BUILD/ceph-14.0.1-2336-g6e9ba79/src/common/shared_cache.hpp: In function 'SharedLRU<K, V>::~SharedLRU() [with K = unsigned int; V = const OSDMap]' thread 9c7f180 time 2019-01-07 06:03:50.661100
2019-01-07T06:03:50.666 INFO:tasks.ceph.osd.2.smithi103.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/14.0.1-2336-g6e9ba79/rpm/el7/BUILD/ceph-14.0.1-2336-g6e9ba79/src/common/shared_cache.hpp: 121: FAILED ceph_assert(weak_refs.empty())
2019-01-07T06:03:50.696 INFO:tasks.ceph.osd.2.smithi103.stderr: ceph version 14.0.1-2336-g6e9ba79 (6e9ba79dc0e0f1cd25e3405a13182db3bf489ce9) nautilus (dev)
2019-01-07T06:03:50.696 INFO:tasks.ceph.osd.2.smithi103.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14a) [0x55338c]
2019-01-07T06:03:50.697 INFO:tasks.ceph.osd.2.smithi103.stderr: 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x55355a]
2019-01-07T06:03:50.697 INFO:tasks.ceph.osd.2.smithi103.stderr: 3: (()+0x5fe03e) [0x70603e]
2019-01-07T06:03:50.697 INFO:tasks.ceph.osd.2.smithi103.stderr: 4: (OSDService::~OSDService()+0x163) [0x6b8443]
2019-01-07T06:03:50.697 INFO:tasks.ceph.osd.2.smithi103.stderr: 5: (OSD::~OSD()+0x2de) [0x6bd59e]
2019-01-07T06:03:50.697 INFO:tasks.ceph.osd.2.smithi103.stderr: 6: (OSD::~OSD()+0x9) [0x6bdb89]
2019-01-07T06:03:50.697 INFO:tasks.ceph.osd.2.smithi103.stderr: 7: (main()+0x1675) [0x556ee5]
2019-01-07T06:03:50.697 INFO:tasks.ceph.osd.2.smithi103.stderr: 8: (__libc_start_main()+0xf5) [0xe6dc445]
2019-01-07T06:03:50.698 INFO:tasks.ceph.osd.2.smithi103.stderr: 9: (()+0x53f445) [0x647445]
2019-01-07T06:03:50.698 INFO:tasks.ceph.osd.2.smithi103.stderr:2019-01-07 06:03:50.656 9c7f180 -1 leaked refs:
2019-01-07T06:03:50.699 INFO:tasks.ceph.osd.2.smithi103.stderr:dump_weak_refs 0x138b58f0 weak_refs: 36 = 0x417c2b90 with 1 refs

From: /ceph/teuthology-archive/pdonnell-2019-01-05_03:44:59-multimds-wip-pdonnell-testing-20190105.003832-distro-basic-smithi/3426727/teuthology.log

History

#1 Updated by Greg Farnum 7 days ago

  • Subject changed from osd: crash under valgrind during shutdown to osd: osdmap cache weak_refs assert during shutdown

Apparently these are popping up again so we should try and track them down, but note that since https://github.com/ceph/ceph/pull/18201 this won't be visible to users, only testers.

Also available in: Atom PDF