Project

General

Profile

Bug #36036

sporadic failure in dynamic features test

Added by Jason Dillaman over 5 years ago. Updated over 3 years ago.

Status:
Can't reproduce
Priority:
High
Assignee:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
luminous,mimic
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

http://qa-proxy.ceph.com/teuthology/yuriw-2018-09-13_15:12:05-rbd-wip-yuri-testing-2018-09-12-2202-luminous-distro-basic-smithi/3016982/teuthology.log

2018-09-13T18:44:32.299 INFO:tasks.workunit.client.0.smithi203.stderr:+ echo '*** Disabling all features'
2018-09-13T18:44:32.299 INFO:tasks.workunit.client.0.smithi203.stderr:+ rbd feature disable client.0.1-clone journaling
2018-09-13T18:44:32.415 INFO:tasks.qemu.client.0.smithi203.stderr:/build/ceph-12.2.8-64-g924d8fe/src/journal/JournalRecorder.cc: In function 'journal::JournalRecorder::~JournalRecorder()' thread 7f1bb89e3700 time 2018-09-13 18:44:32.416243
2018-09-13T18:44:32.416 INFO:tasks.qemu.client.0.smithi203.stderr:/build/ceph-12.2.8-64-g924d8fe/src/journal/JournalRecorder.cc: 82: FAILED assert(m_in_flight_advance_sets == 0)
2018-09-13T18:44:32.421 INFO:tasks.qemu.client.0.smithi203.stderr: ceph version 12.2.8-64-g924d8fe (924d8fe9eb792e61a8edccd59905fb426b600cc8) luminous (stable)
2018-09-13T18:44:32.421 INFO:tasks.qemu.client.0.smithi203.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x7f1c25ae0942]
2018-09-13T18:44:32.421 INFO:tasks.qemu.client.0.smithi203.stderr: 2: (()+0x1fc35f) [0x7f1c2eac835f]
2018-09-13T18:44:32.421 INFO:tasks.qemu.client.0.smithi203.stderr: 3: (()+0x1dd4da) [0x7f1c2eaa94da]
2018-09-13T18:44:32.422 INFO:tasks.qemu.client.0.smithi203.stderr: 4: (()+0x6aacc) [0x7f1c2e936acc]
2018-09-13T18:44:32.422 INFO:tasks.qemu.client.0.smithi203.stderr: 5: (()+0x54879) [0x7f1c2e920879]
2018-09-13T18:44:32.422 INFO:tasks.qemu.client.0.smithi203.stderr: 6: (()+0x63201) [0x7f1c2e92f201]
2018-09-13T18:44:32.422 INFO:tasks.qemu.client.0.smithi203.stderr: 7: (ThreadPool::worker(ThreadPool::WorkThread*)+0xdb9) [0x7f1c25ae9169]
2018-09-13T18:44:32.422 INFO:tasks.qemu.client.0.smithi203.stderr: 8: (ThreadPool::WorkThread::entry()+0x10) [0x7f1c25aea280]
2018-09-13T18:44:32.422 INFO:tasks.qemu.client.0.smithi203.stderr: 9: (()+0x76ba) [0x7f1c38efc6ba]
2018-09-13T18:44:32.423 INFO:tasks.qemu.client.0.smithi203.stderr: 10: (clone()+0x6d) [0x7f1c38c3241d]
2018-09-13T18:44:32.423 INFO:tasks.qemu.client.0.smithi203.stderr: NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
2018-09-13T18:44:59.551 INFO:tasks.qemu.client.0.smithi203.stderr:daemon-helper: command crashed with signal 6
(gdb) print *this
$1 = {m_ioctx = {io_ctx_impl = 0x7f1aa0002fd0}, m_cct = 0x5567d03a2990, m_object_oid_prefix = "journal_data.1.10876b8b4567.", m_journal_metadata = {px = 0x7f1bd8056f70}, m_flush_interval = 0, m_flush_bytes = 0, m_flush_age = 0, m_listener = {<journal::JournalMetadataListener> = {
      _vptr.JournalMetadataListener = 0x7f1c2edf62a0 <vtable for journal::JournalRecorder::Listener+16>}, journal_recorder = 0x7f1aa0000c00}, m_object_handler = {<journal::ObjectRecorder::Handler> = {_vptr.Handler = 0x7f1c2edf62c8 <vtable for journal::JournalRecorder::ObjectHandler+16>}, journal_recorder = 0x7f1aa0000c00}, m_lock = {name = "JournalerRecorder::m_lock", 
    id = -1, recursive = false, lockdep = true, backtrace = false, _m = {__data = {__lock = 2, __count = 0, __owner = 12646, __nusers = 1, __kind = 2, __spins = 0, __elision = 0, __list = {__prev = 0x0, __next = 0x0}}, __size = "\002\000\000\000\000\000\000\000f1\000\000\001\000\000\000\002", '\000' <repeats 22 times>, __align = 2}, nlock = 1, locked_by = 139757038221056, 
    cct = 0x0, logger = 0x0}, m_in_flight_advance_sets = 1, m_in_flight_object_closes = 0, m_current_set = 3, m_object_ptrs = std::map with 4 elements = {[0 '\000'] = {px = 0x7f1bd8052020}, [1 '\001'] = {px = 0x7f1bd80415f0}, [2 '\002'] = {px = 0x7f1bd802c5a0}, [3 '\003'] = {px = 0x7f1bd8044710}}, m_object_locks = std::vector of length 4, capacity 4 = {
    std::shared_ptr (count 2, weak 0) 0x7f1aa0001610, std::shared_ptr (count 2, weak 0) 0x7f1aa0003200, std::shared_ptr (count 2, weak 0) 0x7f1aa0003780, std::shared_ptr (count 2, weak 0) 0x7f1aa0003ca0}, m_prev_future = {px = 0x7f1be4126780}}
(gdb) bt
#0  0x00007f1c38b60428 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54
#1  0x00007f1c38b6202a in __GI_abort () at abort.c:89
#2  0x00007f1c25ae0ace in ceph::__ceph_assert_fail (assertion=assertion@entry=0x7f1c2eb769d6 "m_in_flight_advance_sets == 0", file=file@entry=0x7f1c2eb76800 "/build/ceph-12.2.8-64-g924d8fe/src/journal/JournalRecorder.cc", line=line@entry=82, 
    func=func@entry=0x7f1c2eb77100 <journal::JournalRecorder::~JournalRecorder()::__PRETTY_FUNCTION__> "journal::JournalRecorder::~JournalRecorder()") at /build/ceph-12.2.8-64-g924d8fe/src/common/assert.cc:66
#3  0x00007f1c2eac835f in journal::JournalRecorder::~JournalRecorder (this=0x7f1aa0000c00, __in_chrg=<optimized out>) at /build/ceph-12.2.8-64-g924d8fe/src/journal/JournalRecorder.cc:82
#4  0x00007f1c2eaa94da in journal::Journaler::<lambda(int)>::operator() (r=0, __closure=0x7f1bd802ca10) at /build/ceph-12.2.8-64-g924d8fe/src/journal/Journaler.cc:405
#5  boost::detail::function::void_function_obj_invoker1<journal::Journaler::stop_append(Context*)::<lambda(int)>, void, int>::invoke(boost::detail::function::function_buffer &, int) (function_obj_ptr=..., a0=0) at /build/ceph-12.2.8-64-g924d8fe/obj-x86_64-linux-gnu/boost/include/boost/function/function_template.hpp:159
#6  0x00007f1c2e936acc in boost::function1<void, int>::operator() (a0=<optimized out>, this=<optimized out>) at /build/ceph-12.2.8-64-g924d8fe/obj-x86_64-linux-gnu/boost/include/boost/function/function_template.hpp:760
#7  FunctionContext::finish (this=<optimized out>, r=<optimized out>) at /build/ceph-12.2.8-64-g924d8fe/src/include/Context.h:493
#8  0x00007f1c2e920879 in Context::complete (this=0x7f1bd802ca00, r=<optimized out>) at /build/ceph-12.2.8-64-g924d8fe/src/include/Context.h:70
#9  0x00007f1c2e92f201 in ContextWQ::process (this=0x7f1bd805fcb0, ctx=0x7f1bd802ca00) at /build/ceph-12.2.8-64-g924d8fe/src/common/WorkQueue.h:611
#10 0x00007f1c25ae9169 in ThreadPool::worker (this=0x7f1bd8057680, wt=0x7f1bd80578a0) at /build/ceph-12.2.8-64-g924d8fe/src/common/WorkQueue.cc:120
#11 0x00007f1c25aea280 in ThreadPool::WorkThread::entry (this=<optimized out>) at /build/ceph-12.2.8-64-g924d8fe/src/common/WorkQueue.h:448
#12 0x00007f1c38efc6ba in start_thread (arg=0x7f1bb89e3700) at pthread_create.c:333
#13 0x00007f1c38c3241d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:109

History

#1 Updated by Jason Dillaman over 3 years ago

  • Status changed from New to Can't reproduce

Haven't seen failures during this test in recent memory.

Also available in: Atom PDF