Ceph » rbd

The assertion for "ceph_assert(m_in_flight_callbacks)" can fail in "notify_handler_unlock" if two callbacks race. It's possible a flush request arrived while "handle_append_flushed" had dropped the lock for callbacks but before it could notify the handler.

#2  0x00007f46cf3b5877 in ceph::__ceph_assert_fail (assertion=<optimized out>, file=<optimized out>, line=<optimized out>, 
    func=0x7f46dd5e3980 <journal::ObjectRecorder::notify_handler_unlock(std::unique_lock<std::mutex>&, bool)::__PRETTY_FUNCTION__> "void journal::ObjectRecorder::notify_handler_unlock(std::unique_lock<std::mutex>&, bool)")
    at /usr/src/debug/ceph-16.0.0-6312.gc1613349.el8.x86_64/src/common/assert.cc:75
#3  0x00007f46cf3b5a40 in ceph::__ceph_assert_fail (ctx=...) at /usr/src/debug/ceph-16.0.0-6312.gc1613349.el8.x86_64/src/common/assert.cc:80
#4  0x00007f46dd4acf7e in journal::ObjectRecorder::notify_handler_unlock (this=<optimized out>, locker=..., notify_overflowed=<optimized out>) at /usr/src/debug/ceph-16.0.0-6312.gc1613349.el8.x86_64/src/log/Entry.h:35
#5  0x00007f46dd4b2b69 in journal::ObjectRecorder::handle_append_flushed (this=0x7f4570002b10, tid=<optimized out>, r=<optimized out>) at /usr/src/debug/ceph-16.0.0-6312.gc1613349.el8.x86_64/src/journal/ObjectRecorder.cc:239
#6  0x00007f46dd4b3628 in Context::complete (r=<optimized out>, this=0x7f46883902b0) at /usr/src/debug/ceph-16.0.0-6312.gc1613349.el8.x86_64/src/include/Context.h:99

m_overflowed = true
m_object_closed = true
m_object_closed_notify = true <---- implies 'ObjectRecorder::closed()' was invoked while IO in-flight or callback in-flight
m_in_flight_callbacks = false
m_in_flight_tids = std::set with 1 element = {[0] = 231}