Bug #60343: crash: void MDCache::handle_cache_rejoin_ack(ceph::cref_t<MMDSCacheRejoin>&): assert(isolated_inodes.empty()) - CephFS - Ceph

Actions

Copy link

Bug #60343

open

crash: void MDCache::handle_cache_rejoin_ack(ceph::cref_t<MMDSCacheRejoin>&): assert(isolated_inodes.empty())

Added by Telemetry Bot 11 months ago. Updated 10 months ago.

Status:

New

Priority:

Normal

Assignee:

Kotresh Hiremath Ravishankar

Category:

Target version:

% Done:

Source:

Telemetry

Tags:

Backport:

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

Ceph - v17.2.5

ceph-qa-suite:

Component(FS):

Labels (FS):

Pull request ID:

Crash signature (v1):

c8c9f9364aeaebdd4a10eb84f9e04f3d9a5967b2c54e4dda53494d173e5dad1d

Crash signature (v2):

374c1bb49952f4c442a939bbc3cdb6dda1d4d3e1fec24ada920456bde077d887

Description

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=374c1bb49952f4c442a939bbc3cdb6dda1d4d3e1fec24ada920456bde077d887

Assert condition: isolated_inodes.empty()
Assert function: void MDCache::handle_cache_rejoin_ack(ceph::cref_t<MMDSCacheRejoin>&)

Sanitized backtrace:

    MDCache::handle_cache_rejoin_ack(boost::intrusive_ptr<MMDSCacheRejoin const> const&)
    MDCache::dispatch(boost::intrusive_ptr<Message const> const&)
    MDSRank::_dispatch(boost::intrusive_ptr<Message const> const&, bool)
    MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr<Message const> const&)
    MDSDaemon::ms_dispatch2(boost::intrusive_ptr<Message> const&)
    DispatchQueue::entry()
    DispatchQueue::DispatchThread::entry()

Crash dump sample:

{
    "archived": "2023-01-31 16:32:57.578904",
    "assert_condition": "isolated_inodes.empty()",
    "assert_file": "mds/MDCache.cc",
    "assert_func": "void MDCache::handle_cache_rejoin_ack(ceph::cref_t<MMDSCacheRejoin>&)",
    "assert_line": 5149,
    "assert_msg": "mds/MDCache.cc: In function 'void MDCache::handle_cache_rejoin_ack(ceph::cref_t<MMDSCacheRejoin>&)' thread 7f4c0162a700 time 2023-01-31T14:54:58.582763+0000\nmds/MDCache.cc: 5149: FAILED ceph_assert(isolated_inodes.empty())",
    "assert_thread_name": "ms_dispatch",
    "backtrace": [
        "/lib64/libpthread.so.0(+0x12cf0) [0x7f4c09050cf0]",
        "gsignal()",
        "abort()",
        "(ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x18f) [0x7f4c0a056499]",
        "/usr/lib64/ceph/libceph-common.so.2(+0x269605) [0x7f4c0a056605]",
        "(MDCache::handle_cache_rejoin_ack(boost::intrusive_ptr<MMDSCacheRejoin const> const&)+0x2454) [0x555fa720d244]",
        "(MDCache::dispatch(boost::intrusive_ptr<Message const> const&)+0x3d4) [0x555fa7231014]",
        "(MDSRank::_dispatch(boost::intrusive_ptr<Message const> const&, bool)+0x5db) [0x555fa70a81cb]",
        "(MDSRankDispatcher::ms_dispatch(boost::intrusive_ptr<Message const> const&)+0x5c) [0x555fa70a880c]",
        "(MDSDaemon::ms_dispatch2(boost::intrusive_ptr<Message> const&)+0x1bf) [0x555fa70925ff]",
        "(Messenger::ms_deliver_dispatch(boost::intrusive_ptr<Message> const&)+0x478) [0x7f4c0a2d0c88]",
        "(DispatchQueue::entry()+0x50f) [0x7f4c0a2ce0cf]",
        "(DispatchQueue::DispatchThread::entry()+0x11) [0x7f4c0a3958f1]",
        "/lib64/libpthread.so.0(+0x81cf) [0x7f4c090461cf]",
        "clone()" 
    ],
    "ceph_version": "17.2.5",
    "crash_id": "2023-01-31T14:54:58.585167Z_7321f0ff-3174-4f74-b487-4b45161efe86",
    "entity_name": "mds.9e68a8635d95f76c5eafd52b2fb675f920305c5a",
    "os_id": "almalinux",
    "os_name": "AlmaLinux",
    "os_version": "8.7 (Stone Smilodon)",
    "os_version_id": "8.7",
    "process_name": "ceph-mds",
    "stack_sig": "c8c9f9364aeaebdd4a10eb84f9e04f3d9a5967b2c54e4dda53494d173e5dad1d",
    "timestamp": "2023-01-31T14:54:58.585167Z",
    "utsname_machine": "x86_64",
    "utsname_release": "4.18.0-425.10.1.el8_7.x86_64",
    "utsname_sysname": "Linux",
    "utsname_version": "#1 SMP Thu Jan 12 10:05:00 EST 2023" 
}