Project

General

Profile

Actions

Bug #56229

open

crash: virtual int RocksDBStore::get(const string&, const char*, size_t, ceph::bufferlist*): abort

Added by Telemetry Bot almost 2 years ago. Updated over 1 year ago.

Status:
New
Priority:
Normal
Assignee:
-
Target version:
-
% Done:

0%

Source:
Telemetry
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):

c34bab069413d5bd5ebbe36d1242c4f0488a6ee2f05c5e4d682d83937bc5c5ba
d12efae855ddefbde53c2b4a28aab415bff6c75843198c6561ddde42f5664432


Description

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=1f15cfefd8f91b31dca036b0c56da794fc0506a89a30d08eb7d7aa4760b44f1d

Assert condition: abort
Assert function: virtual int RocksDBStore::get(const string&, const char*, size_t, ceph::bufferlist*)

Sanitized backtrace:

    RocksDBStore::get(std::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, char const*, unsigned long, ceph::buffer::list*)
    BlueStore::Collection::get_onode(ghobject_t const&, bool, bool)
    BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)
    BlueStore::queue_transactions(boost::intrusive_ptr<ObjectStore::CollectionImpl>&, std::vector<ceph::os::Transaction, std::allocator<ceph::os::Transaction> >&, boost::intrusive_ptr<TrackedOp>, ThreadPool::TPHandle*)
    ObjectStore::queue_transaction(boost::intrusive_ptr<ObjectStore::CollectionImpl>&, ceph::os::Transaction&&, boost::intrusive_ptr<TrackedOp>, ThreadPool::TPHandle*)
    OSD::dispatch_context(PeeringCtx&, PG*, std::shared_ptr<OSDMap const>, ThreadPool::TPHandle*)
    OSD::handle_pg_create_info(std::shared_ptr<OSDMap const> const&, PGCreateInfo const*)
    OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)
    ShardedThreadPool::shardedthreadpool_worker(unsigned int)
    ShardedThreadPool::WorkThreadSharded::entry()

Crash dump sample:
{
    "archived": "2022-06-08 10:22:26.455063",
    "assert_condition": "abort",
    "assert_file": "kv/RocksDBStore.cc",
    "assert_func": "virtual int RocksDBStore::get(const string&, const char*, size_t, ceph::bufferlist*)",
    "assert_line": 1939,
    "assert_msg": "kv/RocksDBStore.cc: In function 'virtual int RocksDBStore::get(const string&, const char*, size_t, ceph::bufferlist*)' thread 7f826bf65700 time 2022-06-08T10:31:25.712390+0100\nkv/RocksDBStore.cc: 1939: ceph_abort_msg(\"block checksum mismatch: expected 3786604747, got 2324967102  in db/225090.sst offset 67363189 size 852333\")",
    "assert_thread_name": "tp_osd_tp",
    "backtrace": [
        "/lib64/libpthread.so.0(+0x12c20) [0x7f8290708c20]",
        "gsignal()",
        "abort()",
        "(ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0x1b6) [0x55c6c79dbf6d]",
        "(RocksDBStore::get(std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, char const*, unsigned long, ceph::buffer::v15_2_0::list*)+0x44f) [0x55c6c8554b2f]",
        "(BlueStore::Collection::get_onode(ghobject_t const&, bool, bool)+0x3c2) [0x55c6c8001d92]",
        "(BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Transaction*)+0x1124) [0x55c6c8026304]",
        "(BlueStore::queue_transactions(boost::intrusive_ptr<ObjectStore::CollectionImpl>&, std::vector<ceph::os::Transaction, std::allocator<ceph::os::Transaction> >&, boost::intrusive_ptr<TrackedOp>, ThreadPool::TPHandle*)+0x316) [0x55c6c80426f6]",
        "(ObjectStore::queue_transaction(boost::intrusive_ptr<ObjectStore::CollectionImpl>&, ceph::os::Transaction&&, boost::intrusive_ptr<TrackedOp>, ThreadPool::TPHandle*)+0x85) [0x55c6c7b4bed5]",
        "(OSD::dispatch_context(PeeringCtx&, PG*, std::shared_ptr<OSDMap const>, ThreadPool::TPHandle*)+0xf3) [0x55c6c7ae0dd3]",
        "(OSD::handle_pg_create_info(std::shared_ptr<OSDMap const> const&, PGCreateInfo const*)+0x737) [0x55c6c7ae1bf7]",
        "(OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x33fa) [0x55c6c7b04cba]",
        "(ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x5c4) [0x55c6c817f2c4]",
        "(ShardedThreadPool::WorkThreadSharded::entry()+0x14) [0x55c6c81821a4]",
        "/lib64/libpthread.so.0(+0x817a) [0x7f82906fe17a]",
        "clone()" 
    ],
    "ceph_version": "16.2.9",
    "crash_id": "2022-06-08T09:31:25.731278Z_ae1138df-055f-4094-937a-eb27d58bf128",
    "entity_name": "osd.6de685dedeb44a0b7a31fe1a0c58c3973948e8d6",
    "os_id": "rocky",
    "os_name": "Rocky Linux",
    "os_version": "8.5 (Green Obsidian)",
    "os_version_id": "8.5",
    "process_name": "ceph-osd",
    "stack_sig": "c34bab069413d5bd5ebbe36d1242c4f0488a6ee2f05c5e4d682d83937bc5c5ba",
    "timestamp": "2022-06-08T09:31:25.731278Z",
    "utsname_machine": "x86_64",
    "utsname_release": "4.18.0-348.23.1.el8_5.x86_64",
    "utsname_sysname": "Linux",
    "utsname_version": "#1 SMP Wed Apr 27 15:32:52 UTC 2022" 
}

Actions #1

Updated by Telemetry Bot almost 2 years ago

  • Crash signature (v1) updated (diff)
  • Crash signature (v2) updated (diff)
  • Affected Versions v15.2.10, v16.2.9 added
Actions

Also available in: Atom PDF