Project

General

Profile

Actions
Copy link

Bug #54597

open

crash: int MonitorDBStore::apply_transaction(MonitorDBStore::TransactionRef): abort

Added by Telemetry Bot about 2 years ago. Updated 11 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Telemetry
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
Ceph - v15.2.1, Ceph - v15.2.10, Ceph - v15.2.11, Ceph - v15.2.13, Ceph - v15.2.14, Ceph - v15.2.15, Ceph - v15.2.16, Ceph - v15.2.17, Ceph - v15.2.4, Ceph - v15.2.5, Ceph - v15.2.6, Ceph - v15.2.7, Ceph - v15.2.8, Ceph - v15.2.9, Ceph - v16.2.0, Ceph - v16.2.1, Ceph - v16.2.10, Ceph - v16.2.2, Ceph - v16.2.3, Ceph - v16.2.4, Ceph - v16.2.5, Ceph - v16.2.6, Ceph - v16.2.7, Ceph - v16.2.9, Ceph - v17.2.1, Ceph - v17.2.3, Ceph - v17.2.5
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):

604825b668efd0c914849c40f8d026f419e1eef664a7dfe54345d5e8ad2fde04
9b790daf7f8b3aed83306fd652f31f4705bf890f4fdf9e59c1f8f9a8a5a8ce64
9f138c39ff09273c4f297dd4e2fbd370aa653643ece0f00dfff3ee5047acaa92
09d6931a58a85b94b06306757b70983c7455a1b5d6f4bff191ed236aaacf5cea
0e0994daeb33d8a14a773206edf08ca68b49169c6696040dc14f1c7b549b0bf9
20c3e0d8590fe18bcd803d5cae2b83bfe110fa44b409848218a0de3c43231da7
218a9d1449e0e6c17566db274b394684236bb9ad510dd12e42c0fa45ea4ec636
29d05fdc011395762e51ec239d0b80be233a9c2ef8d1d1eeb83c7063f587a566
2bcfdf9b33cca3545806e57534cb38b7d9e69ac1914596d4f5ea76d6730b5fae
2c617e33a17c683fd90b2f6afe7cde37203c4c2676fc336ff4359c782c7d021c
4d321f3c2e56ab4260830141ea68f5f8e169488c3cdf62b0290746ebbb8dc51f
4fd72e3b395e9fb7eb74be7b03b665db8e3b7846eae740b9f687c0a582c7d744
5234f7c91f4673b69a1f8d5375fe2aa8b8e12920085a5f9b9bbaf31fd7c0729f
5d4a92c4ce3da660d0246f3cd8ba32d527b8521f605dab445c4a60d95e0067eb
5f7ea6b645b4ea706e18040fb03be5c4774a35606f9c9c74ac115f478640775e
60ce53759a0bc2a54baf455ac01df4aefa9f4aaf1867011391b1d98f91f654b6
6559e061fb934b7536cfc81caeeef1627e2612ed4003a705dbc95c0eca6cb8c4
6654c61b6b966963b09e6c3bab0ff6de014838ea259da76e2f8260535688a50e
6ba8037a984b4a14e3dbba488bb2942babcaf67552a411c1c2d22742a5633b4b
712792a8179a05d8c011a2a2ec68cb205e951b5e43249ab06be966f782691075
8a9b414f1d53bf0ee0bfd4f1b37a8af175cc4f09063d8b0e375d3bf39fb81785
8bb7aa74655078b80ad61f67180003de611ba72e271713524ef084733ef20eb5
91055c73f99a913a00025596a9a333d26ce0e97e250bd6e7c1491cc32d32d35c
9a411a500ba2cbc1542a0a701e7a3f366be515ee32cc75c60b0d4322512fbfc4
bf1ae83c5641ba9ec8e1ee50cb83df053c62b20e9594d765535f6d909ce9f962
bf1c5f3aea2aa3406a4ca53005704a9e1ae6700bb6af883c6469608e70a3de5b
c944ab4ecb748632432ac08921771eb100c2c3892f214a6b5f98ab2b5403122c
cc95b289941194258c936f9b72fde8f1f57502a4531daeda4db0234248108842
cdb6e5e5e6ec3091ac6381ed434ab32d6453088753f982cc8038754c7b5fb860
cebe01092979a8c9895f3918491557268bb5b53215c671cc1dc094df26a13776
d0a30c225820681a71ab6d9bfcb3e27ef53e8c11230398f7e08ca318d18f6913
e0d46303bdf6e6f6f7d7813fde617da7e8482c8f3fa432257e02f023a1327496
e7221dcc149ca8c31a61588bbead640ff11c92f8107548f2caa6aba9d2da9390
ea67d850f949e5bf4b4dc1c5709b9c8bc1f60264227ed73d1c3e80390e9d914f
ed691ffcf1c3a5cd1619fbc2e091e2b7a79cebc63b158e5dad2d9c3b0d9b0f92
f8487f74c2417f0fb35b0c256c6ad2cb7ce91559bd627f21d8b6455299ef67a2
ff823ceb41dbf77fa60d02718f4bd8c02fc93c7c217a54c055d92fe160b12cc3
165c1be94f03ec4969972d8bac7660a9ff64599759796b9c588c7ade06f3447c
22da1c3792812ba6401a6f9dfeeeaf80b926c14e6ee2a6ccfe021f7155f2ef07
5fd40d6741e9323b4e63c415b96efdc2cc3fb094476e4157bb3c2659e9b2f373
7756549b4d4c9e7aa5049cf55d10252540aca2868cecc479156843c5c51e022f
97f643cc344c782b840caa978ee4e68d6bc053db6176177ab7ab983bb4712b7d
9a7f296bea19993d38b83004698d592f110a53097d80fa991920078e8b955336
9d846674c06384997cc42a026b0912e5816c4f2f31c8255aadd437e0777e3295
bcbca5c402055722db5cf3aafb400b7028aca9e1080a66f1d6ffacfc7d48e58e
bf2920e351c9ec01c0dd731058b4b3a3f0aa25f8a1b824f9041ce3e323a60aeb
04cd533902d944e5b2a7e4da361da5c7ef8366bd7813ad7d4968b43b00e69cbc
208a12e6a81482074348a60d04b61f7b5a2cec2c53d91908e1837c3f0df39448
290633780dbe9e0d33e1ab92d6d794c36d46eac1af0d04d44c2100de2ec1885e
2f93fccdd629bc16d6e6a0f4e0fe025f19aafb860bbeca01637d5ad01e894d4d
9286aa50477ac81711e08a3b9d66a0c26bcf5689f5d699d63063f9ee81918f75
bcd863a509194e0b6d2f81993fbec45e98bf7e52754d9fe66c47ba48aa65cd15
e380ae02796e5920d75ba4d8ff95269ccc37f185094262e30c3d4b5d7cdad176
e3bcc7fbfcadb417a74d7d5da794c8ee7d8d3bbfab0984fdb79ba3f7e22eac3e
f3f698cf1e613c4e67624b47440f2317647472286c72409c0d15f631bd1014e0

Crash signature (v2):

0e30953dcdc4a62c14603730081d0bf10e4058dfca4f714496d15999f8565337

Description

New crash events were reported via Telemetry with newer versions (['16.2.6', '16.2.7']) than encountered in Tracker (16.2.5).

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=9f138c39ff09273c4f297dd4e2fbd370aa653643ece0f00dfff3ee5047acaa92

Assert condition: abort
Assert function: int MonitorDBStore::apply_transaction(MonitorDBStore::TransactionRef)

Sanitized backtrace:

    /lib/x86_64-linux-gnu/libpthread.so.0(
    MonitorDBStore::apply_transaction(std::shared_ptr<MonitorDBStore::Transaction>)
    Monitor::handle_sync_chunk(boost::intrusive_ptr<MonOpRequest>)
    Monitor::handle_sync(boost::intrusive_ptr<MonOpRequest>)
    Monitor::dispatch_op(boost::intrusive_ptr<MonOpRequest>)
    Monitor::_ms_dispatch(Message*)
    Dispatcher::ms_dispatch2(boost::intrusive_ptr<Message> const&)
    Messenger::ms_deliver_dispatch(boost::intrusive_ptr<Message> const&)
    DispatchQueue::entry()
    DispatchQueue::DispatchThread::entry()
    /lib/x86_64-linux-gnu/libpthread.so.0(
    clone()

Crash dump sample:
{
    "archived": "2022-02-12 19:26:35.405714",
    "assert_condition": "abort",
    "assert_file": "mon/MonitorDBStore.h",
    "assert_func": "int MonitorDBStore::apply_transaction(MonitorDBStore::TransactionRef)",
    "assert_line": 351,
    "assert_msg": "mon/MonitorDBStore.h: In function 'int MonitorDBStore::apply_transaction(MonitorDBStore::TransactionRef)' thread 7f144d73e700 time 2022-02-11T17:47:43.094253-0600\nmon/MonitorDBStore.h: 351: ceph_abort_msg(\"failed to write to db\")",
    "assert_thread_name": "ms_dispatch",
    "backtrace": [
        "/lib/x86_64-linux-gnu/libpthread.so.0(+0x14140) [0x7f14563db140]",
        "gsignal()",
        "abort()",
        "(ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0x18a) [0x7f14568f96f6]",
        "(MonitorDBStore::apply_transaction(std::shared_ptr<MonitorDBStore::Transaction>)+0x88c) [0x55becdaec52c]",
        "(Monitor::handle_sync_chunk(boost::intrusive_ptr<MonOpRequest>)+0x3e8) [0x55becdaade38]",
        "(Monitor::handle_sync(boost::intrusive_ptr<MonOpRequest>)+0x9d) [0x55becdaae6cd]",
        "(Monitor::dispatch_op(boost::intrusive_ptr<MonOpRequest>)+0xe6f) [0x55becdabe7df]",
        "(Monitor::_ms_dispatch(Message*)+0x41e) [0x55becdabf11e]",
        "(Dispatcher::ms_dispatch2(boost::intrusive_ptr<Message> const&)+0x59) [0x55becdaedcb9]",
        "(Messenger::ms_deliver_dispatch(boost::intrusive_ptr<Message> const&)+0x468) [0x7f1456b27478]",
        "(DispatchQueue::entry()+0x5ef) [0x7f1456b24b7f]",
        "(DispatchQueue::DispatchThread::entry()+0xd) [0x7f1456be39bd]",
        "/lib/x86_64-linux-gnu/libpthread.so.0(+0x8ea7) [0x7f14563cfea7]",
        "clone()" 
    ],
    "ceph_version": "16.2.7",
    "crash_id": "2022-02-11T23:47:43.101859Z_fa38822b-af04-424b-8dd2-b500d5193062",
    "entity_name": "mon.1c31117333a964849db367c394331d21a102a7d5",
    "os_id": "11",
    "os_name": "Debian GNU/Linux 11 (bullseye)",
    "os_version": "11 (bullseye)",
    "os_version_id": "11",
    "process_name": "ceph-mon",
    "stack_sig": "9b790daf7f8b3aed83306fd652f31f4705bf890f4fdf9e59c1f8f9a8a5a8ce64",
    "timestamp": "2022-02-11T23:47:43.101859Z",
    "utsname_machine": "x86_64",
    "utsname_release": "5.13.19-2-pve",
    "utsname_sysname": "Linux",
    "utsname_version": "#1 SMP PVE 5.13.19-4 (Mon, 29 Nov 2021 12:10:09 +0100)" 
}

Related issues 1 (0 open — 1 closed)

Related to RADOS - Bug #52193: crash: int MonitorDBStore::apply_transaction(MonitorDBStore::TransactionRef): abortRejected

Actions
Actions
Copy link
 #1

Updated by Telemetry Bot about 2 years ago

  • Related to Bug #52193: crash: int MonitorDBStore::apply_transaction(MonitorDBStore::TransactionRef): abort added
Actions
Copy link
 #2

Updated by Telemetry Bot about 2 years ago

  • Crash signature (v1) updated (diff)
  • Crash signature (v2) updated (diff)
  • Affected Versions v16.2.0, v16.2.1, v16.2.2, v16.2.4, v16.2.5, v16.2.6, v16.2.7 added
Actions
Copy link
 #3

Updated by Telemetry Bot about 2 years ago

  • Crash signature (v1) updated (diff)
  • Crash signature (v2) updated (diff)
Actions
Copy link
 #4

Updated by Telemetry Bot about 2 years ago

  • Crash signature (v1) updated (diff)
  • Affected Versions v15.2.1, v15.2.10, v15.2.11, v15.2.13, v15.2.14, v15.2.15, v15.2.4, v15.2.5, v15.2.6, v15.2.7, v15.2.8, v15.2.9, v16.2.3 added
Actions
Copy link
 #5

Updated by Telemetry Bot over 1 year ago

  • Crash signature (v1) updated (diff)
  • Affected Versions v15.2.16, v16.2.9 added
Actions
Copy link
 #6

Updated by Telemetry Bot 11 months ago

  • Crash signature (v1) updated (diff)
  • Affected Versions v15.2.17, v16.2.10, v17.2.1, v17.2.3, v17.2.5 added
Actions
Copy link

Also available in: Atom PDF