Project

General

Profile

Bug #52139

crash: virtual int KernelDevice::flush(): abort

Added by Telemetry Bot 4 months ago. Updated 4 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Target version:
-
% Done:

0%

Source:
Telemetry
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):

03a9a51810f318ea6f9b15b7132d3d1ac25af27001d5ee73618f1af4a5d9fe64
0bbbc57e894b1a9b9a7c0f08821e4adf69cbc3d81652c2aa2022463390b8430c
0f09dfcb0431330b0d030251f07ad43684fe56921567287bd5805513e30a8492
1553d6dd6c4cc408890059d113cf2640ff88167fcce2cd073e10ad5f1519b343
18ec1763993eed21d68c1277f9e00f25d89d23c6c385aa644ecef367c9f2e90f
19cebafb53865c2dbe55926324005ef5aff27178507702bb2368767d02d5ed9a
1cfc7a64257274b4abed07e2e5dc04697bc14e910a21cf1af7a28328a5ebd031
23225243f8fedd2bc429a19e5ebcbc42fa8bc0a314b3ebba53991d7ec4a081a3
29f5394964f2dfc6f75e3dfd6f08defcd8f6990acf99cb7f1bf2b0fc13a2129e
3027d96183f028e7820fbed314989ef2cb88f4120578150d9d045eddc1d12376
42af8a54902b8a7bad18d426514b1e8a5bcf3c325c3c15c670581dbdb1eb3ac2
488b2ce8a972db4d13f9f054d88b6cc5852095b854fb1dbefcc94ebc943a6b0c
4c4f5dd7913ed1f66092be9fcba7f860d6e1e8e85425369a81552e045f4b6376
4caea5a9450b0852665603589abd2386f9127d07c0a3d2172807013c973aea33
532d014ad227b9a7f0ec09a6a2701b9d3773cda2b5112a900767ba46bd7faec2
555382519e7fc3baaf7b686c01e1d59ecb203dabecee3c31193cf39f2f48637f
58035d75b5a289c8c7799e0f6b30a266ed1e7ef60f160cb320485eff94a55635
5ea04b8a9a9324247cb9ade0cfb45a74ba8ff9655e2b7915951e3237a8586f63
5f19a0a516a3899123556d30fe20f52fda47da92f997359f78d0cb6af1f12f55
618abdaf11afc5d0f215cfc758228b86189afb5cc08d40b698c576bedb0d8202
62509c6694393d3649af09283a83b947ec95d24c77a060cd8029872e56daa32e
67c3c30903bcedf7aaa5071ee86cd88d9b9b19e16d0762183727456c19b41c3a
77645ec32ee64a8c7d27867f23b91dbbc1425ae96dfc86ee92fda0f3bbdb614e
77ba6623e51d6e0994118ebc3536c716cc776b9c4c59155b429713d5d117f8fd
77e17a98342abad9f812518d7bf20b6c5c53ee4082d298d6fd810323711191ac
7afc1c334661b410d5ed708b5a752863a857388396e215b770cd53460755a013
960dafa9377b2db297a4e3215e7679bb713f1b13e187e2c5420110e6dca4106b
96df23137fcc425e9090eacd5e966aa467d8d20766db8462c0832599b601552c
9bbb0a0bf40ae6359e2aff15facd22599e0461185280ad75983f559ba2a23766
9ce5b836b3e0e7213b8938dd048631f8f002c76069e69b88c52a1d140a1f1a49
a1e6179da79ec8bcc3e3600318435ac3e3bdd2026aeb87cbca385ec9b0a31367
a824c348a148cf5eaf8b123aea72b5043de2113986e9e1b736e68c00787db39b
b07c22ae474256b82ffc94c2319fa47511210f4fb8c89d889e4b394653879713
b0ea1c43d298deca6f6dad0110f1082cd7d1c2354eb52c0fd93b880af5bfee52
b25dceff466bf53be5a9a67126669ee62847e3851f97dba75a2d6f17bcb428ec
b3b5f897a2c7f9edc7561b3e13b8fd15adb492a1e985708105f3701907465515
be708843a7ab0100fb3f028e810fa80e3927c3a43d2dce52697aad4a2461d1f5
c860b135a25bf72c077144e34cb1c399f2664b7c0c8a9090cb5ee3270359f217
d46fb62699fdc0ad15be089cbc669af76cb7a68cd7a5fa793c548ed6d22bb1da
d6291d7c4bbbdddc2e0ac96b1e1f4b4dcff4c3656f6ed55206fafd01d1794e47
e14e35f7454bd3dd07c06d392f76f4a5f68bd20d087ef5fbb89afdb2dee256c4
e16c5e8bd5c45bf4731932c78926fec86353dd79973b3c5bacbc30895dd0998d
e21087d047d09fc70f1bdab3b549f1cf18e34b5d5b22f6a31a2b2b12d632aaee
f1b5b1a9661204536bfb1c5b39c68b5e3decc780151464ce35d759978a04d08f
f6a9a6940798ef44b98143e4815be201513a728a201461abeb659f7b8bc59a32
1ee75ba88c2fc47c28f06669c769a6c9e3f19a2b6c87fd5fd72b5c98b9f92c4f
e24a7dd4c54247d9824d39c66d051249cb6dbb80d07bc399690d12eaf2eb3431

Crash signature (v2):

fff55d7102994e1ed007bcdb4842e28bfe05deda13d293057ec5eba41daccce8


Description

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=fff55d7102994e1ed007bcdb4842e28bfe05deda13d293057ec5eba41daccce8

Assert condition: abort
Assert function: virtual int KernelDevice::flush()

Sanitized backtrace:

    KernelDevice::flush()
    BlueFS::flush_bdev(std::array<bool, 5ul>&)
    BlueFS::_flush_bdev_safely(BlueFS::FileWriter*)
    BlueFS::_fsync(BlueFS::FileWriter*, std::unique_lock<std::mutex>&)
    BlueRocksWritableFile::Sync()
    rocksdb::WritableFileWriter::SyncInternal(bool)
    rocksdb::WritableFileWriter::Sync(bool)
    rocksdb::DBImpl::WriteToWAL(rocksdb::WriteThread::WriteGroup const&, rocksdb::log::Writer*, unsigned long*, bool, bool, unsigned long)
    rocksdb::DBImpl::WriteImpl(rocksdb::WriteOptions const&, rocksdb::WriteBatch*, rocksdb::WriteCallback*, unsigned long*, unsigned long, bool, unsigned long*, unsigned long, rocksdb::PreReleaseCallback*)
    rocksdb::DBImpl::Write(rocksdb::WriteOptions const&, rocksdb::WriteBatch*)
    RocksDBStore::submit_common(rocksdb::WriteOptions&, std::shared_ptr<KeyValueDB::TransactionImpl>)
    RocksDBStore::submit_transaction_sync(std::shared_ptr<KeyValueDB::TransactionImpl>)
    BlueStore::_kv_sync_thread()
    BlueStore::KVSyncThread::entry()
    clone()

Crash dump sample:
{
    "assert_condition": "abort",
    "assert_file": "os/bluestore/KernelDevice.cc",
    "assert_func": "virtual int KernelDevice::flush()",
    "assert_line": 435,
    "assert_msg": "os/bluestore/KernelDevice.cc: In function 'virtual int KernelDevice::flush()' thread 7f9dda039700 time 2021-07-16T17:27:29.156318-0300\nos/bluestore/KernelDevice.cc: 435: ceph_abort_msg(\"abort() called\")",
    "assert_thread_name": "bstore_kv_sync",
    "backtrace": [
        "(()+0x12730) [0x7f9dead9e730]",
        "(gsignal()+0x10b) [0x7f9dea87f7bb]",
        "(abort()+0x121) [0x7f9dea86a535]",
        "(ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0x1b2) [0x55f3b0d86243]",
        "(KernelDevice::flush()+0x589) [0x55f3b13e4d19]",
        "(BlueFS::flush_bdev(std::array<bool, 5ul>&)+0x4b) [0x55f3b13978bb]",
        "(BlueFS::_flush_bdev_safely(BlueFS::FileWriter*)+0x11a) [0x55f3b1397aca]",
        "(BlueFS::_fsync(BlueFS::FileWriter*, std::unique_lock<std::mutex>&)+0x1a0) [0x55f3b139dfb0]",
        "(BlueRocksWritableFile::Sync()+0x6c) [0x55f3b13c762c]",
        "(rocksdb::WritableFileWriter::SyncInternal(bool)+0x1b4) [0x55f3b1a56dd6]",
        "(rocksdb::WritableFileWriter::Sync(bool)+0x18c) [0x55f3b1a56840]",
        "(rocksdb::DBImpl::WriteToWAL(rocksdb::WriteThread::WriteGroup const&, rocksdb::log::Writer*, unsigned long*, bool, bool, unsigned long)+0x363) [0x55f3b18479e7]",
        "(rocksdb::DBImpl::WriteImpl(rocksdb::WriteOptions const&, rocksdb::WriteBatch*, rocksdb::WriteCallback*, unsigned long*, unsigned long, bool, unsigned long*, unsigned long, rocksdb::PreReleaseCallback*)+0xf31) [0x55f3b18445ed]",
        "(rocksdb::DBImpl::Write(rocksdb::WriteOptions const&, rocksdb::WriteBatch*)+0x4a) [0x55f3b1843658]",
        "(RocksDBStore::submit_common(rocksdb::WriteOptions&, std::shared_ptr<KeyValueDB::TransactionImpl>)+0x88) [0x55f3b17cbb48]",
        "(RocksDBStore::submit_transaction_sync(std::shared_ptr<KeyValueDB::TransactionImpl>)+0x8c) [0x55f3b17cc48c]",
        "(BlueStore::_kv_sync_thread()+0x31fa) [0x55f3b130bd7a]",
        "(BlueStore::KVSyncThread::entry()+0xd) [0x55f3b13326ad]",
        "(()+0x7fa3) [0x7f9dead93fa3]",
        "(clone()+0x3f) [0x7f9dea9414cf]" 
    ],
    "ceph_version": "15.2.13",
    "crash_id": "2021-07-16T20:27:29.205447Z_d9ed70ec-f99d-45e4-a70d-5d5f2b20becb",
    "entity_name": "osd.1e05e2d508bff7fd28347b94959542a8965aed85",
    "os_id": "10",
    "os_name": "Debian GNU/Linux 10 (buster)",
    "os_version": "10 (buster)",
    "os_version_id": "10",
    "process_name": "ceph-osd",
    "stack_sig": "58035d75b5a289c8c7799e0f6b30a266ed1e7ef60f160cb320485eff94a55635",
    "timestamp": "2021-07-16T20:27:29.205447Z",
    "utsname_machine": "x86_64",
    "utsname_release": "5.4.106-1-pve",
    "utsname_sysname": "Linux",
    "utsname_version": "#1 SMP PVE 5.4.106-1 (Fri, 19 Mar 2021 11:08:47 +0100)" 
}

History

#1 Updated by Telemetry Bot 4 months ago

  • Crash signature (v1) updated (diff)
  • Crash signature (v2) updated (diff)
  • Affected Versions v14.2.0, v14.2.1, v14.2.10, v14.2.11, v14.2.15, v14.2.18, v14.2.2, v14.2.4, v14.2.5, v14.2.6, v14.2.7, v14.2.8, v14.2.9, v15.2.10, v15.2.11, v15.2.12, v15.2.13, v15.2.3, v15.2.4, v15.2.5, v15.2.6, v15.2.7, v15.2.8, v15.2.9 added

#2 Updated by Telemetry Bot 4 months ago

  • Crash signature (v1) updated (diff)

Also available in: Atom PDF