Project

General

Profile

Activity

From 03/06/2022 to 04/04/2022

04/04/2022

06:41 PM Bug #55145 (Resolved): Bogus assert in SimpleBitmap
Neha Ojha
06:39 PM Bug #55145 (Pending Backport): Bogus assert in SimpleBitmap
Neha Ojha
06:38 PM Bug #55145: Bogus assert in SimpleBitmap
Neha Ojha wrote:
> Quincy backport: https://github.com/ceph/ceph/pull/45738 to expedite merge
merged
Yuri Weinstein
06:41 PM Backport #55180 (Resolved): quincy: Bogus assert in SimpleBitmap
Neha Ojha
06:40 PM Backport #55180 (Resolved): quincy: Bogus assert in SimpleBitmap
https://github.com/ceph/ceph/pull/45738 Backport Bot

04/01/2022

02:36 AM Bug #53184: failed to start new osd due to SIGSEGV in BlueStore::read()
Thank you for your investigation. That hypothesis seems to be correct. I understand that more detailed logs are neede... Yuma Ogami

03/31/2022

06:18 PM Bug #55145: Bogus assert in SimpleBitmap
Quincy backport: https://github.com/ceph/ceph/pull/45738 to expedite merge Neha Ojha
02:18 PM Bug #55145: Bogus assert in SimpleBitmap
Seen while upgrading the gibba cluster to 723fda64a662bb79871e590698268007049bcf7f Neha Ojha
11:57 AM Bug #55145 (Fix Under Review): Bogus assert in SimpleBitmap
Gabriel BenHanokh
10:19 AM Bug #55145 (Resolved): Bogus assert in SimpleBitmap
The boundary check in SimpleBitmap is off by one causing an assert to trigger... Gabriel BenHanokh
02:20 PM Bug #54615 (Closed): virtual int KernelDevice::read(uint64_t, uint64_t, ceph::bufferlist*, IOCont...
Adam Kupczyk
01:30 PM Bug #53184: failed to start new osd due to SIGSEGV in BlueStore::read()
Hi Yuma,
thanks a lot for new logs.
But it still looks like there is some gap between mkfs and osd startup during...
Igor Fedotov
10:07 AM Bug #55049: Can't start multiple OSD
Was able to access broken OSD with few "dummy" fix in BlueFS.cc . That was enough to bring OSD up with "custom" ceph-... Karol Murawski

03/28/2022

02:45 PM Bug #54288: rocksdb: Corruption: missing start of fragmented record
just to note: just seen another cluster suffering with the issue and recoverable through the proposed approach Igor Fedotov

03/26/2022

11:24 AM Bug #55049: Can't start multiple OSD
Dan van der Ster wrote:
> > checksum at blob offset 0x0, got 0x6706be76, expected 0xbe005cc8
>
> 0x6706be76 is ap...
Karol Murawski

03/25/2022

08:58 PM Feature #55031 (Resolved): Disable NCB functionality on rotational drives
Neha Ojha
08:58 PM Backport #55032 (Resolved): quincy: Disable NCB functionality on rotational drives
Neha Ojha
03:59 PM Bug #55049: Can't start multiple OSD
Another error:... Karol Murawski
11:32 AM Bug #55049: Can't start multiple OSD
Is there any option to bring up OSD from extracted RocksDB into dir? I can fix rocksdb but don't know how to import i... Karol Murawski
10:57 AM Bug #55049: Can't start multiple OSD
Few OSD more up: fsck -> repair -> OSDMap reimport
Maybe you know how to deal with:...
Karol Murawski
09:36 AM Bug #55049: Can't start multiple OSD
> checksum at blob offset 0x0, got 0x6706be76, expected 0xbe005cc8
0x6706be76 is apparently the checksum of all ze...
Dan van der Ster
08:33 AM Bug #55049: Can't start multiple OSD
osd.log... Pawel Korzybski

03/24/2022

08:19 PM Backport #55024: quincy: BlueFS broken sync compaction mode
Backport Bot wrote:
> https://github.com/ceph/ceph/pull/45600
merged
Yuri Weinstein
05:58 PM Bug #55049: Can't start multiple OSD
Could you provide an example osd log, backtrace from the first crash?
Is there anything relevant in the kernel logs ...
Dan van der Ster
05:30 PM Bug #55049: Can't start multiple OSD
... Karol Murawski
05:29 PM Bug #55049: Can't start multiple OSD
... Karol Murawski
05:19 PM Bug #55049 (New): Can't start multiple OSD
Problem occurred after multiple osd crash.
kernel: 5.15.27-1-pve...
Karol Murawski
08:33 AM Backport #55032 (In Progress): quincy: Disable NCB functionality on rotational drives
Gabriel BenHanokh
08:25 AM Backport #55032 (Resolved): quincy: Disable NCB functionality on rotational drives
https://github.com/ceph/ceph/pull/45615 Backport Bot
08:23 AM Feature #55031 (Pending Backport): Disable NCB functionality on rotational drives
Gabriel BenHanokh
08:22 AM Feature #55031 (Resolved): Disable NCB functionality on rotational drives
NCB code needs to recover allocation map after an OSD crash.
The recovery process on rotational drives is about 20x ...
Gabriel BenHanokh

03/23/2022

06:29 PM Backport #55024: quincy: BlueFS broken sync compaction mode
The core code has already been merged in:
https://github.com/ceph/ceph/pull/45342
Adam Kupczyk
06:15 PM Backport #55024 (In Progress): quincy: BlueFS broken sync compaction mode
Adam Kupczyk
05:55 PM Backport #55024 (Resolved): quincy: BlueFS broken sync compaction mode
https://github.com/ceph/ceph/pull/45600 Backport Bot
05:53 PM Bug #54465 (Pending Backport): BlueFS broken sync compaction mode
Adam Kupczyk
10:50 AM Bug #54615: virtual int KernelDevice::read(uint64_t, uint64_t, ceph::bufferlist*, IOContext*, boo...
@jing zhang - mind me closing the ticket? Igor Fedotov
09:09 AM Bug #54615: virtual int KernelDevice::read(uint64_t, uint64_t, ceph::bufferlist*, IOContext*, boo...
yes, the error is the same on every restart.
I found the dmesg output some error. I will try to fixit. super big t...
jing zhang
07:33 AM Bug #53184: failed to start new osd due to SIGSEGV in BlueStore::read()
> We are going to reproduce the problem by setting `bluefs-buffered-io=true`. And collect the log of the OSD pod imme... Yuma Ogami

03/22/2022

01:26 AM Bug #53184: failed to start new osd due to SIGSEGV in BlueStore::read()
> > 2) Can you try set bluefs-buffered-io to false and check if it's still reproducible?
> Yes, we can. We will try ...
Yuma Ogami

03/21/2022

02:03 PM Bug #54555 (Fix Under Review): ceph-bluestore-tool doesn't handle 'free-fragmentation' command
Igor Fedotov
12:04 PM Bug #54973 (Fix Under Review): Hybrid allocator might return duplicate extents when performing on...
Igor Fedotov
12:03 PM Bug #54973: Hybrid allocator might return duplicate extents when performing online free dump.
Generally this apparently has no impact for regular OSD operation but rather might results in an inconsistent free ex... Igor Fedotov
10:34 AM Bug #54973 (Resolved): Hybrid allocator might return duplicate extents when performing online fre...
The root cause is apparently a lack of proper multithreading synchronization when dumping. Igor Fedotov

03/19/2022

01:30 AM Bug #54964 (New): crash: BlueStore::_omap_setkeys(BlueStore::TransContext*, boost::intrusive_ptr<...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=7a03c0c080cce6f9a0fa5320...
Telemetry Bot
01:30 AM Bug #54963 (New): crash: BlueStore::Onode::calc_omap_key(unsigned char, BlueStore::Onode const*, ...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=5162aea587f97bc99d2ff046...
Telemetry Bot
01:30 AM Bug #54960 (New): crash: rocksdb::PerfStepTimer::Stop()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=227824643d6da1e98d64eae0...
Telemetry Bot
01:29 AM Bug #54957 (New): crash: virtual int RocksDBStore::get(const string&, const string&, ceph::buffer...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=2a186dd3c8bcd917714e0140...
Telemetry Bot
01:29 AM Bug #54956 (New): crash: pread64()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=39aece8706439188ecdf586f...
Telemetry Bot
01:29 AM Bug #54955 (New): crash: rocksdb::MergingIterator::NextAndGetResult(rocksdb::IterateResult*)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=24fce7b2273bf37e9fd79d61...
Telemetry Bot
01:29 AM Bug #54954 (New): crash: pthread_rwlock_wrlock()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=a6531dd22d25428bfe9fbdb4...
Telemetry Bot
01:29 AM Bug #54952 (New): crash: rocksdb::Status::operator=(rocksdb::Status const&)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=090d87ff523cd2b4830d00f8...
Telemetry Bot
01:29 AM Bug #54951 (New): crash: rocksdb::IteratorWrapperBase<rocksdb::Slice>::Next()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=5dc695447cc6c6b30d90fb0c...
Telemetry Bot
01:29 AM Bug #54948 (New): crash: virtual int KernelDevice::read(uint64_t, uint64_t, ceph::bufferlist*, IO...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=d4361d7c42f95d874a760b89...
Telemetry Bot
01:29 AM Bug #54945 (New): crash: virtual int KernelDevice::read(uint64_t, uint64_t, ceph::bufferlist*, IO...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=5a22a923304adbc924188e2c...
Telemetry Bot
01:29 AM Bug #54944 (New): crash: pread64()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=9c7595ecb66ca9cd0f49f835...
Telemetry Bot
01:29 AM Bug #54939 (New): crash: ceph::buffer::create_aligned(unsigned int, unsigned int)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=b7a25464e9d3392254267c4c...
Telemetry Bot
01:29 AM Bug #54936 (New): crash: virtual int RocksDBStore::get(const string&, const string&, ceph::buffer...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=f805dadadba86a64a33c02e4...
Telemetry Bot
01:29 AM Bug #54935 (New): crash: virtual int RocksDBStore::get(const string&, const char*, size_t, ceph::...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=42531dc59cfbbe17b00003cb...
Telemetry Bot
01:29 AM Bug #54934 (New): crash: int64_t BlueFS::_read_random(BlueFS::FileReader*, uint64_t, uint64_t, ch...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=15dd63805c94fa6c885ef357...
Telemetry Bot
01:29 AM Bug #54929 (New): crash: void BlueStore::_do_write_small(BlueStore::TransContext*, BlueStore::Col...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=de2b83c02c7c62399225865f...
Telemetry Bot
01:28 AM Bug #54927 (New): crash: rocksdb::BlockCacheLookupContext::~BlockCacheLookupContext()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=20099dcd6617b74687485ad7...
Telemetry Bot
01:28 AM Bug #54926 (New): crash: BlueStore::_omap_setkeys(BlueStore::TransContext*, boost::intrusive_ptr<...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=753efd411073e16a0d0f4ff6...
Telemetry Bot
01:28 AM Bug #54925 (New): crash: void BlueStore::_txc_apply_kv(BlueStore::TransContext*, bool): assert(r ...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=d83f5be97d510dc4daf41fbb...
Telemetry Bot
01:28 AM Bug #54921 (New): crash: int64_t BlueFS::_read(BlueFS::FileReader*, uint64_t, size_t, ceph::buffe...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=cbae7de3b19ea17f58201c6d...
Telemetry Bot
01:28 AM Bug #54920 (New): crash: pthread_rwlock_rdlock()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=212a531f7ba5fff24d24d89d...
Telemetry Bot
01:28 AM Bug #54919 (New): crash: rocksdb::autovector<rocksdb::IteratorWrapperBase<rocksdb::Slice>*, 8ul>:...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=28351afc91724baed2d56fa4...
Telemetry Bot
01:28 AM Bug #54916 (New): crash: rocksdb::BlockIter<rocksdb::Slice>::NextEntryOffset() const

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=7f95400474e42b1ac1b7c4f3...
Telemetry Bot
01:28 AM Bug #54915 (New): crash: pread64()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=aa2bf9c1788aa8d0ab162b9b...
Telemetry Bot
01:28 AM Bug #54914 (New): crash: rocksdb::DBIter::FindNextUserEntryInternal(bool, rocksdb::Slice const*)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=d19261d17abb644b6f580c6f...
Telemetry Bot
01:28 AM Bug #54912 (New): crash: pread64()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=e11c8cfc49315f6c3965b26b...
Telemetry Bot
01:28 AM Bug #54911 (New): crash: virtual int KernelDevice::read(uint64_t, uint64_t, ceph::bufferlist*, IO...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=219f7d6294727fc2ab5374a8...
Telemetry Bot
01:28 AM Bug #54898 (New): crash: virtual int KernelDevice::flush(): abort

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=3fd2db5b676c16d87740b149...
Telemetry Bot
01:27 AM Bug #54896 (New): crash: RocksDBStore::RocksDBWholeSpaceIteratorImpl::valid()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=99b903acc5293d08df7dc3ce...
Telemetry Bot
01:27 AM Bug #54895 (New): crash: pread64()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=8e294ec35fb26eed82c076b3...
Telemetry Bot
01:27 AM Bug #54894 (New): crash: virtual void KernelDevice::aio_submit(IOContext*): assert(r == 0)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=7b27016e4becc96febf011ac...
Telemetry Bot
01:27 AM Bug #54891 (New): crash: std::basic_ios<char, std::char_traits<char> >::clear(std::_Ios_Iostate)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=99d13974e0cf345b7e0a4c58...
Telemetry Bot
01:27 AM Bug #54890 (New): crash: ceph::buffer::ptr::release()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=2cc9d02fa6a785d76c976657...
Telemetry Bot
01:27 AM Bug #54889 (New): crash: mempool::pool_allocator<(mempool::pool_index_t), bluestore_pextent_t>::i...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=f9e86c894ec3c4a5c34fee95...
Telemetry Bot
01:27 AM Bug #54888 (New): crash: syscall()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=f424e350e7458ac0b9568442...
Telemetry Bot
01:27 AM Bug #54886 (New): crash: rocksdb::BlockBasedTableIterator<rocksdb::DataBlockIter, rocksdb::Slice>...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=ff79eb769d6cc161403a28db...
Telemetry Bot
01:27 AM Bug #54884 (New): crash: rocksdb::crc32c::crc32c_3way(unsigned int, char const*, unsigned long)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=af07d73a7723def1bdc0cf7f...
Telemetry Bot
01:27 AM Bug #54879 (New): crash: BlueFS::_read(BlueFS::FileReader*, unsigned long, unsigned long, ceph::b...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=b3513b3a0db478a6dee6751b...
Telemetry Bot
01:27 AM Bug #54878 (New): crash: rocksdb::DBIter::Next()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=108f8933862f8927cc39737e...
Telemetry Bot
01:27 AM Bug #54877 (New): crash: virtual int KernelDevice::read(uint64_t, uint64_t, ceph::bufferlist*, IO...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=d5f375c05da70e929bcd0914...
Telemetry Bot
01:27 AM Bug #54876 (New): crash: int64_t BlueFS::_read_random(BlueFS::FileReader*, uint64_t, uint64_t, ch...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=665a4b49af4edae7d31e1dd3...
Telemetry Bot
01:27 AM Bug #54875 (New): crash: virtual int KernelDevice::read(uint64_t, uint64_t, ceph::bufferlist*, IO...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=af46d8ee9256e803b58bdfad...
Telemetry Bot
01:27 AM Bug #54874 (New): crash: int64_t BlueFS::_read_random(BlueFS::FileReader*, uint64_t, uint64_t, ch...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=113e3676c05f5a7cbf8ecfc9...
Telemetry Bot
01:27 AM Bug #54873 (New): crash: std::locale::locale()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=22c971f0c180ddaffd79512c...
Telemetry Bot
01:26 AM Bug #54872 (New): crash: rocksdb::BlockBasedTableIterator<rocksdb::DataBlockIter, rocksdb::Slice>...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=52b08eebdbd9ceef8c270c0c...
Telemetry Bot
01:26 AM Bug #54871 (New): crash: ceph::os::Transaction::iterator::iterator(ceph::os::Transaction*)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=532cbc47c37475df40c8903d...
Telemetry Bot
01:26 AM Bug #54870 (New): crash: rocksdb::BinaryHeap<rocksdb::IteratorWrapperBase<rocksdb::Slice>*, rocks...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=ea6e321c4888aa6bf046407b...
Telemetry Bot
01:26 AM Bug #54869 (New): crash: rocksdb::ExtractUserKey(rocksdb::Slice const&)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=055ee35e8a403170f49a08c4...
Telemetry Bot
01:26 AM Bug #54868 (New): crash: rocksdb::MergingIterator::Next()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=3339dffa3476e7bdedd5c345...
Telemetry Bot
01:26 AM Bug #54867 (New): crash: rocksdb::MergingIterator::Next()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=3ddbcff71b9a85f0affa245d...
Telemetry Bot
01:26 AM Bug #54866 (New): crash: virtual int RocksDBStore::get(const string&, const string&, ceph::buffer...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=3543b81ab73a633358b53721...
Telemetry Bot
01:26 AM Bug #54865 (New): crash: rocksdb::MemTable::KeyComparator::operator()(char const*, rocksdb::Slice...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=2b1730ced7fe1e819f95f589...
Telemetry Bot
01:26 AM Bug #54863 (New): crash: rocksdb::DBIter::Next()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=121d5cd8b1786c8dcc7d08aa...
Telemetry Bot
01:26 AM Bug #54862 (New): crash: int64_t BlueFS::_read(BlueFS::FileReader*, uint64_t, size_t, ceph::buffe...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=689d3dfa18bd9a691ebfe4d6...
Telemetry Bot
01:26 AM Bug #54861 (New): crash: rocksdb::Cleanable::Cleanable()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=e21d519ec3fb0f618aebe5ce...
Telemetry Bot
01:26 AM Bug #54858 (New): crash: void std::basic_string<char, std::char_traits<char>, std::allocator<char...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=baa2ec53211042eb69c5f6e7...
Telemetry Bot
01:26 AM Bug #54856 (New): crash: std::enable_if<(is_same_v<bluestore_onode_t, bluestore_onode_t>)||(is_sa...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=323717336c29ab5f731f78b9...
Telemetry Bot
01:26 AM Bug #54854 (New): crash: rocksdb::DBImpl::Get(rocksdb::ReadOptions const&, rocksdb::ColumnFamilyH...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=cd224834824209a5b0f22c4b...
Telemetry Bot
01:26 AM Bug #54853 (New): crash: reverse_nibbles()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=506870e985cc812b1c5974a8...
Telemetry Bot
01:26 AM Bug #54852 (New): crash: ceph::buffer::raw_posix_aligned::~raw_posix_aligned()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=926abd8ab2283864d3ca6df7...
Telemetry Bot
01:26 AM Bug #54850 (New): crash: rocksdb::MergingIterator::NextAndGetResult(rocksdb::IterateResult*)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=123dc6bf6f86fe85365a2fc1...
Telemetry Bot
01:26 AM Bug #54848 (New): crash: rocksdb::BlockIter<rocksdb::IndexValue>::Valid() const

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=d3c14239cbf61664dedda13a...
Telemetry Bot
01:26 AM Bug #54847 (New): crash: int fmt::v6::detail::format_float<double>(double, int, fmt::v6::detail::...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=8c238940b8bc4a67703ebc88...
Telemetry Bot
01:26 AM Bug #54846 (New): crash: rocksdb::MemTableIterator::~MemTableIterator()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=80e7b59ebeb7f8768101fcf1...
Telemetry Bot
01:25 AM Bug #54844 (New): crash: BlueStore::ExtentMap::fault_range(KeyValueDB*, unsigned int, unsigned int)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=b15325f01b9ffdb158931bed...
Telemetry Bot
01:25 AM Bug #54843 (New): crash: std::basic_streambuf<char, std::char_traits<char> >::xsputn(char const*,...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=df9317807de8a30d0bd65d7c...
Telemetry Bot
01:25 AM Bug #54841 (New): crash: rocksdb::ReadOptions::ReadOptions()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=8af037a7be18c1b5b563e065...
Telemetry Bot
01:25 AM Bug #54838 (New): crash: rocksdb::BlockBasedTableIterator<rocksdb::DataBlockIter, rocksdb::Slice>...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=9cc2d8f54e0deec8e42cb6d8...
Telemetry Bot
01:25 AM Bug #54837 (New): crash: rocksdb::ArenaWrappedDBIter::key() const

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=f074d25f484405f5862dc0f8...
Telemetry Bot
01:25 AM Bug #54836 (New): crash: rocksdb::MergingIterator::NextAndGetResult(rocksdb::IterateResult*)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=12d214b4e6a4eb66d347895f...
Telemetry Bot
01:25 AM Bug #54835 (New): crash: rocksdb::MemTableIterator::key() const

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=3fd93dff6bf238fae3ac0366...
Telemetry Bot
01:25 AM Bug #54827 (New): crash: pread64()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=ec7b41ac777421df5a83b213...
Telemetry Bot
01:25 AM Bug #54826 (New): crash: tcmalloc::CentralFreeList::FetchFromOneSpans(int, void**, void**)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=ae802c9ce8e00d889ae689c4...
Telemetry Bot
01:25 AM Bug #54825 (New): crash: rocksdb::DecodeFixed32(char const*)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=eb5ed58b4f247be79ec5e84c...
Telemetry Bot
01:25 AM Bug #54823 (New): crash: void BlueFS::_compact_log_async(std::unique_lock<std::mutex>&): assert(r...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=ee127da19a976dabc71333ae...
Telemetry Bot
01:25 AM Bug #54820 (New): crash: int64_t BlueFS::_read(BlueFS::FileReader*, uint64_t, size_t, ceph::buffe...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=01ed027a684e618efb89d8c7...
Telemetry Bot
01:25 AM Bug #54819 (New): crash: rocksdb::BlockIter<rocksdb::Slice>::status() const

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=677b3129322e08f6b5d1c7b4...
Telemetry Bot
01:24 AM Bug #54815 (New): crash: pread64()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=8bbec41b7d395e99fe299b0a...
Telemetry Bot
01:24 AM Bug #54814 (New): crash: rocksdb::AllocateBlock(unsigned long, rocksdb::MemoryAllocator*)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=0d13d348bc9a59ccaab86d92...
Telemetry Bot
01:24 AM Bug #54813 (New): crash: rocksdb::Slice::Slice(char const*, unsigned long)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=6741cd843ca9a52846fedcfb...
Telemetry Bot
01:24 AM Bug #54812 (New): crash: rocksdb::BlockBasedTableIterator<rocksdb::DataBlockIter, rocksdb::Slice>...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=594898b28f240aa17b680216...
Telemetry Bot
01:24 AM Bug #54810 (New): crash: rocksdb::BlockBasedTableIterator<rocksdb::DataBlockIter, rocksdb::Slice>...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=36e5fb18b7fd18408b058fad...
Telemetry Bot
01:24 AM Bug #54809 (New): crash: rocksdb::SyncPoint::GetInstance()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=51dffb368c01679e885e9312...
Telemetry Bot
01:24 AM Bug #54807 (New): crash: BlueRocksRandomAccessFile::use_direct_io() const

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=3ea6df499514512322106e95...
Telemetry Bot
01:24 AM Bug #54806 (New): crash: ceph::buffer::list::iterator_impl<false>::copy(unsigned int, char*)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=1adc032451cf11b71a144698...
Telemetry Bot
01:24 AM Bug #54805 (New): crash: rocksdb::CachableEntry<rocksdb::Block>::ReleaseCacheHandle(void*, void*)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=7216089c522399793f96943a...
Telemetry Bot
01:24 AM Bug #54804 (New): crash: pread64()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=a7c9473df259f98217882015...
Telemetry Bot
01:24 AM Bug #54800 (New): crash: int64_t BlueFS::_read_random(BlueFS::FileReader*, uint64_t, uint64_t, ch...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=7bb424df03d8cdb81b6aa0c3...
Telemetry Bot
01:24 AM Bug #54796 (New): crash: virtual void KernelDevice::aio_submit(IOContext*): assert(r == 0)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=7041bd171279c8804f9c3543...
Telemetry Bot
01:24 AM Bug #54794 (New): crash: void BlueStore::_do_write_small(BlueStore::TransContext*, BlueStore::Col...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=45dfcf1a55927d004c669aa4...
Telemetry Bot
01:24 AM Bug #54792 (New): crash: virtual int KernelDevice::flush(): abort

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=1a28c7c3f5840b01abed12c0...
Telemetry Bot
01:24 AM Bug #54790 (New): crash: int64_t BlueFS::_read(BlueFS::FileReader*, uint64_t, size_t, ceph::buffe...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=6b13a5603089e2c6b071fe20...
Telemetry Bot
01:23 AM Bug #54786 (New): crash: int64_t BlueFS::_read(BlueFS::FileReader*, uint64_t, size_t, ceph::buffe...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=37a0a5e951940f9943c3aa41...
Telemetry Bot
01:23 AM Bug #54784 (New): crash: pthread_cond_wait()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=c755b8df066d286aacae4164...
Telemetry Bot
01:23 AM Bug #54782 (New): crash: int64_t BlueFS::_read_random(BlueFS::FileReader*, uint64_t, uint64_t, ch...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=e1010c9603d509e53850521b...
Telemetry Bot
01:23 AM Bug #54780 (New): crash: void OSD::handle_osd_map(MOSDMap*): assert(p != added_maps_bl.end())

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=7286bd203800f1a1a572445a...
Telemetry Bot
01:23 AM Bug #54778 (New): crash: tcmalloc::CentralFreeList::FetchFromOneSpans(int, void**, void**)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=e3ba3712874b2b22682a00f4...
Telemetry Bot
01:23 AM Bug #54775 (New): crash: void rocksdb::InlineSkipList<rocksdb::MemTableRep::KeyComparator const&>...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=83033791cc19a2422b46adb2...
Telemetry Bot
01:23 AM Bug #54769 (New): crash: pthread_cond_wait()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=05b8795c965751637477242d...
Telemetry Bot
01:23 AM Bug #54764 (New): crash: rocksdb::BlockBasedTable::NewRangeTombstoneIterator(rocksdb::ReadOptions...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=0ed0b581d62a77e875d924fd...
Telemetry Bot
01:23 AM Bug #54762 (New): crash: void KernelDevice::_aio_thread(): abort

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=4d4e2cc1151cb9149da7785b...
Telemetry Bot
01:23 AM Bug #54761 (New): crash: virtual void KernelDevice::aio_submit(IOContext*): assert(r == 0)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=798a30456cd34e52945f9604...
Telemetry Bot
01:22 AM Bug #54757 (New): crash: virtual int KernelDevice::read(uint64_t, uint64_t, ceph::bufferlist*, IO...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=225109a147680411a4818a15...
Telemetry Bot
01:22 AM Bug #54756 (New): crash: BlueStore::_txc_add_transaction(BlueStore::TransContext*, ceph::os::Tran...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=1a360814f3bf36fa5accb644...
Telemetry Bot
01:22 AM Bug #54752 (New): crash: virtual void KernelDevice::aio_submit(IOContext*): assert(r == 0)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=688489dd89c2fd47cdba69b9...
Telemetry Bot
01:22 AM Bug #54749 (New): crash: BlueStore::_wctx_finish(BlueStore::TransContext*, boost::intrusive_ptr<B...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=61bd313c66cb9e4d89877a58...
Telemetry Bot
01:22 AM Bug #54740 (New): crash: virtual int BlueStore::write_meta(const string&, const string&): assert(...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=eb85ce9dd8d3ccadb24759aa...
Telemetry Bot
01:22 AM Bug #54734 (New): crash: void KernelDevice::_aio_thread(): abort

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=400773dcbaa54cd9edc55f72...
Telemetry Bot
01:22 AM Bug #54733 (New): crash: virtual void KernelDevice::aio_submit(IOContext*): assert(r == 0)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=3792d03860c98355b5c80539...
Telemetry Bot
01:22 AM Bug #54731 (New): crash: virtual void KernelDevice::aio_submit(IOContext*): assert(r == 0)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=ece98da61f6eb5fd446d0cf4...
Telemetry Bot
01:21 AM Bug #54729 (New): crash: virtual int RocksDBStore::get(const string&, const char*, size_t, ceph::...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=56078caa08350bde8a0dfefe...
Telemetry Bot
01:21 AM Bug #54728 (New): crash: int BlueFS::_flush_range(BlueFS::FileWriter*, uint64_t, uint64_t): abort

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=fbdedc3ea56b5ed0a75985e7...
Telemetry Bot
01:21 AM Bug #54727 (Duplicate): crash: __pthread_mutex_lock()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=6b079b81aff3cc5a68cc0ec3...
Telemetry Bot
01:21 AM Bug #54725 (New): crash: virtual void KernelDevice::aio_submit(IOContext*): assert(r == 0)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=193e00083424d7c7fb7c27aa...
Telemetry Bot
01:21 AM Bug #54724 (New): crash: virtual void KernelDevice::aio_submit(IOContext*): assert(r == 0)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=363580eccc036f6aa08158d9...
Telemetry Bot
01:21 AM Bug #54723 (New): crash: virtual void KernelDevice::aio_submit(IOContext*): assert(r == 0)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=675a1a7f4bd3acfc33b84930...
Telemetry Bot
01:21 AM Bug #54716 (New): crash: virtual int RocksDBStore::get(const string&, const char*, size_t, ceph::...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=822ce88d92e225ef0f5ab562...
Telemetry Bot
01:21 AM Bug #54714 (New): crash: virtual int RocksDBStore::get(const string&, const char*, size_t, ceph::...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=0cc7e754334e5c9119f64718...
Telemetry Bot
01:21 AM Bug #54713 (New): crash: pthread_cond_wait()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=728c9e3c549b1db27ffb06d6...
Telemetry Bot
01:21 AM Bug #54711 (New): crash: virtual void KernelDevice::aio_submit(IOContext*): assert(r == 0)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=be47d59ee9cecd64f49c4210...
Telemetry Bot
01:20 AM Bug #54707 (New): crash: BlueStore::read(boost::intrusive_ptr<ObjectStore::CollectionImpl>&, ghob...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=f333fb94049a4ea1a14290d5...
Telemetry Bot
01:20 AM Bug #54702 (New): crash: void BlueStore::_txc_add_transaction(BlueStore::TransContext*, ObjectSto...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=cd7392d053751702cda7fb40...
Telemetry Bot
01:20 AM Bug #54698 (New): crash: pread64()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=16f73c8e16da3b53806365e1...
Telemetry Bot
01:20 AM Bug #54697 (New): crash: pread64()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=03b5be5d385ed39ec69e689d...
Telemetry Bot
01:20 AM Bug #54696 (New): crash: int BlueFS::_flush_range(BlueFS::FileWriter*, uint64_t, uint64_t): abort

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=1829049bd3fcc6401387842f...
Telemetry Bot
01:20 AM Bug #54695 (New): crash: int BlueFS::_flush_range(BlueFS::FileWriter*, uint64_t, uint64_t): abort

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=32a84212e91aad4a2e174bac...
Telemetry Bot
01:20 AM Bug #54693 (New): crash: virtual void KernelDevice::aio_submit(IOContext*): assert(r == 0)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=a5c3cdfba47ee35a82a3e932...
Telemetry Bot
01:19 AM Bug #54690 (New): crash: void BlueStore::_validate_bdev(): assert(dev_size > _get_ondisk_reserved())

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=2d9e881eee6f98576178fe52...
Telemetry Bot
01:19 AM Bug #54684 (New): crash: int64_t BlueFS::_read(BlueFS::FileReader*, uint64_t, size_t, ceph::buffe...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=5dfe479ba7b50b00e1cd1a33...
Telemetry Bot
01:19 AM Bug #54681 (New): crash: virtual void KernelDevice::aio_submit(IOContext*): assert(r == 0)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=8245dc80cbace15849d0097a...
Telemetry Bot
01:19 AM Bug #54679 (New): crash: int64_t BlueFS::_read_random(BlueFS::FileReader*, uint64_t, uint64_t, ch...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=f64d691b03ab23d520ccf5ee...
Telemetry Bot
01:19 AM Bug #54677 (New): crash: void BlueStore::_do_write_small(BlueStore::TransContext*, BlueStore::Col...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=a86186d99b65eee840ef07c8...
Telemetry Bot
01:19 AM Bug #54676 (New): crash: virtual void KernelDevice::aio_submit(IOContext*): assert(r == 0)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=0758c0adfa42498423bcee61...
Telemetry Bot
01:19 AM Bug #54675 (New): crash: void KernelDevice::_aio_thread(): abort

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=3a56e4d96576b02d2ecd98bc...
Telemetry Bot
01:19 AM Bug #54674 (New): crash: virtual int KernelDevice::read(uint64_t, uint64_t, ceph::bufferlist*, IO...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=5ba63415ec1277c37d418b94...
Telemetry Bot
01:19 AM Bug #54673 (New): crash: void BlueStore::_do_write_small(BlueStore::TransContext*, BlueStore::Col...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=5e484403f532be190e6528e5...
Telemetry Bot
01:19 AM Bug #54672 (New): crash: void BlueStore::_do_write_small(BlueStore::TransContext*, BlueStore::Col...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=9e57e788f4a8904b7b97d8a5...
Telemetry Bot
01:19 AM Bug #54671 (New): crash: void BlueStore::_do_write_small(BlueStore::TransContext*, BlueStore::Col...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=f734b82814954971f5f8d5f1...
Telemetry Bot
01:18 AM Bug #54667 (New): crash: virtual void KernelDevice::aio_submit(IOContext*): assert(r == 0)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=fe2996916ee919f09b7610b7...
Telemetry Bot
01:18 AM Bug #54666 (New): crash: virtual void KernelDevice::aio_submit(IOContext*): assert(r == 0)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=936b212a98944d2148a02fff...
Telemetry Bot
01:18 AM Bug #54664 (New): crash: virtual int KernelDevice::flush(): abort

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=b20985b8c92723bc8fefad0d...
Telemetry Bot
01:18 AM Bug #54663 (New): crash: int64_t BlueFS::_read(BlueFS::FileReader*, uint64_t, size_t, ceph::buffe...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=3a4b1867b96800e67dd4f006...
Telemetry Bot
01:18 AM Bug #54662 (New): crash: virtual int KernelDevice::read(uint64_t, uint64_t, ceph::bufferlist*, IO...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=6cfe5c50d0a55f225745690f...
Telemetry Bot
01:18 AM Bug #54661 (New): crash: pread64()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=fcc29a051ab70c4cfb0d7e46...
Telemetry Bot
01:18 AM Bug #54660 (New): crash: pread64()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=7653f439f475062d61bbc7bb...
Telemetry Bot
01:18 AM Bug #54659 (New): crash: virtual int KernelDevice::read(uint64_t, uint64_t, ceph::bufferlist*, IO...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=a4aa47ca0bb923ef14771b1e...
Telemetry Bot
01:18 AM Bug #54658 (New): crash: pread64()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=4b0518ae6783a86a923e7218...
Telemetry Bot
01:18 AM Bug #54657 (Duplicate): crash: void PriorityCache::Manager::balance(): assert(mem_avail >= 0)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=2d7abd90b5f27ed697550ffa...
Telemetry Bot
01:18 AM Bug #54654 (New): crash: virtual void KernelDevice::aio_submit(IOContext*): assert(r == 0)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=550b9fb732302cc71d4e933b...
Telemetry Bot
01:18 AM Bug #54651 (New): crash: void BlueStore::_do_write_small(BlueStore::TransContext*, BlueStore::Col...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=0b0eb79b2518b0a093fb9915...
Telemetry Bot
01:17 AM Bug #54650 (Duplicate): crash: BlueStore::Onode::put()

*New crash events were reported via Telemetry with newer versions (['16.2.4', '16.2.5', '16.2.6', '16.2.7']) than e...
Telemetry Bot
01:17 AM Bug #54649 (New): crash: virtual int RocksDBStore::get(const string&, const string&, ceph::buffer...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=920acb6998ceb1d870105b5b...
Telemetry Bot
01:17 AM Bug #54645 (New): crash: pthread_cond_wait()

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=09f8df8b8a6b8082fb30ac1b...
Telemetry Bot
01:17 AM Bug #54642 (New): crash: int BlueStore::_do_gc(BlueStore::TransContext*, BlueStore::CollectionRef...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=f03ee042bf930a9c9e51a35e...
Telemetry Bot
01:17 AM Bug #54640 (New): crash: void BlueStore::_close_db(bool): assert(db)

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=a60c6e889cda650370212f24...
Telemetry Bot
01:17 AM Bug #54639 (New): crash: virtual int KernelDevice::flush(): abort

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=74b3c332ac3a8e456a6198a5...
Telemetry Bot
01:17 AM Bug #54638 (New): crash: int64_t BlueFS::_read(BlueFS::FileReader*, uint64_t, size_t, ceph::buffe...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=e4cbd32f6bca68d8bc0f95eb...
Telemetry Bot
01:17 AM Bug #54635 (New): crash: void BlueFS::_compact_log_async(std::unique_lock<std::mutex>&): assert(r...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=a18d6a4ece4d47693b85ff5c...
Telemetry Bot
01:17 AM Bug #54634 (New): crash: void BlueFS::_compact_log_async(std::unique_lock<std::mutex>&): assert(r...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=1a1e2a37ab4976e42e06e5a6...
Telemetry Bot
01:17 AM Bug #54633 (New): crash: int BlueFS::_flush_and_sync_log(std::unique_lock<std::mutex>&, uint64_t,...

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=fba988fc8dce7fd1ddb32c5d...
Telemetry Bot
01:16 AM Bug #54628 (New): crash: int BlueFS::_flush_range(BlueFS::FileWriter*, uint64_t, uint64_t): abort

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=8c99d7230e61f254144b1ddb...
Telemetry Bot
01:16 AM Bug #54627 (New): crash: int BlueFS::_flush_range(BlueFS::FileWriter*, uint64_t, uint64_t): abort

http://telemetry.front.sepia.ceph.com:4000/d/jByk5HaMz/crash-spec-x-ray?orgId=1&var-sig_v2=5095a8217dc57050f6c728df...
Telemetry Bot

03/18/2022

07:55 AM Bug #54615: virtual int KernelDevice::read(uint64_t, uint64_t, ceph::bufferlist*, IOContext*, boo...
Looks like rather a hardware issue:
debug -2> 2022-03-16T03:34:15.303+0000 7fad822f6080 -1 bdev(0x55b913340800 /...
Igor Fedotov
06:24 AM Bug #54615: virtual int KernelDevice::read(uint64_t, uint64_t, ceph::bufferlist*, IOContext*, boo...
I deploy it by ceph-rook, and the other ~100 osds is normal but one osd is keeping CrashLoopBackOff with the error st... jing zhang
06:20 AM Bug #54615 (Closed): virtual int KernelDevice::read(uint64_t, uint64_t, ceph::bufferlist*, IOCont...
... jing zhang
02:38 AM Bug #52208: crash: virtual int KernelDevice::read(uint64_t, uint64_t, ceph::bufferlist*, IOContex...
hi experts, are there some updates for this issue?
I meet the same issue from the func ...
jing zhang

03/16/2022

01:23 PM Bug #54561: 5 out of 6 OSD crashing after update to 17.1.0-0.2.rc1.fc37.x86_64
Thanks, that also explains why one OSD survived upgrade. It's on LVM volume (the rest are on raw disks), so the it is... Tomasz Torcz
01:02 PM Bug #54561: 5 out of 6 OSD crashing after update to 17.1.0-0.2.rc1.fc37.x86_64
Tomacz, Kaleb,
broken OSDs should start up fine after you update Ceph binaries with the mentioned patch.
Hence yo...
Igor Fedotov
12:57 PM Bug #54561 (Closed): 5 out of 6 OSD crashing after update to 17.1.0-0.2.rc1.fc37.x86_64
Igor Fedotov
12:51 PM Bug #54561 (Won't Fix): 5 out of 6 OSD crashing after update to 17.1.0-0.2.rc1.fc37.x86_64
Igor Fedotov
12:51 PM Bug #54561: 5 out of 6 OSD crashing after update to 17.1.0-0.2.rc1.fc37.x86_64
After additional investigation I realized that this has already been fixed in master.
Pending backport to Quincy: h...
Igor Fedotov
12:38 PM Bug #54561 (In Progress): 5 out of 6 OSD crashing after update to 17.1.0-0.2.rc1.fc37.x86_64
Igor Fedotov
12:31 PM Bug #54561: 5 out of 6 OSD crashing after update to 17.1.0-0.2.rc1.fc37.x86_64
So it looks like allocation map recovery doesn't properly handle disk sizes which are misaligned with bluestore alloc... Igor Fedotov
11:05 AM Bug #54561: 5 out of 6 OSD crashing after update to 17.1.0-0.2.rc1.fc37.x86_64
Here it is: https://pipebreaker.pl/ceph-osd.1.bitmap.log.zstd Tomasz Torcz
10:50 AM Bug #54561: 5 out of 6 OSD crashing after update to 17.1.0-0.2.rc1.fc37.x86_64
Thanks, Tomasz!
Unfortunately AvlAllocator has got assertion before logging the presumably broken extent.
Could y...
Igor Fedotov
10:23 AM Bug #54561: 5 out of 6 OSD crashing after update to 17.1.0-0.2.rc1.fc37.x86_64
Log with debug bluestore = 20 put at https://pipebreaker.pl/ceph-osd.1.log.zstd (26MiB)
Compressed, as it grown to ...
Tomasz Torcz
10:59 AM Bug #54579 (Fix Under Review): AvlAllocator::init_rm|add_free methods perform assertion check bef...
Igor Fedotov
10:59 AM Bug #54579 (Pending Backport): AvlAllocator::init_rm|add_free methods perform assertion check bef...
Igor Fedotov
10:53 AM Bug #54579 (Resolved): AvlAllocator::init_rm|add_free methods perform assertion check before logging
Hence one is unable to determine what's broken in the input parameters
Igor Fedotov
09:52 AM Bug #54554 (Fix Under Review): Bluestore volume selector improperly tracks bluefs log size
Igor Fedotov
09:49 AM Bug #54554: Bluestore volume selector improperly tracks bluefs log size
Not present in Quincy and beyond due to bluefs refactoring Igor Fedotov
07:33 AM Bug #39318: w_await high when rockdb compacting
hoan nv wrote:
> use rocksdb tuning options in tuning guide : https://ceph.com/community/bluestore-default-vs-tuned-...
Francois Scheurer

03/15/2022

12:29 PM Bug #54561: 5 out of 6 OSD crashing after update to 17.1.0-0.2.rc1.fc37.x86_64
Kaleb,
it would be nice to get OSD startup log with debug-bluestore set to 20.
Thanks,
Igor
Igor Fedotov
11:51 AM Bug #54561: 5 out of 6 OSD crashing after update to 17.1.0-0.2.rc1.fc37.x86_64
https://bugzilla.redhat.com/show_bug.cgi?id=2064219 Kaleb KEITHLEY
11:46 AM Bug #54561 (Closed): 5 out of 6 OSD crashing after update to 17.1.0-0.2.rc1.fc37.x86_64
Description of problem:
After upgrading to 17.1.0-0.2.rc1.fc37.x86_64, 5 out of 6 of my OSDs are crashing on start.
...
Kaleb KEITHLEY

03/14/2022

06:16 PM Bug #54555 (Fix Under Review): ceph-bluestore-tool doesn't handle 'free-fragmentation' command
Igor Fedotov
05:56 PM Bug #54554 (Resolved): Bluestore volume selector improperly tracks bluefs log size
Here is the output of "bluefs stats" admin command:
>ceph tell osd.1 bluefs stats
1 : device size 0x3fffe000 : usin...
Igor Fedotov
04:56 PM Bug #54547: Deferred writes might cause "rocksdb: Corruption: Bad table magic number"
a couple addendums to the previous comment:
- vstart cluster above should use spinning drives or benefit from settin...
Igor Fedotov
04:18 PM Bug #54547: Deferred writes might cause "rocksdb: Corruption: Bad table magic number"
I managed to reproduce (to a major degree) the bug with vstart-ed cluster:
- osd_fast_shutdown = true
- rbd above e...
Igor Fedotov
12:58 PM Bug #54547 (Triaged): Deferred writes might cause "rocksdb: Corruption: Bad table magic number"
Igor Fedotov
12:58 PM Bug #54547 (New): Deferred writes might cause "rocksdb: Corruption: Bad table magic number"
Igor Fedotov
12:57 PM Bug #54547 (Duplicate): Deferred writes might cause "rocksdb: Corruption: Bad table magic number"
Igor Fedotov
12:24 PM Bug #54547 (Resolved): Deferred writes might cause "rocksdb: Corruption: Bad table magic number"
Looks like under some circumstances deferred write op might persist in DB longer then allocated extents it's targeted... Igor Fedotov
01:00 PM Bug #54409 (Duplicate): OSD fails to start up with "rocksdb: Corruption: Bad table magic number" ...
Igor Fedotov
12:58 PM Bug #54409 (Triaged): OSD fails to start up with "rocksdb: Corruption: Bad table magic number" error
Igor Fedotov
12:58 PM Bug #54409 (New): OSD fails to start up with "rocksdb: Corruption: Bad table magic number" error
Igor Fedotov
12:57 PM Bug #54409 (Duplicate): OSD fails to start up with "rocksdb: Corruption: Bad table magic number" ...
Igor Fedotov
01:23 AM Bug #53184: failed to start new osd due to SIGSEGV in BlueStore::read()
The contents of osd.6.log are the log of a different Pod than the prepare pod.
> Yeah, ceph-osd's mkfs and ceph-vo...
Yuma Ogami

03/11/2022

01:52 PM Bug #53184: failed to start new osd due to SIGSEGV in BlueStore::read()
Yuma Ogami wrote:
>
> > 4) Am I correct that this ceph-volume's prepare stuff (which includes mkfs call) is run fr...
Igor Fedotov

03/10/2022

06:59 PM Backport #54523 (In Progress): quincy: default osd_fast_shutdown=true would cause NCB to recover ...
Gabriel BenHanokh
06:54 PM Backport #54523 (Resolved): quincy: default osd_fast_shutdown=true would cause NCB to recover all...
https://github.com/ceph/ceph/pull/45342 Gabriel BenHanokh
06:54 PM Bug #53266 (Pending Backport): default osd_fast_shutdown=true would cause NCB to recover allocati...
Gabriel BenHanokh
01:55 AM Bug #53184: failed to start new osd due to SIGSEGV in BlueStore::read()
Thank you for your reply.
> 1) How easily can you reproduce this issue?
We could reproduce this issue by about 10...
Yuma Ogami

03/09/2022

11:31 PM Bug #54465 (Fix Under Review): BlueFS broken sync compaction mode
Neha Ojha
05:19 PM Bug #53184: failed to start new osd due to SIGSEGV in BlueStore::read()
Hi Yuma,
thanks a lot for the information. It's really helpful.
May I ask some questions, please?
1) How easily ...
Igor Fedotov
07:17 AM Bug #53184: failed to start new osd due to SIGSEGV in BlueStore::read()
I'm sat's colleague.
We experimented in a updated environment and confirmed the same result. Could you please chec...
Yuma Ogami
02:16 PM Bug #38637 (Won't Fix): BlueStore::ExtentMap::fault_range() assert
Igor Fedotov
 

Also available in: Atom