Ceph

2021-04-01T02:33:49.479 INFO:tasks.ceph.osd.2.smithi062.stderr:2021-04-01T02:33:49.474+0000 7fe3e0ad4700 -1 bdev(0x55b60cab6400 /var/lib/ceph/osd/ceph-2/block) _aio_thread stalled aio 0x55b60e47c210 since 2021-04-01T02:32:49.258121+0000, timeout is 60s, suicide
2021-04-01T02:33:49.560 INFO:tasks.ceph.osd.2.smithi062.stderr:/build/ceph-17.0.0-2693-g5c92bde1/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fe3e0ad4700 time 2021-04-01T02:33:49.488270+0000
2021-04-01T02:33:49.561 INFO:tasks.ceph.osd.2.smithi062.stderr:/build/ceph-17.0.0-2693-g5c92bde1/src/blk/kernel/KernelDevice.cc: 645: ceph_abort_msg("stalled aio... buggy kernel or bad device?")
2021-04-01T02:33:49.572 INFO:tasks.ceph.osd.2.smithi062.stderr: ceph version 17.0.0-2693-g5c92bde1 (5c92bde19d0b1ad5e2a680f5925b00ec1f942c7d) quincy (dev)
2021-04-01T02:33:49.572 INFO:tasks.ceph.osd.2.smithi062.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xe0) [0x55b6098dbf30]
2021-04-01T02:33:49.573 INFO:tasks.ceph.osd.2.smithi062.stderr: 2: (KernelDevice::_aio_thread()+0x11a5) [0x55b60a4f5835]
2021-04-01T02:33:49.573 INFO:tasks.ceph.osd.2.smithi062.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x55b60a500941]
2021-04-01T02:33:49.574 INFO:tasks.ceph.osd.2.smithi062.stderr: 4: (Thread::_entry_func(void*)+0xd) [0x55b60a0e63bd]
2021-04-01T02:33:49.574 INFO:tasks.ceph.osd.2.smithi062.stderr: 5: /lib/x86_64-linux-gnu/libpthread.so.0(+0x9609) [0x7fe3e9c5d609]
2021-04-01T02:33:49.575 INFO:tasks.ceph.osd.2.smithi062.stderr: 6: clone()
2021-04-01T02:33:49.575 INFO:tasks.ceph.osd.2.smithi062.stderr:*** Caught signal (Aborted) **
2021-04-01T02:33:49.575 INFO:tasks.ceph.osd.2.smithi062.stderr: in thread 7fe3e0ad4700 thread_name:bstore_aio

From: /ceph/teuthology-archive/pdonnell-2021-04-01_00:45:34-fs-wip-pdonnell-testing-20210331.222326-distro-basic-smithi/6013996/teuthology.log