Support #47667
closedCEPH OS Not starting
0%
Description
one of CEPH OSD not starting
-5> 2020-09-28 13:27:02.912 7f8f15738d80 -1 bdev(0x560e9cf57c00 /var/lib/ceph/osd/ceph-23/block) read stalled read 0x5905e50000~9000 (direct) since 2102.62s, timeout is 5s
-4> 2020-09-28 13:27:02.912 7f8f15738d80 -1 bluestore(/var/lib/ceph/osd/ceph-23) _do_read bdev-read failed: (5) Input/output error
-3> 2020-09-28 13:27:02.912 7f8f15738d80 0 bluestore(/var/lib/ceph/osd/ceph-23) read slow operation observed for l_bluestore_read_lat, latency = 5.05017s
-2> 2020-09-28 13:27:02.912 7f8f15738d80 -1 osd.23 0 failed to load OSD map for epoch 694085, got 0 bytes
-1> 2020-09-28 13:27:02.919 7f8f15738d80 -1 /home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/14.2.2/rpm/el7/BUILD/ceph-14.2.2/src/osd/OSD.h: In function 'OSDMapRef OSDService::get_map(epoch_t)' thread 7f8f15738d80 time 2020-09-28 13:27:02.913182
/home/jenkins-build/build/workspace/ceph-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos7/DIST/centos7/MACHINE_SIZE/huge/release/14.2.2/rpm/el7/BUILD/ceph-14.2.2/src/osd/OSD.h: 842: FAILED ceph_assert(ret)
Updated by Igor Fedotov over 3 years ago
- Project changed from Ceph to bluestore
- Category deleted (
ceph cli)
This looks like a H/W problem:
2020-09-28 13:27:02.912 7f8f15738d80 -1 bdev(0x560e9cf57c00 /var/lib/ceph/osd/ceph-23/block) read stalled read 0x5905e50000~9000 (direct) since 2102.62s, timeout is 5s
Could you please chech for H/W errors with dmesg.
Updated by Shafiq M over 3 years ago
Thanks it is indeed hardware error I am getting disk replaced