Ceph » crimson

• After adding a restart OSDs to the thrash tests: https://github.com/ceph/ceph/pull/56511
• Results are not from main: https://github.com/ceph/ceph-ci/commits/wip-matanb-crimson-testing-thrash-options/

https://pulpito.ceph.com/matan-2024-04-01_13:06:33-crimson-rados-wip-matanb-crimson-testing-thrash-options-distro-crimson-smithi
7633869 OSD3
7633873 OSD3
7633880 OSD.0

DEBUG 2024-04-01 13:50:08,303 [shard 0:main] osd -  pg_epoch 62 pg[3.f( v 57'90 (0'0,57'90] local-lis/les=61/62 n=6 ec=15/15 lis/c=61/34 les/c/f=62/35/0 sis=61) [0,1,3] r=0 lpr=61 pi=[34,61)/1 crt=57'91 lcod 55'88 mlcod 0'0 active+recovering+degraded+snaptrim PeeringState::update_calc_stats misplaced 0
DEBUG 2024-04-01 13:50:08,303 [shard 0:main] osd -  pg_epoch 62 pg[3.f( v 57'90 (0'0,57'90] local-lis/les=61/62 n=6 ec=15/15 lis/c=61/34 les/c/f=62/35/0 sis=61) [0,1,3] r=0 lpr=61 pi=[34,61)/1 crt=57'91 lcod 55'88 mlcod 0'0 active+recovering+snaptrim PeeringState::prepare_stats_for_publish reporting purged_snaps []
DEBUG 2024-04-01 13:50:08,303 [shard 0:main] osd -  pg_epoch 62 pg[3.f( v 57'90 (0'0,57'90] local-lis/les=61/62 n=6 ec=15/15 lis/c=61/34 les/c/f=62/35/0 sis=61) [0,1,3] r=0 lpr=61 pi=[34,61)/1 crt=57'91 lcod 55'88 mlcod 0'0 active+recovering+snaptrim PeeringState::prepare_stats_for_publish publish_stats_to_osd 62:260
ceph-osd: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-2568-gafa73a9e/rpm/el9/BUILD/ceph-19.0.0-2568-gafa73a9e/src/crimson/osd/object_context.h:245: void crimson::osd::ObjectContext::drop_recovery_read(): Assertion `recovery_read_marker' failed.
Aborting on shard 0.
Backtrace:

 0# 0x00007FAE010A154C in /lib64/libc.so.6
 1# raise in /lib64/libc.so.6
 2# abort in /lib64/libc.so.6
 3# 0x00007FAE0102871B in /lib64/libc.so.6
 4# 0x00007FAE0104DCA6 in /lib64/libc.so.6
 5# crimson::osd::ObjectContext::drop_recovery_read() in ceph-osd
 6# PGRecovery::on_global_recover(hobject_t const&, object_stat_sum_t const&, bool) in ceph-osd