Bug #63524
openceph_test_rados create object without reference
0%
Description
tier ops that add refs into the low_tier pools can hit overlap offset which causing few empty entries in low_tier objects
recreate:
1. run command:
ceph_test_rados --set_chunk --enable_dedup --low_tier_pool low_tier --dedup_chunk_size 131072 --dedup_chunk_algo fastcdc --max-ops 1500 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 25 --op delete 10 --op set_chunk 30 --op tier_promote 10 --op tier_evict 10 --op tier_flush 5 --op write_excl 25 --pool unique_pool_0
2. list the object in low_tier pool: rados -p low_tier ls
3. dump the chunk reference of one of the chunks:
ceph-dedup-tool --op dump-chunk-refs --chunk-pool low_tier --object 39dc6354c287437fcfba3f3e2c5f4c3837e563dbb69566160498140cbd2219ae
it should return json, few of them are empty.
if we check the osds log for those refs. we will see overlap error.
Updated by Radoslaw Zarzynski 6 months ago
scrub note: should the status be in progress
?
Updated by Samuel Just 5 months ago
Can you add the "overlap error" lines to the bug?
Updated by Nitzan Mordechai 5 months ago
023-11-28T10:59:40.936+0000 7f28f73bf700 20 osd.0 pg_epoch: 19 pg[2.0( v 19'12 (0'0,19'12] local-lis/les=9/10 n=3 ec=9/9 lis/c=9/9 les/c/f=10/10/0 sis=9) [0] r=0 lpr=9 crt=19'12 lcod 19'11 mlcod 19'11 active+clean] do_osd_ops overlapped !! offset: 1441792 length: 455680 chunk_info: 350720,(len: 1444864 oid: 3:d8326ea3:::folio03338830-2 low_tier:0 offset: 350720 flags: has_reference)