Project

General

Profile

Actions

Bug #63524

open

ceph_test_rados create object without reference

Added by Nitzan Mordechai 6 months ago. Updated 4 months ago.

Status:
In Progress
Priority:
Normal
Category:
deduplication
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

tier ops that add refs into the low_tier pools can hit overlap offset which causing few empty entries in low_tier objects

recreate:
1. run command:
ceph_test_rados --set_chunk --enable_dedup --low_tier_pool low_tier --dedup_chunk_size 131072 --dedup_chunk_algo fastcdc --max-ops 1500 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 25 --op delete 10 --op set_chunk 30 --op tier_promote 10 --op tier_evict 10 --op tier_flush 5 --op write_excl 25 --pool unique_pool_0

2. list the object in low_tier pool: rados -p low_tier ls

3. dump the chunk reference of one of the chunks:
ceph-dedup-tool --op dump-chunk-refs --chunk-pool low_tier --object 39dc6354c287437fcfba3f3e2c5f4c3837e563dbb69566160498140cbd2219ae

it should return json, few of them are empty.
if we check the osds log for those refs. we will see overlap error.

Actions #1

Updated by Radoslaw Zarzynski 6 months ago

scrub note: should the status be in progress?

Actions #2

Updated by Samuel Just 5 months ago

Can you add the "overlap error" lines to the bug?

Actions #3

Updated by Nitzan Mordechai 5 months ago

023-11-28T10:59:40.936+0000 7f28f73bf700 20 osd.0 pg_epoch: 19 pg[2.0( v 19'12 (0'0,19'12] local-lis/les=9/10 n=3 ec=9/9 lis/c=9/9 les/c/f=10/10/0 sis=9) [0] r=0 lpr=9 crt=19'12 lcod 19'11 mlcod 19'11 active+clean] do_osd_ops overlapped !! offset: 1441792 length: 455680 chunk_info: 350720,(len: 1444864 oid: 3:d8326ea3:::folio03338830-2 low_tier:0 offset: 350720 flags: has_reference)
Actions #4

Updated by Nitzan Mordechai 4 months ago

  • Assignee set to Nitzan Mordechai
Actions #5

Updated by Nitzan Mordechai 4 months ago

  • Status changed from New to In Progress
Actions #6

Updated by Nitzan Mordechai 4 months ago

  • Pull request ID set to 55125
Actions

Also available in: Atom PDF