Bug #50552: rgw: set_olh return -2 when resharding - rgw - Ceph

Actions

Copy link

Bug #50552

open

rgw: set_olh return -2 when resharding

Added by Xuehan Xu about 3 years ago. Updated almost 3 years ago.

Status:

Triaged

Priority:

Normal

Assignee:

Mark Kogan

Target version:

% Done:

Source:

Community (dev)

Tags:

Backport:

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

Recently, we found that if we open versioning, some object versions may be lost, it seems that this is due to resharding.

Here is the log output:

2021-04-27 19:35:03.308 7f6a317fa700 0 RGWReshardLock::lock failed to acquire lock on base-bucket2:ebe5dd13-0db4-4739-836c-1486abde1cde.4912.11 ret=-16
2021-04-27 19:35:03.764 7f6a32ffd700 0 RGWReshardLock::lock failed to acquire lock on base-bucket2:ebe5dd13-0db4-4739-836c-1486abde1cde.4912.11 ret=-16
2021-04-27 19:35:08.022 7f6a7ffff700 0 RGWReshardLock::lock failed to acquire lock on base-bucket2:ebe5dd13-0db4-4739-836c-1486abde1cde.4912.11 ret=-16
2021-04-27 19:35:08.022 7f6a33fff700 0 RGWReshardLock::lock failed to acquire lock on base-bucket2:ebe5dd13-0db4-4739-836c-1486abde1cde.4912.11 ret=-16
2021-04-27 19:35:08.256 7f6a30ff9700 0 RGWReshardLock::lock failed to acquire lock on base-bucket2:ebe5dd13-0db4-4739-836c-1486abde1cde.4912.11 ret=-16
2021-04-27 19:35:08.257 7f6b7a307700 0 RGWReshardLock::lock failed to acquire lock on base-bucket2:ebe5dd13-0db4-4739-836c-1486abde1cde.4912.11 ret=-16
2021-04-27 19:35:08.257 7f6a53fff700 0 RGWReshardLock::lock failed to acquire lock on base-bucket2:ebe5dd13-0db4-4739-836c-1486abde1cde.4912.11 ret=-16
2021-04-27 19:35:08.372 7f6a317fa700 0 RGWReshardLock::lock failed to acquire lock on base-bucket2:ebe5dd13-0db4-4739-836c-1486abde1cde.4912.11 ret=-16
2021-04-27 19:35:08.850 7f6a32ffd700 0 RGWReshardLock::lock failed to acquire lock on base-bucket2:ebe5dd13-0db4-4739-836c-1486abde1cde.4912.11 ret=-16
2021-04-27 19:35:14.251 7f6b7a307700 0 check_bucket_shards: resharding needed: stats.num_objects=100070 shard max_objects=100000
2021-04-27 19:35:14.279 7f6a317fa700 0 cls_rgw_bucket_link_olh() returned r=-2
2021-04-27 19:35:14.279 7f6a317fa700 0 bucket_index_link_olh() target_obj=base-bucket2:_:xkNfxlu774LD0RSWFgTwivoXhNOqAMQ_flow-ndg4zg/pcaps/2021042719/27171091938291920 delete_marker=0 returned -2
2021-04-27 19:35:14.616 7f6b79b06700 0 check_bucket_shards: resharding needed: stats.num_objects=100074 shard max_objects=100000
2021-04-27 19:35:15.591 7f6a52ffd700 0 check_bucket_shards: resharding needed: stats.num_objects=100075 shard max_objects=100000
2021-04-27 19:36:07.111 7f6a7d7fa700 0 check_bucket_shards: resharding needed: stats.num_objects=100383 shard max_objects=100000