Ceph

12/16/2014

06:13 PM rgw Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind

Finally..mini test case.
1. New rgw instance
2. Create bucket + 4 x 10m objects (2 by fastcgi, 2 by civetweb)
3.... Richard Chan

05:54 PM rgw Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind

1. The issue is reproducible only on objects created by civetweb.
The bucket can be created by either civetweb or... Richard Chan

05:44 PM rgw Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind

Weird - the problem occurs with objects *created* by civetweb.
How to reproduce:
1. create new rgw instance
2.... Richard Chan

05:06 PM rgw Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind

The corruption occurs if civetweb is the first thing that touches a new rgw setup.
How to reproduce:
1. rmpool .... Richard Chan

04:35 PM rgw Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind

Suddenly civetweb is working, huh!!??
1. Delete 3 objects in succession
[
{ "tag": "default.7460.27",
... Richard Chan

04:23 PM rgw Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind

Logs with good gc behaviour:
1. rm 1 object # 3 oids expected
[root@cephadm ~]# radosgw-admin gc list --include-a... Richard Chan

01:36 AM rgw Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind

civetweb seems to "corrupt" the gc list.
1. rm one object (10M size) with civetweb, 3 oids in gc list
2. rm 2nd o... Richard Chan

12/15/2014

06:44 PM rgw Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind

Revert rgw_gc_max_objs to 32, problem remains. Richard Chan

06:40 PM rgw Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind

civetweb:
when you delete a second object, it does not appear in gc list --incude-all
How to reproduce:
1. add... Richard Chan

05:35 PM rgw Bug #10295: rgw deleting S3 objects leaves __shadow_ objects behind

The rgw parameters are in the global section.
Richard Chan