Bug #63428
openRGW: multipart get wrong storage class metadata
0%
Description
Hi,
When I upload a large file and cancel it, the remaining multipart is in the cold pool, but its storage class is always DEFAULT or empty. This may cause confusion when calculating storage class usage.
$ ceph df
--- POOLS ---
POOL ID PGS STORED OBJECTS USED %USED MAX AVAIL
default.rgw.buckets.data 7 32 2 B 4 4 KiB 0 98 GiB
default.rgw.cold.data 8 128 948 MiB 234 948 MiB 0.94 98 GiB
$ radosgw-admin bucket list
{
"name": "_multipart_testfile6.2~wO3cajJfOJm_X2B1i-fLGzHNBUl8hAB.1",
"instance": "",
"ver": {
"pool": 8,
"epoch": 0
},
"locator": "",
"exists": true,
"meta": {
"category": 1,
"size": 16777216,
"mtime": "2023-11-03T06:51:01.771850Z",
"etag": "2c7ab85a893283e98c931e9511add182",
"storage_class": "",
"owner": "0123456789abcdef0123456789abcdef0123456789abcdef0123456789abcdef",
"owner_display_name": "youruseridhere",
"content_type": "",
"accounted_size": 16777216,
"user_data": "",
"appendable": false
},
"tag": "_5rUvya1gN_1V3Fu6n8_Ck3pYD7hcucF",
"flags": 0,
"pending_map": [],
"versioned_epoch": 0
},
Updated by Huy Nguyen about 1 month ago
As we can see here, default.rgw.cold.data has 0.94% used that mean the multipart object is located on cold pool. But its storage class tell different "storage_class": ""
$ ceph df
--- POOLS ---
POOL ID PGS STORED OBJECTS USED %USED MAX AVAIL
default.rgw.buckets.data 7 32 2 B 4 4 KiB 0 98 GiB
default.rgw.cold.data 8 128 948 MiB 234 948 MiB 0.94 98 GiB
$ radosgw-admin bucket list
...
{
"name": "_multipart_testfile6.2~wO3cajJfOJm_X2B1i-fLGzHNBUl8hAB.1",
"instance": "",
"ver": {
"pool": 8,
"epoch": 0
},
"locator": "",
"exists": true,
"meta": {
"category": 1,
"size": 16777216,
"mtime": "2023-11-03T06:51:01.771850Z",
"etag": "2c7ab85a893283e98c931e9511add182",
"storage_class": "",
"owner": "0123456789abcdef0123456789abcdef0123456789abcdef0123456789abcdef",
"owner_display_name": "youruseridhere",
"content_type": "",
"accounted_size": 16777216,
"user_data": "",
"appendable": false
},
"tag": "_5rUvya1gN_1V3Fu6n8_Ck3pYD7hcucF",
"flags": 0,
"pending_map": [],
"versioned_epoch": 0
}
Updated by Konstantin Shalygin 26 days ago
- Status changed from New to Fix Under Review
- Assignee set to Huy Nguyen
- Target version set to v20.0.0
- Source set to Community (user)
- Backport set to quincy reef squid
- Pull request ID set to 56608