Project

General

Profile

Actions
Copy link

Support #61644

open

The num of objects from "rados cmd" not equal with "s3 api"?

Added by can zhu 11 months ago. Updated 3 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Target version:
-
% Done:

0%

Tags:
Reviewed:
Affected Versions:
Ceph - v16.2.7
Pull request ID:

Description

List objects withe rados cmd like this:
"rados -p oss.rgw.buckets.index ls | grep "c2af65dc-b456-4f5a-be6a-2a142adeea75.335721.1" | awk '{print "rados listomapkeys -p oss.rgw.buckets.index "$1 }'|sh -x >& rados.log"

total objects: 395797

List objects with s3 api:
total objects: 67498

there is some objects, I don't what is wth rados cmd?
"?1000_2020-01-16-DataCollection/sentry/bags/Deeproute_2020-01-17-06-00-58_tz-8.bagiJjN6N.ndal4eiX2oHIwNTZzurvQ9mVl
?1000_2020-01-16-DataCollection/sentry/logs/universal/Deeproute_2020-01-17-05-58-08_tz-8.jsonibnPc47eGcuwSwQnmhfA.LpEb7muIQFV
?1000_2020-01-17-DataCollection/SSD02/sentry/bags/Deeproute_2020-01-17-07-14-52_tz-8.bagiCcjspnQNFsxaCg2ddD7WvJcPesFTUPT
?1000_2020-01-17-DataCollection/SSD02/sentry/bags/Deeproute_2020-01-17-07-14-52_tz-8.bagiFWZgfD.lc3IyVQlcW5bH6wZex565xNE
?1000_2020-01-17-DataCollection/SSD02/sentry/bags/Deeproute_2020-01-17-07-17-37_tz-8.bagiOrky6SJXkTwPPy8mXA5T.jnHmfWACXT
?1000_2020-01-17-DataCollection/SSD02/sentry/bags/Deeproute_2020-01-17-07-17-37_tz-8.bagiU9W8k4nqvYjF8J6MBO.bzvkKz16enkj
?1000_DR-MKZ-1_20220217_215010/bags/important/Necessary/DR_MKZ_1_20220217_221715.Necessary.bagitRa6Y72HyJW99tY6wLF^Z"

Actions
Copy link
 #1

Updated by Alex Wojno 3 months ago

The rados objects you are seeing with the "?" are special objects that are used to maintain metadata about the S3 objects. This is expected behavior.

Actions
Copy link

Also available in: Atom PDF