Project

General

Profile

Actions
Copy link

Bug #16309

closed

rgw: bucket listing hangs on versioned bucket

Added by Osamu KIMURA almost 8 years ago. Updated almost 8 years ago.

Status:
Duplicate
Priority:
High
Assignee:
Orit Wasserman
Target version:
-
% Done:

0%

Source:
Community (dev)
Tags:
Backport:
Regression:
No
Severity:
2 - major
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

GET BUCKET (List Objects) S3 API hangs on a versioned bucket.
The API was terminated with 500 server error (FastCGI timeout), but RGW's internal listing process continued until the RGW was restarted.

RGW repeatedly tries to get information for a specific object that has null version and another version as bellow.

<?xml version="1.0" encoding="UTF-8"?>
<ListVersionsResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/">
 <Name>hojo-bucket-02</Name>
 <Prefix>testfile1896.txt</Prefix>
 <KeyMarker></KeyMarker>
 <MaxKeys>1000</MaxKeys>
 <IsTruncated>false</IsTruncated>
 <Version>
  <Key>testfile1896.txt</Key>
  <VersionId>2MSeTpZoDSqt2nTk1oYHZNmF1e84C.1</VersionId>
  <IsLatest>true</IsLatest>
  <LastModified>2016-05-30T08:39:52.000Z</LastModified>
  <ETag>&quot;1d24c7924b9798bb9064dcb043b3d989&quot;</ETag>
  <Size>3152</Size>
  <StorageClass>STANDARD</StorageClass>
  <Owner>
   <ID>XXXXXXXX</ID>
   <DisplayName>XXXXXXXX</DisplayName>
  </Owner>
 </Version>
 <Version>
  <Key>testfile1896.txt</Key>
  <VersionId>null</VersionId>
  <IsLatest>false</IsLatest>
  <LastModified>2016-05-30T02:43:22.000Z</LastModified>
  <ETag>&quot;20a4fc4c12598089a8937496a5eba67e&quot;</ETag>
  <Size>3052</Size>
  <StorageClass>STANDARD</StorageClass>
  <Owner>
   <ID>XXXXXXXX</ID>
   <DisplayName>XXXXXXXX</DisplayName>
  </Owner>
 </Version>
</ListVersionsResult>

<?xml version="1.0" encoding="UTF-8"?>
<ListVersionsResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/">
<Name>hojo-bucket-02</Name>
<Prefix>testfile1897.txt</Prefix>
<KeyMarker></KeyMarker>
<MaxKeys>1000</MaxKeys>
<IsTruncated>false</IsTruncated>
<Version>
 <Key>testfile1897.txt</Key>
 <VersionId>bPMbvEae4KIxSJZn9folT4sQtt7h0w3</VersionId>
 <IsLatest>true</IsLatest>
 <LastModified>2016-05-30T08:39:52.000Z</LastModified>
 <ETag>&quot;71d8c0b2fc4e320f7f82ce88b737f2dd&quot;</ETag>
 <Size>3152</Size>
 <StorageClass>STANDARD</StorageClass>
 <Owner>
  <ID>XXXXXXXX</ID>
  <DisplayName>XXXXXXXX</DisplayName>
 </Owner>
</Version>
<Version>
 <Key>testfile1897.txt</Key>
 <VersionId>null</VersionId>
 <IsLatest>false</IsLatest>
 <LastModified>2016-05-30T02:43:22.000Z</LastModified>
 <ETag>&quot;27fe674eeca8f3fcff844ad7e91816c9&quot;</ETag>
 <Size>3052</Size>
 <StorageClass>STANDARD</StorageClass>
 <Owner>
  <ID>XXXXXXXX</ID>
  <DisplayName>XXXXXXXX</DisplayName>
 </Owner>
</Version>
</ListVersionsResult>

Files

Download all files
radosgw-20160530.log.gz (580 KB) radosgw-20160530.log.gz Partial radosgw.log on 2016.05.30 Osamu KIMURA, 06/15/2016 05:15 AM
radosgw-20160601.log.gz (53.7 KB) radosgw-20160601.log.gz Partial radosgw.log on 2016.06.01 (reproduced) Osamu KIMURA, 06/15/2016 05:15 AM
radosgw-admin_bi_list-testfile1896.txt (5.69 KB) radosgw-admin_bi_list-testfile1896.txt Output of radosgw-admin bi list --bucket=hojo-bucket-02 --object=testfile1896.txt Osamu KIMURA, 07/01/2016 09:28 AM
Actions
Copy link

Also available in: Atom PDF