Project

General

Profile

Bug #16309

Updated by Orit Wasserman almost 8 years ago

GET BUCKET (List Objects) S3 API hangs on a versioned bucket. 
 The API was terminated with 500 server error (FastCGI timeout), but RGW's internal listing process continued until the RGW was restarted. 

 RGW repeatedly tries to get information for a specific object that has null version and another version as bellow. 

 <pre> 
 <?xml version="1.0" encoding="UTF-8"?> 
 <ListVersionsResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"> 
  <Name>hojo-bucket-02</Name> 
  <Prefix>testfile1896.txt</Prefix> 
  <KeyMarker></KeyMarker> 
  <MaxKeys>1000</MaxKeys> 
  <IsTruncated>false</IsTruncated> 
  <Version> 
   <Key>testfile1896.txt</Key> 
   <VersionId>2MSeTpZoDSqt2nTk1oYHZNmF1e84C.1</VersionId> 
   <IsLatest>true</IsLatest> 
   <LastModified>2016-05-30T08:39:52.000Z</LastModified> 
   <ETag>&quot;1d24c7924b9798bb9064dcb043b3d989&quot;</ETag> 
   <Size>3152</Size> 
   <StorageClass>STANDARD</StorageClass> 
   <Owner> 
    <ID>XXXXXXXX</ID> 
    <DisplayName>XXXXXXXX</DisplayName> 
   </Owner> 
  </Version> 
  <Version> 
   <Key>testfile1896.txt</Key> 
   <VersionId>null</VersionId> 
   <IsLatest>false</IsLatest> 
   <LastModified>2016-05-30T02:43:22.000Z</LastModified> 
   <ETag>&quot;20a4fc4c12598089a8937496a5eba67e&quot;</ETag> 
   <Size>3052</Size> 
   <StorageClass>STANDARD</StorageClass> 
   <Owner> 
    <ID>XXXXXXXX</ID> 
    <DisplayName>XXXXXXXX</DisplayName> 
   </Owner> 
  </Version> 
 </ListVersionsResult> 
 </pre> 

 <pre> 
 <?xml version="1.0" encoding="UTF-8"?> 
 <ListVersionsResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"> 
 <Name>hojo-bucket-02</Name> 
 <Prefix>testfile1897.txt</Prefix> 
 <KeyMarker></KeyMarker> 
 <MaxKeys>1000</MaxKeys> 
 <IsTruncated>false</IsTruncated> 
 <Version> 
  <Key>testfile1897.txt</Key> 
  <VersionId>bPMbvEae4KIxSJZn9folT4sQtt7h0w3</VersionId> 
  <IsLatest>true</IsLatest> 
  <LastModified>2016-05-30T08:39:52.000Z</LastModified> 
  <ETag>&quot;71d8c0b2fc4e320f7f82ce88b737f2dd&quot;</ETag> 
  <Size>3152</Size> 
  <StorageClass>STANDARD</StorageClass> 
  <Owner> 
   <ID>XXXXXXXX</ID> <ID>ZYP03218</ID> 
   <DisplayName>XXXXXXXX</DisplayName> <DisplayName>ZYP03218</DisplayName> 
  </Owner> 
 </Version> 
 <Version> 
  <Key>testfile1897.txt</Key> 
  <VersionId>null</VersionId> 
  <IsLatest>false</IsLatest> 
  <LastModified>2016-05-30T02:43:22.000Z</LastModified> 
  <ETag>&quot;27fe674eeca8f3fcff844ad7e91816c9&quot;</ETag> 
  <Size>3052</Size> 
  <StorageClass>STANDARD</StorageClass> 
  <Owner> 
   <ID>XXXXXXXX</ID> <ID>ZYP03218</ID> 
   <DisplayName>XXXXXXXX</DisplayName> <DisplayName>ZYP03218</DisplayName> 
  </Owner> 
 </Version> 
 </ListVersionsResult> 
 </pre>

Back