Project

General

Profile

Bug #35994

Configurable ListBucket max-keys limit

Added by Robin Johnson 4 months ago. Updated about 13 hours ago.

Status:
Resolved
Priority:
Normal
Assignee:
Target version:
-
Start date:
09/15/2018
Due date:
% Done:

0%

Source:
Community (dev)
Tags:
s3:ListBucket
Backport:
luminous, mimic
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
rgw
Pull request ID:

Description

ListBucket max-keys has no defined limit in the RGW codebase.

Presently it will fall all the way down to the limits in the OMAP code, which cap it at 128k omap keys or some byte value by the sum of the size of OMAP key+values.

Add a new configuration knob, with a default value of 1000 keys, to mirror AWS S3 behavior.


Related issues

Copied to rgw - Backport #37830: mimic: Configurable ListBucket max-keys limit Resolved
Copied to rgw - Backport #37831: luminous: Configurable ListBucket max-keys limit Resolved

History

#1 Updated by Sage Weil 11 days ago

  • Status changed from New to Pending Backport

#2 Updated by Nathan Cutler 8 days ago

  • Copied to Backport #37830: mimic: Configurable ListBucket max-keys limit added

#3 Updated by Nathan Cutler 8 days ago

  • Copied to Backport #37831: luminous: Configurable ListBucket max-keys limit added

#4 Updated by Nathan Cutler about 15 hours ago

  • Status changed from Pending Backport to Duplicate

#5 Updated by Nathan Cutler about 15 hours ago

  • Duplicated by Bug #35990: Chunked encoding fails if chunk greater than 1MiB added

#6 Updated by Nathan Cutler about 13 hours ago

  • Status changed from Duplicate to Pending Backport
  • Pull request ID set to 25793

#7 Updated by Nathan Cutler about 13 hours ago

  • Status changed from Pending Backport to Resolved

#8 Updated by Nathan Cutler about 13 hours ago

  • Duplicated by deleted (Bug #35990: Chunked encoding fails if chunk greater than 1MiB)

Also available in: Atom PDF