Project

General

Profile

Actions

Backport #43823

closed

nautilus: rgw: push rgw bucket listing with prefixes and delimiters logic/filtering to the cls layer to improve performance

Added by Nathan Cutler about 4 years ago. Updated about 3 years ago.

Status:
Rejected
Priority:
Normal
Target version:
-
Release:
nautilus
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Related issues 1 (0 open1 closed)

Copied from rgw - Feature #41051: rgw: push rgw bucket listing with prefixes and delimiters logic/filtering to the cls layer to improve performanceResolvedJ. Eric Ivancich

Actions
Actions #1

Updated by Nathan Cutler about 4 years ago

  • Copied from Feature #41051: rgw: push rgw bucket listing with prefixes and delimiters logic/filtering to the cls layer to improve performance added
Actions #2

Updated by Nathan Cutler about 4 years ago

  • Status changed from New to Need More Info

10 commits - asking a developer to do this one

Actions #3

Updated by J. Eric Ivancich about 4 years ago

  • Status changed from Need More Info to In Progress
  • Assignee set to J. Eric Ivancich
Actions #4

Updated by Michael Bisig about 4 years ago

Hi all,
Thanks for the feature and the work to backport it to Nautilus!
We are currently experiencing such a bucket index listing limitation in one of our buckets which has millions of objects and we were in contact with Paul for this case as well.

We hope this feature will improve the performance for our usecase.

What is the target backport release of this feature?
Thanks in advance for your time.

Actions #5

Updated by Dan van der Ster over 3 years ago

I assume this is not going to be backported to nautilus? If so, it also needs #44353 AFAICT

Actions #6

Updated by J. Eric Ivancich over 3 years ago

  • Status changed from In Progress to New

Backporting this to nautilus is not a priority for me.

Actions #7

Updated by Nathan Cutler over 3 years ago

  • Status changed from New to Need More Info

large-scale backport already assigned to Eric

Actions #8

Updated by J. Eric Ivancich over 3 years ago

Nathan Cutler wrote:

large-scale backport already assigned to Eric

I'm unclear what are you looking for, Nathan.... Are you looking for more information from me?

Actions #9

Updated by Nathan Cutler over 3 years ago

  • Assignee deleted (J. Eric Ivancich)

Eric, I guess you wanted to unassign yourself so I just did that for you.

Actions #10

Updated by Nathan Cutler over 3 years ago

Eric Ivancich wrote:

Nathan Cutler wrote:

large-scale backport already assigned to Eric

I'm unclear what are you looking for, Nathan.... Are you looking for more information from me?

This is a non-trivial backport that needs to be done carefully. So, to clarify a little what I'm trying to achieve. When a backport issue is in "New" status, backporters will be tempted to run the backporting script on it. So we get multiple people trying to run the script, seeing the conflicts, and moving on. Sometimes even the same person runs the script on the issue multiple times.

To avoid wasting people's time, I change the status to "Need More Info" to signify that the backport is non-trivial.

Actions #11

Updated by J. Eric Ivancich about 3 years ago

Nathan Cutler wrote:

Eric Ivancich wrote:

Nathan Cutler wrote:

large-scale backport already assigned to Eric

I'm unclear what are you looking for, Nathan.... Are you looking for more information from me?

This is a non-trivial backport that needs to be done carefully. So, to clarify a little what I'm trying to achieve. When a backport issue is in "New" status, backporters will be tempted to run the backporting script on it. So we get multiple people trying to run the script, seeing the conflicts, and moving on. Sometimes even the same person runs the script on the issue multiple times.

To avoid wasting people's time, I change the status to "Need More Info" to signify that the backport is non-trivial.

Nathan,

I don't think this backport will ever be done; I don't think it's worth the effort. I'd like to close this as Rejected. And then I'd like to remove the backport entry from https://tracker.ceph.com/issues/41051 and mark that as resolved.

Would you be OK with the above?

Thanks,

Eric

Actions #12

Updated by Nathan Cutler about 3 years ago

I'd like to close this as Rejected. And then I'd like to remove the backport entry from https://tracker.ceph.com/issues/41051 and mark that as resolved.

Eric, as far as I'm concerned, you are welcome to mark any backport issue as Rejected when and as you see fit.

However, when a backport ticket is placed in "Rejected" state, the backport should remain in the Backport field of the parent issue, so please don't remove it. If it is removed, the script sees that a backport issue exists for a backport that was not called for and complains, which then causes me to re-add the backport to the Backport field to appease the script ;-)

Actions #13

Updated by Nathan Cutler about 3 years ago

  • Assignee set to J. Eric Ivancich
Actions #14

Updated by J. Eric Ivancich about 3 years ago

  • Status changed from Need More Info to Rejected

The engineering effort required for this non-trivial backport is not worth it.

Actions

Also available in: Atom PDF