rgw: qlen and qactive perf counters leak
In our environment the rgw qlen and qactive perf counters seem to trend slowly upwards. See the plot attached.
I suspect there is a case where the client IO is completed without the qlen/qactive counters getting decremented.
For context, we are trying to see if rgw_max_concurrent_requests can be tuned down to limit the peak rgw memory usage. So we want to monitor how many existing concurrent IOs we have in prod, but clearly this qlen counter isn't reliable for that. We'll send a separate PR to expose the throttle `outstanding_requests` values in a new perf counter to solve this separately, but maybe the qlen leak is obvious to someone?
#1 Updated by Dan van der Ster over 2 years ago
We'll send a separate PR to expose the throttle `outstanding_requests` values in a new perf counter
#2 Updated by Mark Kogan over 2 years ago
- Assignee set to Mark Kogan
#3 Updated by Aleksandr Rudenko almost 2 years ago
We can see same behavior on 14.2.15.