Project

General

Profile

Actions

Bug #45816

closed

[notifications] reading topic info for every op overloads the osd

Added by Yuval Lifshitz almost 4 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
High
Assignee:
Or Friedmann
Target version:
-
% Done:

0%

Source:
Community (user)
Tags:
pubsub
Backport:
nautilus octopus
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

reported here: https://marc.info/?l=ceph-users&m=159091210202115&w=2

for every operation we need to check if notifications are configured for the bucket, this is done via a call to: "rgw_get_system_obj()"
however, on large scale, this is overloading a one OSD.


Related issues 2 (0 open2 closed)

Copied to rgw - Backport #46593: octopus: [notifications] reading topic info for every op overloads the osdResolvedNathan CutlerActions
Copied to rgw - Backport #46594: nautilus: [notifications] reading topic info for every op overloads the osdResolvedNathan CutlerActions
Actions #1

Updated by Yuval Lifshitz almost 4 years ago

note that when OSD replies with ENOENT (when no topics are configured for that user), this reply is not cached, so, OSD is being queries for every op

Actions #2

Updated by Or Friedmann almost 4 years ago

  • Assignee changed from Yuval Lifshitz to Or Friedmann
Actions #3

Updated by Casey Bodley almost 4 years ago

  • Status changed from New to Triaged
Actions #4

Updated by Casey Bodley almost 4 years ago

  • Status changed from Triaged to In Progress
Actions #5

Updated by Or Friedmann almost 4 years ago

  • Status changed from In Progress to Fix Under Review
  • Pull request ID set to 35777
Actions #6

Updated by Casey Bodley almost 4 years ago

  • Status changed from Fix Under Review to Pending Backport
Actions #7

Updated by Nathan Cutler almost 4 years ago

  • Copied to Backport #46593: octopus: [notifications] reading topic info for every op overloads the osd added
Actions #8

Updated by Nathan Cutler almost 4 years ago

  • Copied to Backport #46594: nautilus: [notifications] reading topic info for every op overloads the osd added
Actions #9

Updated by Nathan Cutler over 3 years ago

  • Status changed from Pending Backport to Resolved

While running with --resolve-parent, the script "backport-create-issue" noticed that all backports of this issue are in status "Resolved" or "Rejected".

Actions

Also available in: Atom PDF