Project

General

Profile

Actions
Copy link

Bug #53599

closed

Memory leak in radosgw-admin bucket chown command

Added by Mohammad Fatemipour over 2 years ago. Updated over 1 year ago.

Status:
Resolved
Priority:
Normal
Assignee:
-
Target version:
-
% Done:

100%

Source:
Community (user)
Tags:
chown, radosgw-admin, rgw
Backport:
octopus pacific quincy
Regression:
No
Severity:
1 - critical
Reviewed:
Affected Versions:
Ceph - v15.2.12
ceph-qa-suite:
rgw
Pull request ID:
44357
Crash signature (v1):
Crash signature (v2):

Description

I have a bucket with millions of objects, when i want to change owner of its objects with radosgw-admin bucket chwon command, memory usage of radosgw-admin process raised continuously.
In my case changing owner of 1042000 objects took more than 7 hours and memory usage of radosg-admin process reached to 20GB.

My ceph version is 15.2.12

Files

Download all files
radosgw-admin-leak.png (18.9 KB) radosgw-admin-leak.png this chart represents the strage usage of memory by radosgw-admin bucket chwon command Mohammad Fatemipour, 12/13/2021 09:26 PM
Captura de pantalla 2021-12-29 a las 10.00.43.png (70 KB) Captura de pantalla 2021-12-29 a las 10.00.43.png Felix Barbeira, 12/29/2021 09:01 AM

Related issues 3 (0 open — 3 closed)

Copied to rgw - Backport #54075: octopus: Memory leak in radosgw-admin bucket chown commandResolvedCory SnyderActions
Copied to rgw - Backport #54076: quincy: Memory leak in radosgw-admin bucket chown commandResolvedCory SnyderActions
Copied to rgw - Backport #54077: pacific: Memory leak in radosgw-admin bucket chown commandResolvedCory SnyderActions
Actions
Copy link
 #1

Updated by Felix Barbeira over 2 years ago

It happens to me as well. I tried to chown a large bucket with 450897 objects (2.3TB).

Memory starts to increase until the process crash (no system resources).

I had to double RAM size on the monitors to accomplish this chown operation.

Ceph version: 15.2.9 (deb packages)
SO: Ubuntu 18

Actions
Copy link
 #2

Updated by Mohammad Fatemipour over 2 years ago

I find and fixed the issue (https://github.com/ceph/ceph/pull/44357) and waiting for merge

Actions
Copy link
 #3

Updated by Daniel Gryniewicz over 2 years ago

  • Backport set to octopus, pacific
  • Pull request ID set to 44357
Actions
Copy link
 #4

Updated by Casey Bodley about 2 years ago

  • Status changed from New to Fix Under Review
Actions
Copy link
 #5

Updated by Casey Bodley about 2 years ago

  • Status changed from Fix Under Review to Pending Backport
  • Backport changed from octopus, pacific to octopus pacific quincy
Actions
Copy link
 #6

Updated by Backport Bot about 2 years ago

  • Copied to Backport #54075: octopus: Memory leak in radosgw-admin bucket chown command added
Actions
Copy link
 #7

Updated by Backport Bot about 2 years ago

  • Copied to Backport #54076: quincy: Memory leak in radosgw-admin bucket chown command added
Actions
Copy link
 #8

Updated by Backport Bot about 2 years ago

  • Copied to Backport #54077: pacific: Memory leak in radosgw-admin bucket chown command added
Actions
Copy link
 #9

Updated by Backport Bot over 1 year ago

  • Tags changed from chown, radosgw-admin, rgw to chown, radosgw-admin, rgw backport_processed
Actions
Copy link
 #10

Updated by Konstantin Shalygin over 1 year ago

  • Status changed from Pending Backport to Resolved
  • Tags changed from chown, radosgw-admin, rgw backport_processed to chown, radosgw-admin, rgw
Actions
Copy link
 #11

Updated by Konstantin Shalygin over 1 year ago

  • % Done changed from 0 to 100
Actions
Copy link

Also available in: Atom PDF