Project

General

Profile

Actions

Bug #47927

closed

tools/rados: `rados ls` with json output can result in out of memory error

Added by J. Eric Ivancich over 3 years ago. Updated over 3 years ago.

Status:
Resolved
Priority:
Normal
Category:
-
Target version:
% Done:

0%

Source:
Tags:
Backport:
octopus,nautilus
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

When json or json-pretty output is used for `rados ls`, a formatter is used. Currently that formatter is only flushed when the entire output is generated.

A user had around 65 million objects in a pool and when they tried to do a json listing of the objects in the pool, they ran into issues.


Related issues 2 (0 open2 closed)

Copied to Ceph - Backport #47933: nautilus: tools/rados: `rados ls` with json output can result in out of memory errorResolvedNathan CutlerActions
Copied to Ceph - Backport #47934: octopus: tools/rados: `rados ls` with json output can result in out of memory errorResolvedNathan CutlerActions
Actions #1

Updated by J. Eric Ivancich over 3 years ago

  • Status changed from In Progress to Fix Under Review
  • Pull request ID set to 37739
Actions #2

Updated by J. Eric Ivancich over 3 years ago

  • Status changed from Fix Under Review to Pending Backport
Actions #3

Updated by Nathan Cutler over 3 years ago

  • Copied to Backport #47933: nautilus: tools/rados: `rados ls` with json output can result in out of memory error added
Actions #4

Updated by Nathan Cutler over 3 years ago

  • Copied to Backport #47934: octopus: tools/rados: `rados ls` with json output can result in out of memory error added
Actions #5

Updated by Nathan Cutler over 3 years ago

  • Status changed from Pending Backport to Resolved

While running with --resolve-parent, the script "backport-create-issue" noticed that all backports of this issue are in status "Resolved" or "Rejected".

Actions

Also available in: Atom PDF