Project

General

Profile

Actions

Bug #48721

open

tcmalloc doesn't release memory

Added by Seena Fallah over 3 years ago. Updated over 3 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
nautilus, octopus
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Ceph Monitor isn't releasing memory for about many days! Using nautilus 14.2.14.

MALLOC:    17195971312 (16399.4 MiB) Bytes in use by application
MALLOC: +            0 (    0.0 MiB) Bytes in page heap freelist
MALLOC: +     56086496 (   53.5 MiB) Bytes in central cache freelist
MALLOC: +     21863584 (   20.9 MiB) Bytes in transfer cache freelist
MALLOC: +    126345360 (  120.5 MiB) Bytes in thread cache freelists
MALLOC: +     56094912 (   53.5 MiB) Bytes in malloc metadata
MALLOC:   ------------
MALLOC: =  17456361664 (16647.7 MiB) Actual memory used (physical + swap)
MALLOC: +  19598409728 (18690.5 MiB) Bytes released to OS (aka unmapped)
MALLOC:   ------------
MALLOC: =  37054771392 (35338.2 MiB) Virtual address space used
MALLOC:
MALLOC:         235569              Spans in use
MALLOC:             24              Thread heaps in use
MALLOC:           8192              Tcmalloc page size

Actions #1

Updated by Josh Durgin over 3 years ago

Those stats show the memory is mostly used by the mon or released by tcmalloc but the kernel hasn't reclaimed it.

'in use by application' means the mon is still using it.
'released to OS' means tcmalloc has freed it, but the kernel hasn't claimed the memory back from the process yet

Actions #2

Updated by Seena Fallah over 3 years ago

Josh Durgin wrote:

Those stats show the memory is mostly used by the mon or released by tcmalloc but the kernel hasn't reclaimed it.

Is that a kernel bug or is there any config I should set for the reclaim to proceed?
I'm using kernel 4.15.0-124-generic on ubuntu 18.04.5.

Actions

Also available in: Atom PDF