Actions
Bug #48729
closedBluestore memory leak on srub operations
Status:
Resolved
Priority:
Normal
Assignee:
-
Target version:
-
% Done:
0%
Source:
Tags:
Backport:
Regression:
No
Severity:
2 - major
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
We observed some unlimited growing ram on OSD processes.
During our investigation (valgrind), we gathered information about memory leak.
==3288134== ==3288134== 1,482,956,416 bytes in 6,390,722 blocks are possibly lost in loss record 4,882 of 4,883 ==3288134== at 0xABF4E76: memalign (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so) ==3288134== by 0xABF4FE1: posix_memalign (in /usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so) ==3288134== by 0x10DA5CA: ceph::buffer::v14_2_0::create_aligned_in_mempool(unsigned int, unsigned int, int) (buffer.cc:121) ==3288134== by 0x10DA7A1: ceph::buffer::v14_2_0::create_aligned(unsigned int, unsigned int) (buffer.cc:417) ==3288134== by 0x10DB15B: ceph::buffer::v14_2_0::copy(char const*, unsigned int) (buffer.cc:365) ==3288134== by 0xD3858E: BlueStore::Onode::decode(boost::intrusive_ptr<BlueStore::Collection>, ghobject_t const&, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&, ceph::buffer::v14_2_0::list const&) (buffer.h:233) ==3288134== by 0xD3BB84: BlueStore::Collection::get_onode(ghobject_t const&, bool) (BlueStore.cc:3467) ==3288134== by 0xD566DE: BlueStore::stat(boost::intrusive_ptr<ObjectStore::CollectionImpl>&, ghobject_t const&, stat*, bool) (BlueStore.cc:8908) ==3288134== by 0xAFCBA7: PGBackend::be_scan_list(ScrubMap&, ScrubMapBuilder&) (PGBackend.cc:586) ==3288134== by 0x98CD1A: PG::build_scrub_map_chunk(ScrubMap&, ScrubMapBuilder&, hobject_t, hobject_t, bool, ThreadPool::TPHandle&) (PG.cc:5047) ==3288134== by 0x9BCADA: PG::chunky_scrub(ThreadPool::TPHandle&) (PG.cc:5673) ==3288134== by 0x9BDF5E: PG::scrub(unsigned int, ThreadPool::TPHandle&) (PG.cc:5237)
After some time OSD process is killed by OOM Killer
Actions