Project

General

Profile

Bug #55809

"Leak_IndirectlyLost" valgrind report on mon.c

Added by Laura Flores almost 2 years ago. Updated 5 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
medium-hanging-fruit
Backport:
pacific,quincy
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

/a/yuriw-2022-05-27_21:59:17-rados-wip-yuri-testing-2022-05-27-0934-distro-default-smithi/6851271/remote/smithi085/log/valgrind/mon.c.log.gz

<error>
  <unique>0x6e2c6a6</unique>
  <tid>1</tid>
  <threadname>ceph-mon</threadname>
  <kind>Leak_IndirectlyLost</kind>
  <xwhat>
    <text>48 bytes in 2 blocks are indirectly lost in loss record 10 of 52</text>
    <leakedbytes>48</leakedbytes>
    <leakedblocks>2</leakedblocks>
  </xwhat>
  <stack>
    <frame>
      <ip>0x4C38B6F</ip>
      <obj>/usr/libexec/valgrind/vgpreload_memcheck-amd64-linux.so</obj>
      <fn>operator new[](unsigned long)</fn>
      <dir>/builddir/build/BUILD/valgrind-3.19.0/coregrind/m_replacemalloc</dir>
      <file>vg_replace_malloc.c</file>
      <line>640</line>
    </frame>
    <frame>
      <ip>0x54AE36B</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.2</obj>
      <fn>ceph::buffer::v15_2_0::ptr_node::create_hypercombined(ceph::unique_leakable_ptr&lt;ceph::buffer::v15_2_0::raw&gt;)</fn>
      <dir>/usr/src/debug/ceph-17.0.0-12503.ga847be1e.el8.x86_64/src/common</dir>
      <file>buffer.cc</file>
      <line>2264</line>
    </frame>
    <frame>
      <ip>0x5452611</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.2</obj>
      <fn>create</fn>
      <dir>/usr/src/debug/ceph-17.0.0-12503.ga847be1e.el8.x86_64/src/include</dir>
      <file>buffer.h</file>
      <line>377</line>
    </frame>
    <frame>
      <ip>0x5452611</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.2</obj>
      <fn>ProtocolV2::read_frame_segment()</fn>
      <dir>/usr/src/debug/ceph-17.0.0-12503.ga847be1e.el8.x86_64/src/msg/async</dir>
      <file>ProtocolV2.cc</file>
      <line>1189</line>
    </frame>
    <frame>
      <ip>0x5452AF7</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.2</obj>
      <fn>ProtocolV2::handle_read_frame_preamble_main(std::unique_ptr&lt;ceph::buffer::v15_2_0::ptr_node, ceph::buffer::v15_2_0::ptr_node::disposer&gt;&amp;&amp;, int)</fn>
      <dir>/usr/src/debug/ceph-17.0.0-12503.ga847be1e.el8.x86_64/src/msg/async</dir>
      <file>ProtocolV2.cc</file>
      <line>1132</line>
    </frame>
    <frame>
      <ip>0x543B09B</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.2</obj>
      <fn>ProtocolV2::run_continuation(Ct&lt;ProtocolV2&gt;&amp;)</fn>
      <dir>/usr/src/debug/ceph-17.0.0-12503.ga847be1e.el8.x86_64/src/msg/async</dir>
      <file>ProtocolV2.cc</file>
      <line>49</line>
    </frame>
    <frame>
      <ip>0x543B27E</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.2</obj>
      <fn>ProtocolV2::read_event()</fn>
      <dir>/usr/src/debug/ceph-17.0.0-12503.ga847be1e.el8.x86_64/src/msg/async</dir>
      <file>ProtocolV2.cc</file>
      <line>485</line>
    </frame>
    <frame>
      <ip>0x54013FB</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.2</obj>
      <fn>AsyncConnection::process()</fn>
      <dir>/usr/src/debug/ceph-17.0.0-12503.ga847be1e.el8.x86_64/src/msg/async</dir>
      <file>AsyncConnection.cc</file>
      <line>475</line>
    </frame>
    <frame>
      <ip>0x5461EB9</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.2</obj>
      <fn>EventCenter::process_events(unsigned int, std::chrono::duration&lt;unsigned long, std::ratio&lt;1l, 1000000000l&gt; &gt;*)</fn>
      <dir>/usr/src/debug/ceph-17.0.0-12503.ga847be1e.el8.x86_64/src/msg/async</dir>
      <file>Event.cc</file>
      <line>449</line>
    </frame>
    <frame>
      <ip>0x546903D</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.2</obj>
      <fn>operator()</fn>
      <dir>/usr/src/debug/ceph-17.0.0-12503.ga847be1e.el8.x86_64/src/msg/async</dir>
      <file>Stack.cc</file>
      <line>50</line>
    </frame>
    <frame>
      <ip>0x546903D</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.2</obj>
      <fn>std::_Function_handler&lt;void (), NetworkStack::add_thread(Worker*)::{lambda()#1}&gt;::_M_invoke(std::_Any_data const&amp;)</fn>
      <dir>/usr/include/c++/8/bits</dir>
      <file>std_function.h</file>
      <line>297</line>
    </frame>
    <frame>
      <ip>0x81F8BA2</ip>
      <obj>/usr/lib64/libstdc++.so.6.0.25</obj>
    </frame>
    <frame>
      <ip>0x784C1C9</ip>
      <obj>/usr/lib64/libpthread-2.28.so</obj>
      <fn>start_thread</fn>
    </frame>
    <frame>
      <ip>0x8A9ED82</ip>
      <obj>/usr/lib64/libc-2.28.so</obj>
      <fn>clone</fn>
    </frame>
  </stack>
</error>


Related issues

Related to Ceph - Bug #54603: Valgrind reports memory "Leak_IndirectlyLost" errors on ceph-mon in "buffer::ptr_node::create_hypercombined". New
Related to RADOS - Bug #58739: "Leak_IndirectlyLost" valgrind report on mon.a New
Duplicated by RADOS - Bug #53767: qa/workunits/cls/test_cls_2pc_queue.sh: killing an osd during thrashing causes timeout Duplicate

History

#1 Updated by Laura Flores almost 2 years ago

  • Related to Bug #54603: Valgrind reports memory "Leak_IndirectlyLost" errors on ceph-mon in "buffer::ptr_node::create_hypercombined". added

#2 Updated by Laura Flores almost 2 years ago

Laura Flores wrote:

/a/yuriw-2022-05-27_21:59:17-rados-wip-yuri-testing-2022-05-27-0934-distro-default-smithi/6851271/remote/smithi085/log/valgrind/mon.c.log.gz
[...]

Added a relation to #54603 because the error frames look slightly different. Also, the test on which it failed was different.

Description: rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind}

Failure reason: Command failed (workunit test cls/test_cls_rgw_stats.sh) on smithi085 with status 124: 'mkdir p - /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=a847be1e97ec9c953b2352ff329516e826d4d048 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh'

#3 Updated by Radoslaw Zarzynski over 1 year ago

  • Tags set to low-hanging-fruit

#4 Updated by Laura Flores over 1 year ago

  • Duplicated by Bug #53767: qa/workunits/cls/test_cls_2pc_queue.sh: killing an osd during thrashing causes timeout added

#5 Updated by Laura Flores over 1 year ago

/a/yuriw-2022-07-19_23:25:12-rados-wip-yuri2-testing-2022-07-15-0755-pacific-distro-default-smithi/6939513

#6 Updated by Radoslaw Zarzynski over 1 year ago

  • Backport set to pacific,quincy

#7 Updated by Laura Flores over 1 year ago

  • Tags set to low-hanging-fruit
  • Tags deleted (low-hanging-fruit)

#8 Updated by Laura Flores over 1 year ago

/a/yuriw-2022-08-03_20:33:43-rados-wip-yuri8-testing-2022-08-03-1028-quincy-distro-default-smithi/6957591

#9 Updated by Radoslaw Zarzynski over 1 year ago

  • Tags set to medium-hanging-fruit

#10 Updated by Laura Flores over 1 year ago

  • Tags deleted (low-hanging-fruit)

#11 Updated by Kamoltat (Junior) Sirivadhna over 1 year ago

/a/yuriw-2022-10-12_16:24:50-rados-wip-yuri8-testing-2022-10-12-0718-quincy-distro-default-smithi/7063948/

#12 Updated by Laura Flores about 1 year ago

  • Related to Bug #58739: "Leak_IndirectlyLost" valgrind report on mon.a added

#13 Updated by Laura Flores 10 months ago

/a/yuriw-2023-05-10_14:47:51-rados-wip-yuri5-testing-2023-05-09-1324-pacific-distro-default-smithi/7269818/smithi043/log/valgrind/mon.c.log.gz

#14 Updated by Laura Flores 7 months ago

/a/yuriw-2023-08-16_22:44:42-rados-wip-yuri7-testing-2023-08-16-1309-pacific-distro-default-smithi/7371564/remote/smithi046/log/valgrind/mon.a.log.gz

#15 Updated by Laura Flores 5 months ago

/a/yuriw-2023-09-27_20:58:29-rados-wip-yuri8-testing-2023-09-27-0951-quincy-distro-default-smithi/7405167

Also available in: Atom PDF