Project

General

Profile

Actions
Copy link

Bug #47440

open

nautilus: valgrind caught leak in Messenger::ms_deliver_verify_authorizer

Added by Deepika Upadhyay over 3 years ago. Updated almost 3 years ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

http://qa-proxy.ceph.com/teuthology/yuriw-2020-09-10_15:32:32-rados-wip-yuri2-testing-2020-09-08-1946-nautilus-distro-basic-smithi/5421004/teuthology.log

2020-09-10T21:27:02.352 INFO:teuthology.orchestra.run.smithi197.stderr:2020-09-10 21:27:02.385 7ff1eb1ac700 10 client.29500.objecter  successfully canceled tick
2020-09-10T21:27:02.353 INFO:teuthology.orchestra.run.smithi197.stderr:2020-09-10 21:27:02.385 7ff1eb1ac700  1 -- v1:172.21.15.197:0/1343060562 mark_down 0x7ff1c401bb60 -- 0x7ff1c401a8d0
2020-09-10T21:27:02.353 INFO:teuthology.orchestra.run.smithi197.stderr:2020-09-10 21:27:02.385 7ff1eb1ac700 10 monclient: shutdown
2020-09-10T21:27:02.353 INFO:teuthology.orchestra.run.smithi197.stderr:2020-09-10 21:27:02.385 7ff1eb1ac700  1 -- v1:172.21.15.197:0/1343060562 mark_down 0x7ff1d0000a50 -- 0x7ff1d0004320
2020-09-10T21:27:02.353 INFO:teuthology.orchestra.run.smithi197.stderr:2020-09-10 21:27:02.385 7ff1eb1ac700  1 -- v1:172.21.15.197:0/1343060562 mark_down_all
2020-09-10T21:27:02.353 INFO:teuthology.orchestra.run.smithi197.stderr:2020-09-10 21:27:02.385 7ff1eb1ac700  1 -- v1:172.21.15.197:0/1343060562 shutdown complete.
2020-09-10T21:27:02.354 INFO:teuthology.orchestra.run.smithi197.stderr:2020-09-10 21:27:02.385 7ff1eb1ac700  1 librados: shutdown
2020-09-10T21:27:02.364 INFO:teuthology.misc:Shutting down mds daemons...
2020-09-10T21:27:02.365 INFO:teuthology.misc:Shutting down osd daemons...
2020-09-10T21:27:02.365 DEBUG:tasks.ceph.osd.0:waiting for process to exit
2020-09-10T21:27:02.366 INFO:teuthology.orchestra.run:waiting for 300
2020-09-10T21:27:02.379 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-09-10 21:27:02.403 15863700 -1 received  signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 0  (PID: 35023) UID: 0
2020-09-10T21:27:02.379 INFO:tasks.ceph.osd.0.smithi197.stderr:2020-09-10 21:27:02.404 15863700 -1 osd.0 886 *** Got signal Terminated ***
2020-09-10T21:27:08.468 INFO:tasks.ceph.osd.0:Stopped
2020-09-10T21:27:08.469 DEBUG:tasks.ceph.osd.1:waiting for process to exit
2020-09-10T21:27:08.469 INFO:teuthology.orchestra.run:waiting for 300
2020-09-10T21:27:08.500 INFO:tasks.ceph.osd.1.smithi197.stderr:2020-09-10 21:27:08.511 1505e700 -1 received  signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 1  (PID: 35026) UID: 0
2020-09-10T21:27:08.501 INFO:tasks.ceph.osd.1.smithi197.stderr:2020-09-10 21:27:08.515 1505e700 -1 osd.1 890 *** Got signal Terminated ***
2020-09-10T21:27:14.570 INFO:tasks.ceph.osd.1:Stopped
2020-09-10T21:27:14.571 DEBUG:tasks.ceph.osd.2:waiting for process to exit
2020-09-10T21:27:14.572 INFO:teuthology.orchestra.run:waiting for 300
2020-09-10T21:27:14.604 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-09-10 21:27:14.612 16060700 -1 received  signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --vgdb=yes --exit-on-first-error=yes --error-exitcode=42 --tool=memcheck ceph-osd -f --cluster ceph -i 2  (PID: 35033) UID: 0
2020-09-10T21:27:14.605 INFO:tasks.ceph.osd.2.smithi197.stderr:2020-09-10 21:27:14.616 16060700 -1 osd.2 893 *** Got signal Terminated ***

valgrind termination

Actions
Copy link
 #1

Updated by Deepika Upadhyay over 3 years ago

  • Project changed from Ceph to RADOS
Actions
Copy link
 #2

Updated by Deepika Upadhyay over 3 years ago 

teuthology.log:2020-09-10T21:27:02.352 INFO:teuthology.orchestra.run.smithi197.stderr:2020-09-10 21:27:02.385 7ff1eb1ac700 20 client.29500.objecter shutdown clearing up homeless session...
teuthology.log:2020-09-10T21:27:02.352 INFO:teuthology.orchestra.run.smithi197.stderr:2020-09-10 21:27:02.385 7ff1eb1ac700 10 client.29500.objecter  successfully canceled tick
teuthology.log:2020-09-10T21:27:02.353 INFO:teuthology.orchestra.run.smithi197.stderr:2020-09-10 21:27:02.385 7ff1eb1ac700  1 -- v1:172.21.15.197:0/1343060562 mark_down 0x7ff1c401bb60 -- 0x7ff1c401a8d0


      <obj>/usr/bin/ceph-osd</obj>
      <fn>Messenger::ms_deliver_verify_authorizer(Connection*, int, int, ceph::buffer::v14_2_0::list&amp;, ceph::buffer::v14_2_0::list&amp;, bool&amp;, CryptoKey&amp;, std::string*, std::unique_ptr&lt;AuthAuthorizerChallenge, std::default_delete&lt;AuthAuthorizerChallenge&gt; &gt;*)</fn>
      <dir>/usr/src/debug/ceph-14.2.11-142-g9c9d8e1/src/msg</dir>
      <file>Messenger.cc</file>
      <line>160</line>
Actions
Copy link
 #3

Updated by Deepika Upadhyay over 3 years ago

  • Related to Bug #43915: leaked Session (alloc from OSD::ms_handle_authentication) added
Actions
Copy link
 #4

Updated by Neha Ojha over 3 years ago

  • Related to deleted (Bug #43915: leaked Session (alloc from OSD::ms_handle_authentication))
Actions
Copy link
 #6

Updated by Deepika Upadhyay almost 3 years ago

  • Subject changed from nautilus: valgrind termination to nautilus: valgrind caught leak in Messenger::ms_deliver_verify_authorizer
      <ip>0xF80C0A</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>CephxAuthorizeHandler::verify_authorizer(CephContext*, KeyStore*, ceph::buffer::v14_2_0::list const&amp;, unsigned long, ceph::buffer::v14_2_0::list*, EntityName*, unsigned long*, AuthCapsInfo*, CryptoKey*, std::string*, std::unique_ptr&lt;AuthAuthorizerChallenge, std::default_delete&lt;AuthAuthorizerChallenge&gt; &gt;*)</fn>
      <dir>/usr/src/debug/ceph-14.2.21-317-g829d9986/src/auth/cephx</dir>
      <file>CephxAuthorizeHandler.cc</file>
      <line>38</line>
    </frame>
    <frame>
      <ip>0xE087FA</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>Messenger::ms_deliver_verify_authorizer(Connection*, int, int, ceph::buffer::v14_2_0::list&amp;, ceph::buffer::v14_2_0::list&amp;, bool&amp;, CryptoKey&amp;, std::string*, std::unique_ptr&lt;AuthAuthorizerChallenge, std::default_delete&lt;AuthAuthorizerChallenge&gt; &gt;*)</fn>
      <dir>/usr/src/debug/ceph-14.2.21-317-g829d9986/src/msg</dir>
      <file>Messenger.cc</file>
      <line>147</line>

...

    <frame>
      <ip>0xE3A90B</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>ceph::buffer::v14_2_0::ptr_node::cloner::operator()(ceph::buffer::v14_2_0::ptr_node const&amp;)</fn>
      <dir>/usr/src/debug/ceph-14.2.21-317-g829d9986/src/common</dir>
      <file>buffer.cc</file>
      <line>2219</line>
    </frame>

/ceph/teuthology-archive/yuriw-2021-06-03_16:58:30-rados-wip-yuri7-testing-2021-06-03-0726-nautilus-distro-basic-smithi/6149958/remote/smithi081/log/valgrind/osd.1.lo
g.gz

Actions
Copy link

Also available in: Atom PDF