Project

General

Profile

Actions

Bug #61566

closed

valgrind uninitialised value error inside openssl on centos stream 9

Added by Ilya Dryomov 11 months ago. Updated 9 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
valgrind backport_processed
Backport:
reef
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-24_19:39:45-rbd-wip-yuri2-testing-2023-05-24-0747-distro-default-smithi/7285485/teuthology.log

2023-05-24T20:53:18.322 INFO:tasks.workunit.client.0.smithi161.stderr:==85443== Memcheck, a memory error detector
2023-05-24T20:53:18.322 INFO:tasks.workunit.client.0.smithi161.stderr:==85443== Copyright (C) 2002-2022, and GNU GPL'd, by Julian Seward et al.
2023-05-24T20:53:18.322 INFO:tasks.workunit.client.0.smithi161.stderr:==85443== Using Valgrind-3.19.0 and LibVEX; rerun with -h for copyright info
2023-05-24T20:53:18.323 INFO:tasks.workunit.client.0.smithi161.stderr:==85443== Command: ceph_test_librbd
2023-05-24T20:53:18.323 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==
2023-05-24T20:53:37.244 INFO:tasks.workunit.client.0.smithi161.stderr:==85443== Thread 4 msgr-worker-1:
2023-05-24T20:53:37.244 INFO:tasks.workunit.client.0.smithi161.stderr:==85443== Conditional jump or move depends on uninitialised value(s)
2023-05-24T20:53:37.245 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==    at 0x5710F04: gcm_cipher_internal (ciphercommon_gcm.c:433)
2023-05-24T20:53:37.245 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==    by 0x57111E1: UnknownInlinedFun (ciphercommon_gcm.c:335)
2023-05-24T20:53:37.245 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==    by 0x57111E1: ossl_gcm_stream_final (ciphercommon_gcm.c:326)
2023-05-24T20:53:37.245 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==    by 0x5612594: EVP_DecryptFinal_ex (evp_enc.c:926)
2023-05-24T20:53:37.245 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==    by 0x4F68C5C: ceph::crypto::onwire::AES128GCM_OnWireRxHandler::authenticated_decrypt_update_final(ceph::buffer::v15_2_0::list&) (crypto_onwire.cc:261)
2023-05-24T20:53:37.245 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==    by 0x4F705A3: ceph::msgr::v2::FrameAssembler::disassemble_preamble(ceph::buffer::v15_2_0::list&) (frames_v2.cc:290)
2023-05-24T20:53:37.245 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==    by 0x4F542D9: ProtocolV2::handle_read_frame_preamble_main(std::unique_ptr<ceph::buffer::v15_2_0::ptr_node, ceph::buffer::v15_2_0::ptr_node::disposer>&&, int) (ProtocolV2.cc:1107)
2023-05-24T20:53:37.246 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==    by 0x4F45D08: ProtocolV2::run_continuation(Ct<ProtocolV2>&) (ProtocolV2.cc:49)
2023-05-24T20:53:37.246 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==    by 0x4F253E9: AsyncConnection::process() (AsyncConnection.cc:487)
2023-05-24T20:53:37.246 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==    by 0x4F6DE07: EventCenter::process_events(unsigned int, std::chrono::duration<unsigned long, std::ratio<1l, 1000000000l> >*) (Event.cc:457)
2023-05-24T20:53:37.246 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==    by 0x4F6E2F5: UnknownInlinedFun (Stack.cc:50)
2023-05-24T20:53:37.246 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==    by 0x4F6E2F5: UnknownInlinedFun (invoke.h:61)
2023-05-24T20:53:37.246 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==    by 0x4F6E2F5: UnknownInlinedFun (invoke.h:111)
2023-05-24T20:53:37.246 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==    by 0x4F6E2F5: std::_Function_handler<void (), NetworkStack::add_thread(Worker*)::{lambda()#1}>::_M_invoke(std::_Any_data const&) (std_function.h:290)
2023-05-24T20:53:37.246 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==    by 0x59979D3: ??? (in /usr/lib64/libstdc++.so.6.0.29)
2023-05-24T20:53:37.247 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==    by 0x5C78801: start_thread (in /usr/lib64/libc.so.6)
2023-05-24T20:53:37.247 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==
2023-05-24T20:53:37.689 INFO:tasks.workunit.client.0.smithi161.stderr:warning: failed to enable lockdep
2023-05-24T21:57:09.755 INFO:tasks.workunit.client.0.smithi161.stdout:[----------] Global test environment tear-down
2023-05-24T21:57:09.764 INFO:tasks.workunit.client.0.smithi161.stdout:[==========] 471 tests from 23 test suites ran. (3812048 ms total)
2023-05-24T21:57:09.764 INFO:tasks.workunit.client.0.smithi161.stdout:[  PASSED  ] 372 tests.
2023-05-24T21:57:09.764 INFO:tasks.workunit.client.0.smithi161.stdout:[  SKIPPED ] 99 tests, listed below:
[...]
2023-05-24T21:57:09.937 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==
2023-05-24T21:57:09.937 INFO:tasks.workunit.client.0.smithi161.stderr:==85443== HEAP SUMMARY:
2023-05-24T21:57:09.937 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==     in use at exit: 9,865 bytes in 29 blocks
2023-05-24T21:57:09.937 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==   total heap usage: 153,450,657 allocs, 153,450,628 frees, 171,121,576,924 bytes allocated
2023-05-24T21:57:09.938 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==
2023-05-24T21:57:09.940 INFO:tasks.workunit.client.0.smithi161.stderr:==85443== LEAK SUMMARY:
2023-05-24T21:57:09.940 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==    definitely lost: 0 bytes in 0 blocks
2023-05-24T21:57:09.940 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==    indirectly lost: 0 bytes in 0 blocks
2023-05-24T21:57:09.941 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==      possibly lost: 0 bytes in 0 blocks
2023-05-24T21:57:09.941 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==    still reachable: 9,529 bytes in 27 blocks
2023-05-24T21:57:09.941 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==         suppressed: 336 bytes in 2 blocks
2023-05-24T21:57:09.941 INFO:tasks.workunit.client.0.smithi161.stderr:==85443== Reachable blocks (those to which a pointer was found) are not shown.
2023-05-24T21:57:09.941 INFO:tasks.workunit.client.0.smithi161.stderr:==85443== To see them, rerun with: --leak-check=full --show-leak-kinds=all
2023-05-24T21:57:09.941 INFO:tasks.workunit.client.0.smithi161.stderr:==85443==
2023-05-24T21:57:09.941 INFO:tasks.workunit.client.0.smithi161.stderr:==85443== Use --track-origins=yes to see where uninitialised values come from
2023-05-24T21:57:09.942 INFO:tasks.workunit.client.0.smithi161.stderr:==85443== For lists of detected and suppressed errors, rerun with: -s
2023-05-24T21:57:09.942 INFO:tasks.workunit.client.0.smithi161.stderr:==85443== ERROR SUMMARY: 7554 errors from 1 contexts (suppressed: 0 from 0)
2023-05-24T21:57:09.951 DEBUG:teuthology.orchestra.run:got remote process result: 1

http://qa-proxy.ceph.com/teuthology/yuriw-2023-05-24_19:39:45-rbd-wip-yuri2-testing-2023-05-24-0747-distro-default-smithi/7285480/teuthology.log

2023-05-24T20:50:38.663 INFO:tasks.workunit.client.0.smithi190.stderr:==85296== Memcheck, a memory error detector
2023-05-24T20:50:38.663 INFO:tasks.workunit.client.0.smithi190.stderr:==85296== Copyright (C) 2002-2022, and GNU GPL'd, by Julian Seward et al.
2023-05-24T20:50:38.664 INFO:tasks.workunit.client.0.smithi190.stderr:==85296== Using Valgrind-3.19.0 and LibVEX; rerun with -h for copyright info
2023-05-24T20:50:38.664 INFO:tasks.workunit.client.0.smithi190.stderr:==85296== Command: ceph_test_rbd_mirror
2023-05-24T20:50:38.664 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==
2023-05-24T20:50:57.468 INFO:tasks.workunit.client.0.smithi190.stderr:==85296== Thread 4 msgr-worker-1:
2023-05-24T20:50:57.468 INFO:tasks.workunit.client.0.smithi190.stderr:==85296== Conditional jump or move depends on uninitialised value(s)
2023-05-24T20:50:57.468 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==    at 0x5710F04: gcm_cipher_internal (ciphercommon_gcm.c:433)
2023-05-24T20:50:57.469 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==    by 0x57111E1: UnknownInlinedFun (ciphercommon_gcm.c:335)
2023-05-24T20:50:57.469 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==    by 0x57111E1: ossl_gcm_stream_final (ciphercommon_gcm.c:326)
2023-05-24T20:50:57.469 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==    by 0x5612594: EVP_DecryptFinal_ex (evp_enc.c:926)
2023-05-24T20:50:57.469 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==    by 0x4F68C5C: ceph::crypto::onwire::AES128GCM_OnWireRxHandler::authenticated_decrypt_update_final(ceph::buffer::v15_2_0::list&) (crypto_onwire.cc:261)
2023-05-24T20:50:57.469 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==    by 0x4F705A3: ceph::msgr::v2::FrameAssembler::disassemble_preamble(ceph::buffer::v15_2_0::list&) (frames_v2.cc:290)
2023-05-24T20:50:57.469 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==    by 0x4F542D9: ProtocolV2::handle_read_frame_preamble_main(std::unique_ptr<ceph::buffer::v15_2_0::ptr_node, ceph::buffer::v15_2_0::ptr_node::disposer>&&, int) (ProtocolV2.cc:1107)
2023-05-24T20:50:57.469 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==    by 0x4F45D08: ProtocolV2::run_continuation(Ct<ProtocolV2>&) (ProtocolV2.cc:49)
2023-05-24T20:50:57.470 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==    by 0x4F253E9: AsyncConnection::process() (AsyncConnection.cc:487)
2023-05-24T20:50:57.470 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==    by 0x4F6DE07: EventCenter::process_events(unsigned int, std::chrono::duration<unsigned long, std::ratio<1l, 1000000000l> >*) (Event.cc:457)
2023-05-24T20:50:57.470 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==    by 0x4F6E2F5: UnknownInlinedFun (Stack.cc:50)
2023-05-24T20:50:57.470 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==    by 0x4F6E2F5: UnknownInlinedFun (invoke.h:61)
2023-05-24T20:50:57.470 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==    by 0x4F6E2F5: UnknownInlinedFun (invoke.h:111)
2023-05-24T20:50:57.470 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==    by 0x4F6E2F5: std::_Function_handler<void (), NetworkStack::add_thread(Worker*)::{lambda()#1}>::_M_invoke(std::_Any_data const&) (std_function.h:290)
2023-05-24T20:50:57.470 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==    by 0x59979D3: ??? (in /usr/lib64/libstdc++.so.6.0.29)
2023-05-24T20:50:57.471 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==    by 0x5C78801: start_thread (in /usr/lib64/libc.so.6)
2023-05-24T20:50:57.471 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==
2023-05-24T20:50:57.901 INFO:tasks.workunit.client.0.smithi190.stderr:warning: failed to enable lockdep
2023-05-24T21:25:20.511 INFO:tasks.workunit.client.0.smithi190.stdout:[----------] Global test environment tear-down
2023-05-24T21:25:20.521 INFO:tasks.workunit.client.0.smithi190.stdout:[==========] 145 tests from 14 test suites ran. (2062598 ms total)
2023-05-24T21:25:20.521 INFO:tasks.workunit.client.0.smithi190.stdout:[  PASSED  ] 143 tests.
2023-05-24T21:25:20.521 INFO:tasks.workunit.client.0.smithi190.stdout:[  SKIPPED ] 2 tests, listed below:
[...]
2023-05-24T21:25:20.705 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==
2023-05-24T21:25:20.706 INFO:tasks.workunit.client.0.smithi190.stderr:==85296== HEAP SUMMARY:
2023-05-24T21:25:20.706 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==     in use at exit: 8,067 bytes in 23 blocks
2023-05-24T21:25:20.706 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==   total heap usage: 22,760,989 allocs, 22,760,966 frees, 6,058,338,973 bytes allocated
2023-05-24T21:25:20.706 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==
2023-05-24T21:25:20.709 INFO:tasks.workunit.client.0.smithi190.stderr:==85296== LEAK SUMMARY:
2023-05-24T21:25:20.709 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==    definitely lost: 0 bytes in 0 blocks
2023-05-24T21:25:20.709 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==    indirectly lost: 0 bytes in 0 blocks
2023-05-24T21:25:20.709 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==      possibly lost: 0 bytes in 0 blocks
2023-05-24T21:25:20.709 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==    still reachable: 8,067 bytes in 23 blocks
2023-05-24T21:25:20.709 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==         suppressed: 0 bytes in 0 blocks
2023-05-24T21:25:20.710 INFO:tasks.workunit.client.0.smithi190.stderr:==85296== Reachable blocks (those to which a pointer was found) are not shown.
2023-05-24T21:25:20.710 INFO:tasks.workunit.client.0.smithi190.stderr:==85296== To see them, rerun with: --leak-check=full --show-leak-kinds=all
2023-05-24T21:25:20.710 INFO:tasks.workunit.client.0.smithi190.stderr:==85296==
2023-05-24T21:25:20.710 INFO:tasks.workunit.client.0.smithi190.stderr:==85296== Use --track-origins=yes to see where uninitialised values come from
2023-05-24T21:25:20.710 INFO:tasks.workunit.client.0.smithi190.stderr:==85296== For lists of detected and suppressed errors, rerun with: -s
2023-05-24T21:25:20.710 INFO:tasks.workunit.client.0.smithi190.stderr:==85296== ERROR SUMMARY: 16818 errors from 1 contexts (suppressed: 0 from 0)
2023-05-24T21:25:20.725 DEBUG:teuthology.orchestra.run:got remote process result: 1

Related issues 1 (0 open1 closed)

Copied to Messengers - Backport #62106: reef: valgrind uninitialised value error inside openssl on centos stream 9ResolvedCasey BodleyActions
Actions #1

Updated by Ilya Dryomov 11 months ago

  • Description updated (diff)
Actions #2

Updated by Ilya Dryomov 11 months ago

  • Subject changed from [test] valgrind "still reachable" blocks on centos stream 9 to [test] valgrind uninitialised value error inside openssl on centos stream 9
  • Description updated (diff)
Actions #4

Updated by Ilya Dryomov 11 months ago

  • Description updated (diff)
Actions #5

Updated by Ilya Dryomov 11 months ago

  • Project changed from rbd to Messengers
  • Subject changed from [test] valgrind uninitialised value error inside openssl on centos stream 9 to valgrind uninitialised value error inside openssl on centos stream 9
Actions #6

Updated by Ilya Dryomov 11 months ago

This is not specific to RBD -- we are probably going to need a suppression.

Actions #7

Updated by Casey Bodley 9 months ago

  • Status changed from New to Fix Under Review
  • Tags set to valgrind
  • Backport set to reef
  • Pull request ID set to 52491

i pushed a candidate fix to https://github.com/ceph/ceph/pull/52491 which updates an existing suppression, but haven't tested it

Actions #8

Updated by Ilya Dryomov 9 months ago

  • Assignee set to Casey Bodley
Actions #9

Updated by Ilya Dryomov 9 months ago

  • Status changed from Fix Under Review to Pending Backport
Actions #10

Updated by Backport Bot 9 months ago

  • Copied to Backport #62106: reef: valgrind uninitialised value error inside openssl on centos stream 9 added
Actions #11

Updated by Backport Bot 9 months ago

  • Tags changed from valgrind to valgrind backport_processed
Actions #12

Updated by Ilya Dryomov 9 months ago

  • Status changed from Pending Backport to Resolved
Actions

Also available in: Atom PDF