Project

General

Profile

Actions
Copy link

Bug #16908

closed

InvalidRead in OSD

Added by John Spray over 7 years ago. Updated over 7 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
Samuel Just
Category:
OSD
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

Seen on master today:

<error>
  <unique>0x0</unique>
  <tid>49</tid>
  <threadname>tp_osd_tp</threadname>
  <kind>InvalidRead</kind>
  <what>Invalid read of size 8</what>
  <stack>
    <frame>
      <ip>0x8EF764</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>ReplicatedPG::do_op(std::shared_ptr&lt;OpRequest&gt;&amp;)</fn>
    </frame>
    <frame>
      <ip>0x8AB73B</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>ReplicatedPG::do_request(std::shared_ptr&lt;OpRequest&gt;&amp;, ThreadPool::TPHandle&amp;)</fn>
    </frame>
    <frame>
      <ip>0x763FF4</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>OSD::dequeue_op(boost::intrusive_ptr&lt;PG&gt;, std::shared_ptr&lt;OpRequest&gt;, ThreadPool::TPHandle&amp;)</fn>
    </frame>
    <frame>
      <ip>0x76421C</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>PGQueueable::RunVis::operator()(std::shared_ptr&lt;OpRequest&gt; const&amp;)</fn>
    </frame>
    <frame>
      <ip>0x78523B</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)</fn>
    </frame>
    <frame>
      <ip>0xD5DD64</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>ShardedThreadPool::shardedthreadpool_worker(unsigned int)</fn>
    </frame>
    <frame>
      <ip>0xD5FEBF</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>ShardedThreadPool::WorkThreadSharded::entry()</fn>
    </frame>
    <frame>
      <ip>0xBD6F181</ip>
      <obj>/lib/x86_64-linux-gnu/libpthread-2.19.so</obj>
      <fn>start_thread</fn>
      <dir>/build/buildd/eglibc-2.19/nptl</dir>
      <file>pthread_create.c</file>
      <line>312</line>
    </frame>
    <frame>
      <ip>0xD22247C</ip>
      <obj>/lib/x86_64-linux-gnu/libc-2.19.so</obj>
      <fn>clone</fn>
      <dir>/build/buildd/eglibc-2.19/misc/../sysdeps/unix/sysv/linux/x86_64</dir>
      <file>clone.S</file>
      <line>111</line>
    </frame>
  </stack>
  <auxwhat>Address 0x353022b8 is 1,464 bytes inside a block of size 1,632 free'd</auxwhat>
  <stack>
    <frame>
      <ip>0xA22C2BC</ip>
      <obj>/usr/lib/valgrind/vgpreload_memcheck-amd64-linux.so</obj>
      <fn>operator delete(void*)</fn>
    </frame>
    <frame>
      <ip>0x8EB9E6</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>ReplicatedPG::execute_ctx(ReplicatedPG::OpContext*)</fn>
    </frame>
    <frame>
      <ip>0x8EF6FE</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>ReplicatedPG::do_op(std::shared_ptr&lt;OpRequest&gt;&amp;)</fn>
    </frame>
    <frame>
      <ip>0x8AB73B</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>ReplicatedPG::do_request(std::shared_ptr&lt;OpRequest&gt;&amp;, ThreadPool::TPHandle&amp;)</fn>
    </frame>
    <frame>
      <ip>0x763FF4</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>OSD::dequeue_op(boost::intrusive_ptr&lt;PG&gt;, std::shared_ptr&lt;OpRequest&gt;, ThreadPool::TPHandle&amp;)</fn>
    </frame>
    <frame>
      <ip>0x76421C</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>PGQueueable::RunVis::operator()(std::shared_ptr&lt;OpRequest&gt; const&amp;)</fn>
    </frame>
    <frame>
      <ip>0x78523B</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)</fn>
    </frame>
    <frame>
      <ip>0xD5DD64</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>ShardedThreadPool::shardedthreadpool_worker(unsigned int)</fn>
    </frame>
    <frame>
      <ip>0xD5FEBF</ip>
      <obj>/usr/bin/ceph-osd</obj>
      <fn>ShardedThreadPool::WorkThreadSharded::entry()</fn>
    </frame>
    <frame>
      <ip>0xBD6F181</ip>
      <obj>/lib/x86_64-linux-gnu/libpthread-2.19.so</obj>
      <fn>start_thread</fn>
      <dir>/build/buildd/eglibc-2.19/nptl</dir>
      <file>pthread_create.c</file>
      <line>312</line>
    </frame>
    <frame>
      <ip>0xD22247C</ip>
      <obj>/lib/x86_64-linux-gnu/libc-2.19.so</obj>
      <fn>clone</fn>
      <dir>/build/buildd/eglibc-2.19/misc/../sysdeps/unix/sysv/linux/x86_64</dir>
      <file>clone.S</file>
      <line>111</line>
    </frame>
  </stack>
</error>

http://qa-proxy.ceph.com/teuthology/jspray-2016-08-03_04:47:50-fs:verify-master-distro-basic-mira/347556/

Actions
Copy link

Also available in: Atom PDF