Project

General

Profile

Bug #15870

ceph-osd valgrind invalid reads/writes

Added by Samuel Just almost 8 years ago. Updated over 7 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
other
Tags:
Backport:
jewel,hammer
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

sjust@teuthology:/a/yehudasa-2016-05-11_11:03:48-rgw-wip-rgw-leak-4---basic-smithi/185203/remote

<kind>InvalidWrite</kind>
<what>Invalid write of size 4</what>
<stack>
<frame>
<ip>0xC15A398</ip>
<obj>/usr/lib64/libpthread-2.17.so</obj>
<fn>__pthread_mutex_cond_lock</fn>
</frame>
<frame>
<ip>0xC155764</ip>
<obj>/usr/lib64/libpthread-2.17.so</obj>
<fn>pthread_cond_wait@@GLIBC_2.3.2</fn>
</frame>
<frame>
<ip>0xC284EE</ip>
<obj>/usr/bin/ceph-osd</obj>
<fn>Wait</fn>
<dir>/usr/src/debug/ceph-10.2.0/src/common</dir>
<file>Cond.h</file>
<line>56</line>
</frame>
<frame>
<ip>0xC284EE</ip>
<obj>/usr/bin/ceph-osd</obj>
<fn>Pipe::accept()</fn>
<dir>/usr/src/debug/ceph-10.2.0/src/msg/simple</dir>
<file>Pipe.cc</file>
<line>480</line>
</frame>
<frame>
<ip>0xC2D43E</ip>
<obj>/usr/bin/ceph-osd</obj>
<fn>Pipe::reader()</fn>
<dir>/usr/src/debug/ceph-10.2.0/src/msg/simple</dir>
<file>Pipe.cc</file>
<line>1509</line>
</frame>
<frame>
<ip>0xC3535C</ip>
<obj>/usr/bin/ceph-osd</obj>
<fn>Pipe::Reader::entry()</fn>
<dir>/usr/src/debug/ceph-10.2.0/src/msg/simple</dir>
<file>Pipe.h</file>
<line>52</line>
</frame>
<frame>
<ip>0xC151DC4</ip>
<obj>/usr/lib64/libpthread-2.17.so</obj>
<fn>start_thread</fn>
</frame>
<frame>
<ip>0xDAFE28C</ip>
<obj>/usr/lib64/libc-2.17.so</obj>
<fn>clone</fn>
</frame>
</stack>
<auxwhat>Address 0x3c87a188 is 4,488 bytes inside a block of size 4,792 free'd</auxwhat>
<stack>
<frame>
<ip>0xAD1F131</ip>
<obj>/usr/lib64/valgrind/vgpreload_memcheck-amd64-linux.so</obj>
<fn>operator delete(void*)</fn>
</frame>
<frame>
<ip>0x4CE429</ip>
<obj>/usr/bin/ceph-osd</obj>
<fn>RefCountedObject::put()</fn>
<dir>/usr/src/debug/ceph-10.2.0/src/common</dir>
<file>RefCountedObj.h</file>
<line>48</line>
</frame>
<frame>
<ip>0xB07211</ip>
<obj>/usr/bin/ceph-osd</obj>
<fn>SimpleMessenger::reaper()</fn>
<dir>/usr/src/debug/ceph-10.2.0/src/msg/simple</dir>
<file>SimpleMessenger.cc</file>
<line>260</line>
</frame>
<frame>
<ip>0xB078DF</ip>
<obj>/usr/bin/ceph-osd</obj>
<fn>SimpleMessenger::reaper_entry()</fn>
<dir>/usr/src/debug/ceph-10.2.0/src/msg/simple</dir>
<file>SimpleMessenger.cc</file>
<line>214</line>
</frame>
<frame>
<ip>0xB0D1DC</ip>
<obj>/usr/bin/ceph-osd</obj>
<fn>SimpleMessenger::ReaperThread::entry()</fn>
<dir>/usr/src/debug/ceph-10.2.0/src/msg/simple</dir>
<file>SimpleMessenger.h</file>
<line>196</line>
</frame>
<frame>
<ip>0xC151DC4</ip>
<obj>/usr/lib64/libpthread-2.17.so</obj>
<fn>start_thread</fn>
</frame>
<frame>
<ip>0xDAFE28C</ip>
<obj>/usr/lib64/libc-2.17.so</obj>
<fn>clone</fn>
</frame>
</stack>

Related issues

Copied to Ceph - Backport #15961: jewel: ceph-osd valgrind invalid reads/writes Resolved
Copied to Ceph - Backport #15962: hammer: ceph-osd valgrind invalid reads/writes Resolved

History

#1 Updated by Samuel Just almost 8 years ago

There are actually a bunch of them in this valgrind log and I think they are all the wrong case: the reaper deleted a Pipe object while the replacing pipe was still waiting on the cond variable. Presumably, we need to take a ref in that path.

#2 Updated by Samuel Just almost 8 years ago

  • Backport set to jewel,hammer

#3 Updated by Samuel Just almost 8 years ago

  • Status changed from New to 7

#4 Updated by Samuel Just almost 8 years ago

  • Status changed from 7 to Pending Backport

#5 Updated by Nathan Cutler almost 8 years ago

  • Copied to Backport #15961: jewel: ceph-osd valgrind invalid reads/writes added

#6 Updated by Nathan Cutler almost 8 years ago

  • Copied to Backport #15962: hammer: ceph-osd valgrind invalid reads/writes added

#7 Updated by Nathan Cutler over 7 years ago

  • Status changed from Pending Backport to Resolved

Also available in: Atom PDF