Ceph

-----------
[Mon Oct 6 15:09:03 2014] init: ceph-osd (ceph/46) main process (3058) killed by ABRT signal
-----------

2014-10-06 14:04:47.314592 7f61663fd700 0 -- 10.60.1.6:6817/3058 >> 10.60.1.5:6812/2941 pipe(0x2dd2e800 sd=899 :38136 s=2 pgs=680 cs=43 l=0 c=0x1e9b6160).fault with nothing to s
end, going to standby
2014-10-06 14:32:24.417178 7f6142ded700 0 -- 10.60.1.6:6817/3058 >> 10.60.1.2:6825/7210 pipe(0x2dd2cc80 sd=418 :51395 s=2 pgs=96 cs=11 l=0 c=0xdd7d760).fault with nothing to sen
d, going to standby
2014-10-06 14:51:54.338095 7f61625d5700 0 -- 10.60.1.6:6815/3058 >> 10.60.1.30:0/1017493 pipe(0x22021900 sd=950 :6815 s=0 pgs=0 cs=0 l=1 c=0x6b13440).accept replacing existing (
lossy) channel (new one lossy=1)
2014-10-06 15:09:02.936722 7f6171339700 -1 common/Thread.cc: In function 'void Thread::create(size_t)' thread 7f6171339700 time 2014-10-06 15:09:02.918464
common/Thread.cc: 128: FAILED assert(ret == 0)

ceph version 0.80.6 (f93610a4421cb670b08e974c6550ee715ac528ae)
 1: (Thread::create(unsigned long)+0x8a) [0xa49d7a]
 2: (Pipe::accept()+0x30ad) [0xb25fed]
 3: (Pipe::reader()+0x17c0) [0xb29f00]
 4: (Pipe::Reader::entry()+0xd) [0xb2cd5d]
 5: (()+0x8182) [0x7f620fd30182]
 6: (clone()+0x6d) [0x7f620e4a2fbd]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- begin dump of recent events ---
9999> 2014-10-06 15:08:38.318318 7f61fbf50700 5 - op tracker -- , seq: 5894143, time: 2014-10-06 15:08:38.318245, event: dispatched, request: osd_sub_op_reply(client.34946378
.0:2736589 3.3f4 750ef3f4/rbd_data.2153d3679f42670.0000000000000062/head//3 [] ondisk, result = 0) v2
9998> 2014-10-06 15:08:38.318333 7f61fbf50700 5 - op tracker -- , seq: 5894143, time: 2014-10-06 15:08:38.318333, event: waiting_for_osdmap, request: osd_sub_op_reply(client.
34946378.0:2736589 3.3f4 750ef3f4/rbd_data.2153d3679f42670.0000000000000062/head//3 [] ondisk, result = 0) v2
9997> 2014-10-06 15:08:38.318419 7f61f5f44700 5 - op tracker -- , seq: 5894143, time: 2014-10-06 15:08:38.318419, event: reached_pg, request: osd_sub_op_reply(client.34946378
.0:2736589 3.3f4 750ef3f4/rbd_data.2153d3679f42670.0000000000000062/head//3 [] ondisk, result = 0) v2
9996> 2014-10-06 15:08:38.318461 7f61f5f44700 5 - op tracker -- , seq: 5894143, time: 2014-10-06 15:08:38.318460, event: started, request: osd_sub_op_reply(client.34946378.0:
2736589 3.3f4 750ef3f4/rbd_data.2153d3679f42670.0000000000000062/head//3 [] ondisk, result = 0) v2
9995> 2014-10-06 15:08:38.318722 7f61f5f44700 5 - op tracker -- , seq: 5894142, time: 2014-10-06 15:08:38.318722, event: sub_op_commit_rec, request: osd_op(client.34946378.0:
2736589 rbd_data.2153d3679f42670.0000000000000062 [stat,set-alloc-hint object_size 8388608 write_size 8388608,write 6988288~4096] 3.750ef3f4 ack+ondisk+write e179755) v4
9994> 2014-10-06 15:08:38.318749 7f61f5f44700 1 - 10.60.1.6:6815/3058 --> 10.60.1.31:0/1021771 -- osd_op_reply(2736589 rbd_data.2153d3679f42670.0000000000000062 [stat,set-all
oc-hint object_size 8388608 write_size 8388608,write 6988288~4096] v179755'3279754 uv3279754 ack = 0) v6 -- ?+0 0x2d25a300 con 0x20e79b20
9993> 2014-10-06 15:08:38.318820 7f61f5f44700 1 - 10.60.1.6:6815/3058 --> 10.60.1.31:0/1021771 -- osd_op_reply(2736589 rbd_data.2153d3679f42670.0000000000000062 [stat,set-all
oc-hint object_size 8388608 write_size 8388608,write 6988288~4096] v179755'3279754 uv3279754 ondisk = 0) v6 -- ?+0 0x1c35a500 con 0x20e79b20