Ceph

4> 2014-02-20 00:12:48.296974 7f1623101700 5 - op tracker -- , seq: 39278, time: 2014-02-20 00:12:48.295450, event: throttled, request: MOSDECSubOpReadReply(3.1bs1 290 ECSubReadReply(tid=3149, attrs_read=5)) v1
3> 2014-02-20 00:12:48.296980 7f1623101700 5 - op tracker -- , seq: 39278, time: 2014-02-20 00:12:48.296802, event: all_read, request: MOSDECSubOpReadReply(3.1bs1 290 ECSubReadReply(tid=3149, attrs_read=5)) v1
2> 2014-02-20 00:12:48.296985 7f1623101700 5 - op tracker -- , seq: 39278, time: 2014-02-20 00:12:48.296956, event: dispatched, request: MOSDECSubOpReadReply(3.1bs1 290 ECSubReadReply(tid=3149, attrs_read=5)) v1
1> 2014-02-20 00:12:48.296991 7f1623101700 5 - op tracker -- , seq: 39278, time: 2014-02-20 00:12:48.296991, event: waiting_for_osdmap, request: MOSDECSubOpReadReply(3.1bs1 290 ECSubReadReply(tid=3149, attrs_read=5)) v1
0> 2014-02-20 00:12:48.320359 7f161c8f4700 1 osd/ECBackend.cc: In function 'virtual void FinishReadOp::finish(ThreadPool::TPHandle&)' thread 7f161c8f4700 time 2014-02-20 00:12:47.975514
osd/ECBackend.cc: 990: FAILED assert(ec>tid_to_read_map.count(tid))

ceph version 0.77-475-gc5c7f6c (c5c7f6c8e8643c57f92cf7048a9beec080a59fbe)
1: (FinishReadOp::finish(ThreadPool::TPHandle&)+0x23f) [0x96d1af]
2: (GenContext<ThreadPool::TPHandle&>::complete(ThreadPool::TPHandle&)+0x9) [0x8c5dd9]
3: (ReplicatedPG::BlessedGenContext<ThreadPool::TPHandle&>::finish(ThreadPool::TPHandle&)+0x50) [0x8c85f0]
4: (GenContext<ThreadPool::TPHandle&>::complete(ThreadPool::TPHandle&)+0x9) [0x8c5dd9]
5: (ThreadPool::WorkQueueVal<GenContext<ThreadPool::TPHandle&>*, GenContext<ThreadPool::TPHandle&>*>::_void_process(void*, ThreadPool::TPHandle&)+0x7d) [0x675edd]
6: (ThreadPool::worker(ThreadPool::WorkThread*)+0x4e6) [0xa4cf16]
7: (ThreadPool::WorkThread::entry()+0x10) [0xa4ed20]
8: (()+0x7e9a) [0x7f1631f98e9a]
9: (clone()+0x6d) [0x7f163075d3fd]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- logging levels ---
0/ 5 none
0/ 1 lockdep