Ceph

10.04.26 22:33:30.354868 428a1940 -- 10.178.28.97:6800/10059 --> client7202 10.178.28.97:0/1984433234 -- client_reply(?:1079898 = 2 No such file or directory) - ?+0 0x7f6529e32010
10.04.26 22:33:30.354982 428a1940 -- 10.178.28.97:6800/10059 <== client7202 10.178.28.97:0/1984433234 1553026 ==== client_request(client7202:1079899 rename #100000577c9/cm206 #100000577c9/.cm206.rWltMK) ==== 176+0+0 (2541553992 0 0) 0x7f64c52047d0
10.04.26 22:33:30.355109 428a1940 -- 10.178.28.97:6800/10059 --> client7202 10.178.28.97:0/1984433234 -- client_reply(?:1079899 = 0 Success unsafe) -- ?+0 0x7f6529a12cf0
10.04.26 22:33:30.355222 428a1940 -- 10.178.28.97:6800/10059 <== client7202 10.178.28.97:0/1984433234 1553027 ==== client_request(client7202:1079900 mkdir #100000ce3b9/LC_MESSAGES) ==== 125+0+0 (692925344 0 0) 0x7f64c66409d0
10.04.26 22:33:30.355289 428a1940 -- 10.178.28.97:6800/10059 --> client7202 10.178.28.97:0/1984433234 -- client_caps(revoke ino 100000ce3b9 524089 seq 4 caps=pAsLsXsxFsx dirty=- wanted=- follows 0 size 0/0 ts 1 mtime 10.04.26 22:33:30.354498) -- ?+0 0x7f6528bdb680
10.04.26 22:33:30.355367 428a1940 -- 10.178.28.97:6800/10059 --> osd1 10.178.28.98:6801/9436 -- osd_op(mds0.29:56753 200.00000516 [write 3510400~7717] 1.8317) -- ?+0 0x7f64c857ed40
10.04.26 22:33:30.355475 428a1940 -- 10.178.28.97:6800/10059 <== client7202 10.178.28.97:0/1984433234 1553028 ==== client_request(client7202:1079901 open #100000577c9/gscd) ==== 118+0+0 (195644511 0 0) 0x7f652a4a29f0
mds/MDCache.cc: In function 'void MDCache::trim_dentry(CDentry*, std::map<int, MCacheExpire*, std::less<int>, std::allocator<std::pair<const int, MCacheExpire*> > >&)':
mds/MDCache.cc:4797: FAILED assert(con)
1: (MDCache::trim(int)+0x2a9) [0x52d6f9]
2: (MDS::tick()+0x4ca) [0x4a63aa]
3: (SafeTimer::EventWrapper::finish(int)+0x135) [0x6f4355]
4: (Timer::timer_entry()+0x4b3) [0x6f5c93]
5: (Timer::TimerThread::entry()+0xd) [0x481afd]
6: (Thread::_entry_func(void*)+0x7) [0x4972d7]
7: /lib64/libpthread.so.0 [0x3121206367]
8: (clone()+0x6d) [0x31206d2f7d]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

(03:47:50 PM) fract: (gdb) f 7
(03:47:50 PM) fract: #7 0x000000000052d3ca in MDCache::trim_dentry (this=0x9dd560, dn=0x7f651a955db0, expiremap=@0x40fe5d40) at mds/MDCache.cc:4797
(03:47:50 PM) fract: 4797 assert(con);
(03:48:04 PM) sagewk: that's better.
(03:48:16 PM) fract: (gdb) p /x dnl->inode->inode.ino
(03:48:17 PM) fract: Cannot access memory at address 0x0
(03:48:29 PM) fract: (gdb) p /x dir->inode->inode.ino
(03:48:29 PM) fract: $1 = {val = 0x100000ce101}
(03:49:06 PM) sagewk: p /x dir->inode->parent->dir->inode->inode.ino
(03:49:21 PM) fract: (gdb) p /x dir->inode->parent->dir->inode->inode.ino
(03:49:21 PM) fract: Cannot access memory at address 0x0
(03:50:00 PM) sagewk: p dir->inode->projected_parent
(03:50:26 PM) fract: (gdb) p dir->inode->projected_parent
(03:50:26 PM) fract: $2 = {<std::_List_base<CDentry*,std::allocator<CDentry*> >> = {
(03:50:26 PM) fract: M_impl = {<std::allocator<std::_List_node<CDentry*> >> = {<_gnu_cxx::new_allocator<std::_List_node<CDentry*> >> = {<No data fields>}, <No data fields>}, _M_node = {_M_next = 0x7f64c698ed10, _M_prev = 0x7f64c698ed10}}}, <No data fields>}
(03:50:40 PM) sagewk: p &dir->inode->projected_parent
(03:50:50 PM) fract: (gdb) p &dir->inode->projected_parent
(03:50:50 PM) fract: $3 = (std::list<CDentry*,std::allocator<CDentry*> > *) 0x7f6516f7cc38