2014-11-15 14:22:07.607781 7f42b737a7c0 0 ceph version 0.80.1 (a38fe1169b6d2ac98b427334c12d7cf81f809b74), process ceph-mds, pid 23606 2014-11-15 14:22:07.609964 7f42b737a7c0 1 accepter.accepter.bind my_inst.addr is 0.0.0.0:6800/23606 need_addr=1 2014-11-15 14:22:07.614184 7f42b737a7c0 1 -- 0.0.0.0:6800/23606 messenger.start 2014-11-15 14:22:07.614364 7f42b737a7c0 10 mds.-1.0 168 MDSCacheObject 2014-11-15 14:22:07.614370 7f42b737a7c0 10 mds.-1.0 2304 CInode 2014-11-15 14:22:07.614371 7f42b737a7c0 10 mds.-1.0 16 elist<>::item *7=112 2014-11-15 14:22:07.614372 7f42b737a7c0 10 mds.-1.0 480 inode_t 2014-11-15 14:22:07.614373 7f42b737a7c0 10 mds.-1.0 56 nest_info_t 2014-11-15 14:22:07.614374 7f42b737a7c0 10 mds.-1.0 32 frag_info_t 2014-11-15 14:22:07.614375 7f42b737a7c0 10 mds.-1.0 40 SimpleLock *5=200 2014-11-15 14:22:07.614376 7f42b737a7c0 10 mds.-1.0 48 ScatterLock *3=144 2014-11-15 14:22:07.614378 7f42b737a7c0 10 mds.-1.0 488 CDentry 2014-11-15 14:22:07.614378 7f42b737a7c0 10 mds.-1.0 16 elist<>::item 2014-11-15 14:22:07.614379 7f42b737a7c0 10 mds.-1.0 40 SimpleLock 2014-11-15 14:22:07.614380 7f42b737a7c0 10 mds.-1.0 1016 CDir 2014-11-15 14:22:07.614381 7f42b737a7c0 10 mds.-1.0 16 elist<>::item *2=32 2014-11-15 14:22:07.614383 7f42b737a7c0 10 mds.-1.0 192 fnode_t 2014-11-15 14:22:07.614384 7f42b737a7c0 10 mds.-1.0 56 nest_info_t *2 2014-11-15 14:22:07.614384 7f42b737a7c0 10 mds.-1.0 32 frag_info_t *2 2014-11-15 14:22:07.614385 7f42b737a7c0 10 mds.-1.0 176 Capability 2014-11-15 14:22:07.614386 7f42b737a7c0 10 mds.-1.0 32 xlist<>::item *2=64 2014-11-15 14:22:07.614417 7f42b737a7c0 1 accepter.accepter.start 2014-11-15 14:22:07.614592 7f42b737a7c0 1 -- 0.0.0.0:6800/23606 --> 10.110.13.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- ?+0 0x7f42b9fbc480 con 0x7f42b9fdd080 2014-11-15 14:22:07.614849 7f42b7378700 0 -- 0.0.0.0:6800/23606 >> 10.110.13.2:6789/0 pipe(0x7f42ba058500 sd=8 :0 s=1 pgs=0 cs=0 l=1 c=0x7f42b9fdd080).fault 2014-11-15 14:22:10.614615 7f42b11d6700 1 -- 0.0.0.0:6800/23606 mark_down 0x7f42b9fdd080 -- 0x7f42ba058500 2014-11-15 14:22:10.614743 7f42b11d6700 1 -- 0.0.0.0:6800/23606 --> 10.110.13.4:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- ?+0 0x7f42b9fbc6c0 con 0x7f42b9fdd4a0 2014-11-15 14:22:10.615285 7f42b01d4700 1 -- 10.110.13.3:6800/23606 learned my addr 10.110.13.3:6800/23606 2014-11-15 14:22:10.615326 7f42b01d4700 10 mds.-1.0 MDS::ms_get_authorizer type=mon 2014-11-15 14:22:10.615538 7f42b21d8700 5 mds.-1.0 ms_handle_connect on 10.110.13.4:6789/0 2014-11-15 14:22:13.614963 7f42b11d6700 1 -- 10.110.13.3:6800/23606 mark_down 0x7f42b9fdd4a0 -- 0x7f42ba058780 2014-11-15 14:22:13.615263 7f42b11d6700 1 -- 10.110.13.3:6800/23606 --> 10.110.13.3:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- ?+0 0x7f42b9fbc480 con 0x7f42b9fdd600 2014-11-15 14:22:13.615319 7f42b00d3700 0 -- 10.110.13.3:6800/23606 >> 10.110.13.3:6789/0 pipe(0x7f42ba058a00 sd=8 :0 s=1 pgs=0 cs=0 l=1 c=0x7f42b9fdd600).fault 2014-11-15 14:22:16.615459 7f42b11d6700 1 -- 10.110.13.3:6800/23606 mark_down 0x7f42b9fdd600 -- 0x7f42ba058a00 2014-11-15 14:22:16.615607 7f42b11d6700 1 -- 10.110.13.3:6800/23606 --> 10.110.13.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- ?+0 0x7f42b9fbc6c0 con 0x7f42b9fdd8c0 2014-11-15 14:22:16.615864 7f42b7378700 0 -- 10.110.13.3:6800/23606 >> 10.110.13.2:6789/0 pipe(0x7f42ba058500 sd=9 :0 s=1 pgs=0 cs=0 l=1 c=0x7f42b9fdd8c0).fault 2014-11-15 14:22:19.615887 7f42b11d6700 1 -- 10.110.13.3:6800/23606 mark_down 0x7f42b9fdd8c0 -- 0x7f42ba058500 2014-11-15 14:22:19.616052 7f42b11d6700 1 -- 10.110.13.3:6800/23606 --> 10.110.13.3:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- ?+0 0x7f42b9fbcb40 con 0x7f42b9fdd080 2014-11-15 14:22:19.616145 7f42b00d3700 0 -- 10.110.13.3:6800/23606 >> 10.110.13.3:6789/0 pipe(0x7f42ba058c80 sd=9 :0 s=1 pgs=0 cs=0 l=1 c=0x7f42b9fdd080).fault 2014-11-15 14:22:22.616308 7f42b11d6700 1 -- 10.110.13.3:6800/23606 mark_down 0x7f42b9fdd080 -- 0x7f42ba058c80 2014-11-15 14:22:22.616461 7f42b11d6700 1 -- 10.110.13.3:6800/23606 --> 10.110.13.4:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- ?+0 0x7f42b9fbc900 con 0x7f42b9fddb80 2014-11-15 14:22:22.617037 7f42b7378700 10 mds.-1.0 MDS::ms_get_authorizer type=mon 2014-11-15 14:22:22.617253 7f42b21d8700 5 mds.-1.0 ms_handle_connect on 10.110.13.4:6789/0 2014-11-15 14:22:25.616709 7f42b11d6700 1 -- 10.110.13.3:6800/23606 mark_down 0x7f42b9fddb80 -- 0x7f42ba058780 2014-11-15 14:22:25.616948 7f42b11d6700 1 -- 10.110.13.3:6800/23606 --> 10.110.13.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- ?+0 0x7f42b9fbc480 con 0x7f42b9fdd4a0 2014-11-15 14:22:25.617337 7f42b01d4700 0 -- 10.110.13.3:6800/23606 >> 10.110.13.2:6789/0 pipe(0x7f42ba058a00 sd=8 :0 s=1 pgs=0 cs=0 l=1 c=0x7f42b9fdd4a0).fault 2014-11-15 14:22:28.617101 7f42b11d6700 1 -- 10.110.13.3:6800/23606 mark_down 0x7f42b9fdd4a0 -- 0x7f42ba058a00 2014-11-15 14:22:28.617257 7f42b11d6700 1 -- 10.110.13.3:6800/23606 --> 10.110.13.4:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- ?+0 0x7f42b9fbcd80 con 0x7f42b9fdd600 2014-11-15 14:22:28.617852 7f42b00d3700 10 mds.-1.0 MDS::ms_get_authorizer type=mon 2014-11-15 14:22:28.618059 7f42b21d8700 5 mds.-1.0 ms_handle_connect on 10.110.13.4:6789/0 2014-11-15 14:22:31.617386 7f42b11d6700 1 -- 10.110.13.3:6800/23606 mark_down 0x7f42b9fdd600 -- 0x7f42ba058f00 2014-11-15 14:22:31.617502 7f42b11d6700 1 -- 10.110.13.3:6800/23606 --> 10.110.13.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- ?+0 0x7f42b9fbc6c0 con 0x7f42b9fdd8c0 2014-11-15 14:22:31.617753 7f42b7378700 0 -- 10.110.13.3:6800/23606 >> 10.110.13.2:6789/0 pipe(0x7f42ba058500 sd=8 :0 s=1 pgs=0 cs=0 l=1 c=0x7f42b9fdd8c0).fault 2014-11-15 14:22:34.617698 7f42b11d6700 1 -- 10.110.13.3:6800/23606 mark_down 0x7f42b9fdd8c0 -- 0x7f42ba058500 2014-11-15 14:22:34.617843 7f42b11d6700 1 -- 10.110.13.3:6800/23606 --> 10.110.13.3:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- ?+0 0x7f42b9fbcb40 con 0x7f42b9fddce0 2014-11-15 14:22:34.618012 7f42b01d4700 0 -- 10.110.13.3:6800/23606 >> 10.110.13.3:6789/0 pipe(0x7f42ba058c80 sd=9 :0 s=1 pgs=0 cs=0 l=1 c=0x7f42b9fddce0).fault 2014-11-15 14:22:37.618114 7f42b11d6700 1 -- 10.110.13.3:6800/23606 mark_down 0x7f42b9fddce0 -- 0x7f42ba058c80 2014-11-15 14:22:37.618272 7f42b11d6700 1 -- 10.110.13.3:6800/23606 --> 10.110.13.4:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- ?+0 0x7f42b9fbc900 con 0x7f42b9fdd080 2014-11-15 14:22:37.619060 7f42b7378700 10 mds.-1.0 MDS::ms_get_authorizer type=mon 2014-11-15 14:22:37.619335 7f42b21d8700 5 mds.-1.0 ms_handle_connect on 10.110.13.4:6789/0 2014-11-15 14:22:40.618481 7f42b11d6700 1 -- 10.110.13.3:6800/23606 mark_down 0x7f42b9fdd080 -- 0x7f42ba058780 2014-11-15 14:22:40.618613 7f42b11d6700 1 -- 10.110.13.3:6800/23606 --> 10.110.13.3:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- ?+0 0x7f42b9fbc480 con 0x7f42b9fddb80 2014-11-15 14:22:40.618742 7f42b00d3700 0 -- 10.110.13.3:6800/23606 >> 10.110.13.3:6789/0 pipe(0x7f42ba059180 sd=8 :0 s=1 pgs=0 cs=0 l=1 c=0x7f42b9fddb80).fault 2014-11-15 14:22:43.618835 7f42b11d6700 1 -- 10.110.13.3:6800/23606 mark_down 0x7f42b9fddb80 -- 0x7f42ba059180 2014-11-15 14:22:43.618985 7f42b11d6700 1 -- 10.110.13.3:6800/23606 --> 10.110.13.2:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- ?+0 0x7f42b9fbcd80 con 0x7f42b9fdd4a0 2014-11-15 14:22:43.619364 7f42b01d4700 0 -- 10.110.13.3:6800/23606 >> 10.110.13.2:6789/0 pipe(0x7f42ba058a00 sd=9 :0 s=1 pgs=0 cs=0 l=1 c=0x7f42b9fdd4a0).fault 2014-11-15 14:22:46.619244 7f42b11d6700 1 -- 10.110.13.3:6800/23606 mark_down 0x7f42b9fdd4a0 -- 0x7f42ba058a00 2014-11-15 14:22:46.619390 7f42b11d6700 1 -- 10.110.13.3:6800/23606 --> 10.110.13.3:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- ?+0 0x7f42b9fbc6c0 con 0x7f42b9fdd600 2014-11-15 14:22:46.619501 7f42b00d3700 0 -- 10.110.13.3:6800/23606 >> 10.110.13.3:6789/0 pipe(0x7f42ba058f00 sd=9 :0 s=1 pgs=0 cs=0 l=1 c=0x7f42b9fdd600).fault 2014-11-15 14:22:49.619791 7f42b11d6700 1 -- 10.110.13.3:6800/23606 mark_down 0x7f42b9fdd600 -- 0x7f42ba058f00 2014-11-15 14:22:49.619924 7f42b11d6700 1 -- 10.110.13.3:6800/23606 --> 10.110.13.4:6789/0 -- auth(proto 0 26 bytes epoch 0) v1 -- ?+0 0x7f42b9fbcb40 con 0x7f42b9fdde40 2014-11-15 14:22:49.620679 7f42b01d4700 10 mds.-1.0 MDS::ms_get_authorizer type=mon 2014-11-15 14:22:49.620929 7f42b21d8700 5 mds.-1.0 ms_handle_connect on 10.110.13.4:6789/0