rbd info kvm1148 --debug-rbd 20 --debug-objecter 20 --debug-ms=20 --debug-osd=20 2012-05-30 16:46:35.281623 7fe972d84760 10 -- :/0 ready :/0 2012-05-30 16:46:35.281683 7fe972d84760 1 -- :/0 messenger.start 2012-05-30 16:46:35.281793 7fe96f16b700 10 -- :/1015811 reaper_entry start 2012-05-30 16:46:35.281939 7fe96f16b700 10 -- :/1015811 reaper 2012-05-30 16:46:35.281942 7fe96f16b700 10 -- :/1015811 reaper done 2012-05-30 16:46:35.282250 7fe972d84760 10 -- :/1015811 connect_rank to 46.19.94.1:6789/0, creating pipe and registering 2012-05-30 16:46:35.282294 7fe972d84760 10 -- :/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=-1 pgs=0 cs=0 l=0).register_pipe 2012-05-30 16:46:35.282334 7fe972d84760 1 -- :/1015811 --> 46.19.94.1:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- ?+0 0x7fe9680018a0 con 0x7fe968001470 2012-05-30 16:46:35.282307 7fe972d7c700 10 -- :/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=-1 pgs=0 cs=0 l=0).writer: state = 1 policy.server=0 2012-05-30 16:46:35.282346 7fe972d7c700 10 -- :/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=-1 pgs=0 cs=0 l=0).connect 0 2012-05-30 16:46:35.282363 7fe972d84760 20 -- :/1015811 submit_message auth(proto 0 30 bytes epoch 0) v1 remote 46.19.94.1:6789/0 2012-05-30 16:46:35.282378 7fe972d7c700 10 -- :/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=0 cs=0 l=0).connecting to 46.19.94.1:6789/0 2012-05-30 16:46:35.310494 7fe972d7c700 20 -- :/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=0 cs=0 l=0).connect read peer addr 46.19.94.1:6789/0 on socket 4 2012-05-30 16:46:35.310516 7fe972d7c700 20 -- :/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=0 cs=0 l=0).connect peer addr for me is 46.19.94.16:51595/0 2012-05-30 16:46:35.310523 7fe972d7c700 1 -- 46.19.94.16:0/1015811 learned my addr 46.19.94.16:0/1015811 2012-05-30 16:46:35.310540 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=0 cs=0 l=0).connect sent my addr 46.19.94.16:0/1015811 2012-05-30 16:46:35.310551 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=0 cs=0 l=0).connect sending gseq=1 cseq=0 proto=15 2012-05-30 16:46:35.310558 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=0 cs=0 l=0).connect wrote (self +) cseq, waiting for reply 2012-05-30 16:46:35.331725 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=0 cs=0 l=0).connect got reply tag 1 connect_seq 1 global_seq 269 proto 15 flags 1 2012-05-30 16:46:35.331749 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).connect success 1, lossy = 1, features 32767 2012-05-30 16:46:35.331764 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> :/0 pipe(0x20e72b0 sd=-1 pgs=0 cs=0 l=0).queue_received queuing pipe 2012-05-30 16:46:35.331778 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).connect starting reader 2012-05-30 16:46:35.331798 7fe96f96c700 20 -- 46.19.94.16:0/1015811 dispatch_entry pipe 0x20e72b0 dequeued 0 2012-05-30 16:46:35.331853 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.331873 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer encoding 1 0x7fe9680018a0 auth(proto 0 30 bytes epoch 0) v1 2012-05-30 16:46:35.331900 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sending 1 0x7fe9680018a0 2012-05-30 16:46:35.331881 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:46:35.331909 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_message 0x7fe9680018a0 2012-05-30 16:46:35.331929 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.331939 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:46:35.334026 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got ACK 2012-05-30 16:46:35.334052 7fe96d968700 15 reader got ack seq 1 2012-05-30 16:46:35.334054 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:46:35.334060 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got MSG 2012-05-30 16:46:35.334067 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got envelope type=4 src mon.0 front=751 data=0 off 0 2012-05-30 16:46:35.334078 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader wants 751 from dispatch throttler 0/104857600 2012-05-30 16:46:35.334098 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got front 751 2012-05-30 16:46:35.334105 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).aborted = 0 2012-05-30 16:46:35.334116 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got 751 + 0 + 0 byte message 2012-05-30 16:46:35.334151 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got message 1 0x20ea760 mon_map v1 2012-05-30 16:46:35.334162 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.334184 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_ack 1 2012-05-30 16:46:35.334187 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).queue_received queuing pipe 2012-05-30 16:46:35.334206 7fe96f96c700 20 -- 46.19.94.16:0/1015811 dispatch_entry pipe 0x7fe968001200 dequeued 0x20ea760 2012-05-30 16:46:35.334209 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:46:35.334212 7fe96f96c700 1 -- 46.19.94.16:0/1015811 <== mon.0 46.19.94.1:6789/0 1 ==== mon_map v1 ==== 751+0+0 (4218198165 0 0) 0x20ea760 con 0x7fe968001470 2012-05-30 16:46:35.334218 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got MSG 2012-05-30 16:46:35.334224 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got envelope type=18 src mon.0 front=33 data=0 off 0 2012-05-30 16:46:35.334230 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader wants 33 from dispatch throttler 751/104857600 2012-05-30 16:46:35.334240 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got front 33 2012-05-30 16:46:35.334243 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.334250 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).aborted = 0 2012-05-30 16:46:35.334250 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:46:35.334255 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got 33 + 0 + 0 byte message 2012-05-30 16:46:35.334268 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got message 2 0x7fe968002f30 auth_reply(proto 2 0 Success) v1 2012-05-30 16:46:35.334275 7fe96f96c700 10 -- 46.19.94.16:0/1015811 dispatch_throttle_release 751 to dispatch throttler 784/104857600 2012-05-30 16:46:35.334289 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).queue_received queuing pipe 2012-05-30 16:46:35.334290 7fe96f96c700 20 -- 46.19.94.16:0/1015811 done calling dispatch on 0x20ea760 2012-05-30 16:46:35.334306 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:46:35.334308 7fe96f96c700 20 -- 46.19.94.16:0/1015811 dispatch_entry pipe 0x7fe968001200 dequeued 0x7fe968002f30 2012-05-30 16:46:35.334325 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.334322 7fe96f96c700 1 -- 46.19.94.16:0/1015811 <== mon.0 46.19.94.1:6789/0 2 ==== auth_reply(proto 2 0 Success) v1 ==== 33+0+0 (2220515321 0 0) 0x7fe968002f30 con 0x7fe968001470 2012-05-30 16:46:35.334334 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_ack 2 2012-05-30 16:46:35.334345 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.334351 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:46:35.334511 7fe96f96c700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.1:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- ?+0 0x7fe968003890 con 0x7fe968001470 2012-05-30 16:46:35.334519 7fe96f96c700 20 -- 46.19.94.16:0/1015811 submit_message auth(proto 2 32 bytes epoch 0) v1 remote 46.19.94.1:6789/0 2012-05-30 16:46:35.334529 7fe96f96c700 10 -- 46.19.94.16:0/1015811 dispatch_throttle_release 33 to dispatch throttler 33/104857600 2012-05-30 16:46:35.334533 7fe96f96c700 20 -- 46.19.94.16:0/1015811 done calling dispatch on 0x7fe968002f30 2012-05-30 16:46:35.334533 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.334547 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer encoding 2 0x7fe968003890 auth(proto 2 32 bytes epoch 0) v1 2012-05-30 16:46:35.334558 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sending 2 0x7fe968003890 2012-05-30 16:46:35.334563 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_message 0x7fe968003890 2012-05-30 16:46:35.334580 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.334587 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:46:35.336926 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got ACK 2012-05-30 16:46:35.336950 7fe96d968700 15 reader got ack seq 2 2012-05-30 16:46:35.336952 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:46:35.336957 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got MSG 2012-05-30 16:46:35.336963 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got envelope type=18 src mon.0 front=206 data=0 off 0 2012-05-30 16:46:35.336969 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader wants 206 from dispatch throttler 0/104857600 2012-05-30 16:46:35.336977 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got front 206 2012-05-30 16:46:35.336983 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).aborted = 0 2012-05-30 16:46:35.336993 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got 206 + 0 + 0 byte message 2012-05-30 16:46:35.337014 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got message 3 0x7fe968007d40 auth_reply(proto 2 0 Success) v1 2012-05-30 16:46:35.337022 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).queue_received queuing pipe 2012-05-30 16:46:35.337044 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:46:35.337047 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.337069 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_ack 3 2012-05-30 16:46:35.337074 7fe96f96c700 20 -- 46.19.94.16:0/1015811 dispatch_entry pipe 0x7fe968001200 dequeued 0x7fe968007d40 2012-05-30 16:46:35.337080 7fe96f96c700 1 -- 46.19.94.16:0/1015811 <== mon.0 46.19.94.1:6789/0 3 ==== auth_reply(proto 2 0 Success) v1 ==== 206+0+0 (1434832852 0 0) 0x7fe968007d40 con 0x7fe968001470 2012-05-30 16:46:35.337084 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.337091 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:46:35.337202 7fe96f96c700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.1:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- ?+0 0x7fe968004050 con 0x7fe968001470 2012-05-30 16:46:35.337210 7fe96f96c700 20 -- 46.19.94.16:0/1015811 submit_message auth(proto 2 165 bytes epoch 0) v1 remote 46.19.94.1:6789/0 2012-05-30 16:46:35.337219 7fe96f96c700 10 -- 46.19.94.16:0/1015811 dispatch_throttle_release 206 to dispatch throttler 206/104857600 2012-05-30 16:46:35.337223 7fe96f96c700 20 -- 46.19.94.16:0/1015811 done calling dispatch on 0x7fe968007d40 2012-05-30 16:46:35.337222 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.337231 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer encoding 3 0x7fe968004050 auth(proto 2 165 bytes epoch 0) v1 2012-05-30 16:46:35.337246 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sending 3 0x7fe968004050 2012-05-30 16:46:35.337253 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_message 0x7fe968004050 2012-05-30 16:46:35.337275 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.337281 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:46:35.337935 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got ACK 2012-05-30 16:46:35.337947 7fe96d968700 15 reader got ack seq 3 2012-05-30 16:46:35.337948 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:46:35.337955 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got MSG 2012-05-30 16:46:35.337960 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got envelope type=18 src mon.0 front=409 data=0 off 0 2012-05-30 16:46:35.337966 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader wants 409 from dispatch throttler 0/104857600 2012-05-30 16:46:35.337973 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got front 409 2012-05-30 16:46:35.337979 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).aborted = 0 2012-05-30 16:46:35.337983 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got 409 + 0 + 0 byte message 2012-05-30 16:46:35.338001 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got message 4 0x7fe968004d50 auth_reply(proto 2 0 Success) v1 2012-05-30 16:46:35.338008 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.338028 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_ack 4 2012-05-30 16:46:35.338031 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).queue_received queuing pipe 2012-05-30 16:46:35.338051 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:46:35.338079 7fe96f96c700 20 -- 46.19.94.16:0/1015811 dispatch_entry pipe 0x7fe968001200 dequeued 0x7fe968004d50 2012-05-30 16:46:35.338107 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.338102 7fe96f96c700 1 -- 46.19.94.16:0/1015811 <== mon.0 46.19.94.1:6789/0 4 ==== auth_reply(proto 2 0 Success) v1 ==== 409+0+0 (4113764922 0 0) 0x7fe968004d50 con 0x7fe968001470 2012-05-30 16:46:35.338114 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:46:35.338195 7fe96f96c700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.1:6789/0 -- mon_subscribe({monmap=0+}) v2 -- ?+0 0x7fe968001aa0 con 0x7fe968001470 2012-05-30 16:46:35.338209 7fe96f96c700 20 -- 46.19.94.16:0/1015811 submit_message mon_subscribe({monmap=0+}) v2 remote 46.19.94.1:6789/0 2012-05-30 16:46:35.338222 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.338227 7fe96f96c700 10 -- 46.19.94.16:0/1015811 dispatch_throttle_release 409 to dispatch throttler 409/104857600 2012-05-30 16:46:35.338234 7fe96f96c700 20 -- 46.19.94.16:0/1015811 done calling dispatch on 0x7fe968004d50 2012-05-30 16:46:35.338230 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer encoding 4 0x7fe968001aa0 mon_subscribe({monmap=0+}) v2 2012-05-30 16:46:35.338243 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sending 4 0x7fe968001aa0 2012-05-30 16:46:35.338248 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_message 0x7fe968001aa0 2012-05-30 16:46:35.338263 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.338272 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:46:35.338339 7fe972d84760 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:46:35.338372 7fe972d84760 1 -- 46.19.94.16:0/1015811 --> 46.19.94.1:6789/0 -- mon_subscribe({monmap=9+,osdmap=0}) v2 -- ?+0 0x20ed070 con 0x7fe968001470 2012-05-30 16:46:35.338385 7fe972d84760 20 -- 46.19.94.16:0/1015811 submit_message mon_subscribe({monmap=9+,osdmap=0}) v2 remote 46.19.94.1:6789/0 2012-05-30 16:46:35.338399 7fe972d84760 1 -- 46.19.94.16:0/1015811 --> 46.19.94.1:6789/0 -- mon_subscribe({monmap=9+,osdmap=0}) v2 -- ?+0 0x20edd10 con 0x7fe968001470 2012-05-30 16:46:35.338401 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.338412 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer encoding 5 0x20ed070 mon_subscribe({monmap=9+,osdmap=0}) v2 2012-05-30 16:46:35.338417 7fe972d84760 20 -- 46.19.94.16:0/1015811 submit_message mon_subscribe({monmap=9+,osdmap=0}) v2 remote 46.19.94.1:6789/0 2012-05-30 16:46:35.338422 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sending 5 0x20ed070 2012-05-30 16:46:35.338430 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_message 0x20ed070 2012-05-30 16:46:35.338445 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.338451 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer encoding 6 0x20edd10 mon_subscribe({monmap=9+,osdmap=0}) v2 2012-05-30 16:46:35.338459 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sending 6 0x20edd10 2012-05-30 16:46:35.338464 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_message 0x20edd10 2012-05-30 16:46:35.338474 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.338479 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:46:35.338883 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got ACK 2012-05-30 16:46:35.338894 7fe96d968700 15 reader got ack seq 4 2012-05-30 16:46:35.338899 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:46:35.338905 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got MSG 2012-05-30 16:46:35.338911 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got envelope type=4 src mon.0 front=751 data=0 off 0 2012-05-30 16:46:35.338917 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader wants 751 from dispatch throttler 0/104857600 2012-05-30 16:46:35.338925 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got front 751 2012-05-30 16:46:35.338935 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).aborted = 0 2012-05-30 16:46:35.338939 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got 751 + 0 + 0 byte message 2012-05-30 16:46:35.338954 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got message 5 0x20ef7c0 mon_map v1 2012-05-30 16:46:35.338960 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).queue_received queuing pipe 2012-05-30 16:46:35.338980 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:46:35.338986 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got ACK 2012-05-30 16:46:35.338983 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.339002 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_ack 5 2012-05-30 16:46:35.339008 7fe96f96c700 20 -- 46.19.94.16:0/1015811 dispatch_entry pipe 0x7fe968001200 dequeued 0x20ef7c0 2012-05-30 16:46:35.339025 7fe96f96c700 1 -- 46.19.94.16:0/1015811 <== mon.0 46.19.94.1:6789/0 5 ==== mon_map v1 ==== 751+0+0 (4218198165 0 0) 0x20ef7c0 con 0x7fe968001470 2012-05-30 16:46:35.339032 7fe96d968700 15 reader got ack seq 5 2012-05-30 16:46:35.339037 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:46:35.339041 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.339048 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:46:35.339046 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got MSG 2012-05-30 16:46:35.339057 7fe96f96c700 10 -- 46.19.94.16:0/1015811 dispatch_throttle_release 751 to dispatch throttler 751/104857600 2012-05-30 16:46:35.339063 7fe96f96c700 20 -- 46.19.94.16:0/1015811 done calling dispatch on 0x20ef7c0 2012-05-30 16:46:35.339058 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got envelope type=16 src mon.0 front=20 data=0 off 0 2012-05-30 16:46:35.339069 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader wants 20 from dispatch throttler 0/104857600 2012-05-30 16:46:35.339077 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got front 20 2012-05-30 16:46:35.339083 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).aborted = 0 2012-05-30 16:46:35.339088 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got 20 + 0 + 0 byte message 2012-05-30 16:46:35.339101 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got message 6 0x7fe9680096d0 mon_subscribe_ack(300s) v1 2012-05-30 16:46:35.339116 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).queue_received queuing pipe 2012-05-30 16:46:35.339129 7fe96f96c700 20 -- 46.19.94.16:0/1015811 dispatch_entry pipe 0x7fe968001200 dequeued 0x7fe9680096d0 2012-05-30 16:46:35.339128 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:46:35.339137 7fe96f96c700 1 -- 46.19.94.16:0/1015811 <== mon.0 46.19.94.1:6789/0 6 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (496062740 0 0) 0x7fe9680096d0 con 0x7fe968001470 2012-05-30 16:46:35.339136 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got ACK 2012-05-30 16:46:35.339142 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.339151 7fe96f96c700 10 -- 46.19.94.16:0/1015811 dispatch_throttle_release 20 to dispatch throttler 20/104857600 2012-05-30 16:46:35.339156 7fe96f96c700 20 -- 46.19.94.16:0/1015811 done calling dispatch on 0x7fe9680096d0 2012-05-30 16:46:35.339154 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_ack 6 2012-05-30 16:46:35.339160 7fe96d968700 15 reader got ack seq 6 2012-05-30 16:46:35.339163 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.339163 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:46:35.339168 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:46:35.339539 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got MSG 2012-05-30 16:46:35.339553 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got envelope type=41 src mon.0 front=11213 data=0 off 0 2012-05-30 16:46:35.339568 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader wants 11213 from dispatch throttler 0/104857600 2012-05-30 16:46:35.340130 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got front 11213 2012-05-30 16:46:35.340138 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).aborted = 0 2012-05-30 16:46:35.340145 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got 11213 + 0 + 0 byte message 2012-05-30 16:46:35.340179 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got message 7 0x20f3880 osd_map(6924..6924 src has 6424..6924) v3 2012-05-30 16:46:35.340197 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).queue_received queuing pipe 2012-05-30 16:46:35.340223 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:46:35.340226 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.340245 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_ack 7 2012-05-30 16:46:35.340240 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got MSG 2012-05-30 16:46:35.340250 7fe96f96c700 20 -- 46.19.94.16:0/1015811 dispatch_entry pipe 0x7fe968001200 dequeued 0x20f3880 2012-05-30 16:46:35.340256 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got envelope type=16 src mon.0 front=20 data=0 off 0 2012-05-30 16:46:35.340265 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader wants 20 from dispatch throttler 11213/104857600 2012-05-30 16:46:35.340270 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.340266 7fe96f96c700 1 -- 46.19.94.16:0/1015811 <== mon.0 46.19.94.1:6789/0 7 ==== osd_map(6924..6924 src has 6424..6924) v3 ==== 11213+0+0 (2438059111 0 0) 0x20f3880 con 0x7fe968001470 2012-05-30 16:46:35.340273 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got front 20 2012-05-30 16:46:35.340278 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:46:35.340281 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).aborted = 0 2012-05-30 16:46:35.340286 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got 20 + 0 + 0 byte message 2012-05-30 16:46:35.340294 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got message 8 0x20f4990 mon_subscribe_ack(300s) v1 2012-05-30 16:46:35.340301 7fe96f96c700 3 client.11895.objecter handle_osd_map got epochs [6924,6924] > 0 2012-05-30 16:46:35.340308 7fe96f96c700 3 client.11895.objecter handle_osd_map decoding full epoch 6924 2012-05-30 16:46:35.340306 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).queue_received queuing pipe 2012-05-30 16:46:35.340316 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:46:35.340319 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.340326 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_ack 8 2012-05-30 16:46:35.340326 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got MSG 2012-05-30 16:46:35.340332 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.340335 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got envelope type=41 src mon.0 front=11213 data=0 off 0 2012-05-30 16:46:35.340337 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:46:35.340340 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader wants 11213 from dispatch throttler 11233/104857600 2012-05-30 16:46:35.340505 7fe96f96c700 20 client.11895.objecter dump_active .. 0 homeless 2012-05-30 16:46:35.340532 7fe96f96c700 10 -- 46.19.94.16:0/1015811 dispatch_throttle_release 11213 to dispatch throttler 22446/104857600 2012-05-30 16:46:35.340540 7fe96f96c700 20 -- 46.19.94.16:0/1015811 done calling dispatch on 0x20f3880 2012-05-30 16:46:35.340544 7fe96f96c700 20 -- 46.19.94.16:0/1015811 dispatch_entry pipe 0x7fe968001200 dequeued 0x20f4990 2012-05-30 16:46:35.340547 7fe96f96c700 1 -- 46.19.94.16:0/1015811 <== mon.0 46.19.94.1:6789/0 8 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (496062740 0 0) 0x20f4990 con 0x7fe968001470 2012-05-30 16:46:35.340558 7fe96f96c700 10 -- 46.19.94.16:0/1015811 dispatch_throttle_release 20 to dispatch throttler 11233/104857600 2012-05-30 16:46:35.340562 7fe96f96c700 20 -- 46.19.94.16:0/1015811 done calling dispatch on 0x20f4990 2012-05-30 16:46:35.340641 7fe972d84760 20 librbd: open_image: ictx = 0x20f0ec0 name = 'kvm1148' snap_name = '' 2012-05-30 16:46:35.340655 7fe972d84760 20 librbd: ictx_refresh 0x20f0ec0 2012-05-30 16:46:35.340677 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got front 11213 2012-05-30 16:46:35.340687 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).aborted = 0 2012-05-30 16:46:35.340694 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got 11213 + 0 + 0 byte message 2012-05-30 16:46:35.340714 7fe972d84760 10 client.11895.objecter recalc_op_target tid 1 pgid 2.7d848fd9 acting [2,15] 2012-05-30 16:46:35.340713 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got message 9 0x20f1e90 osd_map(6924..6924 src has 6424..6924) v3 2012-05-30 16:46:35.340728 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).queue_received queuing pipe 2012-05-30 16:46:35.340731 7fe972d84760 10 -- 46.19.94.16:0/1015811 connect_rank to 46.19.94.11:6800/9784, creating pipe and registering 2012-05-30 16:46:35.340741 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:46:35.340744 7fe96f96c700 20 -- 46.19.94.16:0/1015811 dispatch_entry pipe 0x7fe968001200 dequeued 0x20f1e90 2012-05-30 16:46:35.340749 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got MSG 2012-05-30 16:46:35.340754 7fe96f96c700 1 -- 46.19.94.16:0/1015811 <== mon.0 46.19.94.1:6789/0 9 ==== osd_map(6924..6924 src has 6424..6924) v3 ==== 11213+0+0 (2438059111 0 0) 0x20f1e90 con 0x7fe968001470 2012-05-30 16:46:35.340762 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got envelope type=16 src mon.0 front=20 data=0 off 0 2012-05-30 16:46:35.340760 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.340770 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_ack 9 2012-05-30 16:46:35.340769 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader wants 20 from dispatch throttler 11213/104857600 2012-05-30 16:46:35.340772 7fe972d84760 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=-1 pgs=0 cs=0 l=0).register_pipe 2012-05-30 16:46:35.340778 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.340780 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got front 20 2012-05-30 16:46:35.340774 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=-1 pgs=0 cs=0 l=0).writer: state = 1 policy.server=0 2012-05-30 16:46:35.340784 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:46:35.340787 7fe972d84760 20 client.11895.objecter note: not requesting commit 2012-05-30 16:46:35.340787 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).aborted = 0 2012-05-30 16:46:35.340788 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=-1 pgs=0 cs=0 l=0).connect 0 2012-05-30 16:46:35.340796 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got 20 + 0 + 0 byte message 2012-05-30 16:46:35.340796 7fe972d84760 10 client.11895.objecter op_submit oid kvm1148.rbd @2 [read 0~4096] tid 1 osd.2 2012-05-30 16:46:35.340804 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=0 cs=0 l=0).connecting to 46.19.94.11:6800/9784 2012-05-30 16:46:35.340807 7fe972d84760 15 client.11895.objecter send_op 1 to osd.2 2012-05-30 16:46:35.340806 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got message 10 0x7fe9600013f0 mon_subscribe_ack(300s) v1 2012-05-30 16:46:35.340817 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).queue_received queuing pipe 2012-05-30 16:46:35.340820 7fe972d84760 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- osd_op(client.11895.0:1 kvm1148.rbd [read 0~4096] 2.7d848fd9) v4 -- ?+0 0x20fe060 con 0x20f2940 2012-05-30 16:46:35.340826 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:46:35.340829 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.340830 7fe972d84760 20 -- 46.19.94.16:0/1015811 submit_message osd_op(client.11895.0:1 kvm1148.rbd [read 0~4096] 2.7d848fd9) v4 remote 46.19.94.11:6800/9784 2012-05-30 16:46:35.340839 7fe972d84760 5 client.11895.objecter 1 unacked, 0 uncommitted 2012-05-30 16:46:35.340838 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_ack 10 2012-05-30 16:46:35.340845 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.340850 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:46:35.340857 7fe96f96c700 3 client.11895.objecter handle_osd_map ignoring epochs [6924,6924] <= 6924 2012-05-30 16:46:35.340873 7fe96f96c700 20 client.11895.objecter dump_active .. 0 homeless 2012-05-30 16:46:35.340875 7fe96f96c700 20 client.11895.objecter 1 2.7d848fd9 osd.2 kvm1148.rbd [read 0~4096] 2012-05-30 16:46:35.340895 7fe96f96c700 10 -- 46.19.94.16:0/1015811 dispatch_throttle_release 11213 to dispatch throttler 11233/104857600 2012-05-30 16:46:35.340906 7fe96f96c700 20 -- 46.19.94.16:0/1015811 done calling dispatch on 0x20f1e90 2012-05-30 16:46:35.340912 7fe96f96c700 20 -- 46.19.94.16:0/1015811 dispatch_entry pipe 0x7fe968001200 dequeued 0x7fe9600013f0 2012-05-30 16:46:35.340915 7fe96f96c700 1 -- 46.19.94.16:0/1015811 <== mon.0 46.19.94.1:6789/0 10 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (496062740 0 0) 0x7fe9600013f0 con 0x7fe968001470 2012-05-30 16:46:35.340925 7fe96f96c700 10 -- 46.19.94.16:0/1015811 dispatch_throttle_release 20 to dispatch throttler 20/104857600 2012-05-30 16:46:35.340928 7fe96f96c700 20 -- 46.19.94.16:0/1015811 done calling dispatch on 0x7fe9600013f0 2012-05-30 16:46:35.342676 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=0 cs=0 l=0).connect read peer addr 46.19.94.11:6800/9784 on socket 5 2012-05-30 16:46:35.342687 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=0 cs=0 l=0).connect peer addr for me is 46.19.94.16:50393/0 2012-05-30 16:46:35.342704 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=0 cs=0 l=0).connect sent my addr 46.19.94.16:0/1015811 2012-05-30 16:46:35.342755 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=0 cs=0 l=0).connect.authorizer_len=174 protocol=2 2012-05-30 16:46:35.342765 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=0 cs=0 l=0).connect sending gseq=2 cseq=0 proto=24 2012-05-30 16:46:35.342774 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=0 cs=0 l=0).connect wrote (self +) cseq, waiting for reply 2012-05-30 16:46:35.345344 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=0 cs=0 l=0).connect got reply tag 1 connect_seq 1 global_seq 35 proto 24 flags 1 2012-05-30 16:46:35.345369 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=0 cs=0 l=0).reply.authorizer_len=36 2012-05-30 16:46:35.345412 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).connect success 1, lossy = 1, features 32767 2012-05-30 16:46:35.345420 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> :/0 pipe(0x20e72b0 sd=-1 pgs=0 cs=0 l=0).queue_received queuing pipe 2012-05-30 16:46:35.345444 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).connect starting reader 2012-05-30 16:46:35.345467 7fe96f96c700 20 -- 46.19.94.16:0/1015811 dispatch_entry pipe 0x20e72b0 dequeued 0 2012-05-30 16:46:35.345497 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.345515 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 1 0x20fe060 osd_op(client.11895.0:1 kvm1148.rbd [read 0~4096] 2.7d848fd9) v4 2012-05-30 16:46:35.345520 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:46:35.345540 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 1 0x20fe060 2012-05-30 16:46:35.345546 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x20fe060 2012-05-30 16:46:35.345560 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:35.345568 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:46:35.561130 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:46:35.561158 7fe96c764700 15 reader got ack seq 1 2012-05-30 16:46:35.561160 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:46:38.282298 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:46:38.282345 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:38.282362 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:46:38.282385 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:38.282390 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:46:40.338422 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:46:45.338527 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:46:48.282423 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:46:48.282464 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:48.282481 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:46:48.282499 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:48.282504 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:46:50.338630 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:46:50.338645 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:46:50.338652 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:46:50.338657 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.1:6789/0 -- mon_subscribe({monmap=9+,osdmap=6925}) v2 -- ?+0 0x20f6cd0 con 0x7fe968001470 2012-05-30 16:46:50.338685 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message mon_subscribe({monmap=9+,osdmap=6925}) v2 remote 46.19.94.1:6789/0 2012-05-30 16:46:50.338700 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x20f71b0 con 0x20f2940 2012-05-30 16:46:50.338706 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:46:50.338711 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:50.338731 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer encoding 7 0x20f6cd0 mon_subscribe({monmap=9+,osdmap=6925}) v2 2012-05-30 16:46:50.338726 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:50.338770 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sending 7 0x20f6cd0 2012-05-30 16:46:50.338770 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 2 0x20f71b0 ping v1 2012-05-30 16:46:50.338777 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_message 0x20f6cd0 2012-05-30 16:46:50.338779 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 2 0x20f71b0 2012-05-30 16:46:50.338785 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x20f71b0 2012-05-30 16:46:50.338807 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:50.338812 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:46:50.338816 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:50.338822 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:46:50.339316 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got ACK 2012-05-30 16:46:50.339331 7fe96d968700 15 reader got ack seq 7 2012-05-30 16:46:50.339332 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:46:50.339338 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got MSG 2012-05-30 16:46:50.339344 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got envelope type=16 src mon.0 front=20 data=0 off 0 2012-05-30 16:46:50.339350 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader wants 20 from dispatch throttler 0/104857600 2012-05-30 16:46:50.339358 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got front 20 2012-05-30 16:46:50.339364 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).aborted = 0 2012-05-30 16:46:50.339369 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got 20 + 0 + 0 byte message 2012-05-30 16:46:50.339383 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got message 11 0x7fe960004b20 mon_subscribe_ack(300s) v1 2012-05-30 16:46:50.339389 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).queue_received queuing pipe 2012-05-30 16:46:50.339405 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:46:50.339407 7fe96f96c700 20 -- 46.19.94.16:0/1015811 dispatch_entry pipe 0x7fe968001200 dequeued 0x7fe960004b20 2012-05-30 16:46:50.339427 7fe96f96c700 1 -- 46.19.94.16:0/1015811 <== mon.0 46.19.94.1:6789/0 11 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (496062740 0 0) 0x7fe960004b20 con 0x7fe968001470 2012-05-30 16:46:50.339438 7fe96f96c700 10 -- 46.19.94.16:0/1015811 dispatch_throttle_release 20 to dispatch throttler 20/104857600 2012-05-30 16:46:50.339430 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:50.339444 7fe96f96c700 20 -- 46.19.94.16:0/1015811 done calling dispatch on 0x7fe960004b20 2012-05-30 16:46:50.339445 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_ack 11 2012-05-30 16:46:50.339456 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:50.339460 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:46:50.601087 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:46:50.601114 7fe96c764700 15 reader got ack seq 2 2012-05-30 16:46:50.601115 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:46:55.338800 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:46:55.338816 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:46:55.338820 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:46:55.338825 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x20feea0 con 0x20f2940 2012-05-30 16:46:55.338833 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:46:55.338850 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:55.338873 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 3 0x20feea0 ping v1 2012-05-30 16:46:55.338878 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 3 0x20feea0 2012-05-30 16:46:55.338888 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x20feea0 2012-05-30 16:46:55.338905 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:55.338914 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:46:55.549093 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:46:55.549170 7fe96c764700 15 reader got ack seq 3 2012-05-30 16:46:55.549173 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:46:58.282543 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:46:58.282583 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:58.282598 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:46:58.282618 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:46:58.282624 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:47:00.338927 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:47:00.338943 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:47:00.338946 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:47:00.338951 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x20ff730 con 0x20f2940 2012-05-30 16:47:00.338959 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:47:00.338975 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:00.338998 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 4 0x20ff730 ping v1 2012-05-30 16:47:00.339003 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 4 0x20ff730 2012-05-30 16:47:00.339008 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x20ff730 2012-05-30 16:47:00.339026 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:00.339035 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:47:00.545478 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:47:00.545506 7fe96c764700 15 reader got ack seq 4 2012-05-30 16:47:00.545507 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:47:05.339051 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:47:05.339066 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:47:05.339070 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:47:05.339074 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x20fff70 con 0x20f2940 2012-05-30 16:47:05.339082 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:47:05.339099 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:05.339118 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 5 0x20fff70 ping v1 2012-05-30 16:47:05.339123 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 5 0x20fff70 2012-05-30 16:47:05.339127 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x20fff70 2012-05-30 16:47:05.339147 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:05.339156 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:47:05.553125 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:47:05.553151 7fe96c764700 15 reader got ack seq 5 2012-05-30 16:47:05.553152 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:47:08.282663 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:47:08.282703 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:08.282718 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:47:08.282740 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:08.282744 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:47:10.339174 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:47:10.339190 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:47:10.339193 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:47:10.339197 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2100880 con 0x20f2940 2012-05-30 16:47:10.339205 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:47:10.339221 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:10.339244 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 6 0x2100880 ping v1 2012-05-30 16:47:10.339249 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 6 0x2100880 2012-05-30 16:47:10.339254 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2100880 2012-05-30 16:47:10.339272 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:10.339281 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:47:10.541083 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:47:10.541110 7fe96c764700 15 reader got ack seq 6 2012-05-30 16:47:10.541111 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:47:15.339297 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:47:15.339312 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:47:15.339316 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:47:15.339327 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x21010c0 con 0x20f2940 2012-05-30 16:47:15.339335 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:47:15.339355 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:15.339374 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 7 0x21010c0 ping v1 2012-05-30 16:47:15.339379 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 7 0x21010c0 2012-05-30 16:47:15.339389 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x21010c0 2012-05-30 16:47:15.339406 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:15.339824 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:47:15.617206 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:47:15.617224 7fe96c764700 15 reader got ack seq 7 2012-05-30 16:47:15.617226 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:47:18.282781 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:47:18.282822 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:18.282839 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:47:18.282857 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:18.282862 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:47:20.339428 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:47:20.339443 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:47:20.339447 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:47:20.339451 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x21019d0 con 0x20f2940 2012-05-30 16:47:20.339458 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:47:20.339475 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:20.339502 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 8 0x21019d0 ping v1 2012-05-30 16:47:20.339507 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 8 0x21019d0 2012-05-30 16:47:20.339511 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x21019d0 2012-05-30 16:47:20.339531 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:20.339540 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:47:20.541363 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:47:20.541387 7fe96c764700 15 reader got ack seq 8 2012-05-30 16:47:20.541389 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:47:25.339551 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:47:25.339573 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:47:25.339577 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:47:25.339580 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2102210 con 0x20f2940 2012-05-30 16:47:25.339588 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:47:25.339604 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:25.339622 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 9 0x2102210 ping v1 2012-05-30 16:47:25.339631 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 9 0x2102210 2012-05-30 16:47:25.339636 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2102210 2012-05-30 16:47:25.339657 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:25.339666 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:47:25.545108 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:47:25.545148 7fe96c764700 15 reader got ack seq 9 2012-05-30 16:47:25.545150 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:47:28.282900 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:47:28.282940 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:28.282955 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:47:28.282983 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:28.282987 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:47:30.339680 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:47:30.339696 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:47:30.339699 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:47:30.339703 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2102b20 con 0x20f2940 2012-05-30 16:47:30.339711 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:47:30.339727 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:30.339745 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 10 0x2102b20 ping v1 2012-05-30 16:47:30.339753 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 10 0x2102b20 2012-05-30 16:47:30.339757 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2102b20 2012-05-30 16:47:30.339779 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:30.339788 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:47:30.593084 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:47:30.593109 7fe96c764700 15 reader got ack seq 10 2012-05-30 16:47:30.593110 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:47:35.339804 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:47:35.339820 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:47:35.339823 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:47:35.339827 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2103360 con 0x20f2940 2012-05-30 16:47:35.339835 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:47:35.339851 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:35.339869 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 11 0x2103360 ping v1 2012-05-30 16:47:35.339878 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 11 0x2103360 2012-05-30 16:47:35.339882 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2103360 2012-05-30 16:47:35.339906 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:35.339914 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:47:35.545086 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:47:35.545113 7fe96c764700 15 reader got ack seq 11 2012-05-30 16:47:35.545114 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:47:38.283018 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:47:38.283058 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:38.283073 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:47:38.283096 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:38.283100 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:47:40.339929 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:47:40.339944 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:47:40.339947 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:47:40.339951 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2103c70 con 0x20f2940 2012-05-30 16:47:40.339959 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:47:40.339988 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:40.340008 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 12 0x2103c70 ping v1 2012-05-30 16:47:40.340014 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 12 0x2103c70 2012-05-30 16:47:40.340018 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2103c70 2012-05-30 16:47:40.340035 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:40.340043 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:47:40.541087 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:47:40.541112 7fe96c764700 15 reader got ack seq 12 2012-05-30 16:47:40.541113 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:47:45.340059 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:47:45.340075 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:47:45.340078 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:47:45.340082 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x21044b0 con 0x20f2940 2012-05-30 16:47:45.340089 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:47:45.340105 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:45.340123 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 13 0x21044b0 ping v1 2012-05-30 16:47:45.340140 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 13 0x21044b0 2012-05-30 16:47:45.340145 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x21044b0 2012-05-30 16:47:45.340164 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:45.340172 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:47:45.541089 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:47:45.541113 7fe96c764700 15 reader got ack seq 13 2012-05-30 16:47:45.541115 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:47:48.283137 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:47:48.283177 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:48.283191 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:47:48.283220 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:48.283225 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:47:50.340182 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:47:50.340197 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:47:50.340201 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:47:50.340205 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2104dc0 con 0x20f2940 2012-05-30 16:47:50.340219 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:47:50.340240 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:50.340259 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 14 0x2104dc0 ping v1 2012-05-30 16:47:50.340264 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 14 0x2104dc0 2012-05-30 16:47:50.340269 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2104dc0 2012-05-30 16:47:50.340286 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:50.340302 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:47:50.641093 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:47:50.641117 7fe96c764700 15 reader got ack seq 14 2012-05-30 16:47:50.641125 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:47:55.340312 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:47:55.340328 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:47:55.340331 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:47:55.340335 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2105600 con 0x20f2940 2012-05-30 16:47:55.340342 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:47:55.340358 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:55.340377 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 15 0x2105600 ping v1 2012-05-30 16:47:55.340386 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 15 0x2105600 2012-05-30 16:47:55.340391 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2105600 2012-05-30 16:47:55.340408 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:55.340416 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:47:55.545133 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:47:55.545160 7fe96c764700 15 reader got ack seq 15 2012-05-30 16:47:55.545162 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:47:58.283254 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:47:58.283294 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:58.283308 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:47:58.283331 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:47:58.283336 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:48:00.340437 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:48:00.340454 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:48:00.340457 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:48:00.340468 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2105f10 con 0x20f2940 2012-05-30 16:48:00.340477 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:48:00.340498 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:00.340529 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 16 0x2105f10 ping v1 2012-05-30 16:48:00.340534 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 16 0x2105f10 2012-05-30 16:48:00.340538 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2105f10 2012-05-30 16:48:00.340559 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:00.340570 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:48:00.545142 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:48:00.545166 7fe96c764700 15 reader got ack seq 16 2012-05-30 16:48:00.545168 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:48:05.340571 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:48:05.340588 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:48:05.340592 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:48:05.340596 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2106750 con 0x20f2940 2012-05-30 16:48:05.340604 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:48:05.340621 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:05.340642 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 17 0x2106750 ping v1 2012-05-30 16:48:05.340649 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 17 0x2106750 2012-05-30 16:48:05.340653 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2106750 2012-05-30 16:48:05.340676 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:05.340685 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:48:05.589148 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:48:05.589172 7fe96c764700 15 reader got ack seq 17 2012-05-30 16:48:05.589174 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:48:08.283373 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:48:08.283413 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:08.283439 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:48:08.283461 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:08.283466 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:48:10.340697 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:48:10.340713 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:48:10.340716 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:48:10.340727 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2107060 con 0x20f2940 2012-05-30 16:48:10.340735 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:48:10.340755 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:10.340778 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 18 0x2107060 ping v1 2012-05-30 16:48:10.340788 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 18 0x2107060 2012-05-30 16:48:10.340792 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2107060 2012-05-30 16:48:10.340809 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:10.340818 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:48:10.549089 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:48:10.549113 7fe96c764700 15 reader got ack seq 18 2012-05-30 16:48:10.549115 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:48:15.340827 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:48:15.340843 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:48:15.340846 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:48:15.340850 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x21078a0 con 0x20f2940 2012-05-30 16:48:15.340857 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:48:15.340873 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:15.340891 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 19 0x21078a0 ping v1 2012-05-30 16:48:15.340900 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 19 0x21078a0 2012-05-30 16:48:15.340912 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x21078a0 2012-05-30 16:48:15.340931 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:15.340940 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:48:15.545147 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:48:15.545174 7fe96c764700 15 reader got ack seq 19 2012-05-30 16:48:15.545176 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:48:18.283491 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:48:18.283532 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:18.283548 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:48:18.283575 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:18.283579 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:48:20.340951 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:48:20.340977 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:48:20.340980 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:48:20.340984 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x21081b0 con 0x20f2940 2012-05-30 16:48:20.340992 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:48:20.341009 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:20.341038 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 20 0x21081b0 ping v1 2012-05-30 16:48:20.341044 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 20 0x21081b0 2012-05-30 16:48:20.341054 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x21081b0 2012-05-30 16:48:20.341071 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:20.341092 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:48:20.545088 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:48:20.545113 7fe96c764700 15 reader got ack seq 20 2012-05-30 16:48:20.545114 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:48:25.341084 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:48:25.341100 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:48:25.341103 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:48:25.341107 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x21089f0 con 0x20f2940 2012-05-30 16:48:25.341115 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:48:25.341144 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:25.341171 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 21 0x21089f0 ping v1 2012-05-30 16:48:25.341176 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 21 0x21089f0 2012-05-30 16:48:25.341181 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x21089f0 2012-05-30 16:48:25.341200 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:25.341209 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:48:25.565094 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:48:25.565124 7fe96c764700 15 reader got ack seq 21 2012-05-30 16:48:25.565126 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:48:28.283609 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:48:28.283659 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:28.283673 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:48:28.283695 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:28.283700 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:48:30.341221 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:48:30.341236 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:48:30.341239 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:48:30.341243 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2109300 con 0x20f2940 2012-05-30 16:48:30.341251 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:48:30.341267 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:30.341301 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 22 0x2109300 ping v1 2012-05-30 16:48:30.341311 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 22 0x2109300 2012-05-30 16:48:30.341316 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2109300 2012-05-30 16:48:30.341332 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:30.341348 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:48:30.601208 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:48:30.601232 7fe96c764700 15 reader got ack seq 22 2012-05-30 16:48:30.601234 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:48:35.341344 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:48:35.341360 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:48:35.341363 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:48:35.341367 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2109b40 con 0x20f2940 2012-05-30 16:48:35.341374 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:48:35.341390 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:35.341408 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 23 0x2109b40 ping v1 2012-05-30 16:48:35.341417 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 23 0x2109b40 2012-05-30 16:48:35.341421 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2109b40 2012-05-30 16:48:35.341447 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:35.341455 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:48:35.569096 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:48:35.569128 7fe96c764700 15 reader got ack seq 23 2012-05-30 16:48:35.569130 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:48:38.283738 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:48:38.283778 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:38.283792 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:48:38.283820 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:38.283824 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:48:40.341467 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:48:40.341483 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:48:40.341486 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:48:40.341490 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x210a450 con 0x20f2940 2012-05-30 16:48:40.341498 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:48:40.341515 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:40.341543 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 24 0x210a450 ping v1 2012-05-30 16:48:40.341548 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 24 0x210a450 2012-05-30 16:48:40.341552 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x210a450 2012-05-30 16:48:40.341570 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:40.341579 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:48:40.557090 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:48:40.557114 7fe96c764700 15 reader got ack seq 24 2012-05-30 16:48:40.557116 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:48:45.341591 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:48:45.341606 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:48:45.341609 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:48:45.341613 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x210ac90 con 0x20f2940 2012-05-30 16:48:45.341621 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:48:45.341649 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:45.341671 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 25 0x210ac90 ping v1 2012-05-30 16:48:45.341676 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 25 0x210ac90 2012-05-30 16:48:45.341681 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x210ac90 2012-05-30 16:48:45.341708 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:45.341721 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:48:45.545149 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:48:45.545173 7fe96c764700 15 reader got ack seq 25 2012-05-30 16:48:45.545175 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:48:48.283857 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:48:48.283898 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:48.283914 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:48:48.283939 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:48.283944 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:48:50.341721 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:48:50.341736 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:48:50.341739 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:48:50.341743 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x210b5a0 con 0x20f2940 2012-05-30 16:48:50.341750 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:48:50.341766 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:50.341784 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 26 0x210b5a0 ping v1 2012-05-30 16:48:50.341793 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 26 0x210b5a0 2012-05-30 16:48:50.341797 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x210b5a0 2012-05-30 16:48:50.341819 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:50.341828 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:48:50.577086 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:48:50.577111 7fe96c764700 15 reader got ack seq 26 2012-05-30 16:48:50.577113 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:48:55.341844 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:48:55.341860 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:48:55.341863 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:48:55.341867 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x210bde0 con 0x20f2940 2012-05-30 16:48:55.341881 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:48:55.341901 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:55.341924 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 27 0x210bde0 ping v1 2012-05-30 16:48:55.341929 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 27 0x210bde0 2012-05-30 16:48:55.341933 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x210bde0 2012-05-30 16:48:55.341953 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:55.341962 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:48:55.549096 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:48:55.549135 7fe96c764700 15 reader got ack seq 27 2012-05-30 16:48:55.549137 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:48:58.283975 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:48:58.284014 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:58.284029 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:48:58.284059 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:48:58.284064 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:49:00.341974 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:49:00.341989 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:49:00.341993 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:49:00.341997 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x210c6f0 con 0x20f2940 2012-05-30 16:49:00.342004 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:49:00.342020 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:00.342049 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 28 0x210c6f0 ping v1 2012-05-30 16:49:00.342071 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 28 0x210c6f0 2012-05-30 16:49:00.342076 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x210c6f0 2012-05-30 16:49:00.342092 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:00.342105 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:49:00.621094 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:49:00.621124 7fe96c764700 15 reader got ack seq 28 2012-05-30 16:49:00.621127 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:49:05.342097 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:49:05.342112 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:49:05.342115 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:49:05.342125 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x210cf30 con 0x20f2940 2012-05-30 16:49:05.342133 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:49:05.342155 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:05.342176 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 29 0x210cf30 ping v1 2012-05-30 16:49:05.342181 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 29 0x210cf30 2012-05-30 16:49:05.342185 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x210cf30 2012-05-30 16:49:05.342206 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:05.342215 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:49:05.633094 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:49:05.633141 7fe96c764700 15 reader got ack seq 29 2012-05-30 16:49:05.633143 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:49:08.284094 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:49:08.284134 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:08.284148 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:49:08.284185 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:08.284190 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:49:10.342225 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:49:10.342240 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:49:10.342244 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:49:10.342247 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x210d840 con 0x20f2940 2012-05-30 16:49:10.342255 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:49:10.342271 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:10.342288 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 30 0x210d840 ping v1 2012-05-30 16:49:10.342297 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 30 0x210d840 2012-05-30 16:49:10.342302 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x210d840 2012-05-30 16:49:10.342324 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:10.342332 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:49:10.569202 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:49:10.569226 7fe96c764700 15 reader got ack seq 30 2012-05-30 16:49:10.569227 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:49:15.342347 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:49:15.342362 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:49:15.342366 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:49:15.342376 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x210e080 con 0x20f2940 2012-05-30 16:49:15.342384 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:49:15.342405 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:15.342427 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 31 0x210e080 ping v1 2012-05-30 16:49:15.342433 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 31 0x210e080 2012-05-30 16:49:15.342437 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x210e080 2012-05-30 16:49:15.342454 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:15.342470 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:49:15.593096 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:49:15.593126 7fe96c764700 15 reader got ack seq 31 2012-05-30 16:49:15.593128 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:49:18.284214 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:49:18.284254 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:18.284268 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:49:18.284291 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:18.284295 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:49:20.342477 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:49:20.342492 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:49:20.342495 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:49:20.342499 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x210e990 con 0x20f2940 2012-05-30 16:49:20.342507 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:49:20.342523 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:20.342551 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 32 0x210e990 ping v1 2012-05-30 16:49:20.342556 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 32 0x210e990 2012-05-30 16:49:20.342561 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x210e990 2012-05-30 16:49:20.342579 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:20.342588 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:49:20.545088 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:49:20.545112 7fe96c764700 15 reader got ack seq 32 2012-05-30 16:49:20.545114 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:49:25.342599 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:49:25.342621 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:49:25.342624 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:49:25.342628 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x210f1d0 con 0x20f2940 2012-05-30 16:49:25.342635 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:49:25.342651 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:25.342686 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 33 0x210f1d0 ping v1 2012-05-30 16:49:25.342691 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 33 0x210f1d0 2012-05-30 16:49:25.342695 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x210f1d0 2012-05-30 16:49:25.342712 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:25.342721 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:49:25.545087 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:49:25.545113 7fe96c764700 15 reader got ack seq 33 2012-05-30 16:49:25.545115 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:49:28.284335 7fe96e96a700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.1:6789/0 -- mon_subscribe({monmap=9+,osdmap=6925}) v2 -- ?+0 0x210f7a0 con 0x7fe968001470 2012-05-30 16:49:28.284360 7fe96e96a700 20 -- 46.19.94.16:0/1015811 submit_message mon_subscribe({monmap=9+,osdmap=6925}) v2 remote 46.19.94.1:6789/0 2012-05-30 16:49:28.284374 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:49:28.284385 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:28.284405 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:49:28.284427 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer encoding 8 0x210f7a0 mon_subscribe({monmap=9+,osdmap=6925}) v2 2012-05-30 16:49:28.284450 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sending 8 0x210f7a0 2012-05-30 16:49:28.284455 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_message 0x210f7a0 2012-05-30 16:49:28.284468 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:28.284473 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:49:28.284995 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got ACK 2012-05-30 16:49:28.285017 7fe96d968700 15 reader got ack seq 8 2012-05-30 16:49:28.285019 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:49:28.285025 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got MSG 2012-05-30 16:49:28.285032 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got envelope type=16 src mon.0 front=20 data=0 off 0 2012-05-30 16:49:28.285038 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader wants 20 from dispatch throttler 0/104857600 2012-05-30 16:49:28.285047 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got front 20 2012-05-30 16:49:28.285054 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).aborted = 0 2012-05-30 16:49:28.285058 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got 20 + 0 + 0 byte message 2012-05-30 16:49:28.285077 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got message 12 0x7fe96001ac00 mon_subscribe_ack(300s) v1 2012-05-30 16:49:28.285084 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).queue_received queuing pipe 2012-05-30 16:49:28.285105 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:49:28.285108 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:28.285146 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_ack 12 2012-05-30 16:49:28.285152 7fe96f96c700 20 -- 46.19.94.16:0/1015811 dispatch_entry pipe 0x7fe968001200 dequeued 0x7fe96001ac00 2012-05-30 16:49:28.285175 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:28.285172 7fe96f96c700 1 -- 46.19.94.16:0/1015811 <== mon.0 46.19.94.1:6789/0 12 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (496062740 0 0) 0x7fe96001ac00 con 0x7fe968001470 2012-05-30 16:49:28.285181 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:49:28.285186 7fe96f96c700 10 -- 46.19.94.16:0/1015811 dispatch_throttle_release 20 to dispatch throttler 20/104857600 2012-05-30 16:49:28.285192 7fe96f96c700 20 -- 46.19.94.16:0/1015811 done calling dispatch on 0x7fe96001ac00 2012-05-30 16:49:30.342729 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:49:30.342744 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:49:30.342747 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:49:30.342752 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x21102b0 con 0x20f2940 2012-05-30 16:49:30.342759 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:49:30.342776 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:30.342804 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 34 0x21102b0 ping v1 2012-05-30 16:49:30.342809 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 34 0x21102b0 2012-05-30 16:49:30.342814 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x21102b0 2012-05-30 16:49:30.342832 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:30.342841 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:49:30.565126 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:49:30.565150 7fe96c764700 15 reader got ack seq 34 2012-05-30 16:49:30.565152 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:49:35.342853 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:49:35.342869 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:49:35.342872 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:49:35.342876 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2110af0 con 0x20f2940 2012-05-30 16:49:35.342884 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:49:35.342900 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:35.342928 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 35 0x2110af0 ping v1 2012-05-30 16:49:35.342933 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 35 0x2110af0 2012-05-30 16:49:35.342951 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2110af0 2012-05-30 16:49:35.342968 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:35.343380 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:49:35.609087 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:49:35.609111 7fe96c764700 15 reader got ack seq 35 2012-05-30 16:49:35.609113 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:49:38.284468 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:49:38.284508 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:38.284522 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:49:38.284551 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:38.284555 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:49:40.342977 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:49:40.342992 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:49:40.342996 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:49:40.343000 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2111400 con 0x20f2940 2012-05-30 16:49:40.343007 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:49:40.343024 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:40.343051 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 36 0x2111400 ping v1 2012-05-30 16:49:40.343057 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 36 0x2111400 2012-05-30 16:49:40.343061 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2111400 2012-05-30 16:49:40.343079 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:40.343095 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:49:40.605092 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:49:40.605116 7fe96c764700 15 reader got ack seq 36 2012-05-30 16:49:40.605118 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:49:45.343100 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:49:45.343116 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:49:45.343119 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:49:45.343123 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2111c40 con 0x20f2940 2012-05-30 16:49:45.343131 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:49:45.343147 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:45.343175 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 37 0x2111c40 ping v1 2012-05-30 16:49:45.343179 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 37 0x2111c40 2012-05-30 16:49:45.343184 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2111c40 2012-05-30 16:49:45.343207 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:45.343216 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:49:45.577177 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:49:45.577203 7fe96c764700 15 reader got ack seq 37 2012-05-30 16:49:45.577211 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:49:48.284586 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:49:48.284626 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:48.284640 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:49:48.284662 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:48.284666 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:49:50.343223 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:49:50.343238 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:49:50.343242 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:49:50.343246 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2112550 con 0x20f2940 2012-05-30 16:49:50.343253 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:49:50.343269 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:50.343304 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 38 0x2112550 ping v1 2012-05-30 16:49:50.343314 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 38 0x2112550 2012-05-30 16:49:50.343319 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2112550 2012-05-30 16:49:50.343336 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:50.343344 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:49:50.637087 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:49:50.637112 7fe96c764700 15 reader got ack seq 38 2012-05-30 16:49:50.637113 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:49:55.343347 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:49:55.343363 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:49:55.343366 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:49:55.343370 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2112d90 con 0x20f2940 2012-05-30 16:49:55.343384 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:49:55.343406 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:55.343427 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 39 0x2112d90 ping v1 2012-05-30 16:49:55.343432 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 39 0x2112d90 2012-05-30 16:49:55.343441 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2112d90 2012-05-30 16:49:55.343458 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:55.343467 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:49:55.549079 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:49:55.549103 7fe96c764700 15 reader got ack seq 39 2012-05-30 16:49:55.549105 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:49:58.284704 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:49:58.284744 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:58.284770 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:49:58.284792 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:49:58.284797 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:50:00.343479 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:50:00.343494 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:50:00.343497 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:50:00.343501 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x21136a0 con 0x20f2940 2012-05-30 16:50:00.343508 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:50:00.343525 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:00.343553 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 40 0x21136a0 ping v1 2012-05-30 16:50:00.343558 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 40 0x21136a0 2012-05-30 16:50:00.343562 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x21136a0 2012-05-30 16:50:00.343581 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:00.343589 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:50:00.549086 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:50:00.549110 7fe96c764700 15 reader got ack seq 40 2012-05-30 16:50:00.549111 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:50:05.343602 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:50:05.343618 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:50:05.343621 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:50:05.343634 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2113ee0 con 0x20f2940 2012-05-30 16:50:05.343642 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:50:05.343663 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:05.343686 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 41 0x2113ee0 ping v1 2012-05-30 16:50:05.343691 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 41 0x2113ee0 2012-05-30 16:50:05.343708 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2113ee0 2012-05-30 16:50:05.343725 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:05.343739 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:50:05.557126 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:50:05.557151 7fe96c764700 15 reader got ack seq 41 2012-05-30 16:50:05.557153 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:50:08.284822 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:50:08.284862 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:08.284876 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:50:08.284904 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:08.284908 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:50:10.343735 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:50:10.343750 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:50:10.343753 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:50:10.343757 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x21147f0 con 0x20f2940 2012-05-30 16:50:10.343764 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:50:10.343780 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:10.343798 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 42 0x21147f0 ping v1 2012-05-30 16:50:10.343807 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 42 0x21147f0 2012-05-30 16:50:10.343812 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x21147f0 2012-05-30 16:50:10.343833 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:10.343863 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:50:10.581065 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:50:10.581089 7fe96c764700 15 reader got ack seq 42 2012-05-30 16:50:10.581091 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:50:15.343859 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:50:15.343876 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:50:15.343880 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:50:15.343891 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2115030 con 0x20f2940 2012-05-30 16:50:15.343899 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:50:15.343920 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:15.343941 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 43 0x2115030 ping v1 2012-05-30 16:50:15.343951 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 43 0x2115030 2012-05-30 16:50:15.343956 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2115030 2012-05-30 16:50:15.343975 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:15.343984 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:50:15.645084 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:50:15.645111 7fe96c764700 15 reader got ack seq 43 2012-05-30 16:50:15.645113 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:50:18.284941 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:50:18.284982 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:18.284999 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:50:18.285027 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:18.285032 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:50:20.343992 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:50:20.344008 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:50:20.344011 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:50:20.344015 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2115940 con 0x20f2940 2012-05-30 16:50:20.344022 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:50:20.344039 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:20.344068 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 44 0x2115940 ping v1 2012-05-30 16:50:20.344094 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26 d0 sd=5 pgs=35 cs=1 l=1).writer sending 44 0x2115940 2012-05-30 16:50:20.344098 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2115940 2012-05-30 16:50:20.344121 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:20.344130 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:50:20.585115 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:50:20.585154 7fe96c764700 15 reader got ack seq 44 2012-05-30 16:50:20.585156 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:50:25.344117 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:50:25.344134 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:50:25.344144 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:50:25.344148 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2116180 con 0x20f2940 2012-05-30 16:50:25.344157 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:50:25.344178 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:25.344199 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 45 0x2116180 ping v1 2012-05-30 16:50:25.344209 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 45 0x2116180 2012-05-30 16:50:25.344214 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2116180 2012-05-30 16:50:25.344231 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:25.344239 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:50:25.549077 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:50:25.549101 7fe96c764700 15 reader got ack seq 45 2012-05-30 16:50:25.549103 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:50:28.285058 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:50:28.285099 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:28.285116 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:50:28.285189 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:28.285193 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:50:30.344252 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:50:30.344268 7fe96d867700 2 client.11895.objecter tid 1 on osd.2 is laggy 2012-05-30 16:50:30.344272 7fe96d867700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:50:30.344276 7fe96d867700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- ping v1 -- ?+0 0x2116a90 con 0x20f2940 2012-05-30 16:50:30.344284 7fe96d867700 20 -- 46.19.94.16:0/1015811 submit_message ping v1 remote 46.19.94.11:6800/9784 2012-05-30 16:50:30.344301 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:30.344328 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer encoding 46 0x2116a90 ping v1 2012-05-30 16:50:30.344333 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sending 46 0x2116a90 2012-05-30 16:50:30.344337 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).write_message 0x2116a90 2012-05-30 16:50:30.344356 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:30.344364 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer sleeping 2012-05-30 16:50:30.545079 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader got ACK 2012-05-30 16:50:30.545103 7fe96c764700 15 reader got ack seq 46 2012-05-30 16:50:30.545105 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader reading tag... 2012-05-30 16:50:32.305309 7fe96c764700 2 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader couldn't read tag, Success 2012-05-30 16:50:32.305350 7fe96c764700 2 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).fault 0: Success 2012-05-30 16:50:32.305369 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).fault on lossy channel, failing 2012-05-30 16:50:32.305377 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).fail 2012-05-30 16:50:32.305381 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).stop 2012-05-30 16:50:32.305390 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).discard_queue 2012-05-30 16:50:32.305398 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1). dequeued pipe 2012-05-30 16:50:32.305417 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> :/0 pipe(0x20e72b0 sd=-1 pgs=0 cs=0 l=0).queue_received queuing pipe 2012-05-30 16:50:32.305419 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer finishing 2012-05-30 16:50:32.305436 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).writer done 2012-05-30 16:50:32.305438 7fe96c764700 10 -- 46.19.94.16:0/1015811 queue_reap 0x20f26d0 2012-05-30 16:50:32.305446 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).reader done 2012-05-30 16:50:32.305449 7fe96f96c700 20 -- 46.19.94.16:0/1015811 dispatch_entry pipe 0x20e72b0 dequeued 0x2 2012-05-30 16:50:32.305475 7fe96f96c700 1 client.11895.objecter ms_handle_reset on osd.2 2012-05-30 16:50:32.305466 7fe96f16b700 10 -- 46.19.94.16:0/1015811 reaper 2012-05-30 16:50:32.305489 7fe96f16b700 10 -- 46.19.94.16:0/1015811 reaper reaping pipe 0x20f26d0 46.19.94.11:6800/9784 2012-05-30 16:50:32.305489 7fe96f96c700 10 client.11895.objecter reopen_session osd.2 session, addr now osd.2 46.19.94.11:6800/9784 2012-05-30 16:50:32.305494 7fe96f16b700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).discard_queue 2012-05-30 16:50:32.305502 7fe96f16b700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1). dequeued pipe 2012-05-30 16:50:32.305509 7fe96f16b700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x20f26d0 sd=5 pgs=35 cs=1 l=1).unregister_pipe 2012-05-30 16:50:32.305564 7fe96f16b700 10 -- 46.19.94.16:0/1015811 reaper reaped pipe 0x20f26d0 46.19.94.11:6800/9784 2012-05-30 16:50:32.305581 7fe96f16b700 10 -- 46.19.94.16:0/1015811 reaper deleted pipe 0x20f26d0 2012-05-30 16:50:32.305584 7fe96f16b700 10 -- 46.19.94.16:0/1015811 reaper done 2012-05-30 16:50:32.305602 7fe96f96c700 1 -- 46.19.94.16:0/1015811 mark_down 0x20f2940 -- pipe dne 2012-05-30 16:50:32.305632 7fe96f96c700 10 -- 46.19.94.16:0/1015811 connect_rank to 46.19.94.11:6800/9784, creating pipe and registering 2012-05-30 16:50:32.305673 7fe96f96c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=-1 pgs=0 cs=0 l=0).register_pipe 2012-05-30 16:50:32.305683 7fe96f96c700 10 client.11895.objecter kick_requests for osd.2 2012-05-30 16:50:32.305687 7fe96f96c700 15 client.11895.objecter send_op 1 to osd.2 2012-05-30 16:50:32.305678 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=-1 pgs=0 cs=0 l=0).writer: state = 1 policy.server=0 2012-05-30 16:50:32.305689 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=-1 pgs=0 cs=0 l=0).connect 0 2012-05-30 16:50:32.305695 7fe96f96c700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6800/9784 -- osd_op(client.11895.0:1 kvm1148.rbd [read 0~4096] 2.7d848fd9 RETRY) v4 -- ?+0 0x7fe9600248b0 con 0x7fe9600243e0 2012-05-30 16:50:32.305705 7fe96f96c700 20 -- 46.19.94.16:0/1015811 submit_message osd_op(client.11895.0:1 kvm1148.rbd [read 0~4096] 2.7d848fd9 RETRY) v4 remote 46.19.94.11:6800/9784 2012-05-30 16:50:32.305713 7fe96f96c700 10 client.11895.objecter maybe_request_map subscribing (onetime) to next osd map 2012-05-30 16:50:32.305707 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).connecting to 46.19.94.11:6800/9784 2012-05-30 16:50:32.305934 7fe96c764700 2 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).connect error 46.19.94.11:6800/9784, 111: Connection refused 2012-05-30 16:50:32.305949 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).writer: state = 1 policy.server=0 2012-05-30 16:50:32.305954 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).connect 0 2012-05-30 16:50:32.305970 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).connecting to 46.19.94.11:6800/9784 2012-05-30 16:50:32.306337 7fe96c764700 2 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).connect error 46.19.94.11:6800/9784, 111: Connection refused 2012-05-30 16:50:32.306346 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).fault waiting 0.200000 2012-05-30 16:50:32.506463 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).fault done waiting or woke up 2012-05-30 16:50:32.506487 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).writer: state = 1 policy.server=0 2012-05-30 16:50:32.506491 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).connect 0 2012-05-30 16:50:32.506507 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).connecting to 46.19.94.11:6800/9784 2012-05-30 16:50:32.506687 7fe96c764700 2 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).connect error 46.19.94.11:6800/9784, 111: Connection refused 2012-05-30 16:50:32.506704 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).fault waiting 0.400000 2012-05-30 16:50:32.906790 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).fault done waiting or woke up 2012-05-30 16:50:32.906812 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).writer: state = 1 policy.server=0 2012-05-30 16:50:32.906816 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).connect 0 2012-05-30 16:50:32.906831 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).connecting to 46.19.94.11:6800/9784 2012-05-30 16:50:32.907068 7fe96c764700 2 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).connect error 46.19.94.11:6800/9784, 111: Connection refused 2012-05-30 16:50:32.907082 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).fault waiting 0.800000 2012-05-30 16:50:33.707167 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).fault done waiting or woke up 2012-05-30 16:50:33.707189 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).writer: state = 1 policy.server=0 2012-05-30 16:50:33.707193 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).connect 0 2012-05-30 16:50:33.707209 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).connecting to 46.19.94.11:6800/9784 2012-05-30 16:50:33.707519 7fe96c764700 2 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).connect error 46.19.94.11:6800/9784, 111: Connection refused 2012-05-30 16:50:33.707532 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).fault waiting 1.600000 2012-05-30 16:50:35.307623 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).fault done waiting or woke up 2012-05-30 16:50:35.307645 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).writer: state = 1 policy.server=0 2012-05-30 16:50:35.307649 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).connect 0 2012-05-30 16:50:35.307664 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).connecting to 46.19.94.11:6800/9784 2012-05-30 16:50:35.307851 7fe96c764700 2 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).connect error 46.19.94.11:6800/9784, 111: Connection refused 2012-05-30 16:50:35.307871 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).fault waiting 3.200000 2012-05-30 16:50:35.344381 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:50:38.285177 7fe96e96a700 20 -- 46.19.94.16:0/1015811 send_keepalive con 0x7fe968001470, have pipe. 2012-05-30 16:50:38.285218 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:38.285235 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_keepalive 2012-05-30 16:50:38.285262 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:38.285267 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:50:38.507957 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).fault done waiting or woke up 2012-05-30 16:50:38.507981 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).writer: state = 1 policy.server=0 2012-05-30 16:50:38.507986 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).connect 0 2012-05-30 16:50:38.508002 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).connecting to 46.19.94.11:6800/9784 2012-05-30 16:50:38.508147 7fe96c764700 2 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).connect error 46.19.94.11:6800/9784, 111: Connection refused 2012-05-30 16:50:38.508161 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).fault waiting 6.400000 2012-05-30 16:50:40.344486 7fe96d867700 10 client.11895.objecter tick 2012-05-30 16:50:41.324532 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got MSG 2012-05-30 16:50:41.324560 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got envelope type=41 src mon.0 front=165 data=0 off 0 2012-05-30 16:50:41.324567 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader wants 165 from dispatch throttler 0/104857600 2012-05-30 16:50:41.324577 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got front 165 2012-05-30 16:50:41.324584 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).aborted = 0 2012-05-30 16:50:41.324589 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got 165 + 0 + 0 byte message 2012-05-30 16:50:41.324614 7fe96d968700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader got message 13 0x7fe960025e10 osd_map(6925..6925 src has 6424..6925) v3 2012-05-30 16:50:41.324626 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).queue_received queuing pipe 2012-05-30 16:50:41.324648 7fe96d968700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).reader reading tag... 2012-05-30 16:50:41.324653 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:41.324672 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).write_ack 13 2012-05-30 16:50:41.324677 7fe96f96c700 20 -- 46.19.94.16:0/1015811 dispatch_entry pipe 0x7fe968001200 dequeued 0x7fe960025e10 2012-05-30 16:50:41.324698 7fe972d7c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:41.324696 7fe96f96c700 1 -- 46.19.94.16:0/1015811 <== mon.0 46.19.94.1:6789/0 13 ==== osd_map(6925..6925 src has 6424..6925) v3 ==== 165+0+0 (859135109 0 0) 0x7fe960025e10 con 0x7fe968001470 2012-05-30 16:50:41.324705 7fe972d7c700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.1:6789/0 pipe(0x7fe968001200 sd=4 pgs=269 cs=1 l=1).writer sleeping 2012-05-30 16:50:41.324713 7fe96f96c700 3 client.11895.objecter handle_osd_map got epochs [6925,6925] > 6924 2012-05-30 16:50:41.324718 7fe96f96c700 3 client.11895.objecter handle_osd_map decoding incremental epoch 6925 2012-05-30 16:50:41.324773 7fe96f96c700 10 client.11895.objecter recalc_op_target tid 1 pgid 2.7d848fd9 acting [15] 2012-05-30 16:50:41.324781 7fe96f96c700 10 -- 46.19.94.16:0/1015811 connect_rank to 46.19.94.2:6800/20211, creating pipe and registering 2012-05-30 16:50:41.324812 7fe96f96c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=-1 pgs=0 cs=0 l=0).register_pipe 2012-05-30 16:50:41.324835 7fe96f96c700 10 client.11895.objecter close_session for osd.2 2012-05-30 16:50:41.324838 7fe96f96c700 1 -- 46.19.94.16:0/1015811 mark_down 0x7fe9600243e0 -- 0x7fe960024170 2012-05-30 16:50:41.324841 7fe96f96c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).unregister_pipe 2012-05-30 16:50:41.324825 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=-1 pgs=0 cs=0 l=0).writer: state = 1 policy.server=0 2012-05-30 16:50:41.324846 7fe96f96c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).stop 2012-05-30 16:50:41.324850 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=-1 pgs=0 cs=0 l=0).connect 0 2012-05-30 16:50:41.324859 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).fault done waiting or woke up 2012-05-30 16:50:41.324865 7fe96f96c700 15 client.11895.objecter send_op 1 to osd.15 2012-05-30 16:50:41.324866 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=0 cs=0 l=0).connecting to 46.19.94.2:6800/20211 2012-05-30 16:50:41.324868 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).writer finishing 2012-05-30 16:50:41.324882 7fe96c764700 10 -- 46.19.94.16:0/1015811 queue_reap 0x7fe960024170 2012-05-30 16:50:41.324872 7fe96f96c700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.2:6800/20211 -- osd_op(client.11895.0:1 kvm1148.rbd [read 0~4096] 2.7d848fd9 RETRY) v4 -- ?+0 0x7fe960027af0 con 0x7fe960027330 2012-05-30 16:50:41.324893 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).writer done 2012-05-30 16:50:41.324894 7fe96f96c700 20 -- 46.19.94.16:0/1015811 submit_message osd_op(client.11895.0:1 kvm1148.rbd [read 0~4096] 2.7d848fd9 RETRY) v4 remote 46.19.94.2:6800/20211 2012-05-30 16:50:41.324907 7fe96f96c700 20 client.11895.objecter dump_active .. 0 homeless 2012-05-30 16:50:41.324909 7fe96f96c700 20 client.11895.objecter 1 2.7d848fd9 osd.15 kvm1148.rbd [read 0~4096] 2012-05-30 16:50:41.324911 7fe96f16b700 10 -- 46.19.94.16:0/1015811 reaper 2012-05-30 16:50:41.324920 7fe96f96c700 10 -- 46.19.94.16:0/1015811 dispatch_throttle_release 165 to dispatch throttler 165/104857600 2012-05-30 16:50:41.324926 7fe96f96c700 20 -- 46.19.94.16:0/1015811 done calling dispatch on 0x7fe960025e10 2012-05-30 16:50:41.324924 7fe96f16b700 10 -- 46.19.94.16:0/1015811 reaper reaping pipe 0x7fe960024170 46.19.94.11:6800/9784 2012-05-30 16:50:41.324931 7fe96f16b700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).discard_queue 2012-05-30 16:50:41.324938 7fe96f16b700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0). dequeued pipe 2012-05-30 16:50:41.324943 7fe96f16b700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0). discard 0x7fe9600248b0 2012-05-30 16:50:41.324951 7fe96f16b700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6800/9784 pipe(0x7fe960024170 sd=5 pgs=0 cs=0 l=0).unregister_pipe - not registered 2012-05-30 16:50:41.324969 7fe96f16b700 10 -- 46.19.94.16:0/1015811 reaper reaped pipe 0x7fe960024170 46.19.94.11:6800/9784 2012-05-30 16:50:41.324974 7fe96f16b700 10 -- 46.19.94.16:0/1015811 reaper deleted pipe 0x7fe960024170 2012-05-30 16:50:41.324977 7fe96f16b700 10 -- 46.19.94.16:0/1015811 reaper done 2012-05-30 16:50:41.325491 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=0 cs=0 l=0).connect read peer addr 46.19.94.2:6800/20211 on socket 6 2012-05-30 16:50:41.325509 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=0 cs=0 l=0).connect peer addr for me is 46.19.94.16:56002/0 2012-05-30 16:50:41.325542 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=0 cs=0 l=0).connect sent my addr 46.19.94.16:0/1015811 2012-05-30 16:50:41.325620 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=0 cs=0 l=0).connect.authorizer_len=174 protocol=2 2012-05-30 16:50:41.325630 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=0 cs=0 l=0).connect sending gseq=10 cseq=0 proto=24 2012-05-30 16:50:41.325641 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=0 cs=0 l=0).connect wrote (self +) cseq, waiting for reply 2012-05-30 16:50:41.326003 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=0 cs=0 l=0).connect got reply tag 1 connect_seq 1 global_seq 19940 proto 24 flags 1 2012-05-30 16:50:41.326020 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=0 cs=0 l=0).reply.authorizer_len=36 2012-05-30 16:50:41.326082 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).connect success 1, lossy = 1, features 32767 2012-05-30 16:50:41.326093 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> :/0 pipe(0x20e72b0 sd=-1 pgs=0 cs=0 l=0).queue_received queuing pipe 2012-05-30 16:50:41.326107 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).connect starting reader 2012-05-30 16:50:41.326120 7fe96f96c700 20 -- 46.19.94.16:0/1015811 dispatch_entry pipe 0x20e72b0 dequeued 0 2012-05-30 16:50:41.326141 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:41.326153 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).writer encoding 1 0x7fe960027af0 osd_op(client.11895.0:1 kvm1148.rbd [read 0~4096] 2.7d848fd9 RETRY) v4 2012-05-30 16:50:41.326159 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).reader reading tag... 2012-05-30 16:50:41.326173 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).writer sending 1 0x7fe960027af0 2012-05-30 16:50:41.326180 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).write_message 0x7fe960027af0 2012-05-30 16:50:41.326215 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:41.326224 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).writer sleeping 2012-05-30 16:50:41.530799 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).reader got ACK 2012-05-30 16:50:41.530828 7fe96c764700 15 reader got ack seq 1 2012-05-30 16:50:41.530829 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).reader reading tag... 2012-05-30 16:50:43.628553 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).reader got MSG 2012-05-30 16:50:43.628578 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).reader got envelope type=41 src osd.15 front=608 data=0 off 0 2012-05-30 16:50:43.628584 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).reader wants 608 from dispatch throttler 0/104857600 2012-05-30 16:50:43.628594 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).reader got front 608 2012-05-30 16:50:43.628600 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).aborted = 0 2012-05-30 16:50:43.628604 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).reader got 608 + 0 + 0 byte message 2012-05-30 16:50:43.628622 7fe96c764700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).reader got message 1 0x211db70 osd_map(6926..6926 src has 6424..6926) v3 2012-05-30 16:50:43.628640 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).queue_received queuing pipe 2012-05-30 16:50:43.628657 7fe96c764700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).reader reading tag... 2012-05-30 16:50:43.628666 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:43.628687 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).write_ack 1 2012-05-30 16:50:43.628693 7fe96f96c700 20 -- 46.19.94.16:0/1015811 dispatch_entry pipe 0x7fe9600270c0 dequeued 0x211db70 2012-05-30 16:50:43.628714 7fe96c865700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).writer: state = 2 policy.server=0 2012-05-30 16:50:43.628711 7fe96f96c700 1 -- 46.19.94.16:0/1015811 <== osd.15 46.19.94.2:6800/20211 1 ==== osd_map(6926..6926 src has 6424..6926) v3 ==== 608+0+0 (1283618114 0 0) 0x211db70 con 0x7fe960027330 2012-05-30 16:50:43.628721 7fe96c865700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.2:6800/20211 pipe(0x7fe9600270c0 sd=6 pgs=19940 cs=1 l=1).writer sleeping 2012-05-30 16:50:43.628725 7fe96f96c700 3 client.11895.objecter handle_osd_map got epochs [6926,6926] > 6925 2012-05-30 16:50:43.628729 7fe96f96c700 3 client.11895.objecter handle_osd_map decoding incremental epoch 6926 2012-05-30 16:50:43.628759 7fe96f96c700 10 client.11895.objecter recalc_op_target tid 1 pgid 2.7d848fd9 acting [2,15] 2012-05-30 16:50:43.628764 7fe96f96c700 10 -- 46.19.94.16:0/1015811 connect_rank to 46.19.94.11:6802/11198, creating pipe and registering 2012-05-30 16:50:43.628808 7fe96f96c700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6802/11198 pipe(0x7fe960028d80 sd=-1 pgs=0 cs=0 l=0).register_pipe 2012-05-30 16:50:43.628823 7fe96f96c700 15 client.11895.objecter send_op 1 to osd.2 2012-05-30 16:50:43.628815 7fe96c663700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6802/11198 pipe(0x7fe960028d80 sd=-1 pgs=0 cs=0 l=0).writer: state = 1 policy.server=0 2012-05-30 16:50:43.628829 7fe96f96c700 1 -- 46.19.94.16:0/1015811 --> 46.19.94.11:6802/11198 -- osd_op(client.11895.0:1 kvm1148.rbd [read 0~4096] 2.7d848fd9 RETRY) v4 -- ?+0 0x7fe960029530 con 0x7fe960028ff0 2012-05-30 16:50:43.628836 7fe96c663700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6802/11198 pipe(0x7fe960028d80 sd=-1 pgs=0 cs=0 l=0).connect 0 2012-05-30 16:50:43.628855 7fe96f96c700 20 -- 46.19.94.16:0/1015811 submit_message osd_op(client.11895.0:1 kvm1148.rbd [read 0~4096] 2.7d848fd9 RETRY) v4 remote 46.19.94.11:6802/11198 2012-05-30 16:50:43.628859 7fe96c663700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6802/11198 pipe(0x7fe960028d80 sd=5 pgs=0 cs=0 l=0).connecting to 46.19.94.11:6802/11198 2012-05-30 16:50:43.628864 7fe96f96c700 20 client.11895.objecter dump_active .. 0 homeless 2012-05-30 16:50:43.628866 7fe96f96c700 20 client.11895.objecter 1 2.7d848fd9 osd.2 kvm1148.rbd [read 0~4096] 2012-05-30 16:50:43.628874 7fe96f96c700 10 -- 46.19.94.16:0/1015811 dispatch_throttle_release 608 to dispatch throttler 608/104857600 2012-05-30 16:50:43.628879 7fe96f96c700 20 -- 46.19.94.16:0/1015811 done calling dispatch on 0x211db70 2012-05-30 16:50:43.629640 7fe96c663700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6802/11198 pipe(0x7fe960028d80 sd=5 pgs=0 cs=0 l=0).connect read peer addr 46.19.94.11:6802/11198 on socket 5 2012-05-30 16:50:43.629651 7fe96c663700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6802/11198 pipe(0x7fe960028d80 sd=5 pgs=0 cs=0 l=0).connect peer addr for me is 46.19.94.16:60807/0 2012-05-30 16:50:43.629665 7fe96c663700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6802/11198 pipe(0x7fe960028d80 sd=5 pgs=0 cs=0 l=0).connect sent my addr 46.19.94.16:0/1015811 2012-05-30 16:50:43.629711 7fe96c663700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6802/11198 pipe(0x7fe960028d80 sd=5 pgs=0 cs=0 l=0).connect.authorizer_len=174 protocol=2 2012-05-30 16:50:43.629719 7fe96c663700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6802/11198 pipe(0x7fe960028d80 sd=5 pgs=0 cs=0 l=0).connect sending gseq=11 cseq=0 proto=24 2012-05-30 16:50:43.629729 7fe96c663700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6802/11198 pipe(0x7fe960028d80 sd=5 pgs=0 cs=0 l=0).connect wrote (self +) cseq, waiting for reply 2012-05-30 16:50:43.630193 7fe96c663700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6802/11198 pipe(0x7fe960028d80 sd=5 pgs=0 cs=0 l=0).connect got reply tag 1 connect_seq 1 global_seq 11 proto 24 flags 1 2012-05-30 16:50:43.630212 7fe96c663700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6802/11198 pipe(0x7fe960028d80 sd=5 pgs=0 cs=0 l=0).reply.authorizer_len=36 2012-05-30 16:50:43.630237 7fe96c663700 10 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6802/11198 pipe(0x7fe960028d80 sd=5 pgs=11 cs=1 l=1).connect success 1, lossy = 1, features 32767 2012-05-30 16:50:43.630244 7fe96c663700 20 -- 46.19.94.16:0/1015811 >> :/0 pipe(0x20e72b0 sd=-1 pgs=0 cs=0 l=0).queue_received queuing pipe 2012-05-30 16:50:43.630261 7fe96c663700 20 -- 46.19.94.16:0/1015811 >> 46.19.94.11:6802/11198 pipe(0x7fe960028d80 sd=5 pgs=11 cs=1 l=1).connect starting reader 2012-05-30 16:50:43.630271 7fe96f96c700 20 -- 46.19.94.16:0/1015811 dispatch_entry pipe 0x20e72b0 dequeued 0