014-05-19 10:47:19.404543 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:19.404629 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:19.450951 7f555019b700 20 OSD::command_tp worker waiting 2014-05-19 10:47:19.454143 7f555099c700 20 OSD::disk_tp worker waiting 2014-05-19 10:47:19.520907 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:19.520969 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:19.576645 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:19.576718 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:19.672891 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:19.672963 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:19.861639 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:19.861763 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:19.923929 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:19.923984 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.4 >= max 0.5 = no, load too high 2014-05-19 10:47:19.923998 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 2014-05-19 10:47:19.923998 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:19.924001 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2260.46 < min (86400 seconds) 2014-05-19 10:47:19.924020 7f5566602700 20 osd.0 245 sched_scrub done 2014-05-19 10:47:19.924024 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:19.924025 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:19.965533 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) 2014-05-19 10:47:19.965555 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) 2014-05-19 10:47:19.966739 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:19.966824 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:19.966862 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:19.966895 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:19.966942 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:19.966990 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:19.967015 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:19.967039 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:19.967100 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:19.967120 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:19.967139 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:19.967173 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:19.967195 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:19.967217 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:19.967240 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:19.967261 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:19.967281 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:19.967303 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:19.967325 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:19.967344 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:19.967378 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:19.967398 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:19.967424 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:19.967450 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:19.967473 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:19.967492 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:19.967511 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:19.967538 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:19.967571 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:19.967598 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:19.967618 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:19.967640 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:19.967660 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:19.967681 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:19.967708 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:19.967730 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:19.967752 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:19.967770 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:19.967789 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:19.967811 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:19.967834 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:19.967856 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:20.174734 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:20.174855 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:20.466840 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) 2014-05-19 10:47:20.466861 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) 2014-05-19 10:47:20.468014 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:20.468062 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:20.468089 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:20.468154 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:20.468213 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:20.468345 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:20.468371 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:20.468394 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:20.468423 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:20.468445 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:20.468470 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:20.468493 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:20.468518 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:20.468546 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:20.468571 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:20.468595 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:20.468618 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:20.468643 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:20.468675 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:20.468699 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:20.468724 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:20.468748 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:20.468774 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:20.468798 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:20.468824 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:20.468845 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:20.468870 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:20.468892 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:20.468914 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:20.468938 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:20.468964 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:20.468986 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:20.469007 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:20.469032 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:20.469058 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:20.469079 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:20.469101 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:20.469161 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:20.469183 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:20.469204 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:20.469231 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:20.469253 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:20.528634 7f5565600700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:20.678719 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:20.678781 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:20.705710 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:20.705774 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:20.770326 7f55579aa700 20 OSD::op_tp worker waiting 2014-05-19 10:47:20.770349 7f555a1af700 20 OSD::op_tp worker waiting 2014-05-19 10:47:20.770409 7f55551a5700 20 OSD::op_tp worker waiting 2014-05-19 10:47:20.771967 7f55569a8700 20 OSD::op_tp worker waiting 2014-05-19 10:47:20.771991 7f55541a3700 20 OSD::op_tp worker waiting 2014-05-19 10:47:20.772010 7f55589ac700 20 OSD::op_tp worker waiting 2014-05-19 10:47:20.772026 7f55549a4700 20 OSD::op_tp worker waiting 2014-05-19 10:47:20.772062 7f555a9b0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:20.772104 7f555b1b1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:20.772650 7f55581ab700 20 OSD::op_tp worker waiting 2014-05-19 10:47:20.772682 7f55571a9700 20 OSD::op_tp worker waiting 2014-05-19 10:47:20.772715 7f55531a1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:20.772742 7f55599ae700 20 OSD::op_tp worker waiting 2014-05-19 10:47:20.772766 7f555219f700 20 OSD::op_tp worker waiting 2014-05-19 10:47:20.772796 7f55539a2700 20 OSD::op_tp worker waiting 2014-05-19 10:47:20.772824 7f55529a0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:20.772831 7f55591ad700 20 OSD::op_tp worker waiting 2014-05-19 10:47:20.772843 7f55561a7700 20 OSD::op_tp worker waiting 2014-05-19 10:47:20.772918 7f55559a6700 20 OSD::op_tp worker waiting 2014-05-19 10:47:20.772945 7f555199e700 20 OSD::op_tp worker waiting 2014-05-19 10:47:20.924115 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:20.924168 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.4 >= max 0.5 = no, load too high 2014-05-19 10:47:20.924182 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 2014-05-19 10:47:20.924185 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:20.924184 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2261.46 < min (86400 seconds) 2014-05-19 10:47:20.924205 7f5566602700 20 osd.0 245 sched_scrub done 2014-05-19 10:47:20.924207 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:20.924209 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:20.952714 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:20.952993 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:21.086391 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:21.086469 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:21.111966 7f5564dff700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:21.126509 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:21.126728 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:21.321389 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:21.321677 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:21.376024 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:21.376416 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:21.451035 7f555019b700 20 OSD::command_tp worker waiting 2014-05-19 10:47:21.454233 7f555099c700 20 OSD::disk_tp worker waiting 2014-05-19 10:47:21.475584 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:21.475641 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:21.779689 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:21.779792 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:21.831174 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:21.831279 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:21.877316 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:21.877837 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:21.924286 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:21.924340 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.29 >= max 0.5 = no, load too high 2014-05-19 10:47:21.924354 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 2014-05-19 10:47:21.924357 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:21.924357 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2262.46 < min (86400 seconds) 2014-05-19 10:47:21.924376 7f5566602700 20 osd.0 245 sched_scrub done 2014-05-19 10:47:21.924379 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:21.924381 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:22.281463 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:22.281621 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:22.422224 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:22.422716 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:22.528733 7f5565600700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:22.577626 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:22.577677 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:22.655545 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:22.656003 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:22.661020 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:22.661455 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:22.694338 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:22.694487 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:22.770428 7f55579aa700 20 OSD::op_tp worker waiting 2014-05-19 10:47:22.770486 7f555a1af700 20 OSD::op_tp worker waiting 2014-05-19 10:47:22.770546 7f55551a5700 20 OSD::op_tp worker waiting 2014-05-19 10:47:22.772067 7f55569a8700 20 OSD::op_tp worker waiting 2014-05-19 10:47:22.772105 7f55541a3700 20 OSD::op_tp worker waiting 2014-05-19 10:47:22.772119 7f55549a4700 20 OSD::op_tp worker waiting 2014-05-19 10:47:22.772140 7f55589ac700 20 OSD::op_tp worker waiting 2014-05-19 10:47:22.772159 7f555a9b0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:22.772179 7f555b1b1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:22.772720 7f55581ab700 20 OSD::op_tp worker waiting 2014-05-19 10:47:22.772753 7f55571a9700 20 OSD::op_tp worker waiting 2014-05-19 10:47:22.772804 7f55599ae700 20 OSD::op_tp worker waiting 2014-05-19 10:47:22.772816 7f55531a1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:22.772831 7f555219f700 20 OSD::op_tp worker waiting 2014-05-19 10:47:22.772871 7f55591ad700 20 OSD::op_tp worker waiting 2014-05-19 10:47:22.772891 7f55539a2700 20 OSD::op_tp worker waiting 2014-05-19 10:47:22.772910 7f55561a7700 20 OSD::op_tp worker waiting 2014-05-19 10:47:22.772921 7f55529a0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:22.772994 7f55559a6700 20 OSD::op_tp worker waiting 2014-05-19 10:47:22.773006 7f555199e700 20 OSD::op_tp worker waiting 2014-05-19 10:47:22.804207 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:22.804553 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:22.828308 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:22.828396 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:22.906111 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:22.906211 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:22.924472 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:22.924493 7f5566602700 7 osd.0 245 do_mon_report 2014-05-19 10:47:22.924497 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 2014-05-19 10:47:22.924501 7f5566602700 20 osd.0 245 send_pg_stats 2014-05-19 10:47:22.924540 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.29 >= max 0.5 = no, load too high 2014-05-19 10:47:22.924554 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 2014-05-19 10:47:22.924551 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:22.924557 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2263.46 < min (86400 seconds) 2014-05-19 10:47:22.924578 7f5566602700 20 osd.0 245 sched_scrub done 2014-05-19 10:47:22.924581 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:22.924583 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:23.006418 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:23.006609 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:23.112061 7f5564dff700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:23.156684 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:23.156747 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:23.195789 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:23.195930 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:23.367994 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) 2014-05-19 10:47:23.368017 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) 2014-05-19 10:47:23.369295 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:23.369350 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:23.369410 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:23.369470 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:23.369493 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:23.369514 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:23.369533 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:23.369582 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:23.369658 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:23.369703 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:23.369749 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:23.369772 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:23.369798 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:23.369819 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:23.369844 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:23.369865 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:23.369891 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:23.369913 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:23.369935 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:23.369956 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:23.369978 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:23.370000 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:23.370018 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:23.370045 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:23.370071 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:23.370095 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:23.370117 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:23.370138 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:23.370159 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:23.370180 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:23.370206 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:23.370230 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:23.370256 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:23.370277 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:23.370298 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:23.370325 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:23.370347 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:23.370368 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:23.370389 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:23.370409 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:23.370438 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:23.370460 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:23.407649 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:23.407704 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:23.451134 7f555019b700 20 OSD::command_tp worker waiting 2014-05-19 10:47:23.454335 7f555099c700 20 OSD::disk_tp worker waiting 2014-05-19 10:47:23.507877 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:23.508248 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:23.578395 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:23.578873 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:23.675629 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:23.675679 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:23.765829 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:23.766429 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:23.924673 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:23.924730 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.29 >= max 0.5 = no, load too high 2014-05-19 10:47:23.924744 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 2014-05-19 10:47:23.924746 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:23.924747 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2264.46 < min (86400 seconds) 2014-05-19 10:47:23.924765 7f5566602700 20 osd.0 245 sched_scrub done 2014-05-19 10:47:23.924768 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:23.924771 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:23.984882 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:23.984961 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:24.079657 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:24.079744 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:24.123439 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:24.123533 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:24.505749 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:24.505876 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:24.528830 7f5565600700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:24.562812 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:24.562915 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:24.582574 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:24.582649 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:24.609320 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:24.609785 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:24.770528 7f55579aa700 20 OSD::op_tp worker waiting 2014-05-19 10:47:24.770571 7f555a1af700 20 OSD::op_tp worker waiting 2014-05-19 10:47:24.770631 7f55551a5700 20 OSD::op_tp worker waiting 2014-05-19 10:47:24.772167 7f55569a8700 20 OSD::op_tp worker waiting 2014-05-19 10:47:24.772186 7f55541a3700 20 OSD::op_tp worker waiting 2014-05-19 10:47:24.772213 7f55549a4700 20 OSD::op_tp worker waiting 2014-05-19 10:47:24.772236 7f55589ac700 20 OSD::op_tp worker waiting 2014-05-19 10:47:24.772260 7f555a9b0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:24.772300 7f555b1b1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:24.772786 7f55581ab700 20 OSD::op_tp worker waiting 2014-05-19 10:47:24.772821 7f55571a9700 20 OSD::op_tp worker waiting 2014-05-19 10:47:24.772874 7f55599ae700 20 OSD::op_tp worker waiting 2014-05-19 10:47:24.772886 7f55531a1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:24.772909 7f555219f700 20 OSD::op_tp worker waiting 2014-05-19 10:47:24.772951 7f55591ad700 20 OSD::op_tp worker waiting 2014-05-19 10:47:24.772970 7f55539a2700 20 OSD::op_tp worker waiting 2014-05-19 10:47:24.772992 7f55561a7700 20 OSD::op_tp worker waiting 2014-05-19 10:47:24.773016 7f55529a0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:24.773059 7f55559a6700 20 OSD::op_tp worker waiting 2014-05-19 10:47:24.773077 7f555199e700 20 OSD::op_tp worker waiting 2014-05-19 10:47:24.878355 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:24.878427 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:24.919677 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:24.919897 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:24.924860 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:24.924914 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.29 >= max 0.5 = no, load too high 2014-05-19 10:47:24.924928 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 2014-05-19 10:47:24.924929 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:24.924931 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2265.46 < min (86400 seconds) 2014-05-19 10:47:24.924950 7f5566602700 20 osd.0 245 sched_scrub done 2014-05-19 10:47:24.924953 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:24.924955 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:25.022474 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:25.022856 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:25.112156 7f5564dff700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:25.377339 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:25.377709 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:25.422815 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:25.423008 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:25.451216 7f555019b700 20 OSD::command_tp worker waiting 2014-05-19 10:47:25.454434 7f555099c700 20 OSD::disk_tp worker waiting 2014-05-19 10:47:25.467305 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:25.467676 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:25.496877 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:25.496940 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:25.653938 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:25.654298 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:25.686144 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:25.686247 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:25.787072 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:25.787671 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:25.925044 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:25.925070 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off 2014-05-19 10:47:25.925075 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:25.925077 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:25.925120 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:26.309287 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:26.309374 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:26.528928 7f5565600700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:26.657810 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:26.658068 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:26.770627 7f55579aa700 20 OSD::op_tp worker waiting 2014-05-19 10:47:26.770652 7f555a1af700 20 OSD::op_tp worker waiting 2014-05-19 10:47:26.770712 7f55551a5700 20 OSD::op_tp worker waiting 2014-05-19 10:47:26.772269 7f55569a8700 20 OSD::op_tp worker waiting 2014-05-19 10:47:26.772293 7f55549a4700 20 OSD::op_tp worker waiting 2014-05-19 10:47:26.772312 7f55541a3700 20 OSD::op_tp worker waiting 2014-05-19 10:47:26.772325 7f555a9b0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:26.772339 7f55589ac700 20 OSD::op_tp worker waiting 2014-05-19 10:47:26.772364 7f555b1b1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:26.772853 7f55581ab700 20 OSD::op_tp worker waiting 2014-05-19 10:47:26.772889 7f55571a9700 20 OSD::op_tp worker waiting 2014-05-19 10:47:26.772939 7f55599ae700 20 OSD::op_tp worker waiting 2014-05-19 10:47:26.772963 7f55531a1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:26.773023 7f555219f700 20 OSD::op_tp worker waiting 2014-05-19 10:47:26.773043 7f55591ad700 20 OSD::op_tp worker waiting 2014-05-19 10:47:26.773058 7f55561a7700 20 OSD::op_tp worker waiting 2014-05-19 10:47:26.773071 7f55539a2700 20 OSD::op_tp worker waiting 2014-05-19 10:47:26.773084 7f55529a0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:26.773127 7f55559a6700 20 OSD::op_tp worker waiting 2014-05-19 10:47:26.773140 7f555199e700 20 OSD::op_tp worker waiting 2014-05-19 10:47:26.807504 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:26.807757 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:26.925167 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:26.925234 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:26.925231 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.19 >= max 0.5 = no, load too high 2014-05-19 10:47:26.925251 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 2014-05-19 10:47:26.925256 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2267.46 < min (86400 seconds) 2014-05-19 10:47:26.925280 7f5566602700 20 osd.0 245 sched_scrub done 2014-05-19 10:47:26.925285 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:26.925288 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:27.112256 7f5564dff700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:27.131928 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:27.132369 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:27.159063 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:27.159233 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:27.179554 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:27.179725 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:27.308895 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:27.309222 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:27.451297 7f555019b700 20 OSD::command_tp worker waiting 2014-05-19 10:47:27.454534 7f555099c700 20 OSD::disk_tp worker waiting 2014-05-19 10:47:27.488599 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:27.488703 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:27.528785 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:27.528909 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:27.580902 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:27.581088 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:27.925375 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:27.925396 7f5566602700 7 osd.0 245 do_mon_report 2014-05-19 10:47:27.925400 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 2014-05-19 10:47:27.925404 7f5566602700 20 osd.0 245 send_pg_stats 2014-05-19 10:47:27.925413 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off 2014-05-19 10:47:27.925417 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:27.925419 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:27.925454 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:27.986949 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:27.987101 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:28.069394 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) 2014-05-19 10:47:28.069415 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) 2014-05-19 10:47:28.070758 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:28.070833 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:28.070903 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:28.070929 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:28.070969 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:28.071017 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:28.071063 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:28.071108 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:28.071138 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:28.071171 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:28.071194 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:28.071216 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:28.071240 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:28.071261 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:28.071289 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:28.071310 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:28.071332 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:28.071354 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:28.071376 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:28.071397 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:28.071424 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:28.071445 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:28.071472 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:28.071493 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:28.071515 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:28.071541 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:28.071562 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:28.071584 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:28.071606 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:28.071627 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:28.071658 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:28.071681 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:28.071702 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:28.071724 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:28.071746 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:28.071767 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:28.071793 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:28.071814 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:28.071840 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:28.071863 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:28.071884 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:28.071910 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:28.110513 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:28.110977 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:28.278653 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:28.279023 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:28.488541 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:28.488747 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:28.523828 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:28.524263 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:28.529027 7f5565600700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:28.561735 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:28.562215 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:28.770733 7f55579aa700 20 OSD::op_tp worker waiting 2014-05-19 10:47:28.770793 7f555a1af700 20 OSD::op_tp worker waiting 2014-05-19 10:47:28.770856 7f55551a5700 20 OSD::op_tp worker waiting 2014-05-19 10:47:28.772372 7f55569a8700 20 OSD::op_tp worker waiting 2014-05-19 10:47:28.772398 7f555b1b1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:28.772419 7f55541a3700 20 OSD::op_tp worker waiting 2014-05-19 10:47:28.772440 7f55549a4700 20 OSD::op_tp worker waiting 2014-05-19 10:47:28.772464 7f555a9b0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:28.772483 7f55589ac700 20 OSD::op_tp worker waiting 2014-05-19 10:47:28.772923 7f55581ab700 20 OSD::op_tp worker waiting 2014-05-19 10:47:28.772954 7f55571a9700 20 OSD::op_tp worker waiting 2014-05-19 10:47:28.772992 7f55599ae700 20 OSD::op_tp worker waiting 2014-05-19 10:47:28.773034 7f55531a1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:28.773114 7f55591ad700 20 OSD::op_tp worker waiting 2014-05-19 10:47:28.773131 7f55529a0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:28.773145 7f55539a2700 20 OSD::op_tp worker waiting 2014-05-19 10:47:28.773164 7f55561a7700 20 OSD::op_tp worker waiting 2014-05-19 10:47:28.773201 7f555199e700 20 OSD::op_tp worker waiting 2014-05-19 10:47:28.773214 7f555219f700 20 OSD::op_tp worker waiting 2014-05-19 10:47:28.773243 7f55559a6700 20 OSD::op_tp worker waiting 2014-05-19 10:47:28.824912 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:28.825212 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:28.925485 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:28.925511 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off 2014-05-19 10:47:28.925516 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:28.925519 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:28.925548 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:28.998151 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:28.998458 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:29.010287 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:29.010581 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:29.025653 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:29.025801 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:29.112352 7f5564dff700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:29.282234 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:29.282659 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:29.432928 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:29.433227 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:29.451385 7f555019b700 20 OSD::command_tp worker waiting 2014-05-19 10:47:29.454633 7f555099c700 20 OSD::disk_tp worker waiting 2014-05-19 10:47:29.569171 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:29.569335 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:29.589779 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:29.589981 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:29.620834 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:29.621203 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:29.663079 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:29.663563 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:29.770861 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) 2014-05-19 10:47:29.770883 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) 2014-05-19 10:47:29.772163 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:29.772229 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:29.772260 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:29.772298 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:29.772347 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:29.772418 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:29.772469 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:29.772503 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:29.772544 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:29.772579 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:29.772608 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:29.772634 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:29.772661 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:29.772684 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:29.772706 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:29.772732 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:29.772754 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:29.772776 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:29.772798 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:29.772820 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:29.772852 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:29.772876 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:29.772898 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:29.772921 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:29.772942 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:29.772960 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:29.772987 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:29.773011 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:29.773036 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:29.773061 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:29.773082 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:29.773116 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:29.773150 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:29.773172 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:29.773193 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:29.773215 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:29.773241 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:29.773266 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:29.773287 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:29.773308 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:29.773329 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:29.773351 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:29.789773 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:29.789893 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:29.925611 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:29.925665 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.19 >= max 0.5 = no, load too high 2014-05-19 10:47:29.925679 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 2014-05-19 10:47:29.925683 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:29.925683 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2270.46 < min (86400 seconds) 2014-05-19 10:47:29.925701 7f5566602700 20 osd.0 245 sched_scrub done 2014-05-19 10:47:29.925704 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:29.925706 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:29.934640 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:29.934725 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:30.060933 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:30.061009 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:30.291232 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:30.291608 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:30.464129 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:30.464259 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:30.483910 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:30.484361 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:30.526048 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:30.526110 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:30.529124 7f5565600700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:30.724269 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:30.724454 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:30.770832 7f55579aa700 20 OSD::op_tp worker waiting 2014-05-19 10:47:30.770880 7f555a1af700 20 OSD::op_tp worker waiting 2014-05-19 10:47:30.770966 7f55551a5700 20 OSD::op_tp worker waiting 2014-05-19 10:47:30.772471 7f55569a8700 20 OSD::op_tp worker waiting 2014-05-19 10:47:30.772494 7f55541a3700 20 OSD::op_tp worker waiting 2014-05-19 10:47:30.772517 7f555b1b1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:30.772536 7f55549a4700 20 OSD::op_tp worker waiting 2014-05-19 10:47:30.772557 7f55589ac700 20 OSD::op_tp worker waiting 2014-05-19 10:47:30.772596 7f555a9b0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:30.772990 7f55581ab700 20 OSD::op_tp worker waiting 2014-05-19 10:47:30.773019 7f55571a9700 20 OSD::op_tp worker waiting 2014-05-19 10:47:30.773063 7f55599ae700 20 OSD::op_tp worker waiting 2014-05-19 10:47:30.773120 7f55531a1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:30.773180 7f55591ad700 20 OSD::op_tp worker waiting 2014-05-19 10:47:30.773193 7f55529a0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:30.773214 7f55539a2700 20 OSD::op_tp worker waiting 2014-05-19 10:47:30.773232 7f555199e700 20 OSD::op_tp worker waiting 2014-05-19 10:47:30.773242 7f55561a7700 20 OSD::op_tp worker waiting 2014-05-19 10:47:30.773278 7f555219f700 20 OSD::op_tp worker waiting 2014-05-19 10:47:30.773313 7f55559a6700 20 OSD::op_tp worker waiting 2014-05-19 10:47:30.925773 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:30.925831 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.19 >= max 0.5 = no, load too high 2014-05-19 10:47:30.925846 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 2014-05-19 10:47:30.925842 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:30.925849 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2271.46 < min (86400 seconds) 2014-05-19 10:47:30.925869 7f5566602700 20 osd.0 245 sched_scrub done 2014-05-19 10:47:30.925871 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:30.925873 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:31.011014 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:31.011146 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:31.112450 7f5564dff700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:31.179888 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:31.180119 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:31.270341 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:31.270478 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:31.322196 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:31.322311 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:31.451479 7f555019b700 20 OSD::command_tp worker waiting 2014-05-19 10:47:31.454732 7f555099c700 20 OSD::disk_tp worker waiting 2014-05-19 10:47:31.472275 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) 2014-05-19 10:47:31.472296 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) 2014-05-19 10:47:31.473368 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:31.473466 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:31.473515 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:31.473536 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:31.473557 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:31.473626 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:31.473693 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:31.473753 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:31.473785 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:31.473805 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:31.473839 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:31.473868 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:31.473888 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:31.473910 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:31.473929 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:31.473950 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:31.473976 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:31.474000 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:31.474026 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:31.474050 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:31.474075 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:31.474099 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:31.474121 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:31.474145 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:31.474168 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:31.474188 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:31.474214 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:31.474237 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:31.474259 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:31.474284 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:31.474305 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:31.474330 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:31.474356 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:31.474380 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:31.474405 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:31.474429 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:31.474454 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:31.474480 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:31.474505 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:31.474529 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:31.474554 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:31.474578 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:31.555291 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:31.555844 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:31.565767 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:31.566208 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:31.635942 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:31.636031 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:31.925945 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:31.925969 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off 2014-05-19 10:47:31.925974 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:31.925978 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:31.926015 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:31.926969 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:31.927085 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:31.964669 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:31.964859 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:31.992566 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:31.993004 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:32.137765 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:32.137845 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:32.183248 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:32.183830 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:32.511378 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:32.511496 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:32.529223 7f5565600700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:32.656701 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:32.656861 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:32.712563 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:32.712637 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:32.770931 7f55579aa700 20 OSD::op_tp worker waiting 2014-05-19 10:47:32.770960 7f555a1af700 20 OSD::op_tp worker waiting 2014-05-19 10:47:32.771040 7f55551a5700 20 OSD::op_tp worker waiting 2014-05-19 10:47:32.772570 7f55569a8700 20 OSD::op_tp worker waiting 2014-05-19 10:47:32.772591 7f555b1b1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:32.772611 7f55541a3700 20 OSD::op_tp worker waiting 2014-05-19 10:47:32.772627 7f55589ac700 20 OSD::op_tp worker waiting 2014-05-19 10:47:32.772643 7f55549a4700 20 OSD::op_tp worker waiting 2014-05-19 10:47:32.772658 7f555a9b0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:32.773055 7f55581ab700 20 OSD::op_tp worker waiting 2014-05-19 10:47:32.773088 7f55599ae700 20 OSD::op_tp worker waiting 2014-05-19 10:47:32.773100 7f55571a9700 20 OSD::op_tp worker waiting 2014-05-19 10:47:32.773198 7f55531a1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:32.773248 7f55591ad700 20 OSD::op_tp worker waiting 2014-05-19 10:47:32.773259 7f555199e700 20 OSD::op_tp worker waiting 2014-05-19 10:47:32.773269 7f55529a0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:32.773284 7f55539a2700 20 OSD::op_tp worker waiting 2014-05-19 10:47:32.773302 7f55561a7700 20 OSD::op_tp worker waiting 2014-05-19 10:47:32.773341 7f555219f700 20 OSD::op_tp worker waiting 2014-05-19 10:47:32.773375 7f55559a6700 20 OSD::op_tp worker waiting 2014-05-19 10:47:32.785292 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:32.785547 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:32.827480 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:32.827619 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:32.926054 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:32.926075 7f5566602700 7 osd.0 245 do_mon_report 2014-05-19 10:47:32.926079 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 2014-05-19 10:47:32.926083 7f5566602700 20 osd.0 245 send_pg_stats 2014-05-19 10:47:32.926121 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.09 >= max 0.5 = no, load too high 2014-05-19 10:47:32.926134 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 2014-05-19 10:47:32.926131 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:32.926137 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2273.46 < min (86400 seconds) 2014-05-19 10:47:32.926189 7f5566602700 20 osd.0 245 sched_scrub done 2014-05-19 10:47:32.926192 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:32.926194 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:33.081227 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:33.081375 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:33.091009 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:33.091157 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:33.112546 7f5564dff700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:33.328833 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:33.328933 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:33.411757 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:33.411965 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:33.430192 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:33.430328 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:33.451576 7f555019b700 20 OSD::command_tp worker waiting 2014-05-19 10:47:33.454831 7f555099c700 20 OSD::disk_tp worker waiting 2014-05-19 10:47:33.625791 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:33.625900 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:33.867365 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:33.867682 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:33.926268 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:33.926293 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off 2014-05-19 10:47:33.926298 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:33.926300 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:33.926337 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:34.266080 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:34.266144 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:34.414015 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:34.414094 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:34.529322 7f5565600700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:34.531355 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:34.531872 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:34.727284 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:34.727435 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:34.761590 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:34.761711 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:34.771032 7f55579aa700 20 OSD::op_tp worker waiting 2014-05-19 10:47:34.771057 7f555a1af700 20 OSD::op_tp worker waiting 2014-05-19 10:47:34.771106 7f55551a5700 20 OSD::op_tp worker waiting 2014-05-19 10:47:34.772671 7f555b1b1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:34.772697 7f55569a8700 20 OSD::op_tp worker waiting 2014-05-19 10:47:34.772721 7f55549a4700 20 OSD::op_tp worker waiting 2014-05-19 10:47:34.772735 7f55541a3700 20 OSD::op_tp worker waiting 2014-05-19 10:47:34.772756 7f555a9b0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:34.772791 7f55589ac700 20 OSD::op_tp worker waiting 2014-05-19 10:47:34.773124 7f55581ab700 20 OSD::op_tp worker waiting 2014-05-19 10:47:34.773154 7f55599ae700 20 OSD::op_tp worker waiting 2014-05-19 10:47:34.773177 7f55571a9700 20 OSD::op_tp worker waiting 2014-05-19 10:47:34.773272 7f55531a1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:34.773308 7f55591ad700 20 OSD::op_tp worker waiting 2014-05-19 10:47:34.773327 7f555199e700 20 OSD::op_tp worker waiting 2014-05-19 10:47:34.773347 7f55529a0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:34.773359 7f55561a7700 20 OSD::op_tp worker waiting 2014-05-19 10:47:34.773373 7f55539a2700 20 OSD::op_tp worker waiting 2014-05-19 10:47:34.773411 7f555219f700 20 OSD::op_tp worker waiting 2014-05-19 10:47:34.773439 7f55559a6700 20 OSD::op_tp worker waiting 2014-05-19 10:47:34.899491 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:34.899722 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:34.926376 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:34.926430 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.09 >= max 0.5 = no, load too high 2014-05-19 10:47:34.926444 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 2014-05-19 10:47:34.926446 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:34.926447 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2275.46 < min (86400 seconds) 2014-05-19 10:47:34.926466 7f5566602700 20 osd.0 245 sched_scrub done 2014-05-19 10:47:34.926469 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:34.926471 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:34.958132 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:34.958241 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:35.030319 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:35.030565 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:35.084495 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:35.084548 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:35.112643 7f5564dff700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:35.371759 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:35.372155 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:35.451673 7f555019b700 20 OSD::command_tp worker waiting 2014-05-19 10:47:35.454913 7f555099c700 20 OSD::disk_tp worker waiting 2014-05-19 10:47:35.493851 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:35.494026 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:35.573454 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) 2014-05-19 10:47:35.573475 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) 2014-05-19 10:47:35.574730 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:35.574794 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:35.574857 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:35.574883 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:35.574944 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:35.574989 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:35.575027 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:35.575047 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:35.575093 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:35.575142 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:35.575166 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:35.575200 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:35.575242 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:35.575268 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:35.575293 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:35.575316 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:35.575344 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:35.575369 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:35.575393 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:35.575415 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:35.575437 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:35.575459 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:35.575486 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:35.575507 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:35.575532 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:35.575556 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:35.575577 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:35.575605 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:35.575629 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:35.575651 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:35.575674 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:35.575695 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:35.575725 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:35.575749 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:35.575772 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:35.575794 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:35.575815 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:35.575834 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:35.575860 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:35.575881 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:35.575906 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:35.575939 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:35.638456 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:35.638714 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:35.926561 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:35.926585 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off 2014-05-19 10:47:35.926590 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:35.926592 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:35.926631 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:36.012638 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:36.012860 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:36.168738 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:36.169226 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:36.463213 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:36.463475 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:36.481314 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:36.481478 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:36.529420 7f5565600700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:36.582555 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:36.582706 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:36.628098 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:36.628231 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:36.674841 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) 2014-05-19 10:47:36.674862 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) 2014-05-19 10:47:36.676129 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:36.676211 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:36.676257 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:36.676302 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:36.676336 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:36.676378 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:36.676431 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:36.676486 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:36.676526 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:36.676547 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:36.676581 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:36.676624 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:36.676661 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:36.676686 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:36.676712 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:36.676734 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:36.676756 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:36.676781 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:36.676802 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:36.676824 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:36.676845 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:36.676866 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:36.676897 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:36.676919 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:36.676940 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:36.676962 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:36.676982 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:36.677003 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:36.677028 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:36.677050 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:36.677076 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:36.677097 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:36.677158 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:36.677181 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:36.677203 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:36.677231 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:36.677253 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:36.677275 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:36.677301 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:36.677322 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:36.677344 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:36.677370 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:36.771135 7f55579aa700 20 OSD::op_tp worker waiting 2014-05-19 10:47:36.771163 7f555a1af700 20 OSD::op_tp worker waiting 2014-05-19 10:47:36.771186 7f55551a5700 20 OSD::op_tp worker waiting 2014-05-19 10:47:36.772774 7f555b1b1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:36.772796 7f55569a8700 20 OSD::op_tp worker waiting 2014-05-19 10:47:36.772814 7f55549a4700 20 OSD::op_tp worker waiting 2014-05-19 10:47:36.772832 7f55541a3700 20 OSD::op_tp worker waiting 2014-05-19 10:47:36.772847 7f555a9b0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:36.772860 7f55589ac700 20 OSD::op_tp worker waiting 2014-05-19 10:47:36.773189 7f55581ab700 20 OSD::op_tp worker waiting 2014-05-19 10:47:36.773217 7f55599ae700 20 OSD::op_tp worker waiting 2014-05-19 10:47:36.773241 7f55571a9700 20 OSD::op_tp worker waiting 2014-05-19 10:47:36.773340 7f55531a1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:36.773374 7f55591ad700 20 OSD::op_tp worker waiting 2014-05-19 10:47:36.773398 7f555199e700 20 OSD::op_tp worker waiting 2014-05-19 10:47:36.773409 7f55529a0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:36.773424 7f55561a7700 20 OSD::op_tp worker waiting 2014-05-19 10:47:36.773439 7f55539a2700 20 OSD::op_tp worker waiting 2014-05-19 10:47:36.773470 7f555219f700 20 OSD::op_tp worker waiting 2014-05-19 10:47:36.773503 7f55559a6700 20 OSD::op_tp worker waiting 2014-05-19 10:47:36.832854 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:36.833099 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:36.886870 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:36.886980 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:36.912857 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:36.912983 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:36.926681 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:36.926706 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off 2014-05-19 10:47:36.926711 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:36.926714 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:36.926751 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:37.084141 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:37.084344 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:37.112741 7f5564dff700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:37.223358 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:37.223445 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:37.259443 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:37.259529 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:37.339700 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:37.340254 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:37.451769 7f555019b700 20 OSD::command_tp worker waiting 2014-05-19 10:47:37.454998 7f555099c700 20 OSD::disk_tp worker waiting 2014-05-19 10:47:37.724596 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:37.724714 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:37.926782 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:37.926802 7f5566602700 7 osd.0 245 do_mon_report 2014-05-19 10:47:37.926806 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 2014-05-19 10:47:37.926810 7f5566602700 20 osd.0 245 send_pg_stats 2014-05-19 10:47:37.926819 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off 2014-05-19 10:47:37.926823 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:37.926824 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:37.926857 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:38.182638 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:38.182709 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:38.329602 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:38.330152 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:38.376240 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) 2014-05-19 10:47:38.376261 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) 2014-05-19 10:47:38.377457 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:38.377502 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:38.377554 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:38.377575 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:38.377599 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:38.377650 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:38.377710 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:38.377733 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:38.377765 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:38.377810 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:38.377838 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:38.377861 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:38.377896 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:38.377918 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:38.377939 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:38.377961 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:38.377983 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:38.378004 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:38.378027 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:38.378048 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:38.378075 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:38.378096 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:38.378119 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:38.378140 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:38.378162 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:38.378183 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:38.378205 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:38.378226 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:38.378251 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:38.378273 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:38.378295 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:38.378316 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:38.378337 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:38.378358 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:38.378384 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:38.378409 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:38.378435 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:38.378456 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:38.378475 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:38.378501 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:38.378523 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:38.378545 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:38.392113 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:38.392247 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:38.515549 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:38.515649 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:38.529502 7f5565600700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:38.531521 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:38.531756 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:38.771237 7f55579aa700 20 OSD::op_tp worker waiting 2014-05-19 10:47:38.771265 7f55551a5700 20 OSD::op_tp worker waiting 2014-05-19 10:47:38.771286 7f555a1af700 20 OSD::op_tp worker waiting 2014-05-19 10:47:38.772852 7f555b1b1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:38.772870 7f55569a8700 20 OSD::op_tp worker waiting 2014-05-19 10:47:38.772890 7f55549a4700 20 OSD::op_tp worker waiting 2014-05-19 10:47:38.772912 7f55541a3700 20 OSD::op_tp worker waiting 2014-05-19 10:47:38.772925 7f555a9b0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:38.772946 7f55589ac700 20 OSD::op_tp worker waiting 2014-05-19 10:47:38.773253 7f55581ab700 20 OSD::op_tp worker waiting 2014-05-19 10:47:38.773282 7f55599ae700 20 OSD::op_tp worker waiting 2014-05-19 10:47:38.773307 7f55571a9700 20 OSD::op_tp worker waiting 2014-05-19 10:47:38.773407 7f55531a1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:38.773439 7f55591ad700 20 OSD::op_tp worker waiting 2014-05-19 10:47:38.773463 7f555199e700 20 OSD::op_tp worker waiting 2014-05-19 10:47:38.773468 7f55529a0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:38.773485 7f55561a7700 20 OSD::op_tp worker waiting 2014-05-19 10:47:38.773508 7f55539a2700 20 OSD::op_tp worker waiting 2014-05-19 10:47:38.773531 7f555219f700 20 OSD::op_tp worker waiting 2014-05-19 10:47:38.773563 7f55559a6700 20 OSD::op_tp worker waiting 2014-05-19 10:47:38.826166 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:38.826707 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:38.828521 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:38.828958 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:38.926886 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:38.926909 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off 2014-05-19 10:47:38.926915 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:38.926918 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:38.926946 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:38.995330 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:38.995709 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:39.112837 7f5564dff700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:39.133909 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:39.134262 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:39.327478 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:39.328064 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:39.330460 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:39.330563 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:39.451870 7f555019b700 20 OSD::command_tp worker waiting 2014-05-19 10:47:39.455080 7f555099c700 20 OSD::disk_tp worker waiting 2014-05-19 10:47:39.600578 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:39.600998 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:39.617217 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:39.617298 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:39.788247 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:39.788586 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:39.926996 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:39.927051 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.01 >= max 0.5 = no, load too high 2014-05-19 10:47:39.927064 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 2014-05-19 10:47:39.927065 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:39.927067 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2280.46 < min (86400 seconds) 2014-05-19 10:47:39.927086 7f5566602700 20 osd.0 245 sched_scrub done 2014-05-19 10:47:39.927089 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:39.927090 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:39.985616 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:39.986069 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:40.031125 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:40.031318 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:40.093384 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:40.093812 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:40.113870 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:40.113990 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:40.167451 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:40.167508 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:40.240944 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:40.241220 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:40.385900 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:40.386410 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:40.529590 7f5565600700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:40.673526 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:40.673645 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:40.771339 7f55579aa700 20 OSD::op_tp worker waiting 2014-05-19 10:47:40.771366 7f555a1af700 20 OSD::op_tp worker waiting 2014-05-19 10:47:40.771394 7f55551a5700 20 OSD::op_tp worker waiting 2014-05-19 10:47:40.772950 7f55569a8700 20 OSD::op_tp worker waiting 2014-05-19 10:47:40.772975 7f555b1b1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:40.772988 7f55549a4700 20 OSD::op_tp worker waiting 2014-05-19 10:47:40.773010 7f55541a3700 20 OSD::op_tp worker waiting 2014-05-19 10:47:40.773024 7f55589ac700 20 OSD::op_tp worker waiting 2014-05-19 10:47:40.773060 7f555a9b0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:40.773316 7f55581ab700 20 OSD::op_tp worker waiting 2014-05-19 10:47:40.773346 7f55599ae700 20 OSD::op_tp worker waiting 2014-05-19 10:47:40.773379 7f55571a9700 20 OSD::op_tp worker waiting 2014-05-19 10:47:40.773475 7f55531a1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:40.773500 7f55591ad700 20 OSD::op_tp worker waiting 2014-05-19 10:47:40.773523 7f555199e700 20 OSD::op_tp worker waiting 2014-05-19 10:47:40.773528 7f55529a0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:40.773545 7f55561a7700 20 OSD::op_tp worker waiting 2014-05-19 10:47:40.773571 7f55539a2700 20 OSD::op_tp worker waiting 2014-05-19 10:47:40.773590 7f555219f700 20 OSD::op_tp worker waiting 2014-05-19 10:47:40.773626 7f55559a6700 20 OSD::op_tp worker waiting 2014-05-19 10:47:40.927162 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:40.927189 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off 2014-05-19 10:47:40.927194 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:40.927196 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:40.927231 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:41.112925 7f5564dff700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:41.301738 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:41.301931 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:41.318899 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:41.318982 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:41.451972 7f555019b700 20 OSD::command_tp worker waiting 2014-05-19 10:47:41.455162 7f555099c700 20 OSD::disk_tp worker waiting 2014-05-19 10:47:41.683931 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:41.684319 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:41.815032 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:41.815195 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:41.927271 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:41.927297 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off 2014-05-19 10:47:41.927302 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:41.927304 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:41.927340 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:42.033322 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:42.033466 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:42.070189 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:42.070443 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:42.087189 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:42.087461 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:42.213992 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:42.214363 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:42.364435 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:42.364506 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:42.529689 7f5565600700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:42.771443 7f55579aa700 20 OSD::op_tp worker waiting 2014-05-19 10:47:42.771481 7f55551a5700 20 OSD::op_tp worker waiting 2014-05-19 10:47:42.771503 7f555a1af700 20 OSD::op_tp worker waiting 2014-05-19 10:47:42.773051 7f55569a8700 20 OSD::op_tp worker waiting 2014-05-19 10:47:42.773075 7f555b1b1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:42.773098 7f55541a3700 20 OSD::op_tp worker waiting 2014-05-19 10:47:42.773132 7f555a9b0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:42.773153 7f55589ac700 20 OSD::op_tp worker waiting 2014-05-19 10:47:42.773176 7f55549a4700 20 OSD::op_tp worker waiting 2014-05-19 10:47:42.773378 7f55581ab700 20 OSD::op_tp worker waiting 2014-05-19 10:47:42.773407 7f55599ae700 20 OSD::op_tp worker waiting 2014-05-19 10:47:42.773445 7f55571a9700 20 OSD::op_tp worker waiting 2014-05-19 10:47:42.773557 7f55531a1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:42.773579 7f55591ad700 20 OSD::op_tp worker waiting 2014-05-19 10:47:42.773599 7f55529a0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:42.773608 7f55561a7700 20 OSD::op_tp worker waiting 2014-05-19 10:47:42.773626 7f555199e700 20 OSD::op_tp worker waiting 2014-05-19 10:47:42.773641 7f55539a2700 20 OSD::op_tp worker waiting 2014-05-19 10:47:42.773651 7f555219f700 20 OSD::op_tp worker waiting 2014-05-19 10:47:42.773731 7f55559a6700 20 OSD::op_tp worker waiting 2014-05-19 10:47:42.831522 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:42.831673 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:42.927368 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:42.927389 7f5566602700 7 osd.0 245 do_mon_report 2014-05-19 10:47:42.927393 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 2014-05-19 10:47:42.927399 7f5566602700 20 osd.0 245 send_pg_stats 2014-05-19 10:47:42.927410 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off 2014-05-19 10:47:42.927415 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:42.927419 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:42.927448 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:42.974454 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:42.974929 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:43.096510 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:43.096676 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:43.113020 7f5564dff700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:43.142123 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:43.142481 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:43.160819 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:43.160926 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:43.333541 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:43.333607 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:43.452068 7f555019b700 20 OSD::command_tp worker waiting 2014-05-19 10:47:43.455254 7f555099c700 20 OSD::disk_tp worker waiting 2014-05-19 10:47:43.668779 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:43.668903 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:43.927495 7f5566602700 5 osd.0 245 tick 2014-05-19 10:47:43.927520 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off 2014-05-19 10:47:43.927525 7f5566602700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:43.927527 7f5566602700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:43.927547 7f555119d700 20 OSD::recovery_tp worker waiting 2014-05-19 10:47:44.132559 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:44.132652 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:44.170505 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:44.170615 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:44.194644 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:44.194800 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:44.277558 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) 2014-05-19 10:47:44.277579 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) 2014-05-19 10:47:44.278780 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:44.278828 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 2014-05-19 10:47:44.278880 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:44.278909 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 2014-05-19 10:47:44.278934 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:44.278959 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 2014-05-19 10:47:44.278978 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:44.279000 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:44.279023 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:44.279081 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:44.279115 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:44.279134 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 2014-05-19 10:47:44.279153 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:44.279176 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 2014-05-19 10:47:44.279205 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:44.279228 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 2014-05-19 10:47:44.279253 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:44.279272 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 2014-05-19 10:47:44.279295 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:44.279317 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 2014-05-19 10:47:44.279339 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:44.279360 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 2014-05-19 10:47:44.279381 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:44.279403 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 2014-05-19 10:47:44.279429 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:44.279450 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 2014-05-19 10:47:44.279475 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:44.279496 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 2014-05-19 10:47:44.279517 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:44.279544 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:44.279566 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:44.279590 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:44.279611 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:44.279633 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:44.279659 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:44.279681 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 2014-05-19 10:47:44.279702 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:44.279723 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 2014-05-19 10:47:44.279745 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:44.279766 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 2014-05-19 10:47:44.279790 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:44.279812 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 2014-05-19 10:47:44.489872 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:44.489971 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 2014-05-19 10:47:44.529786 7f5565600700 20 KeyValueStore::op_tp worker waiting 2014-05-19 10:47:44.628955 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:44.629023 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 2014-05-19 10:47:44.686986 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:44.687171 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 2014-05-19 10:47:44.771545 7f55579aa700 20 OSD::op_tp worker waiting 2014-05-19 10:47:44.771579 7f55551a5700 20 OSD::op_tp worker waiting 2014-05-19 10:47:44.771600 7f555a1af700 20 OSD::op_tp worker waiting 2014-05-19 10:47:44.773151 7f55569a8700 20 OSD::op_tp worker waiting 2014-05-19 10:47:44.773187 7f55541a3700 20 OSD::op_tp worker waiting 2014-05-19 10:47:44.773203 7f555a9b0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:44.773220 7f555b1b1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:44.773237 7f55589ac700 20 OSD::op_tp worker waiting 2014-05-19 10:47:44.773252 7f55549a4700 20 OSD::op_tp worker waiting 2014-05-19 10:47:44.773443 7f55581ab700 20 OSD::op_tp worker waiting 2014-05-19 10:47:44.773484 7f55599ae700 20 OSD::op_tp worker waiting 2014-05-19 10:47:44.773512 7f55571a9700 20 OSD::op_tp worker waiting 2014-05-19 10:47:44.773627 7f55531a1700 20 OSD::op_tp worker waiting 2014-05-19 10:47:44.773670 7f55561a7700 20 OSD::op_tp worker waiting 2014-05-19 10:47:44.773686 7f55529a0700 20 OSD::op_tp worker waiting 2014-05-19 10:47:44.773701 7f55591ad700 20 OSD::op_tp worker waiting 2014-05-19 10:47:44.773712 7f55539a2700 20 OSD::op_tp worker waiting 2014-05-19 10:47:44.773759 7f555199e700 20 OSD::op_tp worker waiting 2014-05-19 10:47:44.773786 7f555219f700 20 OSD::op_tp worker waiting 2014-05-19 10:47:44.773811 7f55559a6700 20 OSD::op_tp worker waiting 2014-05-19 10:47:44.797549 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:44.798094 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 2014-05-19 10:47:44.798184 7f5549a6c700 10 osd.0 245 new session 0x9318b60 con=0x9600dc0 addr=172.16.96.110:0/1060794 2014-05-19 10:47:44.827771 7f55619be700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:44.827773 7f55619be700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:44.827774 7f55619be700 20 osd.0 245 _dispatch 0xa322000 osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 2014-05-19 10:47:44.827779 7f55619be700 5 -- op tracker -- , seq: 24052, time: 2014-05-19 10:47:44.807399, event: header_read, request: osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 2014-05-19 10:47:44.827799 7f55619be700 5 -- op tracker -- , seq: 24052, time: 2014-05-19 10:47:44.807406, event: throttled, request: osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 2014-05-19 10:47:44.827813 7f55619be700 5 -- op tracker -- , seq: 24052, time: 2014-05-19 10:47:44.827726, event: all_read, request: osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 2014-05-19 10:47:44.827822 7f55619be700 5 -- op tracker -- , seq: 24052, time: 2014-05-19 10:47:44.827769, event: dispatched, request: osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 2014-05-19 10:47:44.827830 7f55619be700 5 -- op tracker -- , seq: 24052, time: 2014-05-19 10:47:44.827830, event: waiting_for_osdmap, request: osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 2014-05-19 10:47:44.827846 7f55619be700 15 osd.0 245 require_same_or_newer_map 245 (i am 245) 0xa322000 2014-05-19 10:47:44.827849 7f55619be700 20 osd.0 245 _share_map_incoming client.4358 172.16.96.110:0/1060794 245 2014-05-19 10:47:44.827864 7f55619be700 15 osd.0 245 enqueue_op 0xa57c780 prio 63 cost 4194304 latency 0.020465 osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 2014-05-19 10:47:44.827878 7f55619be700 10 osd.0 245 do_waiters -- start 2014-05-19 10:47:44.827880 7f55619be700 10 osd.0 245 do_waiters -- finish 2014-05-19 10:47:44.827889 7f55579aa700 12 OSD::op_tp worker wq OSD::OpWQ start processing 0x1 (1 active) 2014-05-19 10:47:44.827914 7f55579aa700 10 osd.0 245 dequeue_op 0xa57c780 prio 63 cost 4194304 latency 0.020515 osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 pg pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] 2014-05-19 10:47:44.827937 7f55579aa700 5 -- op tracker -- , seq: 24052, time: 2014-05-19 10:47:44.827937, event: reached_pg, request: osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 2014-05-19 10:47:44.827957 7f55579aa700 20 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] op_has_sufficient_caps pool=3 (ceph ) owner=0 need_read_cap=0 need_write_cap=1 need_class_read_cap=0 need_class_write_cap=0 -> yes 2014-05-19 10:47:44.827974 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] handle_message: 0xa57c780 2014-05-19 10:47:44.827988 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] do_op osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 may_write -> write-ordered flags ack+ondisk+write 2014-05-19 10:47:44.828100 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] get_object_context: no obc for soid bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 but can_create 2014-05-19 10:47:44.828185 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] create_object_context 0x99f3340 bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 2014-05-19 10:47:44.828201 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] populate_obc_watchers bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 2014-05-19 10:47:44.828211 7f55579aa700 20 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] ReplicatedPG::check_blacklisted_obc_watchers for obc bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 2014-05-19 10:47:44.828222 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] get_object_context: 0x99f3340 bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 rwstate(none n=0 w=0) oi: bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3(0'0 unknown.0.0:0 wrlock_by=unknown.0.0:0 s 0 uv0) ssc: 0x93196c0 snapset: 0=[]:[] 2014-05-19 10:47:44.828239 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] find_object_context bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 @head oi=bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3(0'0 unknown.0.0:0 wrlock_by=unknown.0.0:0 s 0 uv0) 2014-05-19 10:47:44.828292 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] get_object_context: no obc for soid bf28a03f/rbd_data.10426b8b4567.0000000000000004/snapdir//3 and !can_create 2014-05-19 10:47:44.828308 7f55579aa700 5 -- op tracker -- , seq: 24052, time: 2014-05-19 10:47:44.828308, event: started, request: osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 2014-05-19 10:47:44.828323 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] execute_ctx 0x9d9d200 2014-05-19 10:47:44.828339 7f55579aa700 5 -- op tracker -- , seq: 24052, time: 2014-05-19 10:47:44.828339, event: started, request: osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 2014-05-19 10:47:44.828352 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] do_op bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] ov 0'0 av 245'1 snapc 0=[] snapset 0=[]:[] 2014-05-19 10:47:44.828368 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] do_osd_op bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 2014-05-19 10:47:44.828380 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] do_osd_op set-alloc-hint object_size 4194304 write_size 4194304 2014-05-19 10:47:44.828412 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] do_osd_op write 0~4194304 2014-05-19 10:47:44.828437 7f55579aa700 15 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] do_osd_op_effects on session 0x9318b60 2014-05-19 10:47:44.828451 7f55579aa700 20 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] make_writeable bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 snapset=0x93196f8 snapc=0=[] 2014-05-19 10:47:44.828463 7f55579aa700 20 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] setting DIRTY flag 2014-05-19 10:47:44.828472 7f55579aa700 20 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] make_writeable bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 done, snapset=0=[]:[]+head 2014-05-19 10:47:44.828482 7f55579aa700 20 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] finish_ctx bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 0x9d9d200 op modify 2014-05-19 10:47:44.828497 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] set mtime to 2014-05-19 10:46:56.539205 2014-05-19 10:47:44.828539 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] final snapset 0=[]:[]+head in bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 2014-05-19 10:47:44.828562 7f55579aa700 20 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=1 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] zeroing write result code 0 2014-05-19 10:47:44.828576 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=1 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] new_repop rep_tid 1 on osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 2014-05-19 10:47:44.828594 7f55579aa700 7 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=1 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] issue_repop rep_tid 1 o bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 2014-05-19 10:47:44.828615 7f55579aa700 5 -- op tracker -- , seq: 24052, time: 2014-05-19 10:47:44.828615, event: waiting for subops from 44, request: osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 2014-05-19 10:47:44.828646 7f55579aa700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 2014-05-19 10:47:44.828670 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=1 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] append_log log((0'0,0'0], crt=0'0) [245'1 (0'0) modify bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 by client.4358.0:104 2014-05-19 10:46:56.539205] 2014-05-19 10:47:44.828692 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( v 245'1 (0'0,245'1] local-les=222 n=1 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 luod=0'0 crt=0'0 lcod 0'0 mlcod 0'0 active+clean] add_log_entry 245'1 (0'0) modify bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 by client.4358.0:104 2014-05-19 10:46:56.539205 2014-05-19 10:47:44.828717 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( v 245'1 (0'0,245'1] local-les=222 n=1 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 luod=0'0 crt=0'0 lcod 0'0 mlcod 0'0 active+clean] append_log adding 1 keys 2014-05-19 10:47:44.828753 7f55579aa700 10 write_log with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, dirty_divergent_priors: 0, writeout_from: 245'1, trimmed: 2014-05-19 10:47:44.828821 7f5564dff700 12 KeyValueStore::op_tp worker wq KeyValueStore::OpWQ start processing 0x8b7dc20 (1 active) 2014-05-19 10:47:44.828818 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( v 245'1 (0'0,245'1] local-les=222 n=1 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 luod=0'0 crt=0'0 lcod 0'0 mlcod 0'0 active+clean] eval_repop repgather(0x76a0840 245'1 rep_tid=1 committed?=0 applied?=0 lock=0 op=osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4) wants=ad 2014-05-19 10:47:44.828839 7f55579aa700 10 osd.0 245 dequeue_op 0xa57c780 finish 2014-05-19 10:47:44.828843 7f55579aa700 15 OSD::op_tp worker wq OSD::OpWQ done processing 0x1 (0 active) 2014-05-19 10:47:44.828846 7f55579aa700 20 OSD::op_tp worker waiting 2014-05-19 10:47:44.829013 7f5564dff700 -1 bad op 2307 2014-05-19 10:47:44.830448 7f5564dff700 -1 os/KeyValueStore.cc: In function 'unsigned int KeyValueStore::_do_transaction(ObjectStore::Transaction&, KeyValueStore::BufferTransaction&, SequencerPosition&, ThreadPool::TPHandle*)' thread 7f5564dff700 time 2014-05-19 10:47:44.829023 os/KeyValueStore.cc: 1457: FAILED assert(0) ceph version 0.80.1 (a38fe1169b6d2ac98b427334c12d7cf81f809b74) 1: (KeyValueStore::_do_transaction(ObjectStore::Transaction&, KeyValueStore::BufferTransaction&, SequencerPosition&, ThreadPool::TPHandle*)+0x1d0) [0x9d8720] 2: (KeyValueStore::_do_transactions(std::list >&, unsigned long, ThreadPool::TPHandle*)+0x8e) [0x9daa0e] 3: (KeyValueStore::_do_op(KeyValueStore::OpSequencer*, ThreadPool::TPHandle&)+0x97) [0x9dab17] 4: (ThreadPool::worker(ThreadPool::WorkThread*)+0x68a) [0xb5101a] 5: (ThreadPool::WorkThread::entry()+0x10) [0xb52270] 6: (()+0x7e9a) [0x7f556d321e9a] 7: (clone()+0x6d) [0x7f556b8ccccd] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- begin dump of recent events --- -10000> 2014-05-19 10:46:03.135704 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 26 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:03.133347) v2 ==== 47+0+0 (1356889693 0 0) 0xa446700 con 0x96374a0 -9999> 2014-05-19 10:46:03.135718 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -9998> 2014-05-19 10:46:03.233742 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:05.839800) v2 ==== 47+0+0 (2240471237 0 0) 0x9c08000 con 0x9b8de40 -9997> 2014-05-19 10:46:03.233789 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:05.839800) v2 -- ?+0 0xac09500 con 0x9b8de40 -9996> 2014-05-19 10:46:03.233821 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -9995> 2014-05-19 10:46:03.234282 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:05.839800) v2 ==== 47+0+0 (2240471237 0 0) 0x9c6f340 con 0x94e2160 -9994> 2014-05-19 10:46:03.234325 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:05.839800) v2 -- ?+0 0xa36d6c0 con 0x94e2160 -9993> 2014-05-19 10:46:03.234357 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -9992> 2014-05-19 10:46:03.283510 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 36 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:07.226312) v2 ==== 47+0+0 (1413635908 0 0) 0xa093180 con 0x94e3e40 -9991> 2014-05-19 10:46:03.283559 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:07.226312) v2 -- ?+0 0x9c6f340 con 0x94e3e40 -9990> 2014-05-19 10:46:03.283633 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -9989> 2014-05-19 10:46:03.283639 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 36 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:07.226312) v2 ==== 47+0+0 (1413635908 0 0) 0xa0ca700 con 0x9bb69a0 -9988> 2014-05-19 10:46:03.283677 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:07.226312) v2 -- ?+0 0x9c08000 con 0x9bb69a0 -9987> 2014-05-19 10:46:03.283769 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -9986> 2014-05-19 10:46:03.423411 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:06.029495) v2 ==== 47+0+0 (1978531888 0 0) 0xa0eafc0 con 0x96571e0 -9985> 2014-05-19 10:46:03.423466 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:06.029495) v2 ==== 47+0+0 (1978531888 0 0) 0xa209500 con 0x9656420 -9984> 2014-05-19 10:46:03.423464 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:06.029495) v2 -- ?+0 0xa093180 con 0x96571e0 -9983> 2014-05-19 10:46:03.423596 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -9982> 2014-05-19 10:46:03.423900 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:06.029495) v2 -- ?+0 0xa0ca700 con 0x9656420 -9981> 2014-05-19 10:46:03.423937 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -9980> 2014-05-19 10:46:03.429879 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:06.035587) v2 ==== 47+0+0 (3806218086 0 0) 0xa0ba540 con 0x996e000 -9979> 2014-05-19 10:46:03.429923 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:06.035587) v2 -- ?+0 0xa209500 con 0x996e000 -9978> 2014-05-19 10:46:03.429948 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -9977> 2014-05-19 10:46:03.429964 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:06.035587) v2 ==== 47+0+0 (3806218086 0 0) 0x97c28c0 con 0x9a0c9a0 -9976> 2014-05-19 10:46:03.429994 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:06.035587) v2 -- ?+0 0xa0eafc0 con 0x9a0c9a0 -9975> 2014-05-19 10:46:03.430023 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -9974> 2014-05-19 10:46:03.447559 7f555019b700 20 OSD::command_tp worker waiting -9973> 2014-05-19 10:46:03.450547 7f555099c700 20 OSD::disk_tp worker waiting -9972> 2014-05-19 10:46:03.669399 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 29 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:07.611699) v2 ==== 47+0+0 (4277131082 0 0) 0xac09dc0 con 0x99f1080 -9971> 2014-05-19 10:46:03.669458 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:07.611699) v2 -- ?+0 0x97c28c0 con 0x99f1080 -9970> 2014-05-19 10:46:03.669480 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 29 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:07.611699) v2 ==== 47+0+0 (4277131082 0 0) 0xac14c40 con 0x987af20 -9969> 2014-05-19 10:46:03.669515 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -9968> 2014-05-19 10:46:03.669539 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:07.611699) v2 -- ?+0 0xa0ba540 con 0x987af20 -9967> 2014-05-19 10:46:03.669584 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -9966> 2014-05-19 10:46:03.913308 7f5566602700 5 osd.0 245 tick -9965> 2014-05-19 10:46:03.913332 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -9964> 2014-05-19 10:46:03.913337 7f5566602700 10 osd.0 245 do_waiters -- start -9963> 2014-05-19 10:46:03.913339 7f5566602700 10 osd.0 245 do_waiters -- finish -9962> 2014-05-19 10:46:03.913378 7f555119d700 20 OSD::recovery_tp worker waiting -9961> 2014-05-19 10:46:03.943247 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 32 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:07.886086) v2 ==== 47+0+0 (3723768103 0 0) 0xa2bcfc0 con 0x99718c0 -9960> 2014-05-19 10:46:03.943298 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:07.886086) v2 -- ?+0 0xac14c40 con 0x99718c0 -9959> 2014-05-19 10:46:03.943376 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -9958> 2014-05-19 10:46:03.943371 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 32 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:07.886086) v2 ==== 47+0+0 (3723768103 0 0) 0xa0cafc0 con 0x97431e0 -9957> 2014-05-19 10:46:03.943407 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:07.886086) v2 -- ?+0 0xac09dc0 con 0x97431e0 -9956> 2014-05-19 10:46:03.943435 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -9955> 2014-05-19 10:46:04.293321 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:06.899383) v2 ==== 47+0+0 (2591077523 0 0) 0xa243c00 con 0x9b8db80 -9954> 2014-05-19 10:46:04.293392 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:06.899383) v2 -- ?+0 0xa2bcfc0 con 0x9b8db80 -9953> 2014-05-19 10:46:04.293560 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -9952> 2014-05-19 10:46:04.293392 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:06.899383) v2 ==== 47+0+0 (2591077523 0 0) 0xa1ee000 con 0x7b90160 -9951> 2014-05-19 10:46:04.293612 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:06.899383) v2 -- ?+0 0xa0cafc0 con 0x7b90160 -9950> 2014-05-19 10:46:04.293643 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -9949> 2014-05-19 10:46:04.335128 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:06.941230) v2 ==== 47+0+0 (2355959992 0 0) 0x9c088c0 con 0x9b8de40 -9948> 2014-05-19 10:46:04.335151 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:06.941230) v2 ==== 47+0+0 (2355959992 0 0) 0x9c6e000 con 0x94e2160 -9947> 2014-05-19 10:46:04.335179 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:06.941230) v2 -- ?+0 0xa243c00 con 0x9b8de40 -9946> 2014-05-19 10:46:04.335214 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -9945> 2014-05-19 10:46:04.335239 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:06.941230) v2 -- ?+0 0xa1ee000 con 0x94e2160 -9944> 2014-05-19 10:46:04.335541 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -9943> 2014-05-19 10:46:04.525159 7f5565600700 20 KeyValueStore::op_tp worker waiting -9942> 2014-05-19 10:46:04.685719 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:07.291808) v2 ==== 47+0+0 (1317024324 0 0) 0x9c08fc0 con 0x9657080 -9941> 2014-05-19 10:46:04.685770 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:07.291808) v2 -- ?+0 0x9c6e000 con 0x9657080 -9940> 2014-05-19 10:46:04.685703 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:07.291808) v2 ==== 47+0+0 (1317024324 0 0) 0xa856fc0 con 0x96562c0 -9939> 2014-05-19 10:46:04.685850 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -9938> 2014-05-19 10:46:04.685876 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:07.291808) v2 -- ?+0 0x9c088c0 con 0x96562c0 -9937> 2014-05-19 10:46:04.685941 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -9936> 2014-05-19 10:46:04.724437 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:07.330573) v2 ==== 47+0+0 (1681877467 0 0) 0x9f6c380 con 0x95846e0 -9935> 2014-05-19 10:46:04.724488 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:07.330573) v2 -- ?+0 0xa856fc0 con 0x95846e0 -9934> 2014-05-19 10:46:04.724513 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -9933> 2014-05-19 10:46:04.724470 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:07.330573) v2 ==== 47+0+0 (1681877467 0 0) 0xa0b76c0 con 0x9983600 -9932> 2014-05-19 10:46:04.724542 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:07.330573) v2 -- ?+0 0x9c08fc0 con 0x9983600 -9931> 2014-05-19 10:46:04.724645 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -9930> 2014-05-19 10:46:04.766707 7f55579aa700 20 OSD::op_tp worker waiting -9929> 2014-05-19 10:46:04.766738 7f55551a5700 20 OSD::op_tp worker waiting -9928> 2014-05-19 10:46:04.766761 7f555a1af700 20 OSD::op_tp worker waiting -9927> 2014-05-19 10:46:04.768273 7f555a9b0700 20 OSD::op_tp worker waiting -9926> 2014-05-19 10:46:04.768296 7f55569a8700 20 OSD::op_tp worker waiting -9925> 2014-05-19 10:46:04.768329 7f55589ac700 20 OSD::op_tp worker waiting -9924> 2014-05-19 10:46:04.768342 7f55549a4700 20 OSD::op_tp worker waiting -9923> 2014-05-19 10:46:04.768356 7f555b1b1700 20 OSD::op_tp worker waiting -9922> 2014-05-19 10:46:04.768384 7f55541a3700 20 OSD::op_tp worker waiting -9921> 2014-05-19 10:46:04.769569 7f55571a9700 20 OSD::op_tp worker waiting -9920> 2014-05-19 10:46:04.769592 7f55559a6700 20 OSD::op_tp worker waiting -9919> 2014-05-19 10:46:04.769611 7f55599ae700 20 OSD::op_tp worker waiting -9918> 2014-05-19 10:46:04.769633 7f55581ab700 20 OSD::op_tp worker waiting -9917> 2014-05-19 10:46:04.769648 7f55561a7700 20 OSD::op_tp worker waiting -9916> 2014-05-19 10:46:04.769677 7f55529a0700 20 OSD::op_tp worker waiting -9915> 2014-05-19 10:46:04.769686 7f55531a1700 20 OSD::op_tp worker waiting -9914> 2014-05-19 10:46:04.769697 7f555219f700 20 OSD::op_tp worker waiting -9913> 2014-05-19 10:46:04.769707 7f55591ad700 20 OSD::op_tp worker waiting -9912> 2014-05-19 10:46:04.769716 7f55539a2700 20 OSD::op_tp worker waiting -9911> 2014-05-19 10:46:04.769743 7f555199e700 20 OSD::op_tp worker waiting -9910> 2014-05-19 10:46:04.803505 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 26 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:08.746356) v2 ==== 47+0+0 (1571511100 0 0) 0xa36cc40 con 0x94802c0 -9909> 2014-05-19 10:46:04.803588 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:08.746356) v2 -- ?+0 0xa0b76c0 con 0x94802c0 -9908> 2014-05-19 10:46:04.803691 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -9907> 2014-05-19 10:46:04.803533 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 26 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:08.746356) v2 ==== 47+0+0 (1571511100 0 0) 0xac09340 con 0x987b760 -9906> 2014-05-19 10:46:04.803737 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:08.746356) v2 -- ?+0 0x9f6c380 con 0x987b760 -9905> 2014-05-19 10:46:04.803827 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -9904> 2014-05-19 10:46:04.913407 7f5566602700 5 osd.0 245 tick -9903> 2014-05-19 10:46:04.913433 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -9902> 2014-05-19 10:46:04.913438 7f5566602700 10 osd.0 245 do_waiters -- start -9901> 2014-05-19 10:46:04.913441 7f5566602700 10 osd.0 245 do_waiters -- finish -9900> 2014-05-19 10:46:04.913439 7f555119d700 20 OSD::recovery_tp worker waiting -9899> 2014-05-19 10:46:04.968839 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:04.968659) v2 ==== 47+0+0 (711519557 0 0) 0xa2bc000 con 0x9657340 -9898> 2014-05-19 10:46:04.968893 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:04.968659) v2 -- ?+0 0xa36cc40 con 0x9657340 -9897> 2014-05-19 10:46:04.968932 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -9896> 2014-05-19 10:46:04.968971 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:04.968659) v2 ==== 47+0+0 (711519557 0 0) 0xa1ef880 con 0x9656580 -9895> 2014-05-19 10:46:04.969004 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:04.968659) v2 -- ?+0 0xac09340 con 0x9656580 -9894> 2014-05-19 10:46:04.969094 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -9893> 2014-05-19 10:46:05.044571 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 33 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:08.987439) v2 ==== 47+0+0 (1721404842 0 0) 0xa2bc700 con 0x99718c0 -9892> 2014-05-19 10:46:05.044579 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 33 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:08.987439) v2 ==== 47+0+0 (1721404842 0 0) 0xa0cb340 con 0x97431e0 -9891> 2014-05-19 10:46:05.044619 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:08.987439) v2 -- ?+0 0xa1ef880 con 0x99718c0 -9890> 2014-05-19 10:46:05.044706 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -9889> 2014-05-19 10:46:05.044884 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:08.987439) v2 -- ?+0 0xa2bc000 con 0x97431e0 -9888> 2014-05-19 10:46:05.044921 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -9887> 2014-05-19 10:46:05.099673 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 33 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:09.042537) v2 ==== 47+0+0 (1380700349 0 0) 0xa242c40 con 0x94e26e0 -9886> 2014-05-19 10:46:05.099723 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.042537) v2 -- ?+0 0xa0cb340 con 0x94e26e0 -9885> 2014-05-19 10:46:05.099797 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -9884> 2014-05-19 10:46:05.099865 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 33 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:09.042537) v2 ==== 47+0+0 (1380700349 0 0) 0xa05ea80 con 0x987b340 -9883> 2014-05-19 10:46:05.099901 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.042537) v2 -- ?+0 0xa2bc700 con 0x987b340 -9882> 2014-05-19 10:46:05.099929 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -9881> 2014-05-19 10:46:05.108597 7f5564dff700 20 KeyValueStore::op_tp worker waiting -9880> 2014-05-19 10:46:05.447634 7f555019b700 20 OSD::command_tp worker waiting -9879> 2014-05-19 10:46:05.450646 7f555099c700 20 OSD::disk_tp worker waiting -9878> 2014-05-19 10:46:05.561833 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 34 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:09.504720) v2 ==== 47+0+0 (1253221827 0 0) 0x9cd0fc0 con 0x94a5a20 -9877> 2014-05-19 10:46:05.561832 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 34 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:09.504720) v2 ==== 47+0+0 (1253221827 0 0) 0x9c08c40 con 0x99d3340 -9876> 2014-05-19 10:46:05.561881 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.504720) v2 -- ?+0 0xa242c40 con 0x94a5a20 -9875> 2014-05-19 10:46:05.561959 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -9874> 2014-05-19 10:46:05.562042 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.504720) v2 -- ?+0 0xa05ea80 con 0x99d3340 -9873> 2014-05-19 10:46:05.562118 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -9872> 2014-05-19 10:46:05.904703 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 27 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:09.847636) v2 ==== 47+0+0 (1265098653 0 0) 0xac09180 con 0x987b760 -9871> 2014-05-19 10:46:05.904761 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 27 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:09.847636) v2 ==== 47+0+0 (1265098653 0 0) 0xa36d500 con 0x94802c0 -9870> 2014-05-19 10:46:05.904783 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.847636) v2 -- ?+0 0x9c08c40 con 0x987b760 -9869> 2014-05-19 10:46:05.905282 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -9868> 2014-05-19 10:46:05.905350 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.847636) v2 -- ?+0 0x9cd0fc0 con 0x94802c0 -9867> 2014-05-19 10:46:05.905392 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -9866> 2014-05-19 10:46:05.913531 7f5566602700 5 osd.0 245 tick -9865> 2014-05-19 10:46:05.913556 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -9864> 2014-05-19 10:46:05.913562 7f5566602700 10 osd.0 245 do_waiters -- start -9863> 2014-05-19 10:46:05.913564 7f5566602700 10 osd.0 245 do_waiters -- finish -9862> 2014-05-19 10:46:05.913601 7f555119d700 20 OSD::recovery_tp worker waiting -9861> 2014-05-19 10:46:06.070164 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:06.069976) v2 ==== 47+0+0 (357966180 0 0) 0xa1ef500 con 0x9656580 -9860> 2014-05-19 10:46:06.070174 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:06.069976) v2 ==== 47+0+0 (357966180 0 0) 0xa2bd180 con 0x9657340 -9859> 2014-05-19 10:46:06.070213 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:06.069976) v2 -- ?+0 0xac09180 con 0x9656580 -9858> 2014-05-19 10:46:06.070251 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -9857> 2014-05-19 10:46:06.070277 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:06.069976) v2 -- ?+0 0xa36d500 con 0x9657340 -9856> 2014-05-19 10:46:06.070379 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -9855> 2014-05-19 10:46:06.330910 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:08.937093) v2 ==== 47+0+0 (3330385906 0 0) 0xa865880 con 0x996e000 -9854> 2014-05-19 10:46:06.330951 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:08.937093) v2 -- ?+0 0xa1ef500 con 0x996e000 -9853> 2014-05-19 10:46:06.331013 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -9852> 2014-05-19 10:46:06.331194 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:08.937093) v2 ==== 47+0+0 (3330385906 0 0) 0xa665180 con 0x9a0c9a0 -9851> 2014-05-19 10:46:06.331236 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:08.937093) v2 -- ?+0 0xa2bd180 con 0x9a0c9a0 -9850> 2014-05-19 10:46:06.331263 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -9849> 2014-05-19 10:46:06.351863 7f555c1b3700 10 monclient: tick -9848> 2014-05-19 10:46:06.351877 7f555c1b3700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2014-05-19 10:45:36.351876) -9847> 2014-05-19 10:46:06.351899 7f555c1b3700 10 monclient: renew subs? (now: 2014-05-19 10:46:06.351898; renew after: 2014-05-19 10:47:03.081841) -- no -9846> 2014-05-19 10:46:06.525259 7f5565600700 20 KeyValueStore::op_tp worker waiting -9845> 2014-05-19 10:46:06.593128 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 34 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:10.536065) v2 ==== 47+0+0 (1513759045 0 0) 0xa856700 con 0x9743600 -9844> 2014-05-19 10:46:06.593139 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 34 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:10.536065) v2 ==== 47+0+0 (1513759045 0 0) 0x9bcea80 con 0x966e000 -9843> 2014-05-19 10:46:06.593178 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:10.536065) v2 -- ?+0 0xa665180 con 0x9743600 -9842> 2014-05-19 10:46:06.593295 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -9841> 2014-05-19 10:46:06.593370 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:10.536065) v2 -- ?+0 0xa865880 con 0x966e000 -9840> 2014-05-19 10:46:06.593408 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -9839> 2014-05-19 10:46:06.766804 7f55579aa700 20 OSD::op_tp worker waiting -9838> 2014-05-19 10:46:06.766832 7f55551a5700 20 OSD::op_tp worker waiting -9837> 2014-05-19 10:46:06.766856 7f555a1af700 20 OSD::op_tp worker waiting -9836> 2014-05-19 10:46:06.768353 7f555a9b0700 20 OSD::op_tp worker waiting -9835> 2014-05-19 10:46:06.768377 7f55569a8700 20 OSD::op_tp worker waiting -9834> 2014-05-19 10:46:06.768423 7f55549a4700 20 OSD::op_tp worker waiting -9833> 2014-05-19 10:46:06.768449 7f55541a3700 20 OSD::op_tp worker waiting -9832> 2014-05-19 10:46:06.768480 7f55589ac700 20 OSD::op_tp worker waiting -9831> 2014-05-19 10:46:06.768532 7f555b1b1700 20 OSD::op_tp worker waiting -9830> 2014-05-19 10:46:06.769644 7f55571a9700 20 OSD::op_tp worker waiting -9829> 2014-05-19 10:46:06.769666 7f55559a6700 20 OSD::op_tp worker waiting -9828> 2014-05-19 10:46:06.769687 7f55581ab700 20 OSD::op_tp worker waiting -9827> 2014-05-19 10:46:06.769703 7f55599ae700 20 OSD::op_tp worker waiting -9826> 2014-05-19 10:46:06.769722 7f55561a7700 20 OSD::op_tp worker waiting -9825> 2014-05-19 10:46:06.769742 7f55529a0700 20 OSD::op_tp worker waiting -9824> 2014-05-19 10:46:06.769759 7f55531a1700 20 OSD::op_tp worker waiting -9823> 2014-05-19 10:46:06.769775 7f55591ad700 20 OSD::op_tp worker waiting -9822> 2014-05-19 10:46:06.769791 7f555219f700 20 OSD::op_tp worker waiting -9821> 2014-05-19 10:46:06.769806 7f55539a2700 20 OSD::op_tp worker waiting -9820> 2014-05-19 10:46:06.769842 7f555199e700 20 OSD::op_tp worker waiting -9819> 2014-05-19 10:46:06.913650 7f5566602700 5 osd.0 245 tick -9818> 2014-05-19 10:46:06.913676 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -9817> 2014-05-19 10:46:06.913681 7f5566602700 10 osd.0 245 do_waiters -- start -9816> 2014-05-19 10:46:06.913683 7f5566602700 10 osd.0 245 do_waiters -- finish -9815> 2014-05-19 10:46:06.913720 7f555119d700 20 OSD::recovery_tp worker waiting -9814> 2014-05-19 10:46:06.994861 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:09.600999) v2 ==== 47+0+0 (419484998 0 0) 0xa7d4a80 con 0x996fb80 -9813> 2014-05-19 10:46:06.994867 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:09.600999) v2 ==== 47+0+0 (419484998 0 0) 0x9f21c00 con 0x9a0cdc0 -9812> 2014-05-19 10:46:06.994912 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.600999) v2 -- ?+0 0x9bcea80 con 0x996fb80 -9811> 2014-05-19 10:46:06.995043 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -9810> 2014-05-19 10:46:06.995069 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.600999) v2 -- ?+0 0xa856700 con 0x9a0cdc0 -9809> 2014-05-19 10:46:06.995158 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -9808> 2014-05-19 10:46:07.108694 7f5564dff700 20 KeyValueStore::op_tp worker waiting -9807> 2014-05-19 10:46:07.447709 7f555019b700 20 OSD::command_tp worker waiting -9806> 2014-05-19 10:46:07.450729 7f555099c700 20 OSD::disk_tp worker waiting -9805> 2014-05-19 10:46:07.625843 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:10.232082) v2 ==== 47+0+0 (1728771645 0 0) 0x9e116c0 con 0x95846e0 -9804> 2014-05-19 10:46:07.625918 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:10.232082) v2 -- ?+0 0xa7d4a80 con 0x95846e0 -9803> 2014-05-19 10:46:07.625944 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -9802> 2014-05-19 10:46:07.625976 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:10.232082) v2 ==== 47+0+0 (1728771645 0 0) 0xa0b6fc0 con 0x9983600 -9801> 2014-05-19 10:46:07.626004 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:10.232082) v2 -- ?+0 0x9f21c00 con 0x9983600 -9800> 2014-05-19 10:46:07.626080 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -9799> 2014-05-19 10:46:07.716866 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:10.322982) v2 ==== 47+0+0 (2461759855 0 0) 0x9e11dc0 con 0x9aa3600 -9798> 2014-05-19 10:46:07.716897 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:10.322982) v2 ==== 47+0+0 (2461759855 0 0) 0xa209340 con 0x9b8c160 -9797> 2014-05-19 10:46:07.716932 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:10.322982) v2 -- ?+0 0xa0b6fc0 con 0x9aa3600 -9796> 2014-05-19 10:46:07.716990 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -9795> 2014-05-19 10:46:07.717076 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:10.322982) v2 -- ?+0 0x9e116c0 con 0x9b8c160 -9794> 2014-05-19 10:46:07.717176 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -9793> 2014-05-19 10:46:07.746925 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:10.353070) v2 ==== 47+0+0 (1482808658 0 0) 0xa102e00 con 0x9937760 -9792> 2014-05-19 10:46:07.746973 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:10.353070) v2 -- ?+0 0x9e11dc0 con 0x9937760 -9791> 2014-05-19 10:46:07.747005 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -9790> 2014-05-19 10:46:07.746920 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:10.353070) v2 ==== 47+0+0 (1482808658 0 0) 0xa103880 con 0x9656000 -9789> 2014-05-19 10:46:07.747075 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:10.353070) v2 -- ?+0 0xa209340 con 0x9656000 -9788> 2014-05-19 10:46:07.747190 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -9787> 2014-05-19 10:46:07.761730 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 36 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:11.704726) v2 ==== 47+0+0 (3075456128 0 0) 0x9ad3180 con 0x99d31e0 -9786> 2014-05-19 10:46:07.761758 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 36 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:11.704726) v2 ==== 47+0+0 (3075456128 0 0) 0x9e9f500 con 0x95142c0 -9785> 2014-05-19 10:46:07.761781 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:11.704726) v2 -- ?+0 0xa103880 con 0x99d31e0 -9784> 2014-05-19 10:46:07.761820 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -9783> 2014-05-19 10:46:07.761843 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:11.704726) v2 -- ?+0 0xa102e00 con 0x95142c0 -9782> 2014-05-19 10:46:07.761922 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -9781> 2014-05-19 10:46:07.836629 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:10.442751) v2 ==== 47+0+0 (2564065332 0 0) 0xa36c1c0 con 0x9b8de40 -9780> 2014-05-19 10:46:07.836656 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:10.442751) v2 ==== 47+0+0 (2564065332 0 0) 0x9c6f880 con 0x94e2160 -9779> 2014-05-19 10:46:07.836679 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:10.442751) v2 -- ?+0 0x9ad3180 con 0x9b8de40 -9778> 2014-05-19 10:46:07.836714 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -9777> 2014-05-19 10:46:07.836755 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:10.442751) v2 -- ?+0 0x9e9f500 con 0x94e2160 -9776> 2014-05-19 10:46:07.836860 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -9775> 2014-05-19 10:46:07.849476 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 30 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:11.792459) v2 ==== 47+0+0 (2948328726 0 0) 0xa1efc00 con 0x97434a0 -9774> 2014-05-19 10:46:07.849565 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:11.792459) v2 -- ?+0 0x9c6f880 con 0x97434a0 -9773> 2014-05-19 10:46:07.849674 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -9772> 2014-05-19 10:46:07.849750 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 30 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:11.792459) v2 ==== 47+0+0 (2948328726 0 0) 0xa0dc700 con 0x9970840 -9771> 2014-05-19 10:46:07.849786 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:11.792459) v2 -- ?+0 0xa36c1c0 con 0x9970840 -9770> 2014-05-19 10:46:07.849874 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -9769> 2014-05-19 10:46:07.879592 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 32 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:11.822645) v2 ==== 47+0+0 (4070704014 0 0) 0xa4a9a40 con 0x9bb7b80 -9768> 2014-05-19 10:46:07.879618 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 32 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:11.822645) v2 ==== 47+0+0 (4070704014 0 0) 0xa2e0540 con 0x95151e0 -9767> 2014-05-19 10:46:07.879675 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:11.822645) v2 -- ?+0 0xa0dc700 con 0x9bb7b80 -9766> 2014-05-19 10:46:07.879710 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -9765> 2014-05-19 10:46:07.879735 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:11.822645) v2 -- ?+0 0xa1efc00 con 0x95151e0 -9764> 2014-05-19 10:46:07.879834 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -9763> 2014-05-19 10:46:07.913772 7f5566602700 5 osd.0 245 tick -9762> 2014-05-19 10:46:07.913792 7f5566602700 7 osd.0 245 do_mon_report -9761> 2014-05-19 10:46:07.913796 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 -9760> 2014-05-19 10:46:07.913800 7f5566602700 20 osd.0 245 send_pg_stats -9759> 2014-05-19 10:46:07.913809 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -9758> 2014-05-19 10:46:07.913813 7f5566602700 10 osd.0 245 do_waiters -- start -9757> 2014-05-19 10:46:07.913815 7f5566602700 10 osd.0 245 do_waiters -- finish -9756> 2014-05-19 10:46:07.913851 7f555119d700 20 OSD::recovery_tp worker waiting -9755> 2014-05-19 10:46:07.944238 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:10.550263) v2 ==== 47+0+0 (3536132896 0 0) 0xa05e1c0 con 0x9656f20 -9754> 2014-05-19 10:46:07.944350 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:10.550263) v2 ==== 47+0+0 (3536132896 0 0) 0xa0bc540 con 0x9656160 -9753> 2014-05-19 10:46:07.944400 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:10.550263) v2 -- ?+0 0xa4a9a40 con 0x9656160 -9752> 2014-05-19 10:46:07.944480 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -9751> 2014-05-19 10:46:07.944508 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:10.550263) v2 -- ?+0 0xa2e0540 con 0x9656f20 -9750> 2014-05-19 10:46:07.944625 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -9749> 2014-05-19 10:46:08.263325 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:12.206349) v2 ==== 47+0+0 (3026416645 0 0) 0xa2e01c0 con 0x95142c0 -9748> 2014-05-19 10:46:08.263403 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:12.206349) v2 -- ?+0 0xa05e1c0 con 0x95142c0 -9747> 2014-05-19 10:46:08.263441 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -9746> 2014-05-19 10:46:08.263333 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:12.206349) v2 ==== 47+0+0 (3026416645 0 0) 0x9fd88c0 con 0x99d31e0 -9745> 2014-05-19 10:46:08.263479 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:12.206349) v2 -- ?+0 0xa0bc540 con 0x99d31e0 -9744> 2014-05-19 10:46:08.263509 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -9743> 2014-05-19 10:46:08.381014 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 33 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:12.324069) v2 ==== 47+0+0 (3832063887 0 0) 0xa23e1c0 con 0x9bb7b80 -9742> 2014-05-19 10:46:08.381120 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:12.324069) v2 -- ?+0 0x9fd88c0 con 0x9bb7b80 -9741> 2014-05-19 10:46:08.381205 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -9740> 2014-05-19 10:46:08.381039 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 33 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:12.324069) v2 ==== 47+0+0 (3832063887 0 0) 0xa2e08c0 con 0x95151e0 -9739> 2014-05-19 10:46:08.381410 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:12.324069) v2 -- ?+0 0xa2e01c0 con 0x95151e0 -9738> 2014-05-19 10:46:08.381445 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -9737> 2014-05-19 10:46:08.525358 7f5565600700 20 KeyValueStore::op_tp worker waiting -9736> 2014-05-19 10:46:08.584580 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:12.527569) v2 ==== 47+0+0 (3553869555 0 0) 0xa064e00 con 0x9bb69a0 -9735> 2014-05-19 10:46:08.584654 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:12.527569) v2 -- ?+0 0xa23e1c0 con 0x9bb69a0 -9734> 2014-05-19 10:46:08.584578 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:12.527569) v2 ==== 47+0+0 (3553869555 0 0) 0xac15340 con 0x94e3e40 -9733> 2014-05-19 10:46:08.584754 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -9732> 2014-05-19 10:46:08.584783 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:12.527569) v2 -- ?+0 0xa2e08c0 con 0x94e3e40 -9731> 2014-05-19 10:46:08.584887 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -9730> 2014-05-19 10:46:08.600725 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 34 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:12.543796) v2 ==== 47+0+0 (3192480428 0 0) 0xa05e380 con 0x987b340 -9729> 2014-05-19 10:46:08.600776 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:12.543796) v2 -- ?+0 0xa064e00 con 0x987b340 -9728> 2014-05-19 10:46:08.600811 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -9727> 2014-05-19 10:46:08.600841 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 34 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:12.543796) v2 ==== 47+0+0 (3192480428 0 0) 0xa243500 con 0x94e26e0 -9726> 2014-05-19 10:46:08.600883 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:12.543796) v2 -- ?+0 0xac15340 con 0x94e26e0 -9725> 2014-05-19 10:46:08.600966 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -9724> 2014-05-19 10:46:08.766905 7f55579aa700 20 OSD::op_tp worker waiting -9723> 2014-05-19 10:46:08.766931 7f55551a5700 20 OSD::op_tp worker waiting -9722> 2014-05-19 10:46:08.766952 7f555a1af700 20 OSD::op_tp worker waiting -9721> 2014-05-19 10:46:08.768441 7f555a9b0700 20 OSD::op_tp worker waiting -9720> 2014-05-19 10:46:08.768462 7f55569a8700 20 OSD::op_tp worker waiting -9719> 2014-05-19 10:46:08.768496 7f55549a4700 20 OSD::op_tp worker waiting -9718> 2014-05-19 10:46:08.768526 7f55541a3700 20 OSD::op_tp worker waiting -9717> 2014-05-19 10:46:08.768551 7f55589ac700 20 OSD::op_tp worker waiting -9716> 2014-05-19 10:46:08.768604 7f555b1b1700 20 OSD::op_tp worker waiting -9715> 2014-05-19 10:46:08.769730 7f55571a9700 20 OSD::op_tp worker waiting -9714> 2014-05-19 10:46:08.769751 7f55559a6700 20 OSD::op_tp worker waiting -9713> 2014-05-19 10:46:08.769780 7f55529a0700 20 OSD::op_tp worker waiting -9712> 2014-05-19 10:46:08.769803 7f55581ab700 20 OSD::op_tp worker waiting -9711> 2014-05-19 10:46:08.769820 7f55561a7700 20 OSD::op_tp worker waiting -9710> 2014-05-19 10:46:08.769838 7f55531a1700 20 OSD::op_tp worker waiting -9709> 2014-05-19 10:46:08.769859 7f55599ae700 20 OSD::op_tp worker waiting -9708> 2014-05-19 10:46:08.769868 7f55539a2700 20 OSD::op_tp worker waiting -9707> 2014-05-19 10:46:08.769877 7f55591ad700 20 OSD::op_tp worker waiting -9706> 2014-05-19 10:46:08.769893 7f555219f700 20 OSD::op_tp worker waiting -9705> 2014-05-19 10:46:08.769928 7f555199e700 20 OSD::op_tp worker waiting -9704> 2014-05-19 10:46:08.913904 7f5566602700 5 osd.0 245 tick -9703> 2014-05-19 10:46:08.913931 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -9702> 2014-05-19 10:46:08.913936 7f5566602700 10 osd.0 245 do_waiters -- start -9701> 2014-05-19 10:46:08.913938 7f5566602700 10 osd.0 245 do_waiters -- finish -9700> 2014-05-19 10:46:08.913974 7f555119d700 20 OSD::recovery_tp worker waiting -9699> 2014-05-19 10:46:08.950821 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 31 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:12.893884) v2 ==== 47+0+0 (691540367 0 0) 0xa092700 con 0x97434a0 -9698> 2014-05-19 10:46:08.950875 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:12.893884) v2 -- ?+0 0xa243500 con 0x97434a0 -9697> 2014-05-19 10:46:08.950957 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -9696> 2014-05-19 10:46:08.951021 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 31 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:12.893884) v2 ==== 47+0+0 (691540367 0 0) 0xa079880 con 0x9970840 -9695> 2014-05-19 10:46:08.951195 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:12.893884) v2 -- ?+0 0xa05e380 con 0x9970840 -9694> 2014-05-19 10:46:08.951504 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -9693> 2014-05-19 10:46:09.034648 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -9692> 2014-05-19 10:46:09.034670 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -9691> 2014-05-19 10:46:09.034678 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0x99e1c00 con 0x9bdc840 -9690> 2014-05-19 10:46:09.034705 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa865180 con 0x9ad4420 -9689> 2014-05-19 10:46:09.034747 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0x9c6ee00 con 0x9bf31e0 -9688> 2014-05-19 10:46:09.034777 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa1e4540 con 0x998b340 -9687> 2014-05-19 10:46:09.034804 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa2096c0 con 0x9b92840 -9686> 2014-05-19 10:46:09.034820 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa6aafc0 con 0x9ad49a0 -9685> 2014-05-19 10:46:09.034849 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa6d4c40 con 0x7b911e0 -9684> 2014-05-19 10:46:09.034875 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0x9f75500 con 0x7b918c0 -9683> 2014-05-19 10:46:09.034902 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0x9cb48c0 con 0x9aa8c60 -9682> 2014-05-19 10:46:09.034918 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa5161c0 con 0x9bfa000 -9681> 2014-05-19 10:46:09.034952 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa8656c0 con 0x7c23e40 -9680> 2014-05-19 10:46:09.034980 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa516e00 con 0x998b760 -9679> 2014-05-19 10:46:09.035010 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0x94b7340 con 0x7b91080 -9678> 2014-05-19 10:46:09.035028 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa172380 con 0xa28fb80 -9677> 2014-05-19 10:46:09.035042 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa5168c0 con 0x76bdce0 -9676> 2014-05-19 10:46:09.035067 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0x97c21c0 con 0x994ab00 -9675> 2014-05-19 10:46:09.035047 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xa2dee00 con 0x9bdc840 -9674> 2014-05-19 10:46:09.035104 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa092000 con 0x9ac8b00 -9673> 2014-05-19 10:46:09.035132 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa2bca80 con 0x938de40 -9672> 2014-05-19 10:46:09.035148 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa6d4000 con 0x9970b00 -9671> 2014-05-19 10:46:09.035163 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0x97c2540 con 0x99706e0 -9670> 2014-05-19 10:46:09.035177 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa8728c0 con 0x9bb6f20 -9669> 2014-05-19 10:46:09.035191 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa1e5340 con 0x994b340 -9668> 2014-05-19 10:46:09.035205 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa264e00 con 0x98fa2c0 -9667> 2014-05-19 10:46:09.035230 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa45f6c0 con 0x996f8c0 -9666> 2014-05-19 10:46:09.035329 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa2661c0 con 0x996fa20 -9665> 2014-05-19 10:46:09.035361 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0x9d20380 con 0x9ac8160 -9664> 2014-05-19 10:46:09.035389 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0x9ffd340 con 0x7b90420 -9663> 2014-05-19 10:46:09.035418 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa1e5c00 con 0x919fe40 -9662> 2014-05-19 10:46:09.035451 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa0ea000 con 0x9971760 -9661> 2014-05-19 10:46:09.035473 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xac08700 con 0x994af20 -9660> 2014-05-19 10:46:09.035500 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa384fc0 con 0x989be40 -9659> 2014-05-19 10:46:09.035552 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa8648c0 con 0x9adf4a0 -9658> 2014-05-19 10:46:09.035584 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0x9fdc380 con 0x9776160 -9657> 2014-05-19 10:46:09.035615 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa1721c0 con 0x96bd8c0 -9656> 2014-05-19 10:46:09.035647 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa665500 con 0x96bcdc0 -9655> 2014-05-19 10:46:09.035671 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0x9ebbc00 con 0x96954a0 -9654> 2014-05-19 10:46:09.035705 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0x9c6e700 con 0x76bd8c0 -9653> 2014-05-19 10:46:09.035801 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0x9ffd180 con 0x7b90dc0 -9652> 2014-05-19 10:46:09.035823 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa4ef6c0 con 0x978d8c0 -9651> 2014-05-19 10:46:09.035839 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0x99e01c0 con 0x978c580 -9650> 2014-05-19 10:46:09.035909 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0x9b50000 con 0x978d340 -9649> 2014-05-19 10:46:09.035941 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:09.034676) v2 -- ?+0 0xa2df180 con 0x96374a0 -9648> 2014-05-19 10:46:09.036000 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -9647> 2014-05-19 10:46:09.036024 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0x9b51dc0 con 0x9ad4420 -9646> 2014-05-19 10:46:09.036059 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -9645> 2014-05-19 10:46:09.036094 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xac16fc0 con 0x9bf31e0 -9644> 2014-05-19 10:46:09.036126 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -9643> 2014-05-19 10:46:09.036138 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xac15dc0 con 0x998b340 -9642> 2014-05-19 10:46:09.036179 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -9641> 2014-05-19 10:46:09.036194 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xa872380 con 0x9b92840 -9640> 2014-05-19 10:46:09.036225 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -9639> 2014-05-19 10:46:09.036236 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0x9c6e540 con 0x9ad49a0 -9638> 2014-05-19 10:46:09.036266 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -9637> 2014-05-19 10:46:09.036280 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xa6d4380 con 0x7b911e0 -9636> 2014-05-19 10:46:09.036310 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -9635> 2014-05-19 10:46:09.036345 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xa665340 con 0x7b918c0 -9634> 2014-05-19 10:46:09.036374 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -9633> 2014-05-19 10:46:09.036389 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xa1736c0 con 0x9aa8c60 -9632> 2014-05-19 10:46:09.036422 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -9631> 2014-05-19 10:46:09.036436 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xa65bc00 con 0x9bfa000 -9630> 2014-05-19 10:46:09.036462 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -9629> 2014-05-19 10:46:09.036483 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xa107dc0 con 0x7c23e40 -9628> 2014-05-19 10:46:09.036514 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -9627> 2014-05-19 10:46:09.036528 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0x99e1500 con 0x998b760 -9626> 2014-05-19 10:46:09.036559 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -9625> 2014-05-19 10:46:09.036573 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xa873880 con 0x7b91080 -9624> 2014-05-19 10:46:09.036603 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -9623> 2014-05-19 10:46:09.036616 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0x9caa380 con 0xa28fb80 -9622> 2014-05-19 10:46:09.036646 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -9621> 2014-05-19 10:46:09.036660 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0x9fb5c00 con 0x76bdce0 -9620> 2014-05-19 10:46:09.036691 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -9619> 2014-05-19 10:46:09.036703 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0x96bee00 con 0x994ab00 -9618> 2014-05-19 10:46:09.036732 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -9617> 2014-05-19 10:46:09.036745 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xa114fc0 con 0x9ac8b00 -9616> 2014-05-19 10:46:09.036776 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -9615> 2014-05-19 10:46:09.036789 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xa4a88c0 con 0x938de40 -9614> 2014-05-19 10:46:09.036820 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -9613> 2014-05-19 10:46:09.036835 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0x9ab8700 con 0x9970b00 -9612> 2014-05-19 10:46:09.036867 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -9611> 2014-05-19 10:46:09.036880 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0x9c0e700 con 0x99706e0 -9610> 2014-05-19 10:46:09.036911 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -9609> 2014-05-19 10:46:09.036927 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xa030380 con 0x9bb6f20 -9608> 2014-05-19 10:46:09.036958 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -9607> 2014-05-19 10:46:09.036971 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xac17340 con 0x994b340 -9606> 2014-05-19 10:46:09.037001 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -9605> 2014-05-19 10:46:09.037014 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 36 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0x95e61c0 con 0x98fa2c0 -9604> 2014-05-19 10:46:09.037046 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -9603> 2014-05-19 10:46:09.037059 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 36 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xa4461c0 con 0x996f8c0 -9602> 2014-05-19 10:46:09.037089 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -9601> 2014-05-19 10:46:09.037125 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 35 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0x9cb4e00 con 0x996fa20 -9600> 2014-05-19 10:46:09.037160 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -9599> 2014-05-19 10:46:09.037174 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 35 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0x9123c00 con 0x9ac8160 -9598> 2014-05-19 10:46:09.037205 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -9597> 2014-05-19 10:46:09.037220 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 34 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xa192e00 con 0x7b90420 -9596> 2014-05-19 10:46:09.037251 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -9595> 2014-05-19 10:46:09.037265 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 34 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xa103180 con 0x919fe40 -9594> 2014-05-19 10:46:09.037295 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -9593> 2014-05-19 10:46:09.037308 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 33 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0x9b51880 con 0x9971760 -9592> 2014-05-19 10:46:09.037338 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -9591> 2014-05-19 10:46:09.037352 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 33 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0x9fd81c0 con 0x994af20 -9590> 2014-05-19 10:46:09.037381 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -9589> 2014-05-19 10:46:09.037394 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 31 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0x9c08a80 con 0x989be40 -9588> 2014-05-19 10:46:09.037426 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -9587> 2014-05-19 10:46:09.037439 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 31 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0x9cb6e00 con 0x9adf4a0 -9586> 2014-05-19 10:46:09.037469 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -9585> 2014-05-19 10:46:09.037482 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 31 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xa1e4380 con 0x9776160 -9584> 2014-05-19 10:46:09.037513 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -9583> 2014-05-19 10:46:09.037526 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 31 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0x9f6efc0 con 0x96bd8c0 -9582> 2014-05-19 10:46:09.037555 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -9581> 2014-05-19 10:46:09.037576 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 30 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xa618700 con 0x96bcdc0 -9580> 2014-05-19 10:46:09.037607 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -9579> 2014-05-19 10:46:09.037621 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 30 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0x9b501c0 con 0x96954a0 -9578> 2014-05-19 10:46:09.037650 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -9577> 2014-05-19 10:46:09.037664 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 29 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xac176c0 con 0x76bd8c0 -9576> 2014-05-19 10:46:09.037694 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -9575> 2014-05-19 10:46:09.037707 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 29 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0x9ffc000 con 0x7b90dc0 -9574> 2014-05-19 10:46:09.037737 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -9573> 2014-05-19 10:46:09.037750 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 28 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0x9fecfc0 con 0x978d8c0 -9572> 2014-05-19 10:46:09.037777 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -9571> 2014-05-19 10:46:09.037786 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 28 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xa208700 con 0x978c580 -9570> 2014-05-19 10:46:09.037815 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -9569> 2014-05-19 10:46:09.037833 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 27 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0x9f74e00 con 0x978d340 -9568> 2014-05-19 10:46:09.037865 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -9567> 2014-05-19 10:46:09.037878 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 27 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:09.034676) v2 ==== 47+0+0 (2332066562 0 0) 0xa2df340 con 0x96374a0 -9566> 2014-05-19 10:46:09.037908 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -9565> 2014-05-19 10:46:09.108779 7f5564dff700 20 KeyValueStore::op_tp worker waiting -9564> 2014-05-19 10:46:09.324675 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:11.930826) v2 ==== 47+0+0 (2915841700 0 0) 0xa0eae00 con 0x96571e0 -9563> 2014-05-19 10:46:09.324726 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:11.930826) v2 -- ?+0 0xa092700 con 0x96571e0 -9562> 2014-05-19 10:46:09.324761 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -9561> 2014-05-19 10:46:09.324717 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:11.930826) v2 ==== 47+0+0 (2915841700 0 0) 0x99e1180 con 0x9656420 -9560> 2014-05-19 10:46:09.325226 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:11.930826) v2 -- ?+0 0xa079880 con 0x9656420 -9559> 2014-05-19 10:46:09.325260 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -9558> 2014-05-19 10:46:09.447789 7f555019b700 20 OSD::command_tp worker waiting -9557> 2014-05-19 10:46:09.450827 7f555099c700 20 OSD::disk_tp worker waiting -9556> 2014-05-19 10:46:09.570000 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 30 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:13.513062) v2 ==== 47+0+0 (2441688204 0 0) 0xac09c00 con 0x99f1080 -9555> 2014-05-19 10:46:09.570030 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 30 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:13.513062) v2 ==== 47+0+0 (2441688204 0 0) 0xac14a80 con 0x987af20 -9554> 2014-05-19 10:46:09.570055 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.513062) v2 -- ?+0 0xa0eae00 con 0x99f1080 -9553> 2014-05-19 10:46:09.570089 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -9552> 2014-05-19 10:46:09.570561 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.513062) v2 -- ?+0 0x99e1180 con 0x987af20 -9551> 2014-05-19 10:46:09.570605 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -9550> 2014-05-19 10:46:09.594655 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:12.200822) v2 ==== 47+0+0 (424516420 0 0) 0xa1ef340 con 0x7b90160 -9549> 2014-05-19 10:46:09.594679 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:12.200822) v2 ==== 47+0+0 (424516420 0 0) 0xa36da40 con 0x9b8db80 -9548> 2014-05-19 10:46:09.594705 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:12.200822) v2 -- ?+0 0xac09c00 con 0x7b90160 -9547> 2014-05-19 10:46:09.594762 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -9546> 2014-05-19 10:46:09.594797 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:12.200822) v2 -- ?+0 0xac14a80 con 0x9b8db80 -9545> 2014-05-19 10:46:09.594827 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -9544> 2014-05-19 10:46:09.914013 7f5566602700 5 osd.0 245 tick -9543> 2014-05-19 10:46:09.914039 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -9542> 2014-05-19 10:46:09.914044 7f5566602700 10 osd.0 245 do_waiters -- start -9541> 2014-05-19 10:46:09.914046 7f5566602700 10 osd.0 245 do_waiters -- finish -9540> 2014-05-19 10:46:09.914077 7f555119d700 20 OSD::recovery_tp worker waiting -9539> 2014-05-19 10:46:09.927383 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:12.533629) v2 ==== 47+0+0 (2939278442 0 0) 0x9cd1a40 con 0x9983600 -9538> 2014-05-19 10:46:09.927429 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:12.533629) v2 -- ?+0 0xa1ef340 con 0x9983600 -9537> 2014-05-19 10:46:09.927462 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -9536> 2014-05-19 10:46:09.927445 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:12.533629) v2 ==== 47+0+0 (2939278442 0 0) 0x9e11500 con 0x95846e0 -9535> 2014-05-19 10:46:09.927478 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:12.533629) v2 -- ?+0 0xa36da40 con 0x95846e0 -9534> 2014-05-19 10:46:09.927551 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -9533> 2014-05-19 10:46:10.006171 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 28 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:13.949264) v2 ==== 47+0+0 (3332962568 0 0) 0xac08e00 con 0x987b760 -9532> 2014-05-19 10:46:10.006221 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.949264) v2 -- ?+0 0x9e11500 con 0x987b760 -9531> 2014-05-19 10:46:10.006344 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -9530> 2014-05-19 10:46:10.006728 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 28 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:13.949264) v2 ==== 47+0+0 (3332962568 0 0) 0xa36d180 con 0x94802c0 -9529> 2014-05-19 10:46:10.006775 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.949264) v2 -- ?+0 0x9cd1a40 con 0x94802c0 -9528> 2014-05-19 10:46:10.006875 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -9527> 2014-05-19 10:46:10.094520 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 35 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:14.037610) v2 ==== 47+0+0 (131840326 0 0) 0x9e6da40 con 0x9743600 -9526> 2014-05-19 10:46:10.094570 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:14.037610) v2 -- ?+0 0xa36d180 con 0x9743600 -9525> 2014-05-19 10:46:10.094789 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -9524> 2014-05-19 10:46:10.095024 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 35 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:14.037610) v2 ==== 47+0+0 (131840326 0 0) 0x95bcc40 con 0x966e000 -9523> 2014-05-19 10:46:10.095066 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:14.037610) v2 -- ?+0 0xac08e00 con 0x966e000 -9522> 2014-05-19 10:46:10.095159 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -9521> 2014-05-19 10:46:10.425952 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:13.032171) v2 ==== 47+0+0 (4086676009 0 0) 0xa103c00 con 0x9656420 -9520> 2014-05-19 10:46:10.426024 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.032171) v2 -- ?+0 0x95bcc40 con 0x9656420 -9519> 2014-05-19 10:46:10.425960 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:13.032171) v2 ==== 47+0+0 (4086676009 0 0) 0xa092a80 con 0x96571e0 -9518> 2014-05-19 10:46:10.426167 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -9517> 2014-05-19 10:46:10.426237 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.032171) v2 -- ?+0 0x9e6da40 con 0x96571e0 -9516> 2014-05-19 10:46:10.426322 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -9515> 2014-05-19 10:46:10.525449 7f5565600700 20 KeyValueStore::op_tp worker waiting -9514> 2014-05-19 10:46:10.587104 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:13.193260) v2 ==== 47+0+0 (2217646990 0 0) 0xa857c00 con 0x96562c0 -9513> 2014-05-19 10:46:10.587116 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:13.193260) v2 ==== 47+0+0 (2217646990 0 0) 0x9c09dc0 con 0x9657080 -9512> 2014-05-19 10:46:10.587155 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.193260) v2 -- ?+0 0xa103c00 con 0x96562c0 -9511> 2014-05-19 10:46:10.587235 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -9510> 2014-05-19 10:46:10.587356 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.193260) v2 -- ?+0 0xa092a80 con 0x9657080 -9509> 2014-05-19 10:46:10.587406 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -9508> 2014-05-19 10:46:10.618274 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:13.224430) v2 ==== 47+0+0 (442081152 0 0) 0xa2bd6c0 con 0x9aa3600 -9507> 2014-05-19 10:46:10.618324 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.224430) v2 -- ?+0 0x9c09dc0 con 0x9aa3600 -9506> 2014-05-19 10:46:10.618428 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -9505> 2014-05-19 10:46:10.618260 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:13.224430) v2 ==== 47+0+0 (442081152 0 0) 0x9fd8540 con 0x9b8c160 -9504> 2014-05-19 10:46:10.618886 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.224430) v2 -- ?+0 0xa857c00 con 0x9b8c160 -9503> 2014-05-19 10:46:10.618921 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -9502> 2014-05-19 10:46:10.671680 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 31 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:14.614796) v2 ==== 47+0+0 (180689301 0 0) 0xac148c0 con 0x987af20 -9501> 2014-05-19 10:46:10.671752 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:14.614796) v2 -- ?+0 0x9fd8540 con 0x987af20 -9500> 2014-05-19 10:46:10.671803 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -9499> 2014-05-19 10:46:10.671823 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 31 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:14.614796) v2 ==== 47+0+0 (180689301 0 0) 0xac09a40 con 0x99f1080 -9498> 2014-05-19 10:46:10.671853 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:14.614796) v2 -- ?+0 0xa2bd6c0 con 0x99f1080 -9497> 2014-05-19 10:46:10.671950 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -9496> 2014-05-19 10:46:10.767006 7f55579aa700 20 OSD::op_tp worker waiting -9495> 2014-05-19 10:46:10.767029 7f555a1af700 20 OSD::op_tp worker waiting -9494> 2014-05-19 10:46:10.767078 7f55551a5700 20 OSD::op_tp worker waiting -9493> 2014-05-19 10:46:10.768540 7f55569a8700 20 OSD::op_tp worker waiting -9492> 2014-05-19 10:46:10.768563 7f555a9b0700 20 OSD::op_tp worker waiting -9491> 2014-05-19 10:46:10.768583 7f55549a4700 20 OSD::op_tp worker waiting -9490> 2014-05-19 10:46:10.768595 7f55541a3700 20 OSD::op_tp worker waiting -9489> 2014-05-19 10:46:10.768611 7f55589ac700 20 OSD::op_tp worker waiting -9488> 2014-05-19 10:46:10.768670 7f555b1b1700 20 OSD::op_tp worker waiting -9487> 2014-05-19 10:46:10.769813 7f55571a9700 20 OSD::op_tp worker waiting -9486> 2014-05-19 10:46:10.769833 7f55559a6700 20 OSD::op_tp worker waiting -9485> 2014-05-19 10:46:10.769861 7f55529a0700 20 OSD::op_tp worker waiting -9484> 2014-05-19 10:46:10.769881 7f55581ab700 20 OSD::op_tp worker waiting -9483> 2014-05-19 10:46:10.769901 7f55561a7700 20 OSD::op_tp worker waiting -9482> 2014-05-19 10:46:10.769915 7f55539a2700 20 OSD::op_tp worker waiting -9481> 2014-05-19 10:46:10.769929 7f55599ae700 20 OSD::op_tp worker waiting -9480> 2014-05-19 10:46:10.769942 7f55531a1700 20 OSD::op_tp worker waiting -9479> 2014-05-19 10:46:10.769964 7f55591ad700 20 OSD::op_tp worker waiting -9478> 2014-05-19 10:46:10.769981 7f555219f700 20 OSD::op_tp worker waiting -9477> 2014-05-19 10:46:10.769996 7f555199e700 20 OSD::op_tp worker waiting -9476> 2014-05-19 10:46:10.863187 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 35 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:14.806280) v2 ==== 47+0+0 (3969842917 0 0) 0x9b2e1c0 con 0x94a5a20 -9475> 2014-05-19 10:46:10.863228 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:14.806280) v2 -- ?+0 0xac09a40 con 0x94a5a20 -9474> 2014-05-19 10:46:10.863237 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 35 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:14.806280) v2 ==== 47+0+0 (3969842917 0 0) 0x9c08700 con 0x99d3340 -9473> 2014-05-19 10:46:10.863319 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -9472> 2014-05-19 10:46:10.863560 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:14.806280) v2 -- ?+0 0xac148c0 con 0x99d3340 -9471> 2014-05-19 10:46:10.863703 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -9470> 2014-05-19 10:46:10.914136 7f5566602700 5 osd.0 245 tick -9469> 2014-05-19 10:46:10.914162 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -9468> 2014-05-19 10:46:10.914167 7f5566602700 10 osd.0 245 do_waiters -- start -9467> 2014-05-19 10:46:10.914169 7f5566602700 10 osd.0 245 do_waiters -- finish -9466> 2014-05-19 10:46:10.914206 7f555119d700 20 OSD::recovery_tp worker waiting -9465> 2014-05-19 10:46:10.945637 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 34 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:14.888757) v2 ==== 47+0+0 (3275146627 0 0) 0xa031500 con 0x99718c0 -9464> 2014-05-19 10:46:10.945726 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:14.888757) v2 -- ?+0 0x9c08700 con 0x99718c0 -9463> 2014-05-19 10:46:10.945848 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -9462> 2014-05-19 10:46:10.945644 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 34 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:14.888757) v2 ==== 47+0+0 (3275146627 0 0) 0xa0ca000 con 0x97431e0 -9461> 2014-05-19 10:46:10.945935 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:14.888757) v2 -- ?+0 0x9b2e1c0 con 0x97431e0 -9460> 2014-05-19 10:46:10.946020 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -9459> 2014-05-19 10:46:11.032461 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:13.638606) v2 ==== 47+0+0 (588966995 0 0) 0x9ad6700 con 0x9a0c9a0 -9458> 2014-05-19 10:46:11.032501 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.638606) v2 -- ?+0 0xa0ca000 con 0x9a0c9a0 -9457> 2014-05-19 10:46:11.032612 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -9456> 2014-05-19 10:46:11.032652 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:13.638606) v2 ==== 47+0+0 (588966995 0 0) 0x9706c40 con 0x996e000 -9455> 2014-05-19 10:46:11.032689 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.638606) v2 -- ?+0 0xa031500 con 0x996e000 -9454> 2014-05-19 10:46:11.032763 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -9453> 2014-05-19 10:46:11.108858 7f5564dff700 20 KeyValueStore::op_tp worker waiting -9452> 2014-05-19 10:46:11.364641 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 36 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:15.307780) v2 ==== 47+0+0 (659733569 0 0) 0x9d0a1c0 con 0x94a5a20 -9451> 2014-05-19 10:46:11.364660 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 36 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:15.307780) v2 ==== 47+0+0 (659733569 0 0) 0x9e9e8c0 con 0x99d3340 -9450> 2014-05-19 10:46:11.364693 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:15.307780) v2 -- ?+0 0x9ad6700 con 0x94a5a20 -9449> 2014-05-19 10:46:11.364780 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -9448> 2014-05-19 10:46:11.364863 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:15.307780) v2 -- ?+0 0x9706c40 con 0x99d3340 -9447> 2014-05-19 10:46:11.364902 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -9446> 2014-05-19 10:46:11.447873 7f555019b700 20 OSD::command_tp worker waiting -9445> 2014-05-19 10:46:11.450901 7f555099c700 20 OSD::disk_tp worker waiting -9444> 2014-05-19 10:46:11.688565 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:14.294736) v2 ==== 47+0+0 (3177835920 0 0) 0xa4bb880 con 0x9657080 -9443> 2014-05-19 10:46:11.688578 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:14.294736) v2 ==== 47+0+0 (3177835920 0 0) 0xa857180 con 0x96562c0 -9442> 2014-05-19 10:46:11.688618 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:14.294736) v2 -- ?+0 0x9d0a1c0 con 0x9657080 -9441> 2014-05-19 10:46:11.688709 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -9440> 2014-05-19 10:46:11.688858 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:14.294736) v2 -- ?+0 0x9e9e8c0 con 0x96562c0 -9439> 2014-05-19 10:46:11.688938 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -9438> 2014-05-19 10:46:11.914262 7f5566602700 5 osd.0 245 tick -9437> 2014-05-19 10:46:11.914288 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -9436> 2014-05-19 10:46:11.914293 7f5566602700 10 osd.0 245 do_waiters -- start -9435> 2014-05-19 10:46:11.914295 7f5566602700 10 osd.0 245 do_waiters -- finish -9434> 2014-05-19 10:46:11.914333 7f555119d700 20 OSD::recovery_tp worker waiting -9433> 2014-05-19 10:46:11.971472 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:11.971253) v2 ==== 47+0+0 (1420129053 0 0) 0xa242c40 con 0x9656580 -9432> 2014-05-19 10:46:11.971475 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:11.971253) v2 ==== 47+0+0 (1420129053 0 0) 0xac08e00 con 0x9657340 -9431> 2014-05-19 10:46:11.971527 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:11.971253) v2 -- ?+0 0xa857180 con 0x9656580 -9430> 2014-05-19 10:46:11.971558 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -9429> 2014-05-19 10:46:11.971609 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:11.971253) v2 -- ?+0 0xa4bb880 con 0x9657340 -9428> 2014-05-19 10:46:11.971651 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -9427> 2014-05-19 10:46:12.448257 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:15.054447) v2 ==== 47+0+0 (1356534413 0 0) 0xa665180 con 0x9656000 -9426> 2014-05-19 10:46:12.448311 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:15.054447) v2 -- ?+0 0xa242c40 con 0x9656000 -9425> 2014-05-19 10:46:12.448426 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -9424> 2014-05-19 10:46:12.448301 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:15.054447) v2 ==== 47+0+0 (1356534413 0 0) 0xac17dc0 con 0x9937760 -9423> 2014-05-19 10:46:12.448660 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:15.054447) v2 -- ?+0 0xac08e00 con 0x9937760 -9422> 2014-05-19 10:46:12.448755 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -9421> 2014-05-19 10:46:12.496076 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:15.102256) v2 ==== 47+0+0 (920184622 0 0) 0xa645c00 con 0x7b90160 -9420> 2014-05-19 10:46:12.496150 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:15.102256) v2 -- ?+0 0xac17dc0 con 0x7b90160 -9419> 2014-05-19 10:46:12.496188 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -9418> 2014-05-19 10:46:12.496317 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:15.102256) v2 ==== 47+0+0 (920184622 0 0) 0x9ccf180 con 0x9b8db80 -9417> 2014-05-19 10:46:12.496381 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:15.102256) v2 -- ?+0 0xa665180 con 0x9b8db80 -9416> 2014-05-19 10:46:12.496535 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -9415> 2014-05-19 10:46:12.525534 7f5565600700 20 KeyValueStore::op_tp worker waiting -9414> 2014-05-19 10:46:12.645702 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:15.251852) v2 ==== 47+0+0 (816588863 0 0) 0xa464a80 con 0x9656f20 -9413> 2014-05-19 10:46:12.645752 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:15.251852) v2 -- ?+0 0xa645c00 con 0x9656f20 -9412> 2014-05-19 10:46:12.645779 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -9411> 2014-05-19 10:46:12.645932 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:15.251852) v2 ==== 47+0+0 (816588863 0 0) 0x9fd8e00 con 0x9656160 -9410> 2014-05-19 10:46:12.645976 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:15.251852) v2 -- ?+0 0x9ccf180 con 0x9656160 -9409> 2014-05-19 10:46:12.646059 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -9408> 2014-05-19 10:46:12.767108 7f555a1af700 20 OSD::op_tp worker waiting -9407> 2014-05-19 10:46:12.767147 7f55579aa700 20 OSD::op_tp worker waiting -9406> 2014-05-19 10:46:12.767171 7f55551a5700 20 OSD::op_tp worker waiting -9405> 2014-05-19 10:46:12.768640 7f55569a8700 20 OSD::op_tp worker waiting -9404> 2014-05-19 10:46:12.768660 7f555a9b0700 20 OSD::op_tp worker waiting -9403> 2014-05-19 10:46:12.768684 7f55541a3700 20 OSD::op_tp worker waiting -9402> 2014-05-19 10:46:12.768705 7f55549a4700 20 OSD::op_tp worker waiting -9401> 2014-05-19 10:46:12.768734 7f555b1b1700 20 OSD::op_tp worker waiting -9400> 2014-05-19 10:46:12.768753 7f55589ac700 20 OSD::op_tp worker waiting -9399> 2014-05-19 10:46:12.769898 7f55571a9700 20 OSD::op_tp worker waiting -9398> 2014-05-19 10:46:12.769919 7f55559a6700 20 OSD::op_tp worker waiting -9397> 2014-05-19 10:46:12.769950 7f55581ab700 20 OSD::op_tp worker waiting -9396> 2014-05-19 10:46:12.769969 7f55529a0700 20 OSD::op_tp worker waiting -9395> 2014-05-19 10:46:12.769985 7f55539a2700 20 OSD::op_tp worker waiting -9394> 2014-05-19 10:46:12.769999 7f55561a7700 20 OSD::op_tp worker waiting -9393> 2014-05-19 10:46:12.770010 7f55599ae700 20 OSD::op_tp worker waiting -9392> 2014-05-19 10:46:12.770021 7f55531a1700 20 OSD::op_tp worker waiting -9391> 2014-05-19 10:46:12.770034 7f55591ad700 20 OSD::op_tp worker waiting -9390> 2014-05-19 10:46:12.770047 7f555219f700 20 OSD::op_tp worker waiting -9389> 2014-05-19 10:46:12.770061 7f555199e700 20 OSD::op_tp worker waiting -9388> 2014-05-19 10:46:12.896086 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:15.502283) v2 ==== 47+0+0 (412380324 0 0) 0xa4fefc0 con 0x9a0cdc0 -9387> 2014-05-19 10:46:12.896160 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:15.502283) v2 -- ?+0 0xa464a80 con 0x9a0cdc0 -9386> 2014-05-19 10:46:12.896196 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -9385> 2014-05-19 10:46:12.896045 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:15.502283) v2 ==== 47+0+0 (412380324 0 0) 0xa447500 con 0x996fb80 -9384> 2014-05-19 10:46:12.896401 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:15.502283) v2 -- ?+0 0x9fd8e00 con 0x996fb80 -9383> 2014-05-19 10:46:12.896485 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -9382> 2014-05-19 10:46:12.914385 7f5566602700 5 osd.0 245 tick -9381> 2014-05-19 10:46:12.914405 7f5566602700 7 osd.0 245 do_mon_report -9380> 2014-05-19 10:46:12.914409 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 -9379> 2014-05-19 10:46:12.914412 7f5566602700 20 osd.0 245 send_pg_stats -9378> 2014-05-19 10:46:12.914450 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 4.15 >= max 0.5 = no, load too high -9377> 2014-05-19 10:46:12.914463 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -9376> 2014-05-19 10:46:12.914462 7f555119d700 20 OSD::recovery_tp worker waiting -9375> 2014-05-19 10:46:12.914466 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2193.45 < min (86400 seconds) -9374> 2014-05-19 10:46:12.914519 7f5566602700 20 osd.0 245 sched_scrub done -9373> 2014-05-19 10:46:12.914522 7f5566602700 10 osd.0 245 do_waiters -- start -9372> 2014-05-19 10:46:12.914524 7f5566602700 10 osd.0 245 do_waiters -- finish -9371> 2014-05-19 10:46:12.919733 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:15.525935) v2 ==== 47+0+0 (755996215 0 0) 0xa107880 con 0x9b8c160 -9370> 2014-05-19 10:46:12.919750 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:15.525935) v2 ==== 47+0+0 (755996215 0 0) 0xa2bd340 con 0x9aa3600 -9369> 2014-05-19 10:46:12.919785 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:15.525935) v2 -- ?+0 0xa4fefc0 con 0x9aa3600 -9368> 2014-05-19 10:46:12.919884 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -9367> 2014-05-19 10:46:12.920173 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:15.525935) v2 -- ?+0 0xa447500 con 0x9b8c160 -9366> 2014-05-19 10:46:12.920252 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -9365> 2014-05-19 10:46:12.995602 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 36 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:16.938850) v2 ==== 47+0+0 (3125323974 0 0) 0x9fdc540 con 0x966e000 -9364> 2014-05-19 10:46:12.995602 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 36 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:16.938850) v2 ==== 47+0+0 (3125323974 0 0) 0x9e6ddc0 con 0x9743600 -9363> 2014-05-19 10:46:12.995650 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:16.938850) v2 -- ?+0 0xa107880 con 0x966e000 -9362> 2014-05-19 10:46:12.995843 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -9361> 2014-05-19 10:46:12.996059 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:16.938850) v2 -- ?+0 0xa2bd340 con 0x9743600 -9360> 2014-05-19 10:46:12.996139 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -9359> 2014-05-19 10:46:13.108941 7f5564dff700 20 KeyValueStore::op_tp worker waiting -9358> 2014-05-19 10:46:13.136096 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -9357> 2014-05-19 10:46:13.136117 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -9356> 2014-05-19 10:46:13.136126 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9cd1880 con 0x9bdc840 -9355> 2014-05-19 10:46:13.136152 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0xa7d4700 con 0x9ad4420 -9354> 2014-05-19 10:46:13.136191 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9e77c00 con 0x9bf31e0 -9353> 2014-05-19 10:46:13.136207 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0xa4ffa40 con 0x998b340 -9352> 2014-05-19 10:46:13.136222 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0xa05ec40 con 0x9b92840 -9351> 2014-05-19 10:46:13.136252 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0xa1df180 con 0x9ad49a0 -9350> 2014-05-19 10:46:13.136282 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9faa1c0 con 0x7b911e0 -9349> 2014-05-19 10:46:13.136321 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0xa864700 con 0x7b918c0 -9348> 2014-05-19 10:46:13.136352 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9ec1880 con 0x9aa8c60 -9347> 2014-05-19 10:46:13.136378 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9d021c0 con 0x9bfa000 -9346> 2014-05-19 10:46:13.136413 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9ee2e00 con 0x7c23e40 -9345> 2014-05-19 10:46:13.136440 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9fa4fc0 con 0x998b760 -9344> 2014-05-19 10:46:13.136472 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9ed0c40 con 0x7b91080 -9343> 2014-05-19 10:46:13.136489 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9f75a40 con 0xa28fb80 -9342> 2014-05-19 10:46:13.136504 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9c09180 con 0x76bdce0 -9341> 2014-05-19 10:46:13.136529 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0xa115a40 con 0x994ab00 -9340> 2014-05-19 10:46:13.136534 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xa0bac40 con 0x9bdc840 -9339> 2014-05-19 10:46:13.136560 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9e6d880 con 0x9ac8b00 -9338> 2014-05-19 10:46:13.136589 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0xa093880 con 0x938de40 -9337> 2014-05-19 10:46:13.136611 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9f43c00 con 0x9970b00 -9336> 2014-05-19 10:46:13.136626 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9e716c0 con 0x99706e0 -9335> 2014-05-19 10:46:13.136657 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9f6efc0 con 0x9bb6f20 -9334> 2014-05-19 10:46:13.136674 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0xa1e4380 con 0x994b340 -9333> 2014-05-19 10:46:13.136721 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9cb6e00 con 0x98fa2c0 -9332> 2014-05-19 10:46:13.136751 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9c08a80 con 0x996f8c0 -9331> 2014-05-19 10:46:13.136779 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9fd81c0 con 0x996fa20 -9330> 2014-05-19 10:46:13.136808 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9b51880 con 0x9ac8160 -9329> 2014-05-19 10:46:13.136835 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0xa103180 con 0x7b90420 -9328> 2014-05-19 10:46:13.136851 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0xa192e00 con 0x919fe40 -9327> 2014-05-19 10:46:13.136867 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9123c00 con 0x9971760 -9326> 2014-05-19 10:46:13.136882 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9cb4e00 con 0x994af20 -9325> 2014-05-19 10:46:13.136910 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0xa4461c0 con 0x989be40 -9324> 2014-05-19 10:46:13.136941 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x95e61c0 con 0x9adf4a0 -9323> 2014-05-19 10:46:13.136973 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0xac17340 con 0x9776160 -9322> 2014-05-19 10:46:13.137071 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0xa030380 con 0x96bd8c0 -9321> 2014-05-19 10:46:13.137096 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9c0e700 con 0x96bcdc0 -9320> 2014-05-19 10:46:13.137128 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9ab8700 con 0x96954a0 -9319> 2014-05-19 10:46:13.137159 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0xa4a88c0 con 0x76bd8c0 -9318> 2014-05-19 10:46:13.137189 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0xa114fc0 con 0x7b90dc0 -9317> 2014-05-19 10:46:13.137216 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x96bee00 con 0x978d8c0 -9316> 2014-05-19 10:46:13.137262 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9fb5c00 con 0x978c580 -9315> 2014-05-19 10:46:13.137307 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0x9caa380 con 0x978d340 -9314> 2014-05-19 10:46:13.137337 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:13.136124) v2 -- ?+0 0xa873880 con 0x96374a0 -9313> 2014-05-19 10:46:13.137421 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -9312> 2014-05-19 10:46:13.137468 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0x9f43a40 con 0x9ad4420 -9311> 2014-05-19 10:46:13.137514 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -9310> 2014-05-19 10:46:13.137530 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xac16e00 con 0x9bf31e0 -9309> 2014-05-19 10:46:13.137648 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -9308> 2014-05-19 10:46:13.137681 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xac15c00 con 0x998b340 -9307> 2014-05-19 10:46:13.137704 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -9306> 2014-05-19 10:46:13.137711 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xa645c00 con 0x9b92840 -9305> 2014-05-19 10:46:13.137726 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -9304> 2014-05-19 10:46:13.137732 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0x9c0efc0 con 0x9ad49a0 -9303> 2014-05-19 10:46:13.137748 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -9302> 2014-05-19 10:46:13.137754 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0x9c58fc0 con 0x7b911e0 -9301> 2014-05-19 10:46:13.137768 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -9300> 2014-05-19 10:46:13.137776 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0x97d28c0 con 0x7b918c0 -9299> 2014-05-19 10:46:13.137789 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -9298> 2014-05-19 10:46:13.137797 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0x9ad36c0 con 0x9aa8c60 -9297> 2014-05-19 10:46:13.137826 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -9296> 2014-05-19 10:46:13.137836 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0x9cb5340 con 0x9bfa000 -9295> 2014-05-19 10:46:13.137852 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -9294> 2014-05-19 10:46:13.137857 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xa1076c0 con 0x7c23e40 -9293> 2014-05-19 10:46:13.137871 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -9292> 2014-05-19 10:46:13.137876 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0x95c0380 con 0x998b760 -9291> 2014-05-19 10:46:13.137890 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -9290> 2014-05-19 10:46:13.137896 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xa872540 con 0x7b91080 -9289> 2014-05-19 10:46:13.137910 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -9288> 2014-05-19 10:46:13.137914 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xa664fc0 con 0xa28fb80 -9287> 2014-05-19 10:46:13.137951 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -9286> 2014-05-19 10:46:13.137954 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:15.744212) v2 ==== 47+0+0 (1789557524 0 0) 0xa0cb500 con 0x9b8de40 -9285> 2014-05-19 10:46:13.138002 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:15.744212) v2 -- ?+0 0x9fdc540 con 0x9b8de40 -9284> 2014-05-19 10:46:13.137964 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0x9fb5880 con 0x76bdce0 -9283> 2014-05-19 10:46:13.138497 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -9282> 2014-05-19 10:46:13.138573 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -9281> 2014-05-19 10:46:13.138589 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0x9cabc00 con 0x994ab00 -9280> 2014-05-19 10:46:13.138624 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -9279> 2014-05-19 10:46:13.138637 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0x9f428c0 con 0x9ac8b00 -9278> 2014-05-19 10:46:13.138664 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -9277> 2014-05-19 10:46:13.138674 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xa857a40 con 0x938de40 -9276> 2014-05-19 10:46:13.138695 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -9275> 2014-05-19 10:46:13.138701 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xa2e1340 con 0x9970b00 -9274> 2014-05-19 10:46:13.138716 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -9273> 2014-05-19 10:46:13.138736 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0x9c0f500 con 0x99706e0 -9272> 2014-05-19 10:46:13.138755 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -9271> 2014-05-19 10:46:13.138761 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0x9d20380 con 0x9bb6f20 -9270> 2014-05-19 10:46:13.138775 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -9269> 2014-05-19 10:46:13.138780 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xac17180 con 0x994b340 -9268> 2014-05-19 10:46:13.138794 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -9267> 2014-05-19 10:46:13.138798 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xa192e00 con 0x98fa2c0 -9266> 2014-05-19 10:46:13.138813 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -9265> 2014-05-19 10:46:13.138818 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0x9ffd340 con 0x996f8c0 -9264> 2014-05-19 10:46:13.138831 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -9263> 2014-05-19 10:46:13.138844 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 36 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0x951c380 con 0x996fa20 -9262> 2014-05-19 10:46:13.138858 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -9261> 2014-05-19 10:46:13.138863 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 36 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xa28d180 con 0x9ac8160 -9260> 2014-05-19 10:46:13.138877 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -9259> 2014-05-19 10:46:13.138881 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 35 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xa237dc0 con 0x7b90420 -9258> 2014-05-19 10:46:13.138896 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -9257> 2014-05-19 10:46:13.138900 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 35 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0x9ed0000 con 0x919fe40 -9256> 2014-05-19 10:46:13.138913 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -9255> 2014-05-19 10:46:13.138918 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 34 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0x9236e00 con 0x9971760 -9254> 2014-05-19 10:46:13.138932 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -9253> 2014-05-19 10:46:13.138937 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 34 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xa162a80 con 0x994af20 -9252> 2014-05-19 10:46:13.138950 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -9251> 2014-05-19 10:46:13.138957 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 32 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0x9ad2700 con 0x989be40 -9250> 2014-05-19 10:46:13.138971 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -9249> 2014-05-19 10:46:13.138975 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 32 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0x9b50a80 con 0x9adf4a0 -9248> 2014-05-19 10:46:13.138989 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -9247> 2014-05-19 10:46:13.138994 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 32 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xa36c700 con 0x9776160 -9246> 2014-05-19 10:46:13.139008 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -9245> 2014-05-19 10:46:13.139013 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 32 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xa6d5a40 con 0x96bd8c0 -9244> 2014-05-19 10:46:13.139026 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -9243> 2014-05-19 10:46:13.139031 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 31 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0x9455500 con 0x96bcdc0 -9242> 2014-05-19 10:46:13.139045 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -9241> 2014-05-19 10:46:13.139049 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 31 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xa6ab340 con 0x96954a0 -9240> 2014-05-19 10:46:13.139063 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -9239> 2014-05-19 10:46:13.139067 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 30 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xac17500 con 0x76bd8c0 -9238> 2014-05-19 10:46:13.139081 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -9237> 2014-05-19 10:46:13.139086 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 30 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xa2df180 con 0x7b90dc0 -9236> 2014-05-19 10:46:13.139099 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -9235> 2014-05-19 10:46:13.139104 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 29 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xac1ac40 con 0x978d8c0 -9234> 2014-05-19 10:46:13.139118 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -9233> 2014-05-19 10:46:13.139123 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 29 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xac1ba40 con 0x978c580 -9232> 2014-05-19 10:46:13.139136 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -9231> 2014-05-19 10:46:13.139142 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 28 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xa267500 con 0x978d340 -9230> 2014-05-19 10:46:13.139156 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -9229> 2014-05-19 10:46:13.139161 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 28 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:13.136124) v2 ==== 47+0+0 (1807231586 0 0) 0xa2de700 con 0x96374a0 -9228> 2014-05-19 10:46:13.139174 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -9227> 2014-05-19 10:46:13.138059 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:15.744212) v2 ==== 47+0+0 (1789557524 0 0) 0x9c6ec40 con 0x94e2160 -9226> 2014-05-19 10:46:13.139194 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:15.744212) v2 -- ?+0 0x9e6ddc0 con 0x94e2160 -9225> 2014-05-19 10:46:13.139213 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -9224> 2014-05-19 10:46:13.428930 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:16.035101) v2 ==== 47+0+0 (52797478 0 0) 0x9e11880 con 0x95846e0 -9223> 2014-05-19 10:46:13.429017 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:16.035101) v2 ==== 47+0+0 (52797478 0 0) 0x9cd0a80 con 0x9983600 -9222> 2014-05-19 10:46:13.429034 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:16.035101) v2 -- ?+0 0xa0cb500 con 0x95846e0 -9221> 2014-05-19 10:46:13.429240 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -9220> 2014-05-19 10:46:13.429478 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:16.035101) v2 -- ?+0 0x9c6ec40 con 0x9983600 -9219> 2014-05-19 10:46:13.429611 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -9218> 2014-05-19 10:46:13.447955 7f555019b700 20 OSD::command_tp worker waiting -9217> 2014-05-19 10:46:13.451002 7f555099c700 20 OSD::disk_tp worker waiting -9216> 2014-05-19 10:46:13.564729 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:17.507946) v2 ==== 47+0+0 (3805968719 0 0) 0xa102a80 con 0x95142c0 -9215> 2014-05-19 10:46:13.564783 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:17.507946) v2 -- ?+0 0x9cd0a80 con 0x95142c0 -9214> 2014-05-19 10:46:13.564910 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -9213> 2014-05-19 10:46:13.564778 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:17.507946) v2 ==== 47+0+0 (3805968719 0 0) 0x9fd9880 con 0x99d31e0 -9212> 2014-05-19 10:46:13.564950 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:17.507946) v2 -- ?+0 0x9e11880 con 0x99d31e0 -9211> 2014-05-19 10:46:13.565006 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -9210> 2014-05-19 10:46:13.682396 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 34 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:17.625599) v2 ==== 47+0+0 (1280934928 0 0) 0xa23fdc0 con 0x9bb7b80 -9209> 2014-05-19 10:46:13.682448 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:17.625599) v2 -- ?+0 0x9fd9880 con 0x9bb7b80 -9208> 2014-05-19 10:46:13.682355 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 34 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:17.625599) v2 ==== 47+0+0 (1280934928 0 0) 0xa2e0c40 con 0x95151e0 -9207> 2014-05-19 10:46:13.682527 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -9206> 2014-05-19 10:46:13.682562 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:17.625599) v2 -- ?+0 0xa102a80 con 0x95151e0 -9205> 2014-05-19 10:46:13.682637 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -9204> 2014-05-19 10:46:13.885831 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:17.829094) v2 ==== 47+0+0 (1571464755 0 0) 0xac15180 con 0x94e3e40 -9203> 2014-05-19 10:46:13.885892 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:17.829094) v2 -- ?+0 0xa2e0c40 con 0x94e3e40 -9202> 2014-05-19 10:46:13.885924 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -9201> 2014-05-19 10:46:13.885833 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:17.829094) v2 ==== 47+0+0 (1571464755 0 0) 0xa0eb500 con 0x9bb69a0 -9200> 2014-05-19 10:46:13.886256 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:17.829094) v2 -- ?+0 0xa23fdc0 con 0x9bb69a0 -9199> 2014-05-19 10:46:13.886291 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -9198> 2014-05-19 10:46:13.901663 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 35 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:17.844930) v2 ==== 47+0+0 (787574908 0 0) 0xa05e700 con 0x987b340 -9197> 2014-05-19 10:46:13.901673 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 35 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:17.844930) v2 ==== 47+0+0 (787574908 0 0) 0x9e9ea80 con 0x94e26e0 -9196> 2014-05-19 10:46:13.901714 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:17.844930) v2 -- ?+0 0xa0eb500 con 0x987b340 -9195> 2014-05-19 10:46:13.901776 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -9194> 2014-05-19 10:46:13.901801 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:17.844930) v2 -- ?+0 0xac15180 con 0x94e26e0 -9193> 2014-05-19 10:46:13.901829 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -9192> 2014-05-19 10:46:13.914615 7f5566602700 5 osd.0 245 tick -9191> 2014-05-19 10:46:13.914670 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 4.15 >= max 0.5 = no, load too high -9190> 2014-05-19 10:46:13.914684 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -9189> 2014-05-19 10:46:13.914687 7f555119d700 20 OSD::recovery_tp worker waiting -9188> 2014-05-19 10:46:13.914687 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2194.45 < min (86400 seconds) -9187> 2014-05-19 10:46:13.914708 7f5566602700 20 osd.0 245 sched_scrub done -9186> 2014-05-19 10:46:13.914711 7f5566602700 10 osd.0 245 do_waiters -- start -9185> 2014-05-19 10:46:13.914713 7f5566602700 10 osd.0 245 do_waiters -- finish -9184> 2014-05-19 10:46:14.402986 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 36 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:18.346288) v2 ==== 47+0+0 (3671455271 0 0) 0x9e9f6c0 con 0x94e26e0 -9183> 2014-05-19 10:46:14.403026 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 36 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:18.346288) v2 ==== 47+0+0 (3671455271 0 0) 0x9d0b6c0 con 0x987b340 -9182> 2014-05-19 10:46:14.403035 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.346288) v2 -- ?+0 0x9e9ea80 con 0x94e26e0 -9181> 2014-05-19 10:46:14.403433 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -9180> 2014-05-19 10:46:14.403470 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.346288) v2 -- ?+0 0xa05e700 con 0x987b340 -9179> 2014-05-19 10:46:14.403545 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -9178> 2014-05-19 10:46:14.447001 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 35 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:18.390192) v2 ==== 47+0+0 (2594687046 0 0) 0xa0ca540 con 0x97431e0 -9177> 2014-05-19 10:46:14.447007 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 35 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:18.390192) v2 ==== 47+0+0 (2594687046 0 0) 0xa172a80 con 0x99718c0 -9176> 2014-05-19 10:46:14.447051 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.390192) v2 -- ?+0 0x9e9f6c0 con 0x97431e0 -9175> 2014-05-19 10:46:14.447461 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -9174> 2014-05-19 10:46:14.447486 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.390192) v2 -- ?+0 0x9d0b6c0 con 0x99718c0 -9173> 2014-05-19 10:46:14.447569 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -9172> 2014-05-19 10:46:14.525628 7f5565600700 20 KeyValueStore::op_tp worker waiting -9171> 2014-05-19 10:46:14.530403 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:17.136611) v2 ==== 47+0+0 (3782805862 0 0) 0x9c081c0 con 0x95846e0 -9170> 2014-05-19 10:46:14.530440 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:17.136611) v2 ==== 47+0+0 (3782805862 0 0) 0x9209c00 con 0x9983600 -9169> 2014-05-19 10:46:14.530454 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:17.136611) v2 -- ?+0 0xa172a80 con 0x95846e0 -9168> 2014-05-19 10:46:14.530560 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -9167> 2014-05-19 10:46:14.530722 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:17.136611) v2 -- ?+0 0xa0ca540 con 0x9983600 -9166> 2014-05-19 10:46:14.530822 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -9165> 2014-05-19 10:46:14.767192 7f555a1af700 20 OSD::op_tp worker waiting -9164> 2014-05-19 10:46:14.767222 7f55579aa700 20 OSD::op_tp worker waiting -9163> 2014-05-19 10:46:14.767249 7f55551a5700 20 OSD::op_tp worker waiting -9162> 2014-05-19 10:46:14.768742 7f555a9b0700 20 OSD::op_tp worker waiting -9161> 2014-05-19 10:46:14.768764 7f55541a3700 20 OSD::op_tp worker waiting -9160> 2014-05-19 10:46:14.768785 7f55569a8700 20 OSD::op_tp worker waiting -9159> 2014-05-19 10:46:14.768807 7f55549a4700 20 OSD::op_tp worker waiting -9158> 2014-05-19 10:46:14.768831 7f555b1b1700 20 OSD::op_tp worker waiting -9157> 2014-05-19 10:46:14.768854 7f55589ac700 20 OSD::op_tp worker waiting -9156> 2014-05-19 10:46:14.769997 7f55571a9700 20 OSD::op_tp worker waiting -9155> 2014-05-19 10:46:14.770021 7f55559a6700 20 OSD::op_tp worker waiting -9154> 2014-05-19 10:46:14.770036 7f55581ab700 20 OSD::op_tp worker waiting -9153> 2014-05-19 10:46:14.770054 7f55529a0700 20 OSD::op_tp worker waiting -9152> 2014-05-19 10:46:14.770069 7f55561a7700 20 OSD::op_tp worker waiting -9151> 2014-05-19 10:46:14.770091 7f55539a2700 20 OSD::op_tp worker waiting -9150> 2014-05-19 10:46:14.770104 7f55591ad700 20 OSD::op_tp worker waiting -9149> 2014-05-19 10:46:14.770119 7f555219f700 20 OSD::op_tp worker waiting -9148> 2014-05-19 10:46:14.770138 7f55599ae700 20 OSD::op_tp worker waiting -9147> 2014-05-19 10:46:14.770161 7f555199e700 20 OSD::op_tp worker waiting -9146> 2014-05-19 10:46:14.770177 7f55531a1700 20 OSD::op_tp worker waiting -9145> 2014-05-19 10:46:14.797391 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:17.403572) v2 ==== 47+0+0 (1461395588 0 0) 0x9d76540 con 0x7b90160 -9144> 2014-05-19 10:46:14.797401 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:17.403572) v2 ==== 47+0+0 (1461395588 0 0) 0xa1dfdc0 con 0x9b8db80 -9143> 2014-05-19 10:46:14.797442 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:17.403572) v2 -- ?+0 0x9209c00 con 0x7b90160 -9142> 2014-05-19 10:46:14.797668 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -9141> 2014-05-19 10:46:14.797696 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:17.403572) v2 -- ?+0 0x9c081c0 con 0x9b8db80 -9140> 2014-05-19 10:46:14.797770 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -9139> 2014-05-19 10:46:14.852205 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 32 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:18.795366) v2 ==== 47+0+0 (13666659 0 0) 0x95636c0 con 0x97434a0 -9138> 2014-05-19 10:46:14.852259 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.795366) v2 -- ?+0 0x9d76540 con 0x97434a0 -9137> 2014-05-19 10:46:14.852302 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -9136> 2014-05-19 10:46:14.852214 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 32 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:18.795366) v2 ==== 47+0+0 (13666659 0 0) 0x9b44fc0 con 0x9970840 -9135> 2014-05-19 10:46:14.852340 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.795366) v2 -- ?+0 0xa1dfdc0 con 0x9970840 -9134> 2014-05-19 10:46:14.852371 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -9133> 2014-05-19 10:46:14.914799 7f5566602700 5 osd.0 245 tick -9132> 2014-05-19 10:46:14.914852 7f555119d700 20 OSD::recovery_tp worker waiting -9131> 2014-05-19 10:46:14.914852 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 4.15 >= max 0.5 = no, load too high -9130> 2014-05-19 10:46:14.914865 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -9129> 2014-05-19 10:46:14.914868 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2195.45 < min (86400 seconds) -9128> 2014-05-19 10:46:14.914887 7f5566602700 20 osd.0 245 sched_scrub done -9127> 2014-05-19 10:46:14.914890 7f5566602700 10 osd.0 245 do_waiters -- start -9126> 2014-05-19 10:46:14.914892 7f5566602700 10 osd.0 245 do_waiters -- finish -9125> 2014-05-19 10:46:15.109034 7f5564dff700 20 KeyValueStore::op_tp worker waiting -9124> 2014-05-19 10:46:15.448029 7f555019b700 20 OSD::command_tp worker waiting -9123> 2014-05-19 10:46:15.451089 7f555099c700 20 OSD::disk_tp worker waiting -9122> 2014-05-19 10:46:15.907318 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 29 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:19.850649) v2 ==== 47+0+0 (448258628 0 0) 0x9e9fdc0 con 0x987b760 -9121> 2014-05-19 10:46:15.907372 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:19.850649) v2 -- ?+0 0x9b44fc0 con 0x987b760 -9120> 2014-05-19 10:46:15.907403 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -9119> 2014-05-19 10:46:15.907436 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 29 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:19.850649) v2 ==== 47+0+0 (448258628 0 0) 0xac15180 con 0x94802c0 -9118> 2014-05-19 10:46:15.907473 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:19.850649) v2 -- ?+0 0x95636c0 con 0x94802c0 -9117> 2014-05-19 10:46:15.907902 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -9116> 2014-05-19 10:46:15.914980 7f5566602700 5 osd.0 245 tick -9115> 2014-05-19 10:46:15.915005 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -9114> 2014-05-19 10:46:15.915009 7f5566602700 10 osd.0 245 do_waiters -- start -9113> 2014-05-19 10:46:15.915012 7f5566602700 10 osd.0 245 do_waiters -- finish -9112> 2014-05-19 10:46:15.915051 7f555119d700 20 OSD::recovery_tp worker waiting -9111> 2014-05-19 10:46:16.039478 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:18.645665) v2 ==== 47+0+0 (3433499586 0 0) 0x9c6f500 con 0x94e2160 -9110> 2014-05-19 10:46:16.039700 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.645665) v2 -- ?+0 0xac15180 con 0x94e2160 -9109> 2014-05-19 10:46:16.039738 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:18.645665) v2 ==== 47+0+0 (3433499586 0 0) 0x9c0d180 con 0x9b8de40 -9108> 2014-05-19 10:46:16.039781 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -9107> 2014-05-19 10:46:16.040008 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.645665) v2 -- ?+0 0x9e9fdc0 con 0x9b8de40 -9106> 2014-05-19 10:46:16.040053 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -9105> 2014-05-19 10:46:16.072756 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:16.072575) v2 ==== 47+0+0 (2923359670 0 0) 0xa0ba8c0 con 0x9656580 -9104> 2014-05-19 10:46:16.072795 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:16.072575) v2 ==== 47+0+0 (2923359670 0 0) 0xac09a40 con 0x9657340 -9103> 2014-05-19 10:46:16.072806 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:16.072575) v2 -- ?+0 0x9c0d180 con 0x9656580 -9102> 2014-05-19 10:46:16.072886 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -9101> 2014-05-19 10:46:16.072912 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:16.072575) v2 -- ?+0 0x9c6f500 con 0x9657340 -9100> 2014-05-19 10:46:16.072955 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -9099> 2014-05-19 10:46:16.327382 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:18.933594) v2 ==== 47+0+0 (3913124368 0 0) 0xa0dc8c0 con 0x96571e0 -9098> 2014-05-19 10:46:16.327382 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:18.933594) v2 ==== 47+0+0 (3913124368 0 0) 0x9f19c00 con 0x9656420 -9097> 2014-05-19 10:46:16.327460 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.933594) v2 -- ?+0 0xac09a40 con 0x96571e0 -9096> 2014-05-19 10:46:16.327766 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -9095> 2014-05-19 10:46:16.327803 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.933594) v2 -- ?+0 0xa0ba8c0 con 0x9656420 -9094> 2014-05-19 10:46:16.327878 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -9093> 2014-05-19 10:46:16.351992 7f555c1b3700 10 monclient: tick -9092> 2014-05-19 10:46:16.352006 7f555c1b3700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2014-05-19 10:45:46.352004) -9091> 2014-05-19 10:46:16.352023 7f555c1b3700 10 monclient: renew subs? (now: 2014-05-19 10:46:16.352023; renew after: 2014-05-19 10:47:03.081841) -- no -9090> 2014-05-19 10:46:16.421221 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:19.027435) v2 ==== 47+0+0 (2428788724 0 0) 0x9ebb880 con 0x9aa3600 -9089> 2014-05-19 10:46:16.421275 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:19.027435) v2 -- ?+0 0xa0dc8c0 con 0x9aa3600 -9088> 2014-05-19 10:46:16.421322 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -9087> 2014-05-19 10:46:16.421270 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:19.027435) v2 ==== 47+0+0 (2428788724 0 0) 0xa264c40 con 0x9b8c160 -9086> 2014-05-19 10:46:16.421382 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:19.027435) v2 -- ?+0 0x9f19c00 con 0x9b8c160 -9085> 2014-05-19 10:46:16.421566 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -9084> 2014-05-19 10:46:16.525715 7f5565600700 20 KeyValueStore::op_tp worker waiting -9083> 2014-05-19 10:46:16.572882 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 32 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:20.516228) v2 ==== 47+0+0 (934105298 0 0) 0xac14700 con 0x987af20 -9082> 2014-05-19 10:46:16.572898 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 32 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:20.516228) v2 ==== 47+0+0 (934105298 0 0) 0xac08a80 con 0x99f1080 -9081> 2014-05-19 10:46:16.572923 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.516228) v2 -- ?+0 0xa264c40 con 0x987af20 -9080> 2014-05-19 10:46:16.572950 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -9079> 2014-05-19 10:46:16.573171 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.516228) v2 -- ?+0 0x9ebb880 con 0x99f1080 -9078> 2014-05-19 10:46:16.573260 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -9077> 2014-05-19 10:46:16.665906 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:20.609281) v2 ==== 47+0+0 (90632967 0 0) 0x9ee3500 con 0x99d3340 -9076> 2014-05-19 10:46:16.665932 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:20.609281) v2 ==== 47+0+0 (90632967 0 0) 0x9c08700 con 0x94a5a20 -9075> 2014-05-19 10:46:16.665959 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.609281) v2 -- ?+0 0xac14700 con 0x99d3340 -9074> 2014-05-19 10:46:16.666060 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -9073> 2014-05-19 10:46:16.666376 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.609281) v2 -- ?+0 0xac08a80 con 0x94a5a20 -9072> 2014-05-19 10:46:16.666459 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -9071> 2014-05-19 10:46:16.767293 7f555a1af700 20 OSD::op_tp worker waiting -9070> 2014-05-19 10:46:16.767319 7f55579aa700 20 OSD::op_tp worker waiting -9069> 2014-05-19 10:46:16.767343 7f55551a5700 20 OSD::op_tp worker waiting -9068> 2014-05-19 10:46:16.768842 7f555a9b0700 20 OSD::op_tp worker waiting -9067> 2014-05-19 10:46:16.768868 7f55541a3700 20 OSD::op_tp worker waiting -9066> 2014-05-19 10:46:16.768889 7f55569a8700 20 OSD::op_tp worker waiting -9065> 2014-05-19 10:46:16.768913 7f555b1b1700 20 OSD::op_tp worker waiting -9064> 2014-05-19 10:46:16.768931 7f55549a4700 20 OSD::op_tp worker waiting -9063> 2014-05-19 10:46:16.768983 7f55589ac700 20 OSD::op_tp worker waiting -9062> 2014-05-19 10:46:16.770085 7f55571a9700 20 OSD::op_tp worker waiting -9061> 2014-05-19 10:46:16.770115 7f55559a6700 20 OSD::op_tp worker waiting -9060> 2014-05-19 10:46:16.770137 7f55529a0700 20 OSD::op_tp worker waiting -9059> 2014-05-19 10:46:16.770159 7f55581ab700 20 OSD::op_tp worker waiting -9058> 2014-05-19 10:46:16.770180 7f55591ad700 20 OSD::op_tp worker waiting -9057> 2014-05-19 10:46:16.770191 7f55539a2700 20 OSD::op_tp worker waiting -9056> 2014-05-19 10:46:16.770202 7f55599ae700 20 OSD::op_tp worker waiting -9055> 2014-05-19 10:46:16.770216 7f555219f700 20 OSD::op_tp worker waiting -9054> 2014-05-19 10:46:16.770234 7f555199e700 20 OSD::op_tp worker waiting -9053> 2014-05-19 10:46:16.770254 7f55561a7700 20 OSD::op_tp worker waiting -9052> 2014-05-19 10:46:16.770285 7f55531a1700 20 OSD::op_tp worker waiting -9051> 2014-05-19 10:46:16.915101 7f5566602700 5 osd.0 245 tick -9050> 2014-05-19 10:46:16.915170 7f555119d700 20 OSD::recovery_tp worker waiting -9049> 2014-05-19 10:46:16.915165 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 3.82 >= max 0.5 = no, load too high -9048> 2014-05-19 10:46:16.915197 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -9047> 2014-05-19 10:46:16.915203 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2197.45 < min (86400 seconds) -9046> 2014-05-19 10:46:16.915229 7f5566602700 20 osd.0 245 sched_scrub done -9045> 2014-05-19 10:46:16.915234 7f5566602700 10 osd.0 245 do_waiters -- start -9044> 2014-05-19 10:46:16.915238 7f5566602700 10 osd.0 245 do_waiters -- finish -9043> 2014-05-19 10:46:16.933741 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:19.539997) v2 ==== 47+0+0 (1388814209 0 0) 0x9ed01c0 con 0x996e000 -9042> 2014-05-19 10:46:16.933794 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:19.539997) v2 -- ?+0 0x9ee3500 con 0x996e000 -9041> 2014-05-19 10:46:16.933883 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -9040> 2014-05-19 10:46:16.934175 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:19.539997) v2 ==== 47+0+0 (1388814209 0 0) 0xa173340 con 0x9a0c9a0 -9039> 2014-05-19 10:46:16.934213 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:19.539997) v2 -- ?+0 0x9c08700 con 0x9a0c9a0 -9038> 2014-05-19 10:46:16.934245 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -9037> 2014-05-19 10:46:17.008670 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 30 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:20.952041) v2 ==== 47+0+0 (1570067774 0 0) 0x9b2e1c0 con 0x987b760 -9036> 2014-05-19 10:46:17.008720 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.952041) v2 -- ?+0 0x9ed01c0 con 0x987b760 -9035> 2014-05-19 10:46:17.008778 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -9034> 2014-05-19 10:46:17.008732 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 30 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:20.952041) v2 ==== 47+0+0 (1570067774 0 0) 0xac15340 con 0x94802c0 -9033> 2014-05-19 10:46:17.009045 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.952041) v2 -- ?+0 0xa173340 con 0x94802c0 -9032> 2014-05-19 10:46:17.009157 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -9031> 2014-05-19 10:46:17.109125 7f5564dff700 20 KeyValueStore::op_tp worker waiting -9030> 2014-05-19 10:46:17.347154 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:19.953419) v2 ==== 47+0+0 (670678083 0 0) 0x9fa4380 con 0x9656160 -9029> 2014-05-19 10:46:17.347207 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:19.953419) v2 -- ?+0 0x9b2e1c0 con 0x9656160 -9028> 2014-05-19 10:46:17.347244 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -9027> 2014-05-19 10:46:17.347486 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:19.953419) v2 ==== 47+0+0 (670678083 0 0) 0xa464380 con 0x9656f20 -9026> 2014-05-19 10:46:17.347532 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:19.953419) v2 -- ?+0 0xac15340 con 0x9656f20 -9025> 2014-05-19 10:46:17.347558 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -9024> 2014-05-19 10:46:17.348268 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 36 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:21.291688) v2 ==== 47+0+0 (3205020679 0 0) 0xa172e00 con 0x99718c0 -9023> 2014-05-19 10:46:17.348266 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 36 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:21.291688) v2 ==== 47+0+0 (3205020679 0 0) 0xa3db180 con 0x97431e0 -9022> 2014-05-19 10:46:17.348318 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.291688) v2 -- ?+0 0x9fa4380 con 0x99718c0 -9021> 2014-05-19 10:46:17.348343 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -9020> 2014-05-19 10:46:17.348389 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.291688) v2 -- ?+0 0xa464380 con 0x97431e0 -9019> 2014-05-19 10:46:17.348434 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -9018> 2014-05-19 10:46:17.448104 7f555019b700 20 OSD::command_tp worker waiting -9017> 2014-05-19 10:46:17.451163 7f555099c700 20 OSD::disk_tp worker waiting -9016> 2014-05-19 10:46:17.522850 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:20.129047) v2 ==== 47+0+0 (3400364511 0 0) 0xa65ac40 con 0x9b8c160 -9015> 2014-05-19 10:46:17.522901 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.129047) v2 -- ?+0 0xa172e00 con 0x9b8c160 -9014> 2014-05-19 10:46:17.522985 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -9013> 2014-05-19 10:46:17.523020 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:20.129047) v2 ==== 47+0+0 (3400364511 0 0) 0x9cb6c40 con 0x9aa3600 -9012> 2014-05-19 10:46:17.523052 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.129047) v2 -- ?+0 0xa3db180 con 0x9aa3600 -9011> 2014-05-19 10:46:17.523122 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -9010> 2014-05-19 10:46:17.589992 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:20.196186) v2 ==== 47+0+0 (4030234320 0 0) 0xa856a80 con 0x96562c0 -9009> 2014-05-19 10:46:17.590188 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.196186) v2 -- ?+0 0xa65ac40 con 0x96562c0 -9008> 2014-05-19 10:46:17.590272 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -9007> 2014-05-19 10:46:17.590001 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:20.196186) v2 ==== 47+0+0 (4030234320 0 0) 0x9cd1500 con 0x9657080 -9006> 2014-05-19 10:46:17.590296 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.196186) v2 -- ?+0 0x9cb6c40 con 0x9657080 -9005> 2014-05-19 10:46:17.590418 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -9004> 2014-05-19 10:46:17.597238 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:20.203518) v2 ==== 47+0+0 (4101302111 0 0) 0x9ed0a80 con 0x996fb80 -9003> 2014-05-19 10:46:17.597273 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:20.203518) v2 ==== 47+0+0 (4101302111 0 0) 0xa1e4fc0 con 0x9a0cdc0 -9002> 2014-05-19 10:46:17.597288 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.203518) v2 -- ?+0 0xa856a80 con 0x996fb80 -9001> 2014-05-19 10:46:17.597326 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -9000> 2014-05-19 10:46:17.597368 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.203518) v2 -- ?+0 0x9cd1500 con 0x9a0cdc0 -8999> 2014-05-19 10:46:17.597448 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -8998> 2014-05-19 10:46:17.915328 7f5566602700 5 osd.0 245 tick -8997> 2014-05-19 10:46:17.915349 7f5566602700 7 osd.0 245 do_mon_report -8996> 2014-05-19 10:46:17.915353 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 -8995> 2014-05-19 10:46:17.915357 7f5566602700 20 osd.0 245 send_pg_stats -8994> 2014-05-19 10:46:17.915366 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -8993> 2014-05-19 10:46:17.915370 7f5566602700 10 osd.0 245 do_waiters -- start -8992> 2014-05-19 10:46:17.915372 7f5566602700 10 osd.0 245 do_waiters -- finish -8991> 2014-05-19 10:46:17.915380 7f555119d700 20 OSD::recovery_tp worker waiting -8990> 2014-05-19 10:46:18.031798 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:20.638077) v2 ==== 47+0+0 (2214779032 0 0) 0x9e81dc0 con 0x95846e0 -8989> 2014-05-19 10:46:18.031878 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.638077) v2 -- ?+0 0x9ed0a80 con 0x95846e0 -8988> 2014-05-19 10:46:18.031915 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -8987> 2014-05-19 10:46:18.031814 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:20.638077) v2 ==== 47+0+0 (2214779032 0 0) 0xa3dbdc0 con 0x9983600 -8986> 2014-05-19 10:46:18.032347 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.638077) v2 -- ?+0 0xa1e4fc0 con 0x9983600 -8985> 2014-05-19 10:46:18.032378 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -8984> 2014-05-19 10:46:18.298677 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:20.904889) v2 ==== 47+0+0 (2472666040 0 0) 0x9fb4c40 con 0x7b90160 -8983> 2014-05-19 10:46:18.298728 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.904889) v2 -- ?+0 0xa3dbdc0 con 0x7b90160 -8982> 2014-05-19 10:46:18.298764 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -8981> 2014-05-19 10:46:18.298852 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:20.904889) v2 ==== 47+0+0 (2472666040 0 0) 0x9562000 con 0x9b8db80 -8980> 2014-05-19 10:46:18.298894 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.904889) v2 -- ?+0 0x9e81dc0 con 0x9b8db80 -8979> 2014-05-19 10:46:18.298978 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -8978> 2014-05-19 10:46:18.340809 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:20.947044) v2 ==== 47+0+0 (3915309479 0 0) 0xa05e000 con 0x94e2160 -8977> 2014-05-19 10:46:18.340860 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.947044) v2 -- ?+0 0x9fb4c40 con 0x94e2160 -8976> 2014-05-19 10:46:18.340898 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -8975> 2014-05-19 10:46:18.340796 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:20.947044) v2 ==== 47+0+0 (3915309479 0 0) 0xa516540 con 0x9b8de40 -8974> 2014-05-19 10:46:18.341035 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.947044) v2 -- ?+0 0x9562000 con 0x9b8de40 -8973> 2014-05-19 10:46:18.341390 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -8972> 2014-05-19 10:46:18.349522 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:20.955765) v2 ==== 47+0+0 (1458863558 0 0) 0xac17c00 con 0x9937760 -8971> 2014-05-19 10:46:18.349574 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.955765) v2 -- ?+0 0xa05e000 con 0x9937760 -8970> 2014-05-19 10:46:18.349544 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:20.955765) v2 ==== 47+0+0 (1458863558 0 0) 0x9b44700 con 0x9656000 -8969> 2014-05-19 10:46:18.349691 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -8968> 2014-05-19 10:46:18.349833 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.955765) v2 -- ?+0 0xa516540 con 0x9656000 -8967> 2014-05-19 10:46:18.349946 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -8966> 2014-05-19 10:46:18.353078 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 33 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:22.296481) v2 ==== 47+0+0 (3857296450 0 0) 0xa208fc0 con 0x97434a0 -8965> 2014-05-19 10:46:18.353146 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 33 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:22.296481) v2 ==== 47+0+0 (3857296450 0 0) 0x9b44000 con 0x9970840 -8964> 2014-05-19 10:46:18.353143 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.296481) v2 -- ?+0 0xac17c00 con 0x97434a0 -8963> 2014-05-19 10:46:18.353202 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -8962> 2014-05-19 10:46:18.353520 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.296481) v2 -- ?+0 0x9b44700 con 0x9970840 -8961> 2014-05-19 10:46:18.353564 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -8960> 2014-05-19 10:46:18.437494 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -8959> 2014-05-19 10:46:18.437515 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -8958> 2014-05-19 10:46:18.437523 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0x99e1500 con 0x9bdc840 -8957> 2014-05-19 10:46:18.437549 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xa107dc0 con 0x9ad4420 -8956> 2014-05-19 10:46:18.437589 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xa65bc00 con 0x9bf31e0 -8955> 2014-05-19 10:46:18.437603 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xa1736c0 con 0x998b340 -8954> 2014-05-19 10:46:18.437619 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xa665340 con 0x9b92840 -8953> 2014-05-19 10:46:18.437638 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xa6d4380 con 0x9ad49a0 -8952> 2014-05-19 10:46:18.437670 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0x9c6e540 con 0x7b911e0 -8951> 2014-05-19 10:46:18.437700 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xa872380 con 0x7b918c0 -8950> 2014-05-19 10:46:18.437724 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xac15dc0 con 0x9aa8c60 -8949> 2014-05-19 10:46:18.437740 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xac16fc0 con 0x9bfa000 -8948> 2014-05-19 10:46:18.437755 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0x9ffd340 con 0x7c23e40 -8947> 2014-05-19 10:46:18.437771 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xa192e00 con 0x998b760 -8946> 2014-05-19 10:46:18.437804 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xac17180 con 0x7b91080 -8945> 2014-05-19 10:46:18.437819 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0x9d20380 con 0xa28fb80 -8944> 2014-05-19 10:46:18.437834 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0x9c0f500 con 0x76bdce0 -8943> 2014-05-19 10:46:18.437858 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xa2e1340 con 0x994ab00 -8942> 2014-05-19 10:46:18.437884 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xa857a40 con 0x9ac8b00 -8941> 2014-05-19 10:46:18.437911 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0x9f428c0 con 0x938de40 -8940> 2014-05-19 10:46:18.437943 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0x9cabc00 con 0x9970b00 -8939> 2014-05-19 10:46:18.437946 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0x9fd9340 con 0x9ad4420 -8938> 2014-05-19 10:46:18.437967 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0x9fb5880 con 0x99706e0 -8937> 2014-05-19 10:46:18.438085 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xa664fc0 con 0x9bb6f20 -8936> 2014-05-19 10:46:18.438115 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xa872540 con 0x994b340 -8935> 2014-05-19 10:46:18.438133 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0x95c0380 con 0x98fa2c0 -8934> 2014-05-19 10:46:18.438162 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xa1076c0 con 0x996f8c0 -8933> 2014-05-19 10:46:18.438225 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0x9cb5340 con 0x996fa20 -8932> 2014-05-19 10:46:18.438259 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0x9ad36c0 con 0x9ac8160 -8931> 2014-05-19 10:46:18.438287 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0x97d28c0 con 0x7b90420 -8930> 2014-05-19 10:46:18.438327 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0x9c58fc0 con 0x919fe40 -8929> 2014-05-19 10:46:18.438356 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0x9c0efc0 con 0x9971760 -8928> 2014-05-19 10:46:18.438373 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xa645c00 con 0x994af20 -8927> 2014-05-19 10:46:18.438399 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xac15c00 con 0x989be40 -8926> 2014-05-19 10:46:18.438428 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xac16e00 con 0x9adf4a0 -8925> 2014-05-19 10:46:18.438459 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0x9f43a40 con 0x9776160 -8924> 2014-05-19 10:46:18.438489 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xa0bac40 con 0x96bd8c0 -8923> 2014-05-19 10:46:18.438525 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xa2df340 con 0x96bcdc0 -8922> 2014-05-19 10:46:18.438564 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0x9f74e00 con 0x96954a0 -8921> 2014-05-19 10:46:18.438592 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xa208700 con 0x76bd8c0 -8920> 2014-05-19 10:46:18.438623 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0x9fecfc0 con 0x7b90dc0 -8919> 2014-05-19 10:46:18.438653 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0x9ffc000 con 0x978d8c0 -8918> 2014-05-19 10:46:18.438685 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xac176c0 con 0x978c580 -8917> 2014-05-19 10:46:18.438709 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0x9b501c0 con 0x978d340 -8916> 2014-05-19 10:46:18.438725 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:18.437521) v2 -- ?+0 0xa618700 con 0x96374a0 -8915> 2014-05-19 10:46:18.438761 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -8914> 2014-05-19 10:46:18.438792 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xac15a40 con 0x998b340 -8913> 2014-05-19 10:46:18.438832 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -8912> 2014-05-19 10:46:18.438846 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa2e0540 con 0x9b92840 -8911> 2014-05-19 10:46:18.438866 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -8910> 2014-05-19 10:46:18.438872 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0x9ed0540 con 0x9ad49a0 -8909> 2014-05-19 10:46:18.438886 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -8908> 2014-05-19 10:46:18.438903 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0x9d3c380 con 0x7b911e0 -8907> 2014-05-19 10:46:18.438921 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -8906> 2014-05-19 10:46:18.438929 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa619500 con 0x7b918c0 -8905> 2014-05-19 10:46:18.438944 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -8904> 2014-05-19 10:46:18.438958 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa6d5c00 con 0x9aa8c60 -8903> 2014-05-19 10:46:18.438977 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -8902> 2014-05-19 10:46:18.438984 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa872700 con 0x9bfa000 -8901> 2014-05-19 10:46:18.439073 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -8900> 2014-05-19 10:46:18.439082 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0x951c1c0 con 0x7c23e40 -8899> 2014-05-19 10:46:18.439100 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -8898> 2014-05-19 10:46:18.439108 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa45e700 con 0x998b760 -8897> 2014-05-19 10:46:18.439122 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -8896> 2014-05-19 10:46:18.439129 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa872000 con 0x7b91080 -8895> 2014-05-19 10:46:18.439155 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -8894> 2014-05-19 10:46:18.439162 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0x9388e00 con 0xa28fb80 -8893> 2014-05-19 10:46:18.439177 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -8892> 2014-05-19 10:46:18.439191 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa74aa80 con 0x76bdce0 -8891> 2014-05-19 10:46:18.439206 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -8890> 2014-05-19 10:46:18.439211 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0x99fce00 con 0x994ab00 -8889> 2014-05-19 10:46:18.439225 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -8888> 2014-05-19 10:46:18.439239 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa264a80 con 0x9ac8b00 -8887> 2014-05-19 10:46:18.439258 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -8886> 2014-05-19 10:46:18.439263 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa856c40 con 0x938de40 -8885> 2014-05-19 10:46:18.439277 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -8884> 2014-05-19 10:46:18.439285 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa6abdc0 con 0x9970b00 -8883> 2014-05-19 10:46:18.439299 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -8882> 2014-05-19 10:46:18.439303 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa506700 con 0x99706e0 -8881> 2014-05-19 10:46:18.439320 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -8880> 2014-05-19 10:46:18.439327 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0x9ed2540 con 0x9bb6f20 -8879> 2014-05-19 10:46:18.439344 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -8878> 2014-05-19 10:46:18.439351 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa2661c0 con 0x994b340 -8877> 2014-05-19 10:46:18.439365 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -8876> 2014-05-19 10:46:18.439371 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa1e5c00 con 0x98fa2c0 -8875> 2014-05-19 10:46:18.439388 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -8874> 2014-05-19 10:46:18.439393 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa4a8000 con 0x996f8c0 -8873> 2014-05-19 10:46:18.439409 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -8872> 2014-05-19 10:46:18.439418 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa0ea000 con 0x996fa20 -8871> 2014-05-19 10:46:18.439435 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -8870> 2014-05-19 10:46:18.439442 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa516700 con 0x9ac8160 -8869> 2014-05-19 10:46:18.439456 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -8868> 2014-05-19 10:46:18.439464 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 36 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa236540 con 0x7b90420 -8867> 2014-05-19 10:46:18.439478 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -8866> 2014-05-19 10:46:18.439485 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 36 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa45e1c0 con 0x919fe40 -8865> 2014-05-19 10:46:18.439500 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -8864> 2014-05-19 10:46:18.439507 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 35 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa665a40 con 0x9971760 -8863> 2014-05-19 10:46:18.439522 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -8862> 2014-05-19 10:46:18.439529 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 35 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa507180 con 0x994af20 -8861> 2014-05-19 10:46:18.439543 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -8860> 2014-05-19 10:46:18.439550 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 33 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0x9ad2000 con 0x989be40 -8859> 2014-05-19 10:46:18.439564 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -8858> 2014-05-19 10:46:18.439571 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 33 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0x97c2c40 con 0x9adf4a0 -8857> 2014-05-19 10:46:18.439585 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -8856> 2014-05-19 10:46:18.439593 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 33 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa030fc0 con 0x9776160 -8855> 2014-05-19 10:46:18.439613 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -8854> 2014-05-19 10:46:18.439620 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 33 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa092c40 con 0x96bd8c0 -8853> 2014-05-19 10:46:18.439634 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -8852> 2014-05-19 10:46:18.439641 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 32 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa5fc1c0 con 0x96bcdc0 -8851> 2014-05-19 10:46:18.439656 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -8850> 2014-05-19 10:46:18.439663 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 32 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa447c00 con 0x96954a0 -8849> 2014-05-19 10:46:18.439677 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -8848> 2014-05-19 10:46:18.439684 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 31 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0x9b50000 con 0x76bd8c0 -8847> 2014-05-19 10:46:18.439698 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -8846> 2014-05-19 10:46:18.439705 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 31 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0x9236380 con 0x7b90dc0 -8845> 2014-05-19 10:46:18.439719 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -8844> 2014-05-19 10:46:18.439728 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 30 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xac1aa80 con 0x978d8c0 -8843> 2014-05-19 10:46:18.439746 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -8842> 2014-05-19 10:46:18.439753 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 30 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xac1b880 con 0x978c580 -8841> 2014-05-19 10:46:18.439767 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -8840> 2014-05-19 10:46:18.439776 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 29 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xac17dc0 con 0x978d340 -8839> 2014-05-19 10:46:18.439794 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -8838> 2014-05-19 10:46:18.439801 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 29 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa3dbdc0 con 0x96374a0 -8837> 2014-05-19 10:46:18.439815 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -8836> 2014-05-19 10:46:18.439820 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xa2bc380 con 0x9bdc840 -8835> 2014-05-19 10:46:18.439834 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -8834> 2014-05-19 10:46:18.439842 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:18.437521) v2 ==== 47+0+0 (2355118936 0 0) 0xac16c40 con 0x9bf31e0 -8833> 2014-05-19 10:46:18.439859 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -8832> 2014-05-19 10:46:18.525802 7f5565600700 20 KeyValueStore::op_tp worker waiting -8831> 2014-05-19 10:46:18.767395 7f555a1af700 20 OSD::op_tp worker waiting -8830> 2014-05-19 10:46:18.767433 7f55551a5700 20 OSD::op_tp worker waiting -8829> 2014-05-19 10:46:18.767451 7f55579aa700 20 OSD::op_tp worker waiting -8828> 2014-05-19 10:46:18.768934 7f555a9b0700 20 OSD::op_tp worker waiting -8827> 2014-05-19 10:46:18.768952 7f55541a3700 20 OSD::op_tp worker waiting -8826> 2014-05-19 10:46:18.768978 7f555b1b1700 20 OSD::op_tp worker waiting -8825> 2014-05-19 10:46:18.768999 7f55569a8700 20 OSD::op_tp worker waiting -8824> 2014-05-19 10:46:18.769030 7f55549a4700 20 OSD::op_tp worker waiting -8823> 2014-05-19 10:46:18.769057 7f55589ac700 20 OSD::op_tp worker waiting -8822> 2014-05-19 10:46:18.770187 7f55571a9700 20 OSD::op_tp worker waiting -8821> 2014-05-19 10:46:18.770210 7f55559a6700 20 OSD::op_tp worker waiting -8820> 2014-05-19 10:46:18.770231 7f55529a0700 20 OSD::op_tp worker waiting -8819> 2014-05-19 10:46:18.770254 7f55581ab700 20 OSD::op_tp worker waiting -8818> 2014-05-19 10:46:18.770270 7f55591ad700 20 OSD::op_tp worker waiting -8817> 2014-05-19 10:46:18.770285 7f55599ae700 20 OSD::op_tp worker waiting -8816> 2014-05-19 10:46:18.770303 7f55539a2700 20 OSD::op_tp worker waiting -8815> 2014-05-19 10:46:18.770313 7f555219f700 20 OSD::op_tp worker waiting -8814> 2014-05-19 10:46:18.770333 7f55561a7700 20 OSD::op_tp worker waiting -8813> 2014-05-19 10:46:18.770348 7f55531a1700 20 OSD::op_tp worker waiting -8812> 2014-05-19 10:46:18.770357 7f555199e700 20 OSD::op_tp worker waiting -8811> 2014-05-19 10:46:18.866148 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:22.809588) v2 ==== 47+0+0 (2827993659 0 0) 0x9c0e380 con 0x99d31e0 -8810> 2014-05-19 10:46:18.866236 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.809588) v2 -- ?+0 0x9b44000 con 0x99d31e0 -8809> 2014-05-19 10:46:18.866133 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:22.809588) v2 ==== 47+0+0 (2827993659 0 0) 0xa102000 con 0x95142c0 -8808> 2014-05-19 10:46:18.866345 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -8807> 2014-05-19 10:46:18.866441 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.809588) v2 -- ?+0 0xa208fc0 con 0x95142c0 -8806> 2014-05-19 10:46:18.866522 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -8805> 2014-05-19 10:46:18.896785 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:22.840245) v2 ==== 47+0+0 (1456898025 0 0) 0x9c09500 con 0x966e000 -8804> 2014-05-19 10:46:18.896804 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:22.840245) v2 ==== 47+0+0 (1456898025 0 0) 0xac096c0 con 0x9743600 -8803> 2014-05-19 10:46:18.896917 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.840245) v2 -- ?+0 0x9c0e380 con 0x966e000 -8802> 2014-05-19 10:46:18.896961 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -8801> 2014-05-19 10:46:18.897047 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.840245) v2 -- ?+0 0xa102000 con 0x9743600 -8800> 2014-05-19 10:46:18.897083 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -8799> 2014-05-19 10:46:18.915435 7f5566602700 5 osd.0 245 tick -8798> 2014-05-19 10:46:18.915465 7f555119d700 20 OSD::recovery_tp worker waiting -8797> 2014-05-19 10:46:18.915495 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 3.82 >= max 0.5 = no, load too high -8796> 2014-05-19 10:46:18.915526 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -8795> 2014-05-19 10:46:18.915532 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2199.45 < min (86400 seconds) -8794> 2014-05-19 10:46:18.915557 7f5566602700 20 osd.0 245 sched_scrub done -8793> 2014-05-19 10:46:18.915562 7f5566602700 10 osd.0 245 do_waiters -- start -8792> 2014-05-19 10:46:18.915566 7f5566602700 10 osd.0 245 do_waiters -- finish -8791> 2014-05-19 10:46:18.983504 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 35 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:22.927011) v2 ==== 47+0+0 (3443461001 0 0) 0xa23e000 con 0x9bb7b80 -8790> 2014-05-19 10:46:18.983730 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 35 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:22.927011) v2 ==== 47+0+0 (3443461001 0 0) 0xa2e0fc0 con 0x95151e0 -8789> 2014-05-19 10:46:18.983558 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.927011) v2 -- ?+0 0x9c09500 con 0x9bb7b80 -8788> 2014-05-19 10:46:18.984084 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -8787> 2014-05-19 10:46:18.984162 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.927011) v2 -- ?+0 0xac096c0 con 0x95151e0 -8786> 2014-05-19 10:46:18.984198 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -8785> 2014-05-19 10:46:19.109222 7f5564dff700 20 KeyValueStore::op_tp worker waiting -8784> 2014-05-19 10:46:19.398153 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:23.341605) v2 ==== 47+0+0 (659124901 0 0) 0xac09c00 con 0x9743600 -8783> 2014-05-19 10:46:19.398201 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.341605) v2 -- ?+0 0xa2e0fc0 con 0x9743600 -8782> 2014-05-19 10:46:19.398418 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -8781> 2014-05-19 10:46:19.398695 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:23.341605) v2 ==== 47+0+0 (659124901 0 0) 0x9c09dc0 con 0x966e000 -8780> 2014-05-19 10:46:19.398741 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.341605) v2 -- ?+0 0xa23e000 con 0x966e000 -8779> 2014-05-19 10:46:19.398773 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -8778> 2014-05-19 10:46:19.399880 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:22.006146) v2 ==== 47+0+0 (127579077 0 0) 0xa0dcc40 con 0x7b90160 -8777> 2014-05-19 10:46:19.399938 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.006146) v2 -- ?+0 0xac09c00 con 0x7b90160 -8776> 2014-05-19 10:46:19.399999 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -8775> 2014-05-19 10:46:19.399852 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:22.006146) v2 ==== 47+0+0 (127579077 0 0) 0x9b441c0 con 0x9b8db80 -8774> 2014-05-19 10:46:19.400014 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.006146) v2 -- ?+0 0x9c09dc0 con 0x9b8db80 -8773> 2014-05-19 10:46:19.400047 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -8772> 2014-05-19 10:46:19.448185 7f555019b700 20 OSD::command_tp worker waiting -8771> 2014-05-19 10:46:19.451055 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:22.057364) v2 ==== 47+0+0 (3963349782 0 0) 0x9b44380 con 0x9656000 -8770> 2014-05-19 10:46:19.451108 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.057364) v2 -- ?+0 0x9b441c0 con 0x9656000 -8769> 2014-05-19 10:46:19.451187 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -8768> 2014-05-19 10:46:19.451189 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:22.057364) v2 ==== 47+0+0 (3963349782 0 0) 0xac17a40 con 0x9937760 -8767> 2014-05-19 10:46:19.451236 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.057364) v2 -- ?+0 0xa0dcc40 con 0x9937760 -8766> 2014-05-19 10:46:19.451265 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -8765> 2014-05-19 10:46:19.451443 7f555099c700 20 OSD::disk_tp worker waiting -8764> 2014-05-19 10:46:19.648594 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:22.254839) v2 ==== 47+0+0 (1688807783 0 0) 0x9fd88c0 con 0x9656160 -8763> 2014-05-19 10:46:19.648666 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.254839) v2 -- ?+0 0x9b44380 con 0x9656160 -8762> 2014-05-19 10:46:19.648702 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -8761> 2014-05-19 10:46:19.648876 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:22.254839) v2 ==== 47+0+0 (1688807783 0 0) 0xa1ef880 con 0x9656f20 -8760> 2014-05-19 10:46:19.648921 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.254839) v2 -- ?+0 0xac17a40 con 0x9656f20 -8759> 2014-05-19 10:46:19.648997 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -8758> 2014-05-19 10:46:19.704120 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:23.647655) v2 ==== 47+0+0 (1704253529 0 0) 0xa4ee540 con 0x987b340 -8757> 2014-05-19 10:46:19.704177 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:23.647655) v2 ==== 47+0+0 (1704253529 0 0) 0xa856700 con 0x94e26e0 -8756> 2014-05-19 10:46:19.704200 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.647655) v2 -- ?+0 0x9fd88c0 con 0x987b340 -8755> 2014-05-19 10:46:19.704316 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -8754> 2014-05-19 10:46:19.704553 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.647655) v2 -- ?+0 0xa1ef880 con 0x94e26e0 -8753> 2014-05-19 10:46:19.704594 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -8752> 2014-05-19 10:46:19.787023 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:23.730497) v2 ==== 47+0+0 (1551623798 0 0) 0xac14fc0 con 0x94e3e40 -8751> 2014-05-19 10:46:19.787062 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.730497) v2 -- ?+0 0xa856700 con 0x94e3e40 -8750> 2014-05-19 10:46:19.787119 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -8749> 2014-05-19 10:46:19.787081 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:23.730497) v2 ==== 47+0+0 (1551623798 0 0) 0xa0ea540 con 0x9bb69a0 -8748> 2014-05-19 10:46:19.787185 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.730497) v2 -- ?+0 0xa4ee540 con 0x9bb69a0 -8747> 2014-05-19 10:46:19.787220 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -8746> 2014-05-19 10:46:19.915646 7f5566602700 5 osd.0 245 tick -8745> 2014-05-19 10:46:19.915670 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -8744> 2014-05-19 10:46:19.915675 7f5566602700 10 osd.0 245 do_waiters -- start -8743> 2014-05-19 10:46:19.915677 7f5566602700 10 osd.0 245 do_waiters -- finish -8742> 2014-05-19 10:46:19.915715 7f555119d700 20 OSD::recovery_tp worker waiting -8741> 2014-05-19 10:46:20.074197 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 33 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:24.017622) v2 ==== 47+0+0 (3625425203 0 0) 0xa0cb340 con 0x99f1080 -8740> 2014-05-19 10:46:20.074561 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:24.017622) v2 -- ?+0 0xac14fc0 con 0x99f1080 -8739> 2014-05-19 10:46:20.074610 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 33 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:24.017622) v2 ==== 47+0+0 (3625425203 0 0) 0xac14540 con 0x987af20 -8738> 2014-05-19 10:46:20.074641 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -8737> 2014-05-19 10:46:20.074685 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:24.017622) v2 -- ?+0 0xa0ea540 con 0x987af20 -8736> 2014-05-19 10:46:20.074729 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -8735> 2014-05-19 10:46:20.288326 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:24.231837) v2 ==== 47+0+0 (991763964 0 0) 0xac14e00 con 0x94e3e40 -8734> 2014-05-19 10:46:20.288373 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:24.231837) v2 -- ?+0 0xa0cb340 con 0x94e3e40 -8733> 2014-05-19 10:46:20.288380 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:24.231837) v2 ==== 47+0+0 (991763964 0 0) 0xa4a96c0 con 0x9bb69a0 -8732> 2014-05-19 10:46:20.288461 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -8731> 2014-05-19 10:46:20.288543 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:24.231837) v2 -- ?+0 0xac14540 con 0x9bb69a0 -8730> 2014-05-19 10:46:20.288578 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -8729> 2014-05-19 10:46:20.428478 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:23.034692) v2 ==== 47+0+0 (1274654770 0 0) 0xa464540 con 0x9656420 -8728> 2014-05-19 10:46:20.428520 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.034692) v2 -- ?+0 0xa4a96c0 con 0x9656420 -8727> 2014-05-19 10:46:20.428605 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -8726> 2014-05-19 10:46:20.428481 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:23.034692) v2 ==== 47+0+0 (1274654770 0 0) 0x9d3d880 con 0x96571e0 -8725> 2014-05-19 10:46:20.428912 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.034692) v2 -- ?+0 0xac14e00 con 0x96571e0 -8724> 2014-05-19 10:46:20.429003 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -8723> 2014-05-19 10:46:20.525893 7f5565600700 20 KeyValueStore::op_tp worker waiting -8722> 2014-05-19 10:46:20.738872 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -8721> 2014-05-19 10:46:20.738894 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -8720> 2014-05-19 10:46:20.738903 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0x99fce00 con 0x9bdc840 -8719> 2014-05-19 10:46:20.738929 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa74aa80 con 0x9ad4420 -8718> 2014-05-19 10:46:20.738968 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0x9388e00 con 0x9bf31e0 -8717> 2014-05-19 10:46:20.738984 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa872000 con 0x998b340 -8716> 2014-05-19 10:46:20.738999 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa45e700 con 0x9b92840 -8715> 2014-05-19 10:46:20.739026 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0x951c1c0 con 0x9ad49a0 -8714> 2014-05-19 10:46:20.739067 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa872700 con 0x7b911e0 -8713> 2014-05-19 10:46:20.739096 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa6d5c00 con 0x7b918c0 -8712> 2014-05-19 10:46:20.739128 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa619500 con 0x9aa8c60 -8711> 2014-05-19 10:46:20.739154 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0x9d3c380 con 0x9bfa000 -8710> 2014-05-19 10:46:20.739204 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0x9ed0540 con 0x7c23e40 -8709> 2014-05-19 10:46:20.739225 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa2e0540 con 0x998b760 -8708> 2014-05-19 10:46:20.739230 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa4dea80 con 0x9bdc840 -8707> 2014-05-19 10:46:20.739251 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xac15a40 con 0x7b91080 -8706> 2014-05-19 10:46:20.739280 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0x9fd9340 con 0xa28fb80 -8705> 2014-05-19 10:46:20.739301 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa2de700 con 0x76bdce0 -8704> 2014-05-19 10:46:20.739326 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa267500 con 0x994ab00 -8703> 2014-05-19 10:46:20.739351 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xac1ba40 con 0x9ac8b00 -8702> 2014-05-19 10:46:20.739377 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xac1ac40 con 0x938de40 -8701> 2014-05-19 10:46:20.739403 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa2df180 con 0x9970b00 -8700> 2014-05-19 10:46:20.739428 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xac17500 con 0x99706e0 -8699> 2014-05-19 10:46:20.739456 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa6ab340 con 0x9bb6f20 -8698> 2014-05-19 10:46:20.739471 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0x9455500 con 0x994b340 -8697> 2014-05-19 10:46:20.739503 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa6d5a40 con 0x98fa2c0 -8696> 2014-05-19 10:46:20.739529 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa36c700 con 0x996f8c0 -8695> 2014-05-19 10:46:20.739557 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0x9b50a80 con 0x996fa20 -8694> 2014-05-19 10:46:20.739584 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0x9ad2700 con 0x9ac8160 -8693> 2014-05-19 10:46:20.739611 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa162a80 con 0x7b90420 -8692> 2014-05-19 10:46:20.739637 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0x9236e00 con 0x919fe40 -8691> 2014-05-19 10:46:20.739657 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0x9ed0000 con 0x9971760 -8690> 2014-05-19 10:46:20.739671 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa237dc0 con 0x994af20 -8689> 2014-05-19 10:46:20.739693 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa28d180 con 0x989be40 -8688> 2014-05-19 10:46:20.739720 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0x951c380 con 0x9adf4a0 -8687> 2014-05-19 10:46:20.739749 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0x9b51dc0 con 0x9776160 -8686> 2014-05-19 10:46:20.739775 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa2dee00 con 0x96bd8c0 -8685> 2014-05-19 10:46:20.739799 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa446700 con 0x96bcdc0 -8684> 2014-05-19 10:46:20.739824 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa05ee00 con 0x96954a0 -8683> 2014-05-19 10:46:20.739854 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa0ba1c0 con 0x76bd8c0 -8682> 2014-05-19 10:46:20.739885 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0x9fece00 con 0x7b90dc0 -8681> 2014-05-19 10:46:20.739932 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0x92a16c0 con 0x978d8c0 -8680> 2014-05-19 10:46:20.739956 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa4ee8c0 con 0x978c580 -8679> 2014-05-19 10:46:20.739970 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0xa2421c0 con 0x978d340 -8678> 2014-05-19 10:46:20.739985 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:20.738901) v2 -- ?+0 0x9e101c0 con 0x96374a0 -8677> 2014-05-19 10:46:20.740027 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -8676> 2014-05-19 10:46:20.740048 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0x9ebbdc0 con 0x9ad4420 -8675> 2014-05-19 10:46:20.740091 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -8674> 2014-05-19 10:46:20.740100 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xac16a80 con 0x9bf31e0 -8673> 2014-05-19 10:46:20.740145 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -8672> 2014-05-19 10:46:20.740164 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xac15880 con 0x998b340 -8671> 2014-05-19 10:46:20.740185 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -8670> 2014-05-19 10:46:20.740207 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa23f340 con 0x9b92840 -8669> 2014-05-19 10:46:20.740226 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -8668> 2014-05-19 10:46:20.740261 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa65b880 con 0x9ad49a0 -8667> 2014-05-19 10:46:20.740298 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -8666> 2014-05-19 10:46:20.740309 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa242380 con 0x7b911e0 -8665> 2014-05-19 10:46:20.740328 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -8664> 2014-05-19 10:46:20.740333 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0x96befc0 con 0x7b918c0 -8663> 2014-05-19 10:46:20.740359 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -8662> 2014-05-19 10:46:20.740370 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa6d5dc0 con 0x9aa8c60 -8661> 2014-05-19 10:46:20.740398 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -8660> 2014-05-19 10:46:20.740408 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0x94641c0 con 0x9bfa000 -8659> 2014-05-19 10:46:20.740425 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -8658> 2014-05-19 10:46:20.740432 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0x9464000 con 0x7c23e40 -8657> 2014-05-19 10:46:20.740451 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -8656> 2014-05-19 10:46:20.740461 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0x9e77dc0 con 0x998b760 -8655> 2014-05-19 10:46:20.740478 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -8654> 2014-05-19 10:46:20.740492 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0x9d0aa80 con 0x7b91080 -8653> 2014-05-19 10:46:20.740554 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -8652> 2014-05-19 10:46:20.740564 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa236700 con 0xa28fb80 -8651> 2014-05-19 10:46:20.740581 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -8650> 2014-05-19 10:46:20.740586 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa664e00 con 0x76bdce0 -8649> 2014-05-19 10:46:20.740600 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -8648> 2014-05-19 10:46:20.740606 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa172000 con 0x994ab00 -8647> 2014-05-19 10:46:20.740623 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -8646> 2014-05-19 10:46:20.740633 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa243340 con 0x9ac8b00 -8645> 2014-05-19 10:46:20.740652 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -8644> 2014-05-19 10:46:20.740658 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0x9ba5880 con 0x938de40 -8643> 2014-05-19 10:46:20.740671 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -8642> 2014-05-19 10:46:20.740676 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa23e8c0 con 0x9970b00 -8641> 2014-05-19 10:46:20.740689 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -8640> 2014-05-19 10:46:20.740698 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa506380 con 0x99706e0 -8639> 2014-05-19 10:46:20.740712 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -8638> 2014-05-19 10:46:20.740721 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0x9547a40 con 0x9bb6f20 -8637> 2014-05-19 10:46:20.740737 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -8636> 2014-05-19 10:46:20.740741 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa6641c0 con 0x994b340 -8635> 2014-05-19 10:46:20.740755 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -8634> 2014-05-19 10:46:20.740763 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0x9c6fa40 con 0x98fa2c0 -8633> 2014-05-19 10:46:20.740777 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -8632> 2014-05-19 10:46:20.740785 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa103180 con 0x996f8c0 -8631> 2014-05-19 10:46:20.740799 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -8630> 2014-05-19 10:46:20.740806 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa44ca80 con 0x996fa20 -8629> 2014-05-19 10:46:20.740830 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -8628> 2014-05-19 10:46:20.740842 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa517880 con 0x9ac8160 -8627> 2014-05-19 10:46:20.740868 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -8626> 2014-05-19 10:46:20.740877 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa619500 con 0x7b90420 -8625> 2014-05-19 10:46:20.740893 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -8624> 2014-05-19 10:46:20.740901 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa864a80 con 0x919fe40 -8623> 2014-05-19 10:46:20.740918 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -8622> 2014-05-19 10:46:20.740927 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 36 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa0b68c0 con 0x9971760 -8621> 2014-05-19 10:46:20.740943 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -8620> 2014-05-19 10:46:20.740951 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 36 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa74ba40 con 0x994af20 -8619> 2014-05-19 10:46:20.740964 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -8618> 2014-05-19 10:46:20.740972 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 34 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa266fc0 con 0x989be40 -8617> 2014-05-19 10:46:20.740997 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -8616> 2014-05-19 10:46:20.741012 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 34 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa0bda40 con 0x9adf4a0 -8615> 2014-05-19 10:46:20.741033 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -8614> 2014-05-19 10:46:20.741041 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 34 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa7d5a40 con 0x9776160 -8613> 2014-05-19 10:46:20.741059 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -8612> 2014-05-19 10:46:20.741068 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 34 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0x9fd8700 con 0x96bd8c0 -8611> 2014-05-19 10:46:20.741082 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -8610> 2014-05-19 10:46:20.741087 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 33 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0x9209500 con 0x96bcdc0 -8609> 2014-05-19 10:46:20.741101 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -8608> 2014-05-19 10:46:20.741131 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 33 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa114e00 con 0x96954a0 -8607> 2014-05-19 10:46:20.741161 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -8606> 2014-05-19 10:46:20.741176 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 32 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa3dba40 con 0x76bd8c0 -8605> 2014-05-19 10:46:20.741195 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -8604> 2014-05-19 10:46:20.741203 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 32 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xa4ff340 con 0x7b90dc0 -8603> 2014-05-19 10:46:20.741217 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -8602> 2014-05-19 10:46:20.741224 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 31 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xac1a8c0 con 0x978d8c0 -8601> 2014-05-19 10:46:20.741238 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -8600> 2014-05-19 10:46:20.741245 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 31 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0xac1b6c0 con 0x978c580 -8599> 2014-05-19 10:46:20.741259 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -8598> 2014-05-19 10:46:20.741266 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 30 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0x97c3880 con 0x978d340 -8597> 2014-05-19 10:46:20.741280 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -8596> 2014-05-19 10:46:20.741287 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 30 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:20.738901) v2 ==== 47+0+0 (1437252239 0 0) 0x9e81dc0 con 0x96374a0 -8595> 2014-05-19 10:46:20.741301 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -8594> 2014-05-19 10:46:20.767492 7f555a1af700 20 OSD::op_tp worker waiting -8593> 2014-05-19 10:46:20.767513 7f55551a5700 20 OSD::op_tp worker waiting -8592> 2014-05-19 10:46:20.767528 7f55579aa700 20 OSD::op_tp worker waiting -8591> 2014-05-19 10:46:20.769037 7f55541a3700 20 OSD::op_tp worker waiting -8590> 2014-05-19 10:46:20.769063 7f555a9b0700 20 OSD::op_tp worker waiting -8589> 2014-05-19 10:46:20.769087 7f555b1b1700 20 OSD::op_tp worker waiting -8588> 2014-05-19 10:46:20.769117 7f55569a8700 20 OSD::op_tp worker waiting -8587> 2014-05-19 10:46:20.769135 7f55589ac700 20 OSD::op_tp worker waiting -8586> 2014-05-19 10:46:20.769157 7f55549a4700 20 OSD::op_tp worker waiting -8585> 2014-05-19 10:46:20.770259 7f55571a9700 20 OSD::op_tp worker waiting -8584> 2014-05-19 10:46:20.770289 7f55559a6700 20 OSD::op_tp worker waiting -8583> 2014-05-19 10:46:20.770320 7f55581ab700 20 OSD::op_tp worker waiting -8582> 2014-05-19 10:46:20.770338 7f55529a0700 20 OSD::op_tp worker waiting -8581> 2014-05-19 10:46:20.770356 7f55599ae700 20 OSD::op_tp worker waiting -8580> 2014-05-19 10:46:20.770379 7f555219f700 20 OSD::op_tp worker waiting -8579> 2014-05-19 10:46:20.770395 7f55539a2700 20 OSD::op_tp worker waiting -8578> 2014-05-19 10:46:20.770408 7f55561a7700 20 OSD::op_tp worker waiting -8577> 2014-05-19 10:46:20.770428 7f555199e700 20 OSD::op_tp worker waiting -8576> 2014-05-19 10:46:20.770456 7f55591ad700 20 OSD::op_tp worker waiting -8575> 2014-05-19 10:46:20.770489 7f55531a1700 20 OSD::op_tp worker waiting -8574> 2014-05-19 10:46:20.915746 7f5566602700 5 osd.0 245 tick -8573> 2014-05-19 10:46:20.915770 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -8572> 2014-05-19 10:46:20.915775 7f5566602700 10 osd.0 245 do_waiters -- start -8571> 2014-05-19 10:46:20.915777 7f5566602700 10 osd.0 245 do_waiters -- finish -8570> 2014-05-19 10:46:20.915817 7f555119d700 20 OSD::recovery_tp worker waiting -8569> 2014-05-19 10:46:21.024563 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:23.630532) v2 ==== 47+0+0 (4207631802 0 0) 0x9cb7880 con 0x9aa3600 -8568> 2014-05-19 10:46:21.024608 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.630532) v2 -- ?+0 0x9d3d880 con 0x9aa3600 -8567> 2014-05-19 10:46:21.024702 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -8566> 2014-05-19 10:46:21.024604 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:23.630532) v2 ==== 47+0+0 (4207631802 0 0) 0x9ba56c0 con 0x9b8c160 -8565> 2014-05-19 10:46:21.024740 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.630532) v2 -- ?+0 0xa464540 con 0x9b8c160 -8564> 2014-05-19 10:46:21.024819 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -8563> 2014-05-19 10:46:21.109313 7f5564dff700 20 KeyValueStore::op_tp worker waiting -8562> 2014-05-19 10:46:21.240123 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -8561> 2014-05-19 10:46:21.240144 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -8560> 2014-05-19 10:46:21.240153 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0x9ef4540 con 0x9bdc840 -8559> 2014-05-19 10:46:21.240178 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa1e41c0 con 0x9ad4420 -8558> 2014-05-19 10:46:21.240217 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa6441c0 con 0x9bf31e0 -8557> 2014-05-19 10:46:21.240231 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0x9c08380 con 0x998b340 -8556> 2014-05-19 10:46:21.240246 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa05e8c0 con 0x9b92840 -8555> 2014-05-19 10:46:21.240273 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0x9d22540 con 0x9ad49a0 -8554> 2014-05-19 10:46:21.240309 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa74a380 con 0x7b911e0 -8553> 2014-05-19 10:46:21.240335 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0x9b2e380 con 0x7b918c0 -8552> 2014-05-19 10:46:21.240371 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa4ee380 con 0x9aa8c60 -8551> 2014-05-19 10:46:21.240399 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa6aae00 con 0x9bfa000 -8550> 2014-05-19 10:46:21.240456 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0x9d52380 con 0x7c23e40 -8549> 2014-05-19 10:46:21.240486 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0x95e7180 con 0x998b760 -8548> 2014-05-19 10:46:21.240518 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0x9ba48c0 con 0x7b91080 -8547> 2014-05-19 10:46:21.240546 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xac08000 con 0xa28fb80 -8546> 2014-05-19 10:46:21.240579 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa618a80 con 0x76bdce0 -8545> 2014-05-19 10:46:21.240579 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xa4dee00 con 0x9bdc840 -8544> 2014-05-19 10:46:21.240626 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0x9e9f340 con 0x994ab00 -8543> 2014-05-19 10:46:21.240657 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa1efa40 con 0x9ac8b00 -8542> 2014-05-19 10:46:21.240677 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0x9cd08c0 con 0x938de40 -8541> 2014-05-19 10:46:21.240720 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa4fe1c0 con 0x9970b00 -8540> 2014-05-19 10:46:21.240754 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa517340 con 0x99706e0 -8539> 2014-05-19 10:46:21.240785 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0x96be700 con 0x9bb6f20 -8538> 2014-05-19 10:46:21.240803 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa873340 con 0x994b340 -8537> 2014-05-19 10:46:21.240822 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa114e00 con 0x98fa2c0 -8536> 2014-05-19 10:46:21.240850 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0x9209500 con 0x996f8c0 -8535> 2014-05-19 10:46:21.240882 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0x9fd8700 con 0x996fa20 -8534> 2014-05-19 10:46:21.240907 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa7d5a40 con 0x9ac8160 -8533> 2014-05-19 10:46:21.240923 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa0bda40 con 0x7b90420 -8532> 2014-05-19 10:46:21.240937 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa266fc0 con 0x919fe40 -8531> 2014-05-19 10:46:21.240960 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa74ba40 con 0x9971760 -8530> 2014-05-19 10:46:21.240989 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa0b68c0 con 0x994af20 -8529> 2014-05-19 10:46:21.241020 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa864a80 con 0x989be40 -8528> 2014-05-19 10:46:21.241053 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa619500 con 0x9adf4a0 -8527> 2014-05-19 10:46:21.241074 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa517880 con 0x9776160 -8526> 2014-05-19 10:46:21.241098 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa44ca80 con 0x96bd8c0 -8525> 2014-05-19 10:46:21.241150 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa103180 con 0x96bcdc0 -8524> 2014-05-19 10:46:21.241194 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0x9c6fa40 con 0x96954a0 -8523> 2014-05-19 10:46:21.241221 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa6641c0 con 0x76bd8c0 -8522> 2014-05-19 10:46:21.241248 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0x9547a40 con 0x7b90dc0 -8521> 2014-05-19 10:46:21.241277 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa506380 con 0x978d8c0 -8520> 2014-05-19 10:46:21.241308 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa23e8c0 con 0x978c580 -8519> 2014-05-19 10:46:21.241338 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0x9ba5880 con 0x978d340 -8518> 2014-05-19 10:46:21.241362 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:21.240151) v2 -- ?+0 0xa243340 con 0x96374a0 -8517> 2014-05-19 10:46:21.241402 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -8516> 2014-05-19 10:46:21.241426 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0x9cd0000 con 0x9ad4420 -8515> 2014-05-19 10:46:21.241452 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -8514> 2014-05-19 10:46:21.241462 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xac168c0 con 0x9bf31e0 -8513> 2014-05-19 10:46:21.241483 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -8512> 2014-05-19 10:46:21.241498 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xac156c0 con 0x998b340 -8511> 2014-05-19 10:46:21.241532 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -8510> 2014-05-19 10:46:21.241548 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0x9c6ea80 con 0x9b92840 -8509> 2014-05-19 10:46:21.241578 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -8508> 2014-05-19 10:46:21.241588 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0x9ccf180 con 0x9ad49a0 -8507> 2014-05-19 10:46:21.241604 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -8506> 2014-05-19 10:46:21.241609 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xa36ce00 con 0x7b911e0 -8505> 2014-05-19 10:46:21.241623 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -8504> 2014-05-19 10:46:21.241629 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0x9ba41c0 con 0x7b918c0 -8503> 2014-05-19 10:46:21.241697 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -8502> 2014-05-19 10:46:21.241715 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xa857340 con 0x9aa8c60 -8501> 2014-05-19 10:46:21.241752 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -8500> 2014-05-19 10:46:21.241768 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xa517c00 con 0x9bfa000 -8499> 2014-05-19 10:46:21.241799 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -8498> 2014-05-19 10:46:21.241813 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xa1e4a80 con 0x7c23e40 -8497> 2014-05-19 10:46:21.241830 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -8496> 2014-05-19 10:46:21.241835 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xa266700 con 0x998b760 -8495> 2014-05-19 10:46:21.241849 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -8494> 2014-05-19 10:46:21.241866 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xa517a40 con 0x7b91080 -8493> 2014-05-19 10:46:21.241895 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -8492> 2014-05-19 10:46:21.241910 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0x9c0fdc0 con 0xa28fb80 -8491> 2014-05-19 10:46:21.241931 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -8490> 2014-05-19 10:46:21.241942 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xa665c00 con 0x76bdce0 -8489> 2014-05-19 10:46:21.241960 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -8488> 2014-05-19 10:46:21.241967 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0x951ddc0 con 0x994ab00 -8487> 2014-05-19 10:46:21.241981 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -8486> 2014-05-19 10:46:21.241990 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0x9feca80 con 0x9ac8b00 -8485> 2014-05-19 10:46:21.242007 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -8484> 2014-05-19 10:46:21.242014 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0x9ba4a80 con 0x938de40 -8483> 2014-05-19 10:46:21.242028 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -8482> 2014-05-19 10:46:21.242037 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0x9fa9dc0 con 0x9970b00 -8481> 2014-05-19 10:46:21.242054 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -8480> 2014-05-19 10:46:21.242061 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0x9ccec40 con 0x99706e0 -8479> 2014-05-19 10:46:21.242075 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -8478> 2014-05-19 10:46:21.242083 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xac08c40 con 0x9bb6f20 -8477> 2014-05-19 10:46:21.242097 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -8476> 2014-05-19 10:46:21.242106 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0x9e708c0 con 0x994b340 -8475> 2014-05-19 10:46:21.242123 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -8474> 2014-05-19 10:46:21.242130 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xa617340 con 0x98fa2c0 -8473> 2014-05-19 10:46:21.242145 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -8472> 2014-05-19 10:46:21.242153 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0x9faa540 con 0x996f8c0 -8471> 2014-05-19 10:46:21.242167 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -8470> 2014-05-19 10:46:21.242174 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xa872380 con 0x996fa20 -8469> 2014-05-19 10:46:21.242188 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -8468> 2014-05-19 10:46:21.242196 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0x9c0efc0 con 0x9ac8160 -8467> 2014-05-19 10:46:21.242210 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -8466> 2014-05-19 10:46:21.242221 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xac15dc0 con 0x7b90420 -8465> 2014-05-19 10:46:21.242239 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -8464> 2014-05-19 10:46:21.242246 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0x9d3c380 con 0x919fe40 -8463> 2014-05-19 10:46:21.242263 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -8462> 2014-05-19 10:46:21.242270 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xa65a000 con 0x9971760 -8461> 2014-05-19 10:46:21.242284 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -8460> 2014-05-19 10:46:21.242292 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xa619500 con 0x994af20 -8459> 2014-05-19 10:46:21.242306 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -8458> 2014-05-19 10:46:21.242313 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 35 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xa267c00 con 0x989be40 -8457> 2014-05-19 10:46:21.242327 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -8456> 2014-05-19 10:46:21.242334 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 35 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0x99e0000 con 0x9adf4a0 -8455> 2014-05-19 10:46:21.242348 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -8454> 2014-05-19 10:46:21.242358 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 35 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0x9c0f880 con 0x9776160 -8453> 2014-05-19 10:46:21.242375 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -8452> 2014-05-19 10:46:21.242382 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 35 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0x9142a80 con 0x96bd8c0 -8451> 2014-05-19 10:46:21.242396 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -8450> 2014-05-19 10:46:21.242402 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 34 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xa2dfc00 con 0x96bcdc0 -8449> 2014-05-19 10:46:21.242416 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -8448> 2014-05-19 10:46:21.242424 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 34 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xa2bce00 con 0x96954a0 -8447> 2014-05-19 10:46:21.242438 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -8446> 2014-05-19 10:46:21.242445 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 33 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xa0dd880 con 0x76bd8c0 -8445> 2014-05-19 10:46:21.242539 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -8444> 2014-05-19 10:46:21.242550 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 33 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xa8068c0 con 0x7b90dc0 -8443> 2014-05-19 10:46:21.242568 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -8442> 2014-05-19 10:46:21.242576 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 32 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xac1a700 con 0x978d8c0 -8441> 2014-05-19 10:46:21.242590 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -8440> 2014-05-19 10:46:21.242597 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 32 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xac1b500 con 0x978c580 -8439> 2014-05-19 10:46:21.242611 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -8438> 2014-05-19 10:46:21.242618 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 31 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0x9faa1c0 con 0x978d340 -8437> 2014-05-19 10:46:21.242632 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -8436> 2014-05-19 10:46:21.242640 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 31 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.240151) v2 ==== 47+0+0 (2962122435 0 0) 0xa665180 con 0x96374a0 -8435> 2014-05-19 10:46:21.242654 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -8434> 2014-05-19 10:46:21.254257 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 34 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:25.197849) v2 ==== 47+0+0 (2245768704 0 0) 0xa0cac40 con 0x9970840 -8433> 2014-05-19 10:46:21.254433 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 34 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:25.197849) v2 ==== 47+0+0 (2245768704 0 0) 0xa208540 con 0x97434a0 -8432> 2014-05-19 10:46:21.254383 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:25.197849) v2 -- ?+0 0x9ba56c0 con 0x9970840 -8431> 2014-05-19 10:46:21.254653 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -8430> 2014-05-19 10:46:21.254693 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:25.197849) v2 -- ?+0 0x9cb7880 con 0x97434a0 -8429> 2014-05-19 10:46:21.254880 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -8428> 2014-05-19 10:46:21.374127 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:21.373974) v2 ==== 47+0+0 (2349928489 0 0) 0xa865880 con 0x9657340 -8427> 2014-05-19 10:46:21.374161 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:21.373974) v2 ==== 47+0+0 (2349928489 0 0) 0xa5fca80 con 0x9656580 -8426> 2014-05-19 10:46:21.374173 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.373974) v2 -- ?+0 0xa208540 con 0x9657340 -8425> 2014-05-19 10:46:21.374201 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -8424> 2014-05-19 10:46:21.374229 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:21.373974) v2 -- ?+0 0xa0cac40 con 0x9656580 -8423> 2014-05-19 10:46:21.374316 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -8422> 2014-05-19 10:46:21.448269 7f555019b700 20 OSD::command_tp worker waiting -8421> 2014-05-19 10:46:21.451523 7f555099c700 20 OSD::disk_tp worker waiting -8420> 2014-05-19 10:46:21.635252 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:24.241515) v2 ==== 47+0+0 (901013216 0 0) 0xa0bce00 con 0x9a0c9a0 -8419> 2014-05-19 10:46:21.635289 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:24.241515) v2 ==== 47+0+0 (901013216 0 0) 0xa1dec40 con 0x996e000 -8418> 2014-05-19 10:46:21.635307 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:24.241515) v2 -- ?+0 0xa865880 con 0x9a0c9a0 -8417> 2014-05-19 10:46:21.635412 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -8416> 2014-05-19 10:46:21.635449 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:24.241515) v2 -- ?+0 0xa5fca80 con 0x996e000 -8415> 2014-05-19 10:46:21.635522 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -8414> 2014-05-19 10:46:21.691334 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:24.297605) v2 ==== 47+0+0 (1086284536 0 0) 0x9e6dc00 con 0x9657080 -8413> 2014-05-19 10:46:21.691321 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:24.297605) v2 ==== 47+0+0 (1086284536 0 0) 0x92a1500 con 0x96562c0 -8412> 2014-05-19 10:46:21.691382 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:24.297605) v2 -- ?+0 0xa0bce00 con 0x9657080 -8411> 2014-05-19 10:46:21.691467 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -8410> 2014-05-19 10:46:21.691507 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:24.297605) v2 -- ?+0 0xa1dec40 con 0x96562c0 -8409> 2014-05-19 10:46:21.691580 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -8408> 2014-05-19 10:46:21.842273 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:24.448527) v2 ==== 47+0+0 (4149554659 0 0) 0xa1df6c0 con 0x9b8de40 -8407> 2014-05-19 10:46:21.842327 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:24.448527) v2 -- ?+0 0x92a1500 con 0x9b8de40 -8406> 2014-05-19 10:46:21.842403 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -8405> 2014-05-19 10:46:21.842425 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:24.448527) v2 ==== 47+0+0 (4149554659 0 0) 0xa05f340 con 0x94e2160 -8404> 2014-05-19 10:46:21.842473 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:24.448527) v2 -- ?+0 0x9e6dc00 con 0x94e2160 -8403> 2014-05-19 10:46:21.842526 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -8402> 2014-05-19 10:46:21.915857 7f5566602700 5 osd.0 245 tick -8401> 2014-05-19 10:46:21.915885 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -8400> 2014-05-19 10:46:21.915892 7f5566602700 10 osd.0 245 do_waiters -- start -8399> 2014-05-19 10:46:21.915896 7f5566602700 10 osd.0 245 do_waiters -- finish -8398> 2014-05-19 10:46:21.915922 7f555119d700 20 OSD::recovery_tp worker waiting -8397> 2014-05-19 10:46:21.967074 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:25.910646) v2 ==== 47+0+0 (2755082509 0 0) 0xa0eb500 con 0x99d3340 -8396> 2014-05-19 10:46:21.967110 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:25.910646) v2 ==== 47+0+0 (2755082509 0 0) 0xa74afc0 con 0x94a5a20 -8395> 2014-05-19 10:46:21.967126 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:25.910646) v2 -- ?+0 0xa1df6c0 con 0x99d3340 -8394> 2014-05-19 10:46:21.967157 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -8393> 2014-05-19 10:46:21.967447 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:25.910646) v2 -- ?+0 0xa05f340 con 0x94a5a20 -8392> 2014-05-19 10:46:21.967502 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -8391> 2014-05-19 10:46:22.298496 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:24.904788) v2 ==== 47+0+0 (4113343692 0 0) 0xa6ab500 con 0x996fb80 -8390> 2014-05-19 10:46:22.298548 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:24.904788) v2 -- ?+0 0xa0eb500 con 0x996fb80 -8389> 2014-05-19 10:46:22.298611 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -8388> 2014-05-19 10:46:22.298493 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:24.904788) v2 ==== 47+0+0 (4113343692 0 0) 0x9c08e00 con 0x9a0cdc0 -8387> 2014-05-19 10:46:22.298695 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:24.904788) v2 -- ?+0 0xa74afc0 con 0x9a0cdc0 -8386> 2014-05-19 10:46:22.298791 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -8385> 2014-05-19 10:46:22.525990 7f5565600700 20 KeyValueStore::op_tp worker waiting -8384> 2014-05-19 10:46:22.767577 7f555a1af700 20 OSD::op_tp worker waiting -8383> 2014-05-19 10:46:22.767596 7f55551a5700 20 OSD::op_tp worker waiting -8382> 2014-05-19 10:46:22.767613 7f55579aa700 20 OSD::op_tp worker waiting -8381> 2014-05-19 10:46:22.769139 7f55541a3700 20 OSD::op_tp worker waiting -8380> 2014-05-19 10:46:22.769162 7f555a9b0700 20 OSD::op_tp worker waiting -8379> 2014-05-19 10:46:22.769184 7f555b1b1700 20 OSD::op_tp worker waiting -8378> 2014-05-19 10:46:22.769198 7f55569a8700 20 OSD::op_tp worker waiting -8377> 2014-05-19 10:46:22.769222 7f55589ac700 20 OSD::op_tp worker waiting -8376> 2014-05-19 10:46:22.769238 7f55549a4700 20 OSD::op_tp worker waiting -8375> 2014-05-19 10:46:22.770336 7f55571a9700 20 OSD::op_tp worker waiting -8374> 2014-05-19 10:46:22.770369 7f55559a6700 20 OSD::op_tp worker waiting -8373> 2014-05-19 10:46:22.770384 7f55581ab700 20 OSD::op_tp worker waiting -8372> 2014-05-19 10:46:22.770414 7f55529a0700 20 OSD::op_tp worker waiting -8371> 2014-05-19 10:46:22.770427 7f55599ae700 20 OSD::op_tp worker waiting -8370> 2014-05-19 10:46:22.770443 7f555219f700 20 OSD::op_tp worker waiting -8369> 2014-05-19 10:46:22.770460 7f55539a2700 20 OSD::op_tp worker waiting -8368> 2014-05-19 10:46:22.770480 7f55561a7700 20 OSD::op_tp worker waiting -8367> 2014-05-19 10:46:22.770508 7f555199e700 20 OSD::op_tp worker waiting -8366> 2014-05-19 10:46:22.770558 7f55531a1700 20 OSD::op_tp worker waiting -8365> 2014-05-19 10:46:22.770570 7f55591ad700 20 OSD::op_tp worker waiting -8364> 2014-05-19 10:46:22.909705 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 31 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:26.853289) v2 ==== 47+0+0 (718690667 0 0) 0xac14c40 con 0x94802c0 -8363> 2014-05-19 10:46:22.909773 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.853289) v2 -- ?+0 0x9c08e00 con 0x94802c0 -8362> 2014-05-19 10:46:22.909668 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 31 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:26.853289) v2 ==== 47+0+0 (718690667 0 0) 0xac09dc0 con 0x987b760 -8361> 2014-05-19 10:46:22.909854 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -8360> 2014-05-19 10:46:22.909880 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.853289) v2 -- ?+0 0xa6ab500 con 0x987b760 -8359> 2014-05-19 10:46:22.910391 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -8358> 2014-05-19 10:46:22.915985 7f5566602700 5 osd.0 245 tick -8357> 2014-05-19 10:46:22.916005 7f5566602700 7 osd.0 245 do_mon_report -8356> 2014-05-19 10:46:22.916009 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 -8355> 2014-05-19 10:46:22.916013 7f5566602700 20 osd.0 245 send_pg_stats -8354> 2014-05-19 10:46:22.916023 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -8353> 2014-05-19 10:46:22.916027 7f5566602700 10 osd.0 245 do_waiters -- start -8352> 2014-05-19 10:46:22.916029 7f5566602700 10 osd.0 245 do_waiters -- finish -8351> 2014-05-19 10:46:22.916062 7f555119d700 20 OSD::recovery_tp worker waiting -8350> 2014-05-19 10:46:22.941510 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -8349> 2014-05-19 10:46:22.941531 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -8348> 2014-05-19 10:46:22.941540 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xa172000 con 0x9bdc840 -8347> 2014-05-19 10:46:22.941567 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xa664e00 con 0x9ad4420 -8346> 2014-05-19 10:46:22.941607 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xa236700 con 0x9bf31e0 -8345> 2014-05-19 10:46:22.941623 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0x9d0aa80 con 0x998b340 -8344> 2014-05-19 10:46:22.941637 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0x9e77dc0 con 0x9b92840 -8343> 2014-05-19 10:46:22.941665 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0x9464000 con 0x9ad49a0 -8342> 2014-05-19 10:46:22.941696 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0x94641c0 con 0x7b911e0 -8341> 2014-05-19 10:46:22.941722 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xa6d5dc0 con 0x7b918c0 -8340> 2014-05-19 10:46:22.941746 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0x96befc0 con 0x9aa8c60 -8339> 2014-05-19 10:46:22.941776 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xa242380 con 0x9bfa000 -8338> 2014-05-19 10:46:22.941818 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xa65b880 con 0x7c23e40 -8337> 2014-05-19 10:46:22.941851 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xa23f340 con 0x998b760 -8336> 2014-05-19 10:46:22.941884 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0x9c0efc0 con 0x7b91080 -8335> 2014-05-19 10:46:22.941918 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xa872380 con 0xa28fb80 -8334> 2014-05-19 10:46:22.941942 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0x9faa540 con 0x76bdce0 -8333> 2014-05-19 10:46:22.941980 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xa617340 con 0x994ab00 -8332> 2014-05-19 10:46:22.941926 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xa4df340 con 0x9bdc840 -8331> 2014-05-19 10:46:22.941997 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0x9e708c0 con 0x9ac8b00 -8330> 2014-05-19 10:46:22.942048 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xac08c40 con 0x938de40 -8329> 2014-05-19 10:46:22.942078 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0x9ccec40 con 0x9970b00 -8328> 2014-05-19 10:46:22.942099 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0x9fa9dc0 con 0x99706e0 -8327> 2014-05-19 10:46:22.942137 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0x9ba4a80 con 0x9bb6f20 -8326> 2014-05-19 10:46:22.942161 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0x9feca80 con 0x994b340 -8325> 2014-05-19 10:46:22.942203 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0x951ddc0 con 0x98fa2c0 -8324> 2014-05-19 10:46:22.942234 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xa665c00 con 0x996f8c0 -8323> 2014-05-19 10:46:22.942263 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0x9c0fdc0 con 0x996fa20 -8322> 2014-05-19 10:46:22.942292 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xa517a40 con 0x9ac8160 -8321> 2014-05-19 10:46:22.942318 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xa266700 con 0x7b90420 -8320> 2014-05-19 10:46:22.942346 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xa1e4a80 con 0x919fe40 -8319> 2014-05-19 10:46:22.942376 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xa517c00 con 0x9971760 -8318> 2014-05-19 10:46:22.942408 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xa857340 con 0x994af20 -8317> 2014-05-19 10:46:22.942435 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0x9ba41c0 con 0x989be40 -8316> 2014-05-19 10:46:22.942450 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xa36ce00 con 0x9adf4a0 -8315> 2014-05-19 10:46:22.942467 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0x9ccf180 con 0x9776160 -8314> 2014-05-19 10:46:22.942496 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0x9c6ea80 con 0x96bd8c0 -8313> 2014-05-19 10:46:22.942527 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xac156c0 con 0x96bcdc0 -8312> 2014-05-19 10:46:22.942558 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xac168c0 con 0x96954a0 -8311> 2014-05-19 10:46:22.942628 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0x9cd0000 con 0x76bd8c0 -8310> 2014-05-19 10:46:22.942654 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xa4dee00 con 0x7b90dc0 -8309> 2014-05-19 10:46:22.942682 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0x9e81dc0 con 0x978d8c0 -8308> 2014-05-19 10:46:22.942714 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0x97c3880 con 0x978c580 -8307> 2014-05-19 10:46:22.942745 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xac1b6c0 con 0x978d340 -8306> 2014-05-19 10:46:22.942775 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:22.941538) v2 -- ?+0 0xac1a8c0 con 0x96374a0 -8305> 2014-05-19 10:46:22.942867 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -8304> 2014-05-19 10:46:22.942889 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xa0bc1c0 con 0x9ad4420 -8303> 2014-05-19 10:46:22.942916 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -8302> 2014-05-19 10:46:22.942927 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xac16700 con 0x9bf31e0 -8301> 2014-05-19 10:46:22.942963 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -8300> 2014-05-19 10:46:22.942970 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xac15500 con 0x998b340 -8299> 2014-05-19 10:46:22.942985 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -8298> 2014-05-19 10:46:22.942991 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xa102540 con 0x9b92840 -8297> 2014-05-19 10:46:22.943005 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -8296> 2014-05-19 10:46:22.943010 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xa4a9a40 con 0x9ad49a0 -8295> 2014-05-19 10:46:22.943027 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -8294> 2014-05-19 10:46:22.943035 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xa74bdc0 con 0x7b911e0 -8293> 2014-05-19 10:46:22.943051 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -8292> 2014-05-19 10:46:22.943059 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0x9ba48c0 con 0x7b918c0 -8291> 2014-05-19 10:46:22.943104 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -8290> 2014-05-19 10:46:22.943125 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xac15c00 con 0x9aa8c60 -8289> 2014-05-19 10:46:22.943160 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -8288> 2014-05-19 10:46:22.943175 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0x9c0f500 con 0x9bfa000 -8287> 2014-05-19 10:46:22.943205 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -8286> 2014-05-19 10:46:22.943215 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xa4d0fc0 con 0x7c23e40 -8285> 2014-05-19 10:46:22.943231 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -8284> 2014-05-19 10:46:22.943238 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xa7d48c0 con 0x998b760 -8283> 2014-05-19 10:46:22.943255 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -8282> 2014-05-19 10:46:22.943272 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xa0bd500 con 0x7b91080 -8281> 2014-05-19 10:46:22.943301 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -8280> 2014-05-19 10:46:22.943309 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0x9f19500 con 0xa28fb80 -8279> 2014-05-19 10:46:22.943344 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -8278> 2014-05-19 10:46:22.943350 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xa1156c0 con 0x76bdce0 -8277> 2014-05-19 10:46:22.943375 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -8276> 2014-05-19 10:46:22.943385 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xa873dc0 con 0x994ab00 -8275> 2014-05-19 10:46:22.943402 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -8274> 2014-05-19 10:46:22.943394 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:25.549808) v2 ==== 47+0+0 (1233233907 0 0) 0x9ed2a80 con 0x9b8de40 -8273> 2014-05-19 10:46:22.943435 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:25.549808) v2 -- ?+0 0xac09dc0 con 0x9b8de40 -8272> 2014-05-19 10:46:22.943527 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -8271> 2014-05-19 10:46:22.943548 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:25.549808) v2 ==== 47+0+0 (1233233907 0 0) 0xa05e540 con 0x94e2160 -8270> 2014-05-19 10:46:22.943581 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:25.549808) v2 -- ?+0 0xac14c40 con 0x94e2160 -8269> 2014-05-19 10:46:22.943437 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xa872c40 con 0x9ac8b00 -8268> 2014-05-19 10:46:22.944096 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -8267> 2014-05-19 10:46:22.944123 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -8266> 2014-05-19 10:46:22.944137 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0x9e6c540 con 0x938de40 -8265> 2014-05-19 10:46:22.944165 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -8264> 2014-05-19 10:46:22.944171 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xa208000 con 0x9970b00 -8263> 2014-05-19 10:46:22.944196 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -8262> 2014-05-19 10:46:22.944202 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0x9ed1c00 con 0x99706e0 -8261> 2014-05-19 10:46:22.944217 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -8260> 2014-05-19 10:46:22.944226 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xac088c0 con 0x9bb6f20 -8259> 2014-05-19 10:46:22.944244 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -8258> 2014-05-19 10:46:22.944251 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0x9c6e8c0 con 0x994b340 -8257> 2014-05-19 10:46:22.944266 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -8256> 2014-05-19 10:46:22.944274 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xa616c40 con 0x98fa2c0 -8255> 2014-05-19 10:46:22.944289 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -8254> 2014-05-19 10:46:22.944293 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0x9f7afc0 con 0x996f8c0 -8253> 2014-05-19 10:46:22.944310 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -8252> 2014-05-19 10:46:22.944317 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xa872e00 con 0x996fa20 -8251> 2014-05-19 10:46:22.944334 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -8250> 2014-05-19 10:46:22.944342 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0x9123c00 con 0x9ac8160 -8249> 2014-05-19 10:46:22.944356 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -8248> 2014-05-19 10:46:22.944361 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0x9ec1880 con 0x7b90420 -8247> 2014-05-19 10:46:22.944378 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -8246> 2014-05-19 10:46:22.944383 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xac16fc0 con 0x919fe40 -8245> 2014-05-19 10:46:22.944400 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -8244> 2014-05-19 10:46:22.944407 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xa44ca80 con 0x9971760 -8243> 2014-05-19 10:46:22.944422 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -8242> 2014-05-19 10:46:22.944427 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0x951c380 con 0x994af20 -8241> 2014-05-19 10:46:22.944443 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -8240> 2014-05-19 10:46:22.944450 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 36 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0x9ed1dc0 con 0x989be40 -8239> 2014-05-19 10:46:22.944467 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -8238> 2014-05-19 10:46:22.944474 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 36 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xa4a8c40 con 0x9adf4a0 -8237> 2014-05-19 10:46:22.944488 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -8236> 2014-05-19 10:46:22.944496 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 36 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0x9fa4c40 con 0x9776160 -8235> 2014-05-19 10:46:22.944512 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -8234> 2014-05-19 10:46:22.944520 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 36 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xa106540 con 0x96bd8c0 -8233> 2014-05-19 10:46:22.944534 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -8232> 2014-05-19 10:46:22.944542 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 35 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0x9ef41c0 con 0x96bcdc0 -8231> 2014-05-19 10:46:22.944556 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -8230> 2014-05-19 10:46:22.944563 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 35 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xa2bc1c0 con 0x96954a0 -8229> 2014-05-19 10:46:22.944578 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -8228> 2014-05-19 10:46:22.944585 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 34 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xa6136c0 con 0x76bd8c0 -8227> 2014-05-19 10:46:22.944599 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -8226> 2014-05-19 10:46:22.944606 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 34 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xa23f6c0 con 0x7b90dc0 -8225> 2014-05-19 10:46:22.944620 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -8224> 2014-05-19 10:46:22.944629 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 33 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xac1a540 con 0x978d8c0 -8223> 2014-05-19 10:46:22.944646 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -8222> 2014-05-19 10:46:22.944654 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 33 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xac1b340 con 0x978c580 -8221> 2014-05-19 10:46:22.944668 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -8220> 2014-05-19 10:46:22.944677 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 32 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xa6d4c40 con 0x978d340 -8219> 2014-05-19 10:46:22.944694 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -8218> 2014-05-19 10:46:22.944701 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 32 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:22.941538) v2 ==== 47+0+0 (1456354040 0 0) 0xac14a80 con 0x96374a0 -8217> 2014-05-19 10:46:22.944718 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -8216> 2014-05-19 10:46:22.975254 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 34 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:26.918953) v2 ==== 47+0+0 (1742794279 0 0) 0xa0cafc0 con 0x99f1080 -8215> 2014-05-19 10:46:22.975284 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 34 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:26.918953) v2 ==== 47+0+0 (1742794279 0 0) 0xac14380 con 0x987af20 -8214> 2014-05-19 10:46:22.975299 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.918953) v2 -- ?+0 0xa05e540 con 0x99f1080 -8213> 2014-05-19 10:46:22.975329 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -8212> 2014-05-19 10:46:22.975365 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.918953) v2 -- ?+0 0x9ed2a80 con 0x987af20 -8211> 2014-05-19 10:46:22.975418 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -8210> 2014-05-19 10:46:23.109386 7f5564dff700 20 KeyValueStore::op_tp worker waiting -8209> 2014-05-19 10:46:23.189506 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:27.133152) v2 ==== 47+0+0 (4079650875 0 0) 0xa4a8380 con 0x9bb69a0 -8208> 2014-05-19 10:46:23.189558 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:27.133152) v2 -- ?+0 0xac14380 con 0x9bb69a0 -8207> 2014-05-19 10:46:23.189650 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -8206> 2014-05-19 10:46:23.189558 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:27.133152) v2 ==== 47+0+0 (4079650875 0 0) 0xa36cc40 con 0x94e3e40 -8205> 2014-05-19 10:46:23.189706 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:27.133152) v2 -- ?+0 0xa0cafc0 con 0x94e3e40 -8204> 2014-05-19 10:46:23.189819 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -8203> 2014-05-19 10:46:23.249722 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:27.193313) v2 ==== 47+0+0 (1734100586 0 0) 0x9fdc540 con 0x99718c0 -8202> 2014-05-19 10:46:23.249782 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:27.193313) v2 ==== 47+0+0 (1734100586 0 0) 0x9ab8700 con 0x97431e0 -8201> 2014-05-19 10:46:23.249792 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:27.193313) v2 -- ?+0 0xa4a8380 con 0x99718c0 -8200> 2014-05-19 10:46:23.249875 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -8199> 2014-05-19 10:46:23.249921 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:27.193313) v2 -- ?+0 0xa36cc40 con 0x97431e0 -8198> 2014-05-19 10:46:23.249994 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -8197> 2014-05-19 10:46:23.333273 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:25.939563) v2 ==== 47+0+0 (889001398 0 0) 0xa0dc8c0 con 0x9983600 -8196> 2014-05-19 10:46:23.333260 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:25.939563) v2 ==== 47+0+0 (889001398 0 0) 0xa2081c0 con 0x95846e0 -8195> 2014-05-19 10:46:23.333331 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:25.939563) v2 -- ?+0 0x9fdc540 con 0x95846e0 -8194> 2014-05-19 10:46:23.333420 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -8193> 2014-05-19 10:46:23.333623 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:25.939563) v2 -- ?+0 0x9ab8700 con 0x9983600 -8192> 2014-05-19 10:46:23.333702 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -8191> 2014-05-19 10:46:23.442970 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -8190> 2014-05-19 10:46:23.442993 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -8189> 2014-05-19 10:46:23.443001 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa4ff340 con 0x9bdc840 -8188> 2014-05-19 10:46:23.443027 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa3dba40 con 0x9ad4420 -8187> 2014-05-19 10:46:23.443065 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa873dc0 con 0x9bf31e0 -8186> 2014-05-19 10:46:23.443081 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa1156c0 con 0x998b340 -8185> 2014-05-19 10:46:23.443115 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0x9f19500 con 0x9b92840 -8184> 2014-05-19 10:46:23.443143 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa0bd500 con 0x9ad49a0 -8183> 2014-05-19 10:46:23.443174 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa7d48c0 con 0x7b911e0 -8182> 2014-05-19 10:46:23.443199 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa4d0fc0 con 0x7b918c0 -8181> 2014-05-19 10:46:23.443223 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0x9c0f500 con 0x9aa8c60 -8180> 2014-05-19 10:46:23.443295 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xac15c00 con 0x9bfa000 -8179> 2014-05-19 10:46:23.443327 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0x9ba48c0 con 0x7c23e40 -8178> 2014-05-19 10:46:23.443350 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa74bdc0 con 0x998b760 -8177> 2014-05-19 10:46:23.443378 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa4a9a40 con 0x7b91080 -8176> 2014-05-19 10:46:23.443376 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xa030540 con 0x9bdc840 -8175> 2014-05-19 10:46:23.443406 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa102540 con 0xa28fb80 -8174> 2014-05-19 10:46:23.443432 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xac15500 con 0x76bdce0 -8173> 2014-05-19 10:46:23.443457 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xac16700 con 0x994ab00 -8172> 2014-05-19 10:46:23.443482 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa0bc1c0 con 0x9ac8b00 -8171> 2014-05-19 10:46:23.443498 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa4df340 con 0x938de40 -8170> 2014-05-19 10:46:23.443512 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa665180 con 0x9970b00 -8169> 2014-05-19 10:46:23.443535 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0x9faa1c0 con 0x99706e0 -8168> 2014-05-19 10:46:23.443576 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xac1b500 con 0x9bb6f20 -8167> 2014-05-19 10:46:23.443603 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xac1a700 con 0x994b340 -8166> 2014-05-19 10:46:23.443631 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa8068c0 con 0x98fa2c0 -8165> 2014-05-19 10:46:23.443648 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa0dd880 con 0x996f8c0 -8164> 2014-05-19 10:46:23.443662 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa2bce00 con 0x996fa20 -8163> 2014-05-19 10:46:23.443685 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa2dfc00 con 0x9ac8160 -8162> 2014-05-19 10:46:23.443712 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0x9142a80 con 0x7b90420 -8161> 2014-05-19 10:46:23.443732 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0x9c0f880 con 0x919fe40 -8160> 2014-05-19 10:46:23.443746 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0x99e0000 con 0x9971760 -8159> 2014-05-19 10:46:23.443760 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa267c00 con 0x994af20 -8158> 2014-05-19 10:46:23.443797 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa619500 con 0x989be40 -8157> 2014-05-19 10:46:23.443828 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa65a000 con 0x9adf4a0 -8156> 2014-05-19 10:46:23.443848 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0x9d3c380 con 0x9776160 -8155> 2014-05-19 10:46:23.443862 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xac15dc0 con 0x96bd8c0 -8154> 2014-05-19 10:46:23.443876 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xac15880 con 0x96bcdc0 -8153> 2014-05-19 10:46:23.443891 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xac16a80 con 0x96954a0 -8152> 2014-05-19 10:46:23.443905 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0x9ebbdc0 con 0x76bd8c0 -8151> 2014-05-19 10:46:23.443919 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa4dea80 con 0x7b90dc0 -8150> 2014-05-19 10:46:23.443946 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xac16c40 con 0x978d8c0 -8149> 2014-05-19 10:46:23.443974 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa2bc380 con 0x978c580 -8148> 2014-05-19 10:46:23.444026 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xa3dbdc0 con 0x978d340 -8147> 2014-05-19 10:46:23.444163 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:23.443000) v2 -- ?+0 0xac17dc0 con 0x96374a0 -8146> 2014-05-19 10:46:23.444218 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -8145> 2014-05-19 10:46:23.444241 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0x9fb5a40 con 0x9ad4420 -8144> 2014-05-19 10:46:23.444269 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -8143> 2014-05-19 10:46:23.444275 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xac16540 con 0x9bf31e0 -8142> 2014-05-19 10:46:23.444315 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -8141> 2014-05-19 10:46:23.444353 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0x9e708c0 con 0x998b340 -8140> 2014-05-19 10:46:23.444388 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -8139> 2014-05-19 10:46:23.444407 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xa1028c0 con 0x9b92840 -8138> 2014-05-19 10:46:23.444441 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -8137> 2014-05-19 10:46:23.444456 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xa516380 con 0x9ad49a0 -8136> 2014-05-19 10:46:23.444483 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -8135> 2014-05-19 10:46:23.444504 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xa74a540 con 0x7b911e0 -8134> 2014-05-19 10:46:23.444523 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -8133> 2014-05-19 10:46:23.444531 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xac08fc0 con 0x7b918c0 -8132> 2014-05-19 10:46:23.444546 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -8131> 2014-05-19 10:46:23.444551 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xa4461c0 con 0x9aa8c60 -8130> 2014-05-19 10:46:23.444567 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -8129> 2014-05-19 10:46:23.444574 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0x9c09180 con 0x9bfa000 -8128> 2014-05-19 10:46:23.444589 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -8127> 2014-05-19 10:46:23.444594 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0x9f43c00 con 0x7c23e40 -8126> 2014-05-19 10:46:23.444641 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -8125> 2014-05-19 10:46:23.444653 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xac168c0 con 0x998b760 -8124> 2014-05-19 10:46:23.444676 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -8123> 2014-05-19 10:46:23.444687 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xa447880 con 0x7b91080 -8122> 2014-05-19 10:46:23.444708 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -8121> 2014-05-19 10:46:23.444716 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xa4a88c0 con 0xa28fb80 -8120> 2014-05-19 10:46:23.444732 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -8119> 2014-05-19 10:46:23.444742 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0x9562700 con 0x76bdce0 -8118> 2014-05-19 10:46:23.444759 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -8117> 2014-05-19 10:46:23.444766 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xa5076c0 con 0x994ab00 -8116> 2014-05-19 10:46:23.444781 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -8115> 2014-05-19 10:46:23.444788 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xa8721c0 con 0x9ac8b00 -8114> 2014-05-19 10:46:23.444803 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -8113> 2014-05-19 10:46:23.444810 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0x99e0540 con 0x938de40 -8112> 2014-05-19 10:46:23.444827 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -8111> 2014-05-19 10:46:23.444835 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xa163a40 con 0x9970b00 -8110> 2014-05-19 10:46:23.444850 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -8109> 2014-05-19 10:46:23.444858 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xa1eee00 con 0x99706e0 -8108> 2014-05-19 10:46:23.444875 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -8107> 2014-05-19 10:46:23.444882 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xa6abc00 con 0x9bb6f20 -8106> 2014-05-19 10:46:23.444896 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -8105> 2014-05-19 10:46:23.444904 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0x9c6efc0 con 0x994b340 -8104> 2014-05-19 10:46:23.444919 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -8103> 2014-05-19 10:46:23.444927 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0x9e9fc00 con 0x98fa2c0 -8102> 2014-05-19 10:46:23.444944 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -8101> 2014-05-19 10:46:23.444951 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0x9cd0c40 con 0x996f8c0 -8100> 2014-05-19 10:46:23.444966 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -8099> 2014-05-19 10:46:23.444973 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xa864700 con 0x996fa20 -8098> 2014-05-19 10:46:23.444987 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -8097> 2014-05-19 10:46:23.444995 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0x9fa8380 con 0x9ac8160 -8096> 2014-05-19 10:46:23.445009 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -8095> 2014-05-19 10:46:23.445016 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0x9cb48c0 con 0x7b90420 -8094> 2014-05-19 10:46:23.445031 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -8093> 2014-05-19 10:46:23.445038 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0x9d021c0 con 0x919fe40 -8092> 2014-05-19 10:46:23.445051 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -8091> 2014-05-19 10:46:23.445059 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xa2dee00 con 0x9971760 -8090> 2014-05-19 10:46:23.445074 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -8089> 2014-05-19 10:46:23.445082 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xac16e00 con 0x994af20 -8088> 2014-05-19 10:46:23.445096 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -8087> 2014-05-19 10:46:23.445140 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0x9fa4fc0 con 0x989be40 -8086> 2014-05-19 10:46:23.445171 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -8085> 2014-05-19 10:46:23.445181 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xa864a80 con 0x9adf4a0 -8084> 2014-05-19 10:46:23.445200 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -8083> 2014-05-19 10:46:23.445208 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xa4ffdc0 con 0x9776160 -8082> 2014-05-19 10:46:23.445223 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -8081> 2014-05-19 10:46:23.445231 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xac14c40 con 0x96bd8c0 -8080> 2014-05-19 10:46:23.445246 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -8079> 2014-05-19 10:46:23.445253 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 36 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xa873c00 con 0x96bcdc0 -8078> 2014-05-19 10:46:23.445267 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -8077> 2014-05-19 10:46:23.445274 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 36 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xa856380 con 0x96954a0 -8076> 2014-05-19 10:46:23.445288 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -8075> 2014-05-19 10:46:23.445295 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 35 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0x9c6f180 con 0x76bd8c0 -8074> 2014-05-19 10:46:23.445310 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -8073> 2014-05-19 10:46:23.445317 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 35 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0x948fc00 con 0x7b90dc0 -8072> 2014-05-19 10:46:23.445331 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -8071> 2014-05-19 10:46:23.445343 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 34 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xac1a380 con 0x978d8c0 -8070> 2014-05-19 10:46:23.445361 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -8069> 2014-05-19 10:46:23.445368 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 34 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xac1b180 con 0x978c580 -8068> 2014-05-19 10:46:23.445382 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -8067> 2014-05-19 10:46:23.445389 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 33 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xa6d56c0 con 0x978d340 -8066> 2014-05-19 10:46:23.445403 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -8065> 2014-05-19 10:46:23.445411 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 33 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.443000) v2 ==== 47+0+0 (2679978715 0 0) 0xa2bcfc0 con 0x96374a0 -8064> 2014-05-19 10:46:23.445426 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -8063> 2014-05-19 10:46:23.448350 7f555019b700 20 OSD::command_tp worker waiting -8062> 2014-05-19 10:46:23.451608 7f555099c700 20 OSD::disk_tp worker waiting -8061> 2014-05-19 10:46:23.675597 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:23.675431) v2 ==== 47+0+0 (673319025 0 0) 0xa208380 con 0x9656580 -8060> 2014-05-19 10:46:23.675638 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:23.675431) v2 ==== 47+0+0 (673319025 0 0) 0x9ad28c0 con 0x9657340 -8059> 2014-05-19 10:46:23.675646 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.675431) v2 -- ?+0 0xa2081c0 con 0x9656580 -8058> 2014-05-19 10:46:23.675704 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -8057> 2014-05-19 10:46:23.675732 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:23.675431) v2 -- ?+0 0xa0dc8c0 con 0x9657340 -8056> 2014-05-19 10:46:23.675773 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -8055> 2014-05-19 10:46:23.750091 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:26.356365) v2 ==== 47+0+0 (348393604 0 0) 0xa0dc700 con 0x9656160 -8054> 2014-05-19 10:46:23.750132 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.356365) v2 -- ?+0 0xa208380 con 0x9656160 -8053> 2014-05-19 10:46:23.750158 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -8052> 2014-05-19 10:46:23.750152 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:26.356365) v2 ==== 47+0+0 (348393604 0 0) 0xa1ee700 con 0x9656f20 -8051> 2014-05-19 10:46:23.750606 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.356365) v2 -- ?+0 0x9ad28c0 con 0x9656f20 -8050> 2014-05-19 10:46:23.750681 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -8049> 2014-05-19 10:46:23.750886 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:27.694646) v2 ==== 47+0+0 (254666956 0 0) 0xa243c00 con 0x99718c0 -8048> 2014-05-19 10:46:23.750929 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:27.694646) v2 -- ?+0 0xa0dc700 con 0x99718c0 -8047> 2014-05-19 10:46:23.750957 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -8046> 2014-05-19 10:46:23.750979 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:27.694646) v2 ==== 47+0+0 (254666956 0 0) 0x9ebbc00 con 0x97431e0 -8045> 2014-05-19 10:46:23.751032 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:27.694646) v2 -- ?+0 0xa1ee700 con 0x97431e0 -8044> 2014-05-19 10:46:23.751063 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -8043> 2014-05-19 10:46:23.916117 7f5566602700 5 osd.0 245 tick -8042> 2014-05-19 10:46:23.916143 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -8041> 2014-05-19 10:46:23.916148 7f5566602700 10 osd.0 245 do_waiters -- start -8040> 2014-05-19 10:46:23.916150 7f5566602700 10 osd.0 245 do_waiters -- finish -8039> 2014-05-19 10:46:23.916188 7f555119d700 20 OSD::recovery_tp worker waiting -8038> 2014-05-19 10:46:24.176939 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:24.176826) v2 ==== 47+0+0 (3637252945 0 0) 0xa3dafc0 con 0x9656580 -8037> 2014-05-19 10:46:24.176997 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:24.176826) v2 -- ?+0 0xa243c00 con 0x9656580 -8036> 2014-05-19 10:46:24.177039 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:24.176826) v2 ==== 47+0+0 (3637252945 0 0) 0x9ad2fc0 con 0x9657340 -8035> 2014-05-19 10:46:24.177094 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -8034> 2014-05-19 10:46:24.177148 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:24.176826) v2 -- ?+0 0x9ebbc00 con 0x9657340 -8033> 2014-05-19 10:46:24.177183 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -8032> 2014-05-19 10:46:24.526086 7f5565600700 20 KeyValueStore::op_tp worker waiting -8031> 2014-05-19 10:46:24.599702 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:27.206019) v2 ==== 47+0+0 (2529208610 0 0) 0xac1bdc0 con 0x996fb80 -8030> 2014-05-19 10:46:24.599779 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:27.206019) v2 -- ?+0 0xa3dafc0 con 0x996fb80 -8029> 2014-05-19 10:46:24.599731 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:27.206019) v2 ==== 47+0+0 (2529208610 0 0) 0xac1ac40 con 0x9a0cdc0 -8028> 2014-05-19 10:46:24.599858 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -8027> 2014-05-19 10:46:24.600198 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:27.206019) v2 -- ?+0 0x9ad2fc0 con 0x9a0cdc0 -8026> 2014-05-19 10:46:24.600285 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -8025> 2014-05-19 10:46:24.701140 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:27.307470) v2 ==== 47+0+0 (3642574520 0 0) 0xac23dc0 con 0x7b90160 -8024> 2014-05-19 10:46:24.701144 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:27.307470) v2 ==== 47+0+0 (3642574520 0 0) 0xac22fc0 con 0x9b8db80 -8023> 2014-05-19 10:46:24.701190 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:27.307470) v2 -- ?+0 0xac1ac40 con 0x7b90160 -8022> 2014-05-19 10:46:24.701254 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -8021> 2014-05-19 10:46:24.701346 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:27.307470) v2 -- ?+0 0xac1bdc0 con 0x9b8db80 -8020> 2014-05-19 10:46:24.701424 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -8019> 2014-05-19 10:46:24.767449 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:28.711099) v2 ==== 47+0+0 (335399517 0 0) 0x9d0bc00 con 0x99d31e0 -8018> 2014-05-19 10:46:24.767436 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:28.711099) v2 ==== 47+0+0 (335399517 0 0) 0xa1021c0 con 0x95142c0 -8017> 2014-05-19 10:46:24.767491 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.711099) v2 -- ?+0 0xac22fc0 con 0x99d31e0 -8016> 2014-05-19 10:46:24.767517 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -8015> 2014-05-19 10:46:24.767548 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.711099) v2 -- ?+0 0xac23dc0 con 0x95142c0 -8014> 2014-05-19 10:46:24.767581 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -8013> 2014-05-19 10:46:24.767698 7f55551a5700 20 OSD::op_tp worker waiting -8012> 2014-05-19 10:46:24.767735 7f55579aa700 20 OSD::op_tp worker waiting -8011> 2014-05-19 10:46:24.767796 7f555a1af700 20 OSD::op_tp worker waiting -8010> 2014-05-19 10:46:24.769240 7f55541a3700 20 OSD::op_tp worker waiting -8009> 2014-05-19 10:46:24.769262 7f555a9b0700 20 OSD::op_tp worker waiting -8008> 2014-05-19 10:46:24.769279 7f55569a8700 20 OSD::op_tp worker waiting -8007> 2014-05-19 10:46:24.769303 7f55549a4700 20 OSD::op_tp worker waiting -8006> 2014-05-19 10:46:24.769335 7f555b1b1700 20 OSD::op_tp worker waiting -8005> 2014-05-19 10:46:24.769358 7f55589ac700 20 OSD::op_tp worker waiting -8004> 2014-05-19 10:46:24.770418 7f55571a9700 20 OSD::op_tp worker waiting -8003> 2014-05-19 10:46:24.770450 7f55559a6700 20 OSD::op_tp worker waiting -8002> 2014-05-19 10:46:24.770469 7f55581ab700 20 OSD::op_tp worker waiting -8001> 2014-05-19 10:46:24.770490 7f55539a2700 20 OSD::op_tp worker waiting -8000> 2014-05-19 10:46:24.770506 7f555219f700 20 OSD::op_tp worker waiting -7999> 2014-05-19 10:46:24.770520 7f55599ae700 20 OSD::op_tp worker waiting -7998> 2014-05-19 10:46:24.770534 7f55529a0700 20 OSD::op_tp worker waiting -7997> 2014-05-19 10:46:24.770553 7f55561a7700 20 OSD::op_tp worker waiting -7996> 2014-05-19 10:46:24.770590 7f555199e700 20 OSD::op_tp worker waiting -7995> 2014-05-19 10:46:24.770622 7f55531a1700 20 OSD::op_tp worker waiting -7994> 2014-05-19 10:46:24.770634 7f55591ad700 20 OSD::op_tp worker waiting -7993> 2014-05-19 10:46:24.884632 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 36 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:28.828317) v2 ==== 47+0+0 (2470280010 0 0) 0xa4a9340 con 0x95151e0 -7992> 2014-05-19 10:46:24.884710 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.828317) v2 -- ?+0 0xa1021c0 con 0x95151e0 -7991> 2014-05-19 10:46:24.884953 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -7990> 2014-05-19 10:46:24.885092 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 36 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:28.828317) v2 ==== 47+0+0 (2470280010 0 0) 0xa23ec40 con 0x9bb7b80 -7989> 2014-05-19 10:46:24.885152 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.828317) v2 -- ?+0 0x9d0bc00 con 0x9bb7b80 -7988> 2014-05-19 10:46:24.885185 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -7987> 2014-05-19 10:46:24.916240 7f5566602700 5 osd.0 245 tick -7986> 2014-05-19 10:46:24.916266 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -7985> 2014-05-19 10:46:24.916271 7f5566602700 10 osd.0 245 do_waiters -- start -7984> 2014-05-19 10:46:24.916274 7f5566602700 10 osd.0 245 do_waiters -- finish -7983> 2014-05-19 10:46:24.916311 7f555119d700 20 OSD::recovery_tp worker waiting -7982> 2014-05-19 10:46:25.005430 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:28.948954) v2 ==== 47+0+0 (50106415 0 0) 0xa4eea80 con 0x987b340 -7981> 2014-05-19 10:46:25.005485 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.948954) v2 -- ?+0 0xa23ec40 con 0x987b340 -7980> 2014-05-19 10:46:25.005564 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -7979> 2014-05-19 10:46:25.005272 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:28.948954) v2 ==== 47+0+0 (50106415 0 0) 0xa856e00 con 0x94e26e0 -7978> 2014-05-19 10:46:25.005870 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.948954) v2 -- ?+0 0xa4a9340 con 0x94e26e0 -7977> 2014-05-19 10:46:25.005916 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -7976> 2014-05-19 10:46:25.109483 7f5564dff700 20 KeyValueStore::op_tp worker waiting -7975> 2014-05-19 10:46:25.268743 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:29.212453) v2 ==== 47+0+0 (1862704701 0 0) 0x9ad2c40 con 0x95142c0 -7974> 2014-05-19 10:46:25.268768 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:29.212453) v2 ==== 47+0+0 (1862704701 0 0) 0x9d0bdc0 con 0x99d31e0 -7973> 2014-05-19 10:46:25.268793 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:29.212453) v2 -- ?+0 0xa856e00 con 0x95142c0 -7972> 2014-05-19 10:46:25.268894 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -7971> 2014-05-19 10:46:25.268932 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:29.212453) v2 -- ?+0 0xa4eea80 con 0x99d31e0 -7970> 2014-05-19 10:46:25.269004 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -7969> 2014-05-19 10:46:25.299098 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:29.242845) v2 ==== 47+0+0 (1633809860 0 0) 0xac08540 con 0x9743600 -7968> 2014-05-19 10:46:25.299222 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:29.242845) v2 -- ?+0 0x9ad2c40 con 0x9743600 -7967> 2014-05-19 10:46:25.299208 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:29.242845) v2 ==== 47+0+0 (1633809860 0 0) 0x9c08540 con 0x966e000 -7966> 2014-05-19 10:46:25.299443 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -7965> 2014-05-19 10:46:25.299524 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:29.242845) v2 -- ?+0 0x9d0bdc0 con 0x966e000 -7964> 2014-05-19 10:46:25.299573 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -7963> 2014-05-19 10:46:25.352589 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:27.958929) v2 ==== 47+0+0 (3392346540 0 0) 0x9b45180 con 0x9656000 -7962> 2014-05-19 10:46:25.352638 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:27.958929) v2 -- ?+0 0x9c08540 con 0x9656000 -7961> 2014-05-19 10:46:25.352718 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -7960> 2014-05-19 10:46:25.353011 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:27.958929) v2 ==== 47+0+0 (3392346540 0 0) 0xac17880 con 0x9937760 -7959> 2014-05-19 10:46:25.353052 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:27.958929) v2 -- ?+0 0xac08540 con 0x9937760 -7958> 2014-05-19 10:46:25.353152 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -7957> 2014-05-19 10:46:25.386149 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:29.329787) v2 ==== 47+0+0 (1487454945 0 0) 0xac2ae00 con 0x9bb7b80 -7956> 2014-05-19 10:46:25.386216 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:29.329787) v2 -- ?+0 0x9b45180 con 0x9bb7b80 -7955> 2014-05-19 10:46:25.386294 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -7954> 2014-05-19 10:46:25.386500 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:29.329787) v2 ==== 47+0+0 (1487454945 0 0) 0xac28e00 con 0x95151e0 -7953> 2014-05-19 10:46:25.386543 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:29.329787) v2 -- ?+0 0xac17880 con 0x95151e0 -7952> 2014-05-19 10:46:25.386576 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -7951> 2014-05-19 10:46:25.448441 7f555019b700 20 OSD::command_tp worker waiting -7950> 2014-05-19 10:46:25.451705 7f555099c700 20 OSD::disk_tp worker waiting -7949> 2014-05-19 10:46:25.729594 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:28.335929) v2 ==== 47+0+0 (1958580449 0 0) 0x9ad3500 con 0x96571e0 -7948> 2014-05-19 10:46:25.729648 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.335929) v2 -- ?+0 0xac28e00 con 0x96571e0 -7947> 2014-05-19 10:46:25.729683 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -7946> 2014-05-19 10:46:25.730133 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:28.335929) v2 ==== 47+0+0 (1958580449 0 0) 0xa4a8e00 con 0x9656420 -7945> 2014-05-19 10:46:25.730191 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.335929) v2 -- ?+0 0xac2ae00 con 0x9656420 -7944> 2014-05-19 10:46:25.730227 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -7943> 2014-05-19 10:46:25.878278 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:25.878103) v2 ==== 47+0+0 (1503763931 0 0) 0xac148c0 con 0x9656580 -7942> 2014-05-19 10:46:25.878326 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:25.878103) v2 -- ?+0 0xa4a8e00 con 0x9656580 -7941> 2014-05-19 10:46:25.878363 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -7940> 2014-05-19 10:46:25.878344 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:25.878103) v2 ==== 47+0+0 (1503763931 0 0) 0x9f6fc00 con 0x9657340 -7939> 2014-05-19 10:46:25.878387 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:25.878103) v2 -- ?+0 0x9ad3500 con 0x9657340 -7938> 2014-05-19 10:46:25.878421 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -7937> 2014-05-19 10:46:25.916347 7f5566602700 5 osd.0 245 tick -7936> 2014-05-19 10:46:25.916371 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -7935> 2014-05-19 10:46:25.916376 7f5566602700 10 osd.0 245 do_waiters -- start -7934> 2014-05-19 10:46:25.916378 7f5566602700 10 osd.0 245 do_waiters -- finish -7933> 2014-05-19 10:46:25.916416 7f555119d700 20 OSD::recovery_tp worker waiting -7932> 2014-05-19 10:46:26.231001 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:28.837337) v2 ==== 47+0+0 (1509033596 0 0) 0x9d52000 con 0x96571e0 -7931> 2014-05-19 10:46:26.231076 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.837337) v2 -- ?+0 0x9f6fc00 con 0x96571e0 -7930> 2014-05-19 10:46:26.231154 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -7929> 2014-05-19 10:46:26.231318 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:28.837337) v2 ==== 47+0+0 (1509033596 0 0) 0xa1eec40 con 0x9656420 -7928> 2014-05-19 10:46:26.231358 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.837337) v2 -- ?+0 0xac148c0 con 0x9656420 -7927> 2014-05-19 10:46:26.231426 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -7926> 2014-05-19 10:46:26.325712 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:28.932053) v2 ==== 47+0+0 (1172693861 0 0) 0xac28fc0 con 0x9aa3600 -7925> 2014-05-19 10:46:26.325762 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.932053) v2 -- ?+0 0x9d52000 con 0x9aa3600 -7924> 2014-05-19 10:46:26.325861 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -7923> 2014-05-19 10:46:26.325755 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:28.932053) v2 ==== 47+0+0 (1172693861 0 0) 0xac29dc0 con 0x9b8c160 -7922> 2014-05-19 10:46:26.325951 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.932053) v2 -- ?+0 0xa1eec40 con 0x9b8c160 -7921> 2014-05-19 10:46:26.326254 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -7920> 2014-05-19 10:46:26.336673 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:28.942995) v2 ==== 47+0+0 (679405256 0 0) 0xa74ae00 con 0x996e000 -7919> 2014-05-19 10:46:26.336690 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:28.942995) v2 ==== 47+0+0 (679405256 0 0) 0xa0bd880 con 0x9a0c9a0 -7918> 2014-05-19 10:46:26.336755 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.942995) v2 -- ?+0 0xac29dc0 con 0x996e000 -7917> 2014-05-19 10:46:26.336810 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -7916> 2014-05-19 10:46:26.336965 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.942995) v2 -- ?+0 0xac28fc0 con 0x9a0c9a0 -7915> 2014-05-19 10:46:26.337170 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -7914> 2014-05-19 10:46:26.352119 7f555c1b3700 10 monclient: tick -7913> 2014-05-19 10:46:26.352133 7f555c1b3700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2014-05-19 10:45:56.352132) -7912> 2014-05-19 10:46:26.352153 7f555c1b3700 10 monclient: renew subs? (now: 2014-05-19 10:46:26.352153; renew after: 2014-05-19 10:47:03.081841) -- no -7911> 2014-05-19 10:46:26.379693 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:26.379526) v2 ==== 47+0+0 (3377456614 0 0) 0xa05ea80 con 0x9656580 -7910> 2014-05-19 10:46:26.379733 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:26.379526) v2 ==== 47+0+0 (3377456614 0 0) 0xa0cbdc0 con 0x9657340 -7909> 2014-05-19 10:46:26.379745 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.379526) v2 -- ?+0 0xa74ae00 con 0x9656580 -7908> 2014-05-19 10:46:26.379794 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -7907> 2014-05-19 10:46:26.379821 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.379526) v2 -- ?+0 0xa0bd880 con 0x9657340 -7906> 2014-05-19 10:46:26.379871 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -7905> 2014-05-19 10:46:26.400384 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:30.344206) v2 ==== 47+0+0 (1392381924 0 0) 0x9c081c0 con 0x966e000 -7904> 2014-05-19 10:46:26.400426 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:30.344206) v2 -- ?+0 0xa05ea80 con 0x966e000 -7903> 2014-05-19 10:46:26.400463 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -7902> 2014-05-19 10:46:26.400483 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:30.344206) v2 ==== 47+0+0 (1392381924 0 0) 0xac08700 con 0x9743600 -7901> 2014-05-19 10:46:26.400513 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:30.344206) v2 -- ?+0 0xa0cbdc0 con 0x9743600 -7900> 2014-05-19 10:46:26.400583 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -7899> 2014-05-19 10:46:26.410891 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 32 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:30.354700) v2 ==== 47+0+0 (1077805067 0 0) 0xa3db880 con 0x94802c0 -7898> 2014-05-19 10:46:26.410901 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 32 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:30.354700) v2 ==== 47+0+0 (1077805067 0 0) 0xa078540 con 0x987b760 -7897> 2014-05-19 10:46:26.410953 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:30.354700) v2 -- ?+0 0xac08700 con 0x94802c0 -7896> 2014-05-19 10:46:26.411071 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -7895> 2014-05-19 10:46:26.411181 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:30.354700) v2 -- ?+0 0x9c081c0 con 0x987b760 -7894> 2014-05-19 10:46:26.411262 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -7893> 2014-05-19 10:46:26.444922 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:29.051262) v2 ==== 47+0+0 (384805078 0 0) 0x9b45880 con 0x9b8de40 -7892> 2014-05-19 10:46:26.444916 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:29.051262) v2 ==== 47+0+0 (384805078 0 0) 0x94256c0 con 0x94e2160 -7891> 2014-05-19 10:46:26.445001 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:29.051262) v2 -- ?+0 0xa078540 con 0x9b8de40 -7890> 2014-05-19 10:46:26.445192 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -7889> 2014-05-19 10:46:26.445215 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:29.051262) v2 -- ?+0 0xa3db880 con 0x94e2160 -7888> 2014-05-19 10:46:26.445250 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -7887> 2014-05-19 10:46:26.526185 7f5565600700 20 KeyValueStore::op_tp worker waiting -7886> 2014-05-19 10:46:26.767794 7f55551a5700 20 OSD::op_tp worker waiting -7885> 2014-05-19 10:46:26.767816 7f55579aa700 20 OSD::op_tp worker waiting -7884> 2014-05-19 10:46:26.767903 7f555a1af700 20 OSD::op_tp worker waiting -7883> 2014-05-19 10:46:26.769340 7f55541a3700 20 OSD::op_tp worker waiting -7882> 2014-05-19 10:46:26.769369 7f555a9b0700 20 OSD::op_tp worker waiting -7881> 2014-05-19 10:46:26.769387 7f55549a4700 20 OSD::op_tp worker waiting -7880> 2014-05-19 10:46:26.769429 7f55589ac700 20 OSD::op_tp worker waiting -7879> 2014-05-19 10:46:26.769457 7f55569a8700 20 OSD::op_tp worker waiting -7878> 2014-05-19 10:46:26.769480 7f555b1b1700 20 OSD::op_tp worker waiting -7877> 2014-05-19 10:46:26.770500 7f55571a9700 20 OSD::op_tp worker waiting -7876> 2014-05-19 10:46:26.770534 7f55559a6700 20 OSD::op_tp worker waiting -7875> 2014-05-19 10:46:26.770556 7f55581ab700 20 OSD::op_tp worker waiting -7874> 2014-05-19 10:46:26.770573 7f55539a2700 20 OSD::op_tp worker waiting -7873> 2014-05-19 10:46:26.770595 7f55599ae700 20 OSD::op_tp worker waiting -7872> 2014-05-19 10:46:26.770609 7f555219f700 20 OSD::op_tp worker waiting -7871> 2014-05-19 10:46:26.770629 7f55561a7700 20 OSD::op_tp worker waiting -7870> 2014-05-19 10:46:26.770646 7f55529a0700 20 OSD::op_tp worker waiting -7869> 2014-05-19 10:46:26.770657 7f555199e700 20 OSD::op_tp worker waiting -7868> 2014-05-19 10:46:26.770692 7f55531a1700 20 OSD::op_tp worker waiting -7867> 2014-05-19 10:46:26.770706 7f55591ad700 20 OSD::op_tp worker waiting -7866> 2014-05-19 10:46:26.916463 7f5566602700 5 osd.0 245 tick -7865> 2014-05-19 10:46:26.916516 7f555119d700 20 OSD::recovery_tp worker waiting -7864> 2014-05-19 10:46:26.916517 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 3.23 >= max 0.5 = no, load too high -7863> 2014-05-19 10:46:26.916531 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -7862> 2014-05-19 10:46:26.916534 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2207.45 < min (86400 seconds) -7861> 2014-05-19 10:46:26.916553 7f5566602700 20 osd.0 245 sched_scrub done -7860> 2014-05-19 10:46:26.916556 7f5566602700 10 osd.0 245 do_waiters -- start -7859> 2014-05-19 10:46:26.916558 7f5566602700 10 osd.0 245 do_waiters -- finish -7858> 2014-05-19 10:46:26.944310 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -7857> 2014-05-19 10:46:26.944331 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -7856> 2014-05-19 10:46:26.944340 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xac1b880 con 0x9bdc840 -7855> 2014-05-19 10:46:26.944366 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xac1aa80 con 0x9ad4420 -7854> 2014-05-19 10:46:26.944404 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0x9236380 con 0x9bf31e0 -7853> 2014-05-19 10:46:26.944419 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0x9b50000 con 0x998b340 -7852> 2014-05-19 10:46:26.944433 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa447c00 con 0x9b92840 -7851> 2014-05-19 10:46:26.944447 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa5fc1c0 con 0x9ad49a0 -7850> 2014-05-19 10:46:26.944477 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa092c40 con 0x7b911e0 -7849> 2014-05-19 10:46:26.944549 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa030fc0 con 0x7b918c0 -7848> 2014-05-19 10:46:26.944582 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0x97c2c40 con 0x9aa8c60 -7847> 2014-05-19 10:46:26.944617 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0x9ad2000 con 0x9bfa000 -7846> 2014-05-19 10:46:26.944656 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa507180 con 0x7c23e40 -7845> 2014-05-19 10:46:26.944688 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa665a40 con 0x998b760 -7844> 2014-05-19 10:46:26.944718 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa45e1c0 con 0x7b91080 -7843> 2014-05-19 10:46:26.944744 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa236540 con 0xa28fb80 -7842> 2014-05-19 10:46:26.944732 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xa385340 con 0x9bdc840 -7841> 2014-05-19 10:46:26.944762 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa516700 con 0x76bdce0 -7840> 2014-05-19 10:46:26.944788 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa0ea000 con 0x994ab00 -7839> 2014-05-19 10:46:26.944819 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa4a8000 con 0x9ac8b00 -7838> 2014-05-19 10:46:26.944843 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa1e5c00 con 0x938de40 -7837> 2014-05-19 10:46:26.944882 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa2661c0 con 0x9970b00 -7836> 2014-05-19 10:46:26.944911 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0x9ed2540 con 0x99706e0 -7835> 2014-05-19 10:46:26.944941 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa506700 con 0x9bb6f20 -7834> 2014-05-19 10:46:26.944972 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa6abdc0 con 0x994b340 -7833> 2014-05-19 10:46:26.944992 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa856c40 con 0x98fa2c0 -7832> 2014-05-19 10:46:26.945008 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa264a80 con 0x996f8c0 -7831> 2014-05-19 10:46:26.945027 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0x948fc00 con 0x996fa20 -7830> 2014-05-19 10:46:26.945044 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0x9c6f180 con 0x9ac8160 -7829> 2014-05-19 10:46:26.945088 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa856380 con 0x7b90420 -7828> 2014-05-19 10:46:26.945128 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa873c00 con 0x919fe40 -7827> 2014-05-19 10:46:26.945147 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xac14c40 con 0x9971760 -7826> 2014-05-19 10:46:26.945170 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa4ffdc0 con 0x994af20 -7825> 2014-05-19 10:46:26.945185 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa864a80 con 0x989be40 -7824> 2014-05-19 10:46:26.945199 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0x9fa4fc0 con 0x9adf4a0 -7823> 2014-05-19 10:46:26.945215 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xac16e00 con 0x9776160 -7822> 2014-05-19 10:46:26.945254 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa2dee00 con 0x96bd8c0 -7821> 2014-05-19 10:46:26.945285 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0x9d021c0 con 0x96bcdc0 -7820> 2014-05-19 10:46:26.945314 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0x9cb48c0 con 0x96954a0 -7819> 2014-05-19 10:46:26.945334 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0x9fa8380 con 0x76bd8c0 -7818> 2014-05-19 10:46:26.945357 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa864700 con 0x7b90dc0 -7817> 2014-05-19 10:46:26.945384 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0x9cd0c40 con 0x978d8c0 -7816> 2014-05-19 10:46:26.945490 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0x9e9fc00 con 0x978c580 -7815> 2014-05-19 10:46:26.945527 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0x9c6efc0 con 0x978d340 -7814> 2014-05-19 10:46:26.945555 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:26.944338) v2 -- ?+0 0xa6abc00 con 0x96374a0 -7813> 2014-05-19 10:46:26.945656 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -7812> 2014-05-19 10:46:26.945683 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0x9faa380 con 0x9ad4420 -7811> 2014-05-19 10:46:26.945712 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -7810> 2014-05-19 10:46:26.945721 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xac16380 con 0x9bf31e0 -7809> 2014-05-19 10:46:26.945739 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -7808> 2014-05-19 10:46:26.945747 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0x9e716c0 con 0x998b340 -7807> 2014-05-19 10:46:26.945762 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -7806> 2014-05-19 10:46:26.945802 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xa1efdc0 con 0x9b92840 -7805> 2014-05-19 10:46:26.945840 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -7804> 2014-05-19 10:46:26.945856 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xac09880 con 0x9ad49a0 -7803> 2014-05-19 10:46:26.945881 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -7802> 2014-05-19 10:46:26.946003 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0x9fd9340 con 0x7b911e0 -7801> 2014-05-19 10:46:26.946026 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -7800> 2014-05-19 10:46:26.946035 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xac081c0 con 0x7b918c0 -7799> 2014-05-19 10:46:26.946050 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -7798> 2014-05-19 10:46:26.946058 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xa384fc0 con 0x9aa8c60 -7797> 2014-05-19 10:46:26.946076 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -7796> 2014-05-19 10:46:26.946083 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0x9547dc0 con 0x9bfa000 -7795> 2014-05-19 10:46:26.946097 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -7794> 2014-05-19 10:46:26.946102 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xa093880 con 0x7c23e40 -7793> 2014-05-19 10:46:26.946118 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -7792> 2014-05-19 10:46:26.946123 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xac17500 con 0x998b760 -7791> 2014-05-19 10:46:26.946137 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -7790> 2014-05-19 10:46:26.946147 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xa2df340 con 0x7b91080 -7789> 2014-05-19 10:46:26.946161 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -7788> 2014-05-19 10:46:26.946169 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0x9c6e700 con 0xa28fb80 -7787> 2014-05-19 10:46:26.946183 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -7786> 2014-05-19 10:46:26.946188 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0x9feca80 con 0x76bdce0 -7785> 2014-05-19 10:46:26.946205 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -7784> 2014-05-19 10:46:26.946211 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xa1e56c0 con 0x994ab00 -7783> 2014-05-19 10:46:26.946224 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -7782> 2014-05-19 10:46:26.946229 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xa4ef180 con 0x9ac8b00 -7781> 2014-05-19 10:46:26.946246 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -7780> 2014-05-19 10:46:26.946251 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0x9e9fa40 con 0x938de40 -7779> 2014-05-19 10:46:26.946266 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -7778> 2014-05-19 10:46:26.946275 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xa0bd180 con 0x9970b00 -7777> 2014-05-19 10:46:26.946292 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -7776> 2014-05-19 10:46:26.946300 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xa1ef6c0 con 0x99706e0 -7775> 2014-05-19 10:46:26.946314 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -7774> 2014-05-19 10:46:26.946323 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0x9d23dc0 con 0x9bb6f20 -7773> 2014-05-19 10:46:26.946340 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -7772> 2014-05-19 10:46:26.946348 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xa1e4e00 con 0x994b340 -7771> 2014-05-19 10:46:26.946364 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -7770> 2014-05-19 10:46:26.946371 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0x9ffcfc0 con 0x98fa2c0 -7769> 2014-05-19 10:46:26.946386 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -7768> 2014-05-19 10:46:26.946394 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xa6648c0 con 0x996f8c0 -7767> 2014-05-19 10:46:26.946411 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -7766> 2014-05-19 10:46:26.946419 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0x9f75500 con 0x996fa20 -7765> 2014-05-19 10:46:26.946433 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -7764> 2014-05-19 10:46:26.946438 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xa4fe380 con 0x9ac8160 -7763> 2014-05-19 10:46:26.946451 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -7762> 2014-05-19 10:46:26.946459 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0x9ee2700 con 0x7b90420 -7761> 2014-05-19 10:46:26.946476 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -7760> 2014-05-19 10:46:26.946483 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xa5161c0 con 0x919fe40 -7759> 2014-05-19 10:46:26.946497 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -7758> 2014-05-19 10:46:26.946510 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xa0bac40 con 0x9971760 -7757> 2014-05-19 10:46:26.946528 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -7756> 2014-05-19 10:46:26.946535 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xac17340 con 0x994af20 -7755> 2014-05-19 10:46:26.946549 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -7754> 2014-05-19 10:46:26.946556 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0x9fa41c0 con 0x989be40 -7753> 2014-05-19 10:46:26.946571 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -7752> 2014-05-19 10:46:26.946578 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xa8648c0 con 0x9adf4a0 -7751> 2014-05-19 10:46:26.946592 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -7750> 2014-05-19 10:46:26.946599 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xa4fe1c0 con 0x9776160 -7749> 2014-05-19 10:46:26.946614 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -7748> 2014-05-19 10:46:26.946621 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xac15180 con 0x96bd8c0 -7747> 2014-05-19 10:46:26.946634 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -7746> 2014-05-19 10:46:26.946643 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0x9cd0c40 con 0x96bcdc0 -7745> 2014-05-19 10:46:26.946658 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -7744> 2014-05-19 10:46:26.946665 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0x92a16c0 con 0x96954a0 -7743> 2014-05-19 10:46:26.946679 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -7742> 2014-05-19 10:46:26.946687 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 36 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0x9c6e1c0 con 0x76bd8c0 -7741> 2014-05-19 10:46:26.946703 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -7740> 2014-05-19 10:46:26.946710 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 36 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0x9f18c40 con 0x7b90dc0 -7739> 2014-05-19 10:46:26.946724 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -7738> 2014-05-19 10:46:26.946731 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 35 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xac1a1c0 con 0x978d8c0 -7737> 2014-05-19 10:46:26.946745 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -7736> 2014-05-19 10:46:26.946753 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 35 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0xac1afc0 con 0x978c580 -7735> 2014-05-19 10:46:26.946767 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -7734> 2014-05-19 10:46:26.946774 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 34 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0x9d3cfc0 con 0x978d340 -7733> 2014-05-19 10:46:26.946788 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -7732> 2014-05-19 10:46:26.946796 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 34 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:26.944338) v2 ==== 47+0+0 (3743583619 0 0) 0x9fd8fc0 con 0x96374a0 -7731> 2014-05-19 10:46:26.946810 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -7730> 2014-05-19 10:46:26.992628 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:29.598969) v2 ==== 47+0+0 (586358941 0 0) 0x9b44540 con 0x96562c0 -7729> 2014-05-19 10:46:26.992646 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:29.598969) v2 ==== 47+0+0 (586358941 0 0) 0x9e6d180 con 0x9657080 -7728> 2014-05-19 10:46:26.992679 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:29.598969) v2 -- ?+0 0x9b45880 con 0x96562c0 -7727> 2014-05-19 10:46:26.992915 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -7726> 2014-05-19 10:46:26.993181 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:29.598969) v2 -- ?+0 0x94256c0 con 0x9657080 -7725> 2014-05-19 10:46:26.993218 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -7724> 2014-05-19 10:46:27.109580 7f5564dff700 20 KeyValueStore::op_tp worker waiting -7723> 2014-05-19 10:46:27.155480 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 35 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.099206) v2 ==== 47+0+0 (1883709271 0 0) 0xa23ee00 con 0x9970840 -7722> 2014-05-19 10:46:27.155521 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.099206) v2 -- ?+0 0x9b44540 con 0x9970840 -7721> 2014-05-19 10:46:27.155425 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 35 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.099206) v2 ==== 47+0+0 (1883709271 0 0) 0x92b1180 con 0x97434a0 -7720> 2014-05-19 10:46:27.156037 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -7719> 2014-05-19 10:46:27.156074 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.099206) v2 -- ?+0 0x9e6d180 con 0x97434a0 -7718> 2014-05-19 10:46:27.156129 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -7717> 2014-05-19 10:46:27.448534 7f555019b700 20 OSD::command_tp worker waiting -7716> 2014-05-19 10:46:27.451804 7f555099c700 20 OSD::disk_tp worker waiting -7715> 2014-05-19 10:46:27.656998 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 36 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.600851) v2 ==== 47+0+0 (3408389649 0 0) 0xa23f180 con 0x9970840 -7714> 2014-05-19 10:46:27.657004 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 36 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.600851) v2 ==== 47+0+0 (3408389649 0 0) 0xa0ea8c0 con 0x97434a0 -7713> 2014-05-19 10:46:27.657047 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.600851) v2 -- ?+0 0xa23ee00 con 0x9970840 -7712> 2014-05-19 10:46:27.657149 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -7711> 2014-05-19 10:46:27.657176 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.600851) v2 -- ?+0 0x92b1180 con 0x97434a0 -7710> 2014-05-19 10:46:27.657483 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -7709> 2014-05-19 10:46:27.852865 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.796695) v2 ==== 47+0+0 (286155947 0 0) 0xa4a9180 con 0x99718c0 -7708> 2014-05-19 10:46:27.852931 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.796695) v2 -- ?+0 0xa23f180 con 0x99718c0 -7707> 2014-05-19 10:46:27.852969 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -7706> 2014-05-19 10:46:27.852873 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.796695) v2 ==== 47+0+0 (286155947 0 0) 0x9faa8c0 con 0x97431e0 -7705> 2014-05-19 10:46:27.852993 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.796695) v2 -- ?+0 0xa0ea8c0 con 0x97431e0 -7704> 2014-05-19 10:46:27.853066 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -7703> 2014-05-19 10:46:27.867990 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.811862) v2 ==== 47+0+0 (3465943215 0 0) 0xa0eb340 con 0x99d3340 -7702> 2014-05-19 10:46:27.868034 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.811862) v2 -- ?+0 0xa4a9180 con 0x99d3340 -7701> 2014-05-19 10:46:27.868041 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.811862) v2 ==== 47+0+0 (3465943215 0 0) 0xa74a8c0 con 0x94a5a20 -7700> 2014-05-19 10:46:27.868136 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -7699> 2014-05-19 10:46:27.868174 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.811862) v2 -- ?+0 0x9faa8c0 con 0x94a5a20 -7698> 2014-05-19 10:46:27.868210 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -7697> 2014-05-19 10:46:27.890612 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.834447) v2 ==== 47+0+0 (3743261643 0 0) 0xa36ddc0 con 0x94e3e40 -7696> 2014-05-19 10:46:27.890686 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.834447) v2 -- ?+0 0xa74a8c0 con 0x94e3e40 -7695> 2014-05-19 10:46:27.890741 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -7694> 2014-05-19 10:46:27.890762 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.834447) v2 ==== 47+0+0 (3743261643 0 0) 0xa4ef340 con 0x9bb69a0 -7693> 2014-05-19 10:46:27.890868 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.834447) v2 -- ?+0 0xa0eb340 con 0x9bb69a0 -7692> 2014-05-19 10:46:27.890942 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -7691> 2014-05-19 10:46:27.916634 7f5566602700 5 osd.0 245 tick -7690> 2014-05-19 10:46:27.916654 7f5566602700 7 osd.0 245 do_mon_report -7689> 2014-05-19 10:46:27.916658 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 -7688> 2014-05-19 10:46:27.916662 7f5566602700 20 osd.0 245 send_pg_stats -7687> 2014-05-19 10:46:27.916687 7f555119d700 20 OSD::recovery_tp worker waiting -7686> 2014-05-19 10:46:27.916699 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 3.23 >= max 0.5 = no, load too high -7685> 2014-05-19 10:46:27.916712 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -7684> 2014-05-19 10:46:27.916715 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2208.45 < min (86400 seconds) -7683> 2014-05-19 10:46:27.916734 7f5566602700 20 osd.0 245 sched_scrub done -7682> 2014-05-19 10:46:27.916737 7f5566602700 10 osd.0 245 do_waiters -- start -7681> 2014-05-19 10:46:27.916739 7f5566602700 10 osd.0 245 do_waiters -- finish -7680> 2014-05-19 10:46:28.169944 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:32.113796) v2 ==== 47+0+0 (3445439930 0 0) 0x9ad3dc0 con 0x95142c0 -7679> 2014-05-19 10:46:28.169944 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:32.113796) v2 ==== 47+0+0 (3445439930 0 0) 0xa265880 con 0x99d31e0 -7678> 2014-05-19 10:46:28.170421 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:32.113796) v2 -- ?+0 0xa36ddc0 con 0x95142c0 -7677> 2014-05-19 10:46:28.170454 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -7676> 2014-05-19 10:46:28.170480 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:32.113796) v2 -- ?+0 0xa4ef340 con 0x99d31e0 -7675> 2014-05-19 10:46:28.170512 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -7674> 2014-05-19 10:46:28.287247 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:32.231082) v2 ==== 47+0+0 (951119353 0 0) 0xac28c40 con 0x95151e0 -7673> 2014-05-19 10:46:28.287296 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:32.231082) v2 -- ?+0 0x9ad3dc0 con 0x95151e0 -7672> 2014-05-19 10:46:28.287294 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:32.231082) v2 ==== 47+0+0 (951119353 0 0) 0xac2ac40 con 0x9bb7b80 -7671> 2014-05-19 10:46:28.287374 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -7670> 2014-05-19 10:46:28.287664 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:32.231082) v2 -- ?+0 0xa265880 con 0x9bb7b80 -7669> 2014-05-19 10:46:28.287747 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -7668> 2014-05-19 10:46:28.369445 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:32.313329) v2 ==== 47+0+0 (1073727875 0 0) 0xa064e00 con 0x99d3340 -7667> 2014-05-19 10:46:28.369471 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:32.313329) v2 ==== 47+0+0 (1073727875 0 0) 0x9b44e00 con 0x94a5a20 -7666> 2014-05-19 10:46:28.369493 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:32.313329) v2 -- ?+0 0xac2ac40 con 0x99d3340 -7665> 2014-05-19 10:46:28.369568 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -7664> 2014-05-19 10:46:28.369614 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:32.313329) v2 -- ?+0 0xac28c40 con 0x94a5a20 -7663> 2014-05-19 10:46:28.369704 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -7662> 2014-05-19 10:46:28.526284 7f5565600700 20 KeyValueStore::op_tp worker waiting -7661> 2014-05-19 10:46:28.532290 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.138643) v2 ==== 47+0+0 (1349399445 0 0) 0x9fa8c40 con 0x96571e0 -7660> 2014-05-19 10:46:28.532349 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.138643) v2 ==== 47+0+0 (1349399445 0 0) 0xa1eea80 con 0x9656420 -7659> 2014-05-19 10:46:28.532341 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.138643) v2 -- ?+0 0x9b44e00 con 0x96571e0 -7658> 2014-05-19 10:46:28.532454 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -7657> 2014-05-19 10:46:28.532733 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.138643) v2 -- ?+0 0xa064e00 con 0x9656420 -7656> 2014-05-19 10:46:28.532776 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -7655> 2014-05-19 10:46:28.634606 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.240981) v2 ==== 47+0+0 (930761220 0 0) 0x9748e00 con 0x95846e0 -7654> 2014-05-19 10:46:28.634673 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.240981) v2 -- ?+0 0xa1eea80 con 0x95846e0 -7653> 2014-05-19 10:46:28.634949 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -7652> 2014-05-19 10:46:28.634617 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.240981) v2 ==== 47+0+0 (930761220 0 0) 0xa4fefc0 con 0x9983600 -7651> 2014-05-19 10:46:28.634987 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.240981) v2 -- ?+0 0x9fa8c40 con 0x9983600 -7650> 2014-05-19 10:46:28.635065 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -7649> 2014-05-19 10:46:28.638012 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.244379) v2 ==== 47+0+0 (650210052 0 0) 0x92b0c40 con 0x996e000 -7648> 2014-05-19 10:46:28.638063 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.244379) v2 -- ?+0 0x9748e00 con 0x996e000 -7647> 2014-05-19 10:46:28.638046 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.244379) v2 ==== 47+0+0 (650210052 0 0) 0xa103340 con 0x9a0c9a0 -7646> 2014-05-19 10:46:28.638145 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -7645> 2014-05-19 10:46:28.638361 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.244379) v2 -- ?+0 0xa4fefc0 con 0x9a0c9a0 -7644> 2014-05-19 10:46:28.638402 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -7643> 2014-05-19 10:46:28.645718 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -7642> 2014-05-19 10:46:28.645739 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -7641> 2014-05-19 10:46:28.645748 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xa1eee00 con 0x9bdc840 -7640> 2014-05-19 10:46:28.645774 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xa163a40 con 0x9ad4420 -7639> 2014-05-19 10:46:28.645815 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0x99e0540 con 0x9bf31e0 -7638> 2014-05-19 10:46:28.645831 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xa8721c0 con 0x998b340 -7637> 2014-05-19 10:46:28.645847 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xa5076c0 con 0x9b92840 -7636> 2014-05-19 10:46:28.645888 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0x9562700 con 0x9ad49a0 -7635> 2014-05-19 10:46:28.645913 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xa4a88c0 con 0x7b911e0 -7634> 2014-05-19 10:46:28.645940 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xa447880 con 0x7b918c0 -7633> 2014-05-19 10:46:28.645967 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xac168c0 con 0x9aa8c60 -7632> 2014-05-19 10:46:28.645995 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0x9f43c00 con 0x9bfa000 -7631> 2014-05-19 10:46:28.646063 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0x9c09180 con 0x7c23e40 -7630> 2014-05-19 10:46:28.646090 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xa4461c0 con 0x998b760 -7629> 2014-05-19 10:46:28.646122 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xac08fc0 con 0x7b91080 -7628> 2014-05-19 10:46:28.646151 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xa74a540 con 0xa28fb80 -7627> 2014-05-19 10:46:28.646179 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xa5161c0 con 0x76bdce0 -7626> 2014-05-19 10:46:28.646130 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0x9caae00 con 0x9bdc840 -7625> 2014-05-19 10:46:28.646209 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0x9ee2700 con 0x994ab00 -7624> 2014-05-19 10:46:28.646246 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xa4fe380 con 0x9ac8b00 -7623> 2014-05-19 10:46:28.646290 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0x9f75500 con 0x938de40 -7622> 2014-05-19 10:46:28.646316 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xa6648c0 con 0x9970b00 -7621> 2014-05-19 10:46:28.646340 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0x9ffcfc0 con 0x99706e0 -7620> 2014-05-19 10:46:28.646366 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xa1e4e00 con 0x9bb6f20 -7619> 2014-05-19 10:46:28.646389 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0x9d23dc0 con 0x994b340 -7618> 2014-05-19 10:46:28.646413 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xa1ef6c0 con 0x98fa2c0 -7617> 2014-05-19 10:46:28.646435 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xa0bd180 con 0x996f8c0 -7616> 2014-05-19 10:46:28.646523 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0x9e9fa40 con 0x996fa20 -7615> 2014-05-19 10:46:28.646581 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xa4ef180 con 0x9ac8160 -7614> 2014-05-19 10:46:28.646618 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xa1e56c0 con 0x7b90420 -7613> 2014-05-19 10:46:28.646641 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0x9feca80 con 0x919fe40 -7612> 2014-05-19 10:46:28.646666 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0x9c6e700 con 0x9971760 -7611> 2014-05-19 10:46:28.646689 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xa2df340 con 0x994af20 -7610> 2014-05-19 10:46:28.646711 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xac17500 con 0x989be40 -7609> 2014-05-19 10:46:28.646733 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xa093880 con 0x9adf4a0 -7608> 2014-05-19 10:46:28.646757 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0x9547dc0 con 0x9776160 -7607> 2014-05-19 10:46:28.646797 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xa384fc0 con 0x96bd8c0 -7606> 2014-05-19 10:46:28.646822 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xac081c0 con 0x96bcdc0 -7605> 2014-05-19 10:46:28.646850 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0x9fd9340 con 0x96954a0 -7604> 2014-05-19 10:46:28.646904 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xac09880 con 0x76bd8c0 -7603> 2014-05-19 10:46:28.646934 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xa1efdc0 con 0x7b90dc0 -7602> 2014-05-19 10:46:28.646958 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0x9e716c0 con 0x978d8c0 -7601> 2014-05-19 10:46:28.646981 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xac16380 con 0x978c580 -7600> 2014-05-19 10:46:28.647033 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0x9faa380 con 0x978d340 -7599> 2014-05-19 10:46:28.647061 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:28.645746) v2 -- ?+0 0xa385340 con 0x96374a0 -7598> 2014-05-19 10:46:28.647102 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -7597> 2014-05-19 10:46:28.647158 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa0eaa80 con 0x9ad4420 -7596> 2014-05-19 10:46:28.647231 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -7595> 2014-05-19 10:46:28.647250 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xac161c0 con 0x9bf31e0 -7594> 2014-05-19 10:46:28.647304 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -7593> 2014-05-19 10:46:28.647318 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa1efa40 con 0x998b340 -7592> 2014-05-19 10:46:28.647353 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -7591> 2014-05-19 10:46:28.647406 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa1eefc0 con 0x9b92840 -7590> 2014-05-19 10:46:28.647449 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -7589> 2014-05-19 10:46:28.647462 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0x9c09a40 con 0x9ad49a0 -7588> 2014-05-19 10:46:28.647481 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -7587> 2014-05-19 10:46:28.647516 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0x9d20380 con 0x7b911e0 -7586> 2014-05-19 10:46:28.647543 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -7585> 2014-05-19 10:46:28.647552 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xac08000 con 0x7b918c0 -7584> 2014-05-19 10:46:28.647569 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -7583> 2014-05-19 10:46:28.647579 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0x9cce8c0 con 0x9aa8c60 -7582> 2014-05-19 10:46:28.647623 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -7581> 2014-05-19 10:46:28.647633 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa617340 con 0x9bfa000 -7580> 2014-05-19 10:46:28.647651 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -7579> 2014-05-19 10:46:28.647661 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa092000 con 0x7c23e40 -7578> 2014-05-19 10:46:28.647679 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -7577> 2014-05-19 10:46:28.647686 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0x9c6fa40 con 0x998b760 -7576> 2014-05-19 10:46:28.647701 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -7575> 2014-05-19 10:46:28.647708 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa2de8c0 con 0x7b91080 -7574> 2014-05-19 10:46:28.647722 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -7573> 2014-05-19 10:46:28.647729 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0x9c06a80 con 0xa28fb80 -7572> 2014-05-19 10:46:28.647745 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -7571> 2014-05-19 10:46:28.647753 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa873340 con 0x76bdce0 -7570> 2014-05-19 10:46:28.647770 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -7569> 2014-05-19 10:46:28.647777 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa1e4380 con 0x994ab00 -7568> 2014-05-19 10:46:28.647791 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -7567> 2014-05-19 10:46:28.647799 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa857500 con 0x9ac8b00 -7566> 2014-05-19 10:46:28.647813 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -7565> 2014-05-19 10:46:28.647821 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0x9d448c0 con 0x938de40 -7564> 2014-05-19 10:46:28.647834 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -7563> 2014-05-19 10:46:28.647849 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa236700 con 0x9970b00 -7562> 2014-05-19 10:46:28.647867 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -7561> 2014-05-19 10:46:28.647875 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa4a96c0 con 0x99706e0 -7560> 2014-05-19 10:46:28.647888 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -7559> 2014-05-19 10:46:28.647896 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa2bd500 con 0x9bb6f20 -7558> 2014-05-19 10:46:28.647911 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -7557> 2014-05-19 10:46:28.647915 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0x97d2a80 con 0x994b340 -7556> 2014-05-19 10:46:28.647929 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -7555> 2014-05-19 10:46:28.647936 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0x9c6efc0 con 0x98fa2c0 -7554> 2014-05-19 10:46:28.647953 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -7553> 2014-05-19 10:46:28.647960 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0x9cb6700 con 0x996f8c0 -7552> 2014-05-19 10:46:28.647974 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -7551> 2014-05-19 10:46:28.647983 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa817a40 con 0x996fa20 -7550> 2014-05-19 10:46:28.647998 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -7549> 2014-05-19 10:46:28.648005 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa645c00 con 0x9ac8160 -7548> 2014-05-19 10:46:28.648019 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -7547> 2014-05-19 10:46:28.648027 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa872fc0 con 0x7b90420 -7546> 2014-05-19 10:46:28.648045 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -7545> 2014-05-19 10:46:28.648052 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa209180 con 0x919fe40 -7544> 2014-05-19 10:46:28.648066 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -7543> 2014-05-19 10:46:28.648073 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa030380 con 0x9971760 -7542> 2014-05-19 10:46:28.648090 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -7541> 2014-05-19 10:46:28.648097 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa1ef180 con 0x994af20 -7540> 2014-05-19 10:46:28.648111 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -7539> 2014-05-19 10:46:28.648118 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0x9fa5c00 con 0x989be40 -7538> 2014-05-19 10:46:28.648133 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -7537> 2014-05-19 10:46:28.648140 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa816a80 con 0x9adf4a0 -7536> 2014-05-19 10:46:28.648153 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -7535> 2014-05-19 10:46:28.648160 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0x95e7180 con 0x9776160 -7534> 2014-05-19 10:46:28.648174 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -7533> 2014-05-19 10:46:28.648182 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa103180 con 0x96bd8c0 -7532> 2014-05-19 10:46:28.648196 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -7531> 2014-05-19 10:46:28.648204 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa3dba40 con 0x96bcdc0 -7530> 2014-05-19 10:46:28.648222 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -7529> 2014-05-19 10:46:28.648229 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0x9ffc000 con 0x96954a0 -7528> 2014-05-19 10:46:28.648242 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -7527> 2014-05-19 10:46:28.648250 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xa1dfdc0 con 0x76bd8c0 -7526> 2014-05-19 10:46:28.648264 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -7525> 2014-05-19 10:46:28.648271 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xac17c00 con 0x7b90dc0 -7524> 2014-05-19 10:46:28.648285 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -7523> 2014-05-19 10:46:28.648292 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 36 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xac1a000 con 0x978d8c0 -7522> 2014-05-19 10:46:28.648307 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -7521> 2014-05-19 10:46:28.648314 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 36 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0xac1ae00 con 0x978c580 -7520> 2014-05-19 10:46:28.648328 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -7519> 2014-05-19 10:46:28.648335 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 35 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0x9cb7dc0 con 0x978d340 -7518> 2014-05-19 10:46:28.648352 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -7517> 2014-05-19 10:46:28.648360 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 35 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:28.645746) v2 ==== 47+0+0 (3528709266 0 0) 0x9fd9180 con 0x96374a0 -7516> 2014-05-19 10:46:28.648374 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -7515> 2014-05-19 10:46:28.701033 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.307392) v2 ==== 47+0+0 (1525104943 0 0) 0xac1ba40 con 0x9a0cdc0 -7514> 2014-05-19 10:46:28.701416 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.307392) v2 -- ?+0 0xa103340 con 0x9a0cdc0 -7513> 2014-05-19 10:46:28.701029 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.307392) v2 ==== 47+0+0 (1525104943 0 0) 0xac1bc00 con 0x996fb80 -7512> 2014-05-19 10:46:28.701490 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -7511> 2014-05-19 10:46:28.701565 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.307392) v2 -- ?+0 0x92b0c40 con 0x996fb80 -7510> 2014-05-19 10:46:28.701609 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -7509> 2014-05-19 10:46:28.767893 7f55551a5700 20 OSD::op_tp worker waiting -7508> 2014-05-19 10:46:28.767917 7f55579aa700 20 OSD::op_tp worker waiting -7507> 2014-05-19 10:46:28.767976 7f555a1af700 20 OSD::op_tp worker waiting -7506> 2014-05-19 10:46:28.769441 7f55541a3700 20 OSD::op_tp worker waiting -7505> 2014-05-19 10:46:28.769465 7f555a9b0700 20 OSD::op_tp worker waiting -7504> 2014-05-19 10:46:28.769487 7f55549a4700 20 OSD::op_tp worker waiting -7503> 2014-05-19 10:46:28.769502 7f55589ac700 20 OSD::op_tp worker waiting -7502> 2014-05-19 10:46:28.769538 7f55569a8700 20 OSD::op_tp worker waiting -7501> 2014-05-19 10:46:28.769587 7f555b1b1700 20 OSD::op_tp worker waiting -7500> 2014-05-19 10:46:28.770586 7f55571a9700 20 OSD::op_tp worker waiting -7499> 2014-05-19 10:46:28.770615 7f55559a6700 20 OSD::op_tp worker waiting -7498> 2014-05-19 10:46:28.770639 7f55581ab700 20 OSD::op_tp worker waiting -7497> 2014-05-19 10:46:28.770660 7f55599ae700 20 OSD::op_tp worker waiting -7496> 2014-05-19 10:46:28.770683 7f55539a2700 20 OSD::op_tp worker waiting -7495> 2014-05-19 10:46:28.770701 7f55529a0700 20 OSD::op_tp worker waiting -7494> 2014-05-19 10:46:28.770715 7f555219f700 20 OSD::op_tp worker waiting -7493> 2014-05-19 10:46:28.770729 7f55561a7700 20 OSD::op_tp worker waiting -7492> 2014-05-19 10:46:28.770753 7f555199e700 20 OSD::op_tp worker waiting -7491> 2014-05-19 10:46:28.770781 7f55531a1700 20 OSD::op_tp worker waiting -7490> 2014-05-19 10:46:28.770806 7f55591ad700 20 OSD::op_tp worker waiting -7489> 2014-05-19 10:46:28.876540 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 35 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:32.820380) v2 ==== 47+0+0 (3221708147 0 0) 0xa0cb6c0 con 0x99f1080 -7488> 2014-05-19 10:46:28.876540 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 35 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:32.820380) v2 ==== 47+0+0 (3221708147 0 0) 0xac141c0 con 0x987af20 -7487> 2014-05-19 10:46:28.876588 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:32.820380) v2 -- ?+0 0xac1ba40 con 0x99f1080 -7486> 2014-05-19 10:46:28.876693 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -7485> 2014-05-19 10:46:28.877263 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:32.820380) v2 -- ?+0 0xac1bc00 con 0x987af20 -7484> 2014-05-19 10:46:28.877298 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -7483> 2014-05-19 10:46:28.916829 7f5566602700 5 osd.0 245 tick -7482> 2014-05-19 10:46:28.916854 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -7481> 2014-05-19 10:46:28.916859 7f5566602700 10 osd.0 245 do_waiters -- start -7480> 2014-05-19 10:46:28.916861 7f5566602700 10 osd.0 245 do_waiters -- finish -7479> 2014-05-19 10:46:28.916899 7f555119d700 20 OSD::recovery_tp worker waiting -7478> 2014-05-19 10:46:28.954416 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:32.898266) v2 ==== 47+0+0 (2019535145 0 0) 0xac09dc0 con 0x97431e0 -7477> 2014-05-19 10:46:28.954498 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:32.898266) v2 -- ?+0 0xa0cb6c0 con 0x97431e0 -7476> 2014-05-19 10:46:28.954555 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -7475> 2014-05-19 10:46:28.954686 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:32.898266) v2 ==== 47+0+0 (2019535145 0 0) 0x9e6dc00 con 0x99718c0 -7474> 2014-05-19 10:46:28.954724 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:32.898266) v2 -- ?+0 0xac141c0 con 0x99718c0 -7473> 2014-05-19 10:46:28.954828 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -7472> 2014-05-19 10:46:29.051625 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.657935) v2 ==== 47+0+0 (2958787781 0 0) 0xa1ee8c0 con 0x9656f20 -7471> 2014-05-19 10:46:29.051630 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.657935) v2 ==== 47+0+0 (2958787781 0 0) 0x99e16c0 con 0x9656160 -7470> 2014-05-19 10:46:29.051667 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.657935) v2 -- ?+0 0xac09dc0 con 0x9656f20 -7469> 2014-05-19 10:46:29.051768 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -7468> 2014-05-19 10:46:29.051815 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.657935) v2 -- ?+0 0x9e6dc00 con 0x9656160 -7467> 2014-05-19 10:46:29.051894 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -7466> 2014-05-19 10:46:29.109676 7f5564dff700 20 KeyValueStore::op_tp worker waiting -7465> 2014-05-19 10:46:29.293996 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.900324) v2 ==== 47+0+0 (1113810486 0 0) 0x9b45a40 con 0x96562c0 -7464> 2014-05-19 10:46:29.294049 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.900324) v2 -- ?+0 0x99e16c0 con 0x96562c0 -7463> 2014-05-19 10:46:29.294087 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.900324) v2 ==== 47+0+0 (1113810486 0 0) 0x9e6d6c0 con 0x9657080 -7462> 2014-05-19 10:46:29.294161 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -7461> 2014-05-19 10:46:29.294192 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.900324) v2 -- ?+0 0xa1ee8c0 con 0x9657080 -7460> 2014-05-19 10:46:29.294228 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -7459> 2014-05-19 10:46:29.312171 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 33 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:33.256050) v2 ==== 47+0+0 (1334133290 0 0) 0xa23fc00 con 0x94802c0 -7458> 2014-05-19 10:46:29.312224 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:33.256050) v2 -- ?+0 0x9e6d6c0 con 0x94802c0 -7457> 2014-05-19 10:46:29.312254 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -7456> 2014-05-19 10:46:29.312183 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 33 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:33.256050) v2 ==== 47+0+0 (1334133290 0 0) 0xa5fdc00 con 0x987b760 -7455> 2014-05-19 10:46:29.312316 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:33.256050) v2 -- ?+0 0x9b45a40 con 0x987b760 -7454> 2014-05-19 10:46:29.312368 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -7453> 2014-05-19 10:46:29.377836 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 36 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:33.321722) v2 ==== 47+0+0 (3571720239 0 0) 0xac14000 con 0x987af20 -7452> 2014-05-19 10:46:29.377838 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 36 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:33.321722) v2 ==== 47+0+0 (3571720239 0 0) 0xa36da40 con 0x99f1080 -7451> 2014-05-19 10:46:29.377892 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:33.321722) v2 -- ?+0 0xa5fdc00 con 0x987af20 -7450> 2014-05-19 10:46:29.378016 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -7449> 2014-05-19 10:46:29.378351 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:33.321722) v2 -- ?+0 0xa23fc00 con 0x99f1080 -7448> 2014-05-19 10:46:29.378423 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -7447> 2014-05-19 10:46:29.448627 7f555019b700 20 OSD::command_tp worker waiting -7446> 2014-05-19 10:46:29.451903 7f555099c700 20 OSD::disk_tp worker waiting -7445> 2014-05-19 10:46:29.453964 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:32.060347) v2 ==== 47+0+0 (1641560451 0 0) 0x9b44c40 con 0x9656000 -7444> 2014-05-19 10:46:29.454017 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:32.060347) v2 -- ?+0 0xac14000 con 0x9656000 -7443> 2014-05-19 10:46:29.454051 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -7442> 2014-05-19 10:46:29.454560 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:32.060347) v2 ==== 47+0+0 (1641560451 0 0) 0xa36d180 con 0x9937760 -7441> 2014-05-19 10:46:29.454615 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:32.060347) v2 -- ?+0 0xa36da40 con 0x9937760 -7440> 2014-05-19 10:46:29.454653 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -7439> 2014-05-19 10:46:29.795415 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:32.401802) v2 ==== 47+0+0 (2350192432 0 0) 0xa23efc0 con 0x9657080 -7438> 2014-05-19 10:46:29.795467 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:32.401802) v2 -- ?+0 0xa36d180 con 0x9657080 -7437> 2014-05-19 10:46:29.795710 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:32.401802) v2 ==== 47+0+0 (2350192432 0 0) 0x9b44a80 con 0x96562c0 -7436> 2014-05-19 10:46:29.795856 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -7435> 2014-05-19 10:46:29.795893 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:32.401802) v2 -- ?+0 0x9b44c40 con 0x96562c0 -7434> 2014-05-19 10:46:29.795970 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -7433> 2014-05-19 10:46:29.881146 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:29.880907) v2 ==== 47+0+0 (2338131169 0 0) 0x9fa4540 con 0x9656580 -7432> 2014-05-19 10:46:29.881159 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:29.880907) v2 ==== 47+0+0 (2338131169 0 0) 0xa0cba40 con 0x9657340 -7431> 2014-05-19 10:46:29.881199 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:29.880907) v2 -- ?+0 0x9b44a80 con 0x9656580 -7430> 2014-05-19 10:46:29.881230 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -7429> 2014-05-19 10:46:29.881280 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:29.880907) v2 -- ?+0 0xa23efc0 con 0x9657340 -7428> 2014-05-19 10:46:29.881324 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -7427> 2014-05-19 10:46:29.916934 7f5566602700 5 osd.0 245 tick -7426> 2014-05-19 10:46:29.916986 7f555119d700 20 OSD::recovery_tp worker waiting -7425> 2014-05-19 10:46:29.916988 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 3.23 >= max 0.5 = no, load too high -7424> 2014-05-19 10:46:29.917002 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -7423> 2014-05-19 10:46:29.917005 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2210.45 < min (86400 seconds) -7422> 2014-05-19 10:46:29.917023 7f5566602700 20 osd.0 245 sched_scrub done -7421> 2014-05-19 10:46:29.917026 7f5566602700 10 osd.0 245 do_waiters -- start -7420> 2014-05-19 10:46:29.917028 7f5566602700 10 osd.0 245 do_waiters -- finish -7419> 2014-05-19 10:46:30.526378 7f5565600700 20 KeyValueStore::op_tp worker waiting -7418> 2014-05-19 10:46:30.602359 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:33.208756) v2 ==== 47+0+0 (4028521571 0 0) 0xac22e00 con 0x9b8db80 -7417> 2014-05-19 10:46:30.602377 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:33.208756) v2 ==== 47+0+0 (4028521571 0 0) 0xac23c00 con 0x7b90160 -7416> 2014-05-19 10:46:30.602405 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:33.208756) v2 -- ?+0 0x9fa4540 con 0x9b8db80 -7415> 2014-05-19 10:46:30.602737 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -7414> 2014-05-19 10:46:30.602992 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:33.208756) v2 -- ?+0 0xa0cba40 con 0x7b90160 -7413> 2014-05-19 10:46:30.603040 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -7412> 2014-05-19 10:46:30.767979 7f55551a5700 20 OSD::op_tp worker waiting -7411> 2014-05-19 10:46:30.768000 7f55579aa700 20 OSD::op_tp worker waiting -7410> 2014-05-19 10:46:30.768032 7f555a1af700 20 OSD::op_tp worker waiting -7409> 2014-05-19 10:46:30.769543 7f555a9b0700 20 OSD::op_tp worker waiting -7408> 2014-05-19 10:46:30.769565 7f55549a4700 20 OSD::op_tp worker waiting -7407> 2014-05-19 10:46:30.769585 7f55589ac700 20 OSD::op_tp worker waiting -7406> 2014-05-19 10:46:30.769610 7f55541a3700 20 OSD::op_tp worker waiting -7405> 2014-05-19 10:46:30.769634 7f55569a8700 20 OSD::op_tp worker waiting -7404> 2014-05-19 10:46:30.769655 7f555b1b1700 20 OSD::op_tp worker waiting -7403> 2014-05-19 10:46:30.770669 7f55571a9700 20 OSD::op_tp worker waiting -7402> 2014-05-19 10:46:30.770710 7f55581ab700 20 OSD::op_tp worker waiting -7401> 2014-05-19 10:46:30.770724 7f55559a6700 20 OSD::op_tp worker waiting -7400> 2014-05-19 10:46:30.770742 7f55599ae700 20 OSD::op_tp worker waiting -7399> 2014-05-19 10:46:30.770762 7f55539a2700 20 OSD::op_tp worker waiting -7398> 2014-05-19 10:46:30.770784 7f555219f700 20 OSD::op_tp worker waiting -7397> 2014-05-19 10:46:30.770802 7f55561a7700 20 OSD::op_tp worker waiting -7396> 2014-05-19 10:46:30.770815 7f55529a0700 20 OSD::op_tp worker waiting -7395> 2014-05-19 10:46:30.770850 7f55531a1700 20 OSD::op_tp worker waiting -7394> 2014-05-19 10:46:30.770867 7f555199e700 20 OSD::op_tp worker waiting -7393> 2014-05-19 10:46:30.770884 7f55591ad700 20 OSD::op_tp worker waiting -7392> 2014-05-19 10:46:30.906362 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:34.850302) v2 ==== 47+0+0 (1402929153 0 0) 0xa4ef500 con 0x987b340 -7391> 2014-05-19 10:46:30.906375 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:34.850302) v2 ==== 47+0+0 (1402929153 0 0) 0xa8576c0 con 0x94e26e0 -7390> 2014-05-19 10:46:30.906414 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.850302) v2 -- ?+0 0xac22e00 con 0x987b340 -7389> 2014-05-19 10:46:30.906746 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -7388> 2014-05-19 10:46:30.906819 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.850302) v2 -- ?+0 0xac23c00 con 0x94e26e0 -7387> 2014-05-19 10:46:30.906990 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -7386> 2014-05-19 10:46:30.917119 7f5566602700 5 osd.0 245 tick -7385> 2014-05-19 10:46:30.917172 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 3.23 >= max 0.5 = no, load too high -7384> 2014-05-19 10:46:30.917185 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -7383> 2014-05-19 10:46:30.917188 7f555119d700 20 OSD::recovery_tp worker waiting -7382> 2014-05-19 10:46:30.917188 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2211.45 < min (86400 seconds) -7381> 2014-05-19 10:46:30.917207 7f5566602700 20 osd.0 245 sched_scrub done -7380> 2014-05-19 10:46:30.917210 7f5566602700 10 osd.0 245 do_waiters -- start -7379> 2014-05-19 10:46:30.917212 7f5566602700 10 osd.0 245 do_waiters -- finish -7378> 2014-05-19 10:46:31.109751 7f5564dff700 20 KeyValueStore::op_tp worker waiting -7377> 2014-05-19 10:46:31.270739 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:35.214751) v2 ==== 47+0+0 (768321951 0 0) 0xa44ddc0 con 0x99d3340 -7376> 2014-05-19 10:46:31.270795 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:35.214751) v2 -- ?+0 0xa4ef500 con 0x99d3340 -7375> 2014-05-19 10:46:31.270831 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:35.214751) v2 ==== 47+0+0 (768321951 0 0) 0x9b45c00 con 0x94a5a20 -7374> 2014-05-19 10:46:31.271191 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -7373> 2014-05-19 10:46:31.271259 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:35.214751) v2 -- ?+0 0xa8576c0 con 0x94a5a20 -7372> 2014-05-19 10:46:31.271297 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -7371> 2014-05-19 10:46:31.407818 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:35.351841) v2 ==== 47+0+0 (729970920 0 0) 0x9ad2540 con 0x94e26e0 -7370> 2014-05-19 10:46:31.407866 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:35.351841) v2 -- ?+0 0x9b45c00 con 0x94e26e0 -7369> 2014-05-19 10:46:31.408034 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -7368> 2014-05-19 10:46:31.407838 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:35.351841) v2 ==== 47+0+0 (729970920 0 0) 0xa4ee000 con 0x987b340 -7367> 2014-05-19 10:46:31.408358 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:35.351841) v2 -- ?+0 0xa44ddc0 con 0x987b340 -7366> 2014-05-19 10:46:31.408407 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -7365> 2014-05-19 10:46:31.448720 7f555019b700 20 OSD::command_tp worker waiting -7364> 2014-05-19 10:46:31.452000 7f555099c700 20 OSD::disk_tp worker waiting -7363> 2014-05-19 10:46:31.496866 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:34.103257) v2 ==== 47+0+0 (3907190804 0 0) 0x9b45340 con 0x96562c0 -7362> 2014-05-19 10:46:31.496876 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:34.103257) v2 ==== 47+0+0 (3907190804 0 0) 0xa23e700 con 0x9657080 -7361> 2014-05-19 10:46:31.496935 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.103257) v2 -- ?+0 0xa4ee000 con 0x96562c0 -7360> 2014-05-19 10:46:31.497128 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -7359> 2014-05-19 10:46:31.497263 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.103257) v2 -- ?+0 0x9ad2540 con 0x9657080 -7358> 2014-05-19 10:46:31.497407 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -7357> 2014-05-19 10:46:31.536003 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:34.142394) v2 ==== 47+0+0 (4147727082 0 0) 0xa4fe000 con 0x9983600 -7356> 2014-05-19 10:46:31.536052 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.142394) v2 -- ?+0 0xa23e700 con 0x9983600 -7355> 2014-05-19 10:46:31.536139 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -7354> 2014-05-19 10:46:31.536469 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:34.142394) v2 ==== 47+0+0 (4147727082 0 0) 0xa507dc0 con 0x95846e0 -7353> 2014-05-19 10:46:31.536537 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.142394) v2 -- ?+0 0x9b45340 con 0x95846e0 -7352> 2014-05-19 10:46:31.536583 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -7351> 2014-05-19 10:46:31.547208 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -7350> 2014-05-19 10:46:31.547230 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -7349> 2014-05-19 10:46:31.547238 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xa2bcfc0 con 0x9bdc840 -7348> 2014-05-19 10:46:31.547264 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xa6d56c0 con 0x9ad4420 -7347> 2014-05-19 10:46:31.547306 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xac1b180 con 0x9bf31e0 -7346> 2014-05-19 10:46:31.547322 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xac1a380 con 0x998b340 -7345> 2014-05-19 10:46:31.547339 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0x9d448c0 con 0x9b92840 -7344> 2014-05-19 10:46:31.547363 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xa857500 con 0x9ad49a0 -7343> 2014-05-19 10:46:31.547401 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xa1e4380 con 0x7b911e0 -7342> 2014-05-19 10:46:31.547429 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xa873340 con 0x7b918c0 -7341> 2014-05-19 10:46:31.547460 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0x9c06a80 con 0x9aa8c60 -7340> 2014-05-19 10:46:31.547485 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xa2de8c0 con 0x9bfa000 -7339> 2014-05-19 10:46:31.547511 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0x9c6fa40 con 0x7c23e40 -7338> 2014-05-19 10:46:31.547536 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xa092000 con 0x998b760 -7337> 2014-05-19 10:46:31.547557 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xa617340 con 0x7b91080 -7336> 2014-05-19 10:46:31.547582 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0x9cce8c0 con 0xa28fb80 -7335> 2014-05-19 10:46:31.547608 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xac08000 con 0x76bdce0 -7334> 2014-05-19 10:46:31.547634 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0x9d20380 con 0x994ab00 -7333> 2014-05-19 10:46:31.547661 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0x9c09a40 con 0x9ac8b00 -7332> 2014-05-19 10:46:31.547654 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0x9f19500 con 0x9bdc840 -7331> 2014-05-19 10:46:31.547713 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xa1eefc0 con 0x938de40 -7330> 2014-05-19 10:46:31.547739 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xa1efa40 con 0x9970b00 -7329> 2014-05-19 10:46:31.547754 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xac161c0 con 0x99706e0 -7328> 2014-05-19 10:46:31.547770 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xa0eaa80 con 0x9bb6f20 -7327> 2014-05-19 10:46:31.547783 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0x9caae00 con 0x994b340 -7326> 2014-05-19 10:46:31.547797 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0x9fd8fc0 con 0x98fa2c0 -7325> 2014-05-19 10:46:31.547817 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0x9d3cfc0 con 0x996f8c0 -7324> 2014-05-19 10:46:31.547841 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xac1afc0 con 0x996fa20 -7323> 2014-05-19 10:46:31.547856 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xac1a1c0 con 0x9ac8160 -7322> 2014-05-19 10:46:31.547870 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0x9f18c40 con 0x7b90420 -7321> 2014-05-19 10:46:31.547883 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0x9c6e1c0 con 0x919fe40 -7320> 2014-05-19 10:46:31.547913 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0x92a16c0 con 0x9971760 -7319> 2014-05-19 10:46:31.547930 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0x9cd0c40 con 0x994af20 -7318> 2014-05-19 10:46:31.547944 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xac15180 con 0x989be40 -7317> 2014-05-19 10:46:31.547958 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xa4fe1c0 con 0x9adf4a0 -7316> 2014-05-19 10:46:31.547985 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xa8648c0 con 0x9776160 -7315> 2014-05-19 10:46:31.548010 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0x9fa41c0 con 0x96bd8c0 -7314> 2014-05-19 10:46:31.548036 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xac17340 con 0x96bcdc0 -7313> 2014-05-19 10:46:31.548057 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xa0bac40 con 0x96954a0 -7312> 2014-05-19 10:46:31.548084 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xa516380 con 0x76bd8c0 -7311> 2014-05-19 10:46:31.548112 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xa1028c0 con 0x7b90dc0 -7310> 2014-05-19 10:46:31.548137 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0x9e708c0 con 0x978d8c0 -7309> 2014-05-19 10:46:31.548158 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xac16540 con 0x978c580 -7308> 2014-05-19 10:46:31.548172 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0x9fb5a40 con 0x978d340 -7307> 2014-05-19 10:46:31.548199 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:31.547236) v2 -- ?+0 0xa030540 con 0x96374a0 -7306> 2014-05-19 10:46:31.548243 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -7305> 2014-05-19 10:46:31.548277 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0x9d0a1c0 con 0x9ad4420 -7304> 2014-05-19 10:46:31.548313 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -7303> 2014-05-19 10:46:31.548331 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xac16000 con 0x9bf31e0 -7302> 2014-05-19 10:46:31.548362 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -7301> 2014-05-19 10:46:31.548373 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa857a40 con 0x998b340 -7300> 2014-05-19 10:46:31.548390 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -7299> 2014-05-19 10:46:31.548396 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0x9ebb880 con 0x9b92840 -7298> 2014-05-19 10:46:31.548411 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -7297> 2014-05-19 10:46:31.548416 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0x9e76e00 con 0x9ad49a0 -7296> 2014-05-19 10:46:31.548430 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -7295> 2014-05-19 10:46:31.548435 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0x9f75a40 con 0x7b911e0 -7294> 2014-05-19 10:46:31.548488 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -7293> 2014-05-19 10:46:31.548500 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0x9e10c40 con 0x7b918c0 -7292> 2014-05-19 10:46:31.548530 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -7291> 2014-05-19 10:46:31.548575 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa07a540 con 0x9aa8c60 -7290> 2014-05-19 10:46:31.548630 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -7289> 2014-05-19 10:46:31.548658 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0x9e9f340 con 0x9bfa000 -7288> 2014-05-19 10:46:31.548694 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -7287> 2014-05-19 10:46:31.548706 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa2bca80 con 0x7c23e40 -7286> 2014-05-19 10:46:31.548723 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -7285> 2014-05-19 10:46:31.548731 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa05ee00 con 0x998b760 -7284> 2014-05-19 10:46:31.548746 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -7283> 2014-05-19 10:46:31.548751 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa2df180 con 0x7b91080 -7282> 2014-05-19 10:46:31.548765 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -7281> 2014-05-19 10:46:31.548770 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa4dea80 con 0xa28fb80 -7280> 2014-05-19 10:46:31.548785 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -7279> 2014-05-19 10:46:31.548791 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa872540 con 0x76bdce0 -7278> 2014-05-19 10:46:31.548805 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -7277> 2014-05-19 10:46:31.548810 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa1e5340 con 0x994ab00 -7276> 2014-05-19 10:46:31.548824 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -7275> 2014-05-19 10:46:31.548831 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa856c40 con 0x9ac8b00 -7274> 2014-05-19 10:46:31.548845 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -7273> 2014-05-19 10:46:31.548850 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa0bd180 con 0x938de40 -7272> 2014-05-19 10:46:31.548864 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -7271> 2014-05-19 10:46:31.548869 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa6441c0 con 0x9970b00 -7270> 2014-05-19 10:46:31.548883 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -7269> 2014-05-19 10:46:31.548890 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa0ba8c0 con 0x99706e0 -7268> 2014-05-19 10:46:31.548905 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -7267> 2014-05-19 10:46:31.548912 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0x9fd8700 con 0x9bb6f20 -7266> 2014-05-19 10:46:31.548926 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -7265> 2014-05-19 10:46:31.548934 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0x9ba56c0 con 0x994b340 -7264> 2014-05-19 10:46:31.548947 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -7263> 2014-05-19 10:46:31.548954 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0x9faa380 con 0x98fa2c0 -7262> 2014-05-19 10:46:31.548969 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -7261> 2014-05-19 10:46:31.548976 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa4ff500 con 0x996f8c0 -7260> 2014-05-19 10:46:31.548990 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -7259> 2014-05-19 10:46:31.548998 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa1de1c0 con 0x996fa20 -7258> 2014-05-19 10:46:31.549014 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -7257> 2014-05-19 10:46:31.549022 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0x9cb4e00 con 0x9ac8160 -7256> 2014-05-19 10:46:31.549035 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -7255> 2014-05-19 10:46:31.549043 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa8736c0 con 0x7b90420 -7254> 2014-05-19 10:46:31.549057 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -7253> 2014-05-19 10:46:31.549064 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa23e380 con 0x919fe40 -7252> 2014-05-19 10:46:31.549078 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -7251> 2014-05-19 10:46:31.549086 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa1721c0 con 0x9971760 -7250> 2014-05-19 10:46:31.549100 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -7249> 2014-05-19 10:46:31.549133 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0x9ba4c40 con 0x994af20 -7248> 2014-05-19 10:46:31.549151 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -7247> 2014-05-19 10:46:31.549156 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa516e00 con 0x989be40 -7246> 2014-05-19 10:46:31.549173 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -7245> 2014-05-19 10:46:31.549181 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa0bc380 con 0x9adf4a0 -7244> 2014-05-19 10:46:31.549195 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -7243> 2014-05-19 10:46:31.549204 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0x95e6540 con 0x9776160 -7242> 2014-05-19 10:46:31.549222 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -7241> 2014-05-19 10:46:31.549229 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa446700 con 0x96bd8c0 -7240> 2014-05-19 10:46:31.549243 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -7239> 2014-05-19 10:46:31.549250 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa664e00 con 0x96bcdc0 -7238> 2014-05-19 10:46:31.549264 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -7237> 2014-05-19 10:46:31.549272 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0x96bee00 con 0x96954a0 -7236> 2014-05-19 10:46:31.549289 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -7235> 2014-05-19 10:46:31.549297 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa05e380 con 0x76bd8c0 -7234> 2014-05-19 10:46:31.549311 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -7233> 2014-05-19 10:46:31.549318 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xac17dc0 con 0x7b90dc0 -7232> 2014-05-19 10:46:31.549332 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -7231> 2014-05-19 10:46:31.549339 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa4ff340 con 0x978d8c0 -7230> 2014-05-19 10:46:31.549353 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -7229> 2014-05-19 10:46:31.549361 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0x99e0540 con 0x978c580 -7228> 2014-05-19 10:46:31.549374 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -7227> 2014-05-19 10:46:31.549386 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 36 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0xa0ebc00 con 0x978d340 -7226> 2014-05-19 10:46:31.549403 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -7225> 2014-05-19 10:46:31.549411 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 36 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.547236) v2 ==== 47+0+0 (3136798130 0 0) 0x9209c00 con 0x96374a0 -7224> 2014-05-19 10:46:31.549425 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -7223> 2014-05-19 10:46:31.582744 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.582498) v2 ==== 47+0+0 (889110596 0 0) 0x9d0ae00 con 0x9657340 -7222> 2014-05-19 10:46:31.582735 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:31.582498) v2 ==== 47+0+0 (889110596 0 0) 0x9cb9c00 con 0x9656580 -7221> 2014-05-19 10:46:31.582800 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.582498) v2 -- ?+0 0xa4fe000 con 0x9657340 -7220> 2014-05-19 10:46:31.582837 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -7219> 2014-05-19 10:46:31.582935 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:31.582498) v2 -- ?+0 0xa507dc0 con 0x9656580 -7218> 2014-05-19 10:46:31.582979 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -7217> 2014-05-19 10:46:31.627212 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:34.233563) v2 ==== 47+0+0 (3770749972 0 0) 0xac2bdc0 con 0x9aa3600 -7216> 2014-05-19 10:46:31.627263 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.233563) v2 -- ?+0 0x9d0ae00 con 0x9aa3600 -7215> 2014-05-19 10:46:31.627306 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:34.233563) v2 ==== 47+0+0 (3770749972 0 0) 0xac29c00 con 0x9b8c160 -7214> 2014-05-19 10:46:31.627340 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -7213> 2014-05-19 10:46:31.627418 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.233563) v2 -- ?+0 0x9cb9c00 con 0x9b8c160 -7212> 2014-05-19 10:46:31.627591 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -7211> 2014-05-19 10:46:31.703844 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:34.310277) v2 ==== 47+0+0 (190850091 0 0) 0xac23a40 con 0x7b90160 -7210> 2014-05-19 10:46:31.703857 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:34.310277) v2 ==== 47+0+0 (190850091 0 0) 0xac22c40 con 0x9b8db80 -7209> 2014-05-19 10:46:31.703893 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.310277) v2 -- ?+0 0xac2bdc0 con 0x7b90160 -7208> 2014-05-19 10:46:31.703924 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -7207> 2014-05-19 10:46:31.704020 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.310277) v2 -- ?+0 0xac29c00 con 0x9b8db80 -7206> 2014-05-19 10:46:31.704142 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -7205> 2014-05-19 10:46:31.746387 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:34.352777) v2 ==== 47+0+0 (4081450248 0 0) 0xac1ba40 con 0x94e2160 -7204> 2014-05-19 10:46:31.746415 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:34.352777) v2 ==== 47+0+0 (4081450248 0 0) 0xa4bb880 con 0x9b8de40 -7203> 2014-05-19 10:46:31.746458 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.352777) v2 -- ?+0 0xac23a40 con 0x94e2160 -7202> 2014-05-19 10:46:31.746827 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -7201> 2014-05-19 10:46:31.746899 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.352777) v2 -- ?+0 0xac22c40 con 0x9b8de40 -7200> 2014-05-19 10:46:31.746941 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -7199> 2014-05-19 10:46:31.758321 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:35.702163) v2 ==== 47+0+0 (682470605 0 0) 0xa0ea540 con 0x9970840 -7198> 2014-05-19 10:46:31.758161 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:35.702163) v2 ==== 47+0+0 (682470605 0 0) 0xa264a80 con 0x97434a0 -7197> 2014-05-19 10:46:31.758367 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:35.702163) v2 -- ?+0 0xa4bb880 con 0x9970840 -7196> 2014-05-19 10:46:31.758676 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -7195> 2014-05-19 10:46:31.758794 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:35.702163) v2 -- ?+0 0xac1ba40 con 0x97434a0 -7194> 2014-05-19 10:46:31.758834 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -7193> 2014-05-19 10:46:31.917279 7f5566602700 5 osd.0 245 tick -7192> 2014-05-19 10:46:31.917304 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -7191> 2014-05-19 10:46:31.917307 7f5566602700 10 osd.0 245 do_waiters -- start -7190> 2014-05-19 10:46:31.917309 7f5566602700 10 osd.0 245 do_waiters -- finish -7189> 2014-05-19 10:46:31.917349 7f555119d700 20 OSD::recovery_tp worker waiting -7188> 2014-05-19 10:46:31.998316 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:34.604717) v2 ==== 47+0+0 (891282111 0 0) 0x9ad3500 con 0x96562c0 -7187> 2014-05-19 10:46:31.998349 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:34.604717) v2 ==== 47+0+0 (891282111 0 0) 0x9c088c0 con 0x9657080 -7186> 2014-05-19 10:46:31.998368 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.604717) v2 -- ?+0 0xa0ea540 con 0x96562c0 -7185> 2014-05-19 10:46:31.998399 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -7184> 2014-05-19 10:46:31.998435 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.604717) v2 -- ?+0 0xa264a80 con 0x9657080 -7183> 2014-05-19 10:46:31.998582 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -7182> 2014-05-19 10:46:32.033721 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:34.640114) v2 ==== 47+0+0 (1560273162 0 0) 0x9cb7340 con 0x96571e0 -7181> 2014-05-19 10:46:32.033751 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:34.640114) v2 ==== 47+0+0 (1560273162 0 0) 0xa4d0380 con 0x9656420 -7180> 2014-05-19 10:46:32.033799 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.640114) v2 -- ?+0 0x9c088c0 con 0x96571e0 -7179> 2014-05-19 10:46:32.033836 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -7178> 2014-05-19 10:46:32.033903 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.640114) v2 -- ?+0 0x9ad3500 con 0x9656420 -7177> 2014-05-19 10:46:32.034000 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -7176> 2014-05-19 10:46:32.301596 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:36.245596) v2 ==== 47+0+0 (1625151666 0 0) 0xac08380 con 0x9743600 -7175> 2014-05-19 10:46:32.301673 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:36.245596) v2 -- ?+0 0x9cb7340 con 0x9743600 -7174> 2014-05-19 10:46:32.301845 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -7173> 2014-05-19 10:46:32.301596 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:36.245596) v2 ==== 47+0+0 (1625151666 0 0) 0xa172e00 con 0x966e000 -7172> 2014-05-19 10:46:32.302000 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:36.245596) v2 -- ?+0 0xa4d0380 con 0x966e000 -7171> 2014-05-19 10:46:32.302090 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -7170> 2014-05-19 10:46:32.455665 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:36.399753) v2 ==== 47+0+0 (2798181133 0 0) 0x9e6ddc0 con 0x99718c0 -7169> 2014-05-19 10:46:32.455711 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:36.399753) v2 -- ?+0 0xa172e00 con 0x99718c0 -7168> 2014-05-19 10:46:32.455795 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -7167> 2014-05-19 10:46:32.455792 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:36.399753) v2 ==== 47+0+0 (2798181133 0 0) 0xac09500 con 0x97431e0 -7166> 2014-05-19 10:46:32.456236 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:36.399753) v2 -- ?+0 0xac08380 con 0x97431e0 -7165> 2014-05-19 10:46:32.456282 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -7164> 2014-05-19 10:46:32.526479 7f5565600700 20 KeyValueStore::op_tp worker waiting -7163> 2014-05-19 10:46:32.739412 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:35.345838) v2 ==== 47+0+0 (2316183058 0 0) 0xa1ee8c0 con 0x996e000 -7162> 2014-05-19 10:46:32.739694 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:35.345838) v2 -- ?+0 0x9e6ddc0 con 0x996e000 -7161> 2014-05-19 10:46:32.739488 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:35.345838) v2 ==== 47+0+0 (2316183058 0 0) 0xac29dc0 con 0x9a0c9a0 -7160> 2014-05-19 10:46:32.739832 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -7159> 2014-05-19 10:46:32.739858 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:35.345838) v2 -- ?+0 0xac09500 con 0x9a0c9a0 -7158> 2014-05-19 10:46:32.739891 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -7157> 2014-05-19 10:46:32.768068 7f55551a5700 20 OSD::op_tp worker waiting -7156> 2014-05-19 10:46:32.768088 7f55579aa700 20 OSD::op_tp worker waiting -7155> 2014-05-19 10:46:32.768110 7f555a1af700 20 OSD::op_tp worker waiting -7154> 2014-05-19 10:46:32.769644 7f555a9b0700 20 OSD::op_tp worker waiting -7153> 2014-05-19 10:46:32.769665 7f55589ac700 20 OSD::op_tp worker waiting -7152> 2014-05-19 10:46:32.769697 7f55549a4700 20 OSD::op_tp worker waiting -7151> 2014-05-19 10:46:32.769720 7f55541a3700 20 OSD::op_tp worker waiting -7150> 2014-05-19 10:46:32.769772 7f55569a8700 20 OSD::op_tp worker waiting -7149> 2014-05-19 10:46:32.769830 7f555b1b1700 20 OSD::op_tp worker waiting -7148> 2014-05-19 10:46:32.770753 7f55571a9700 20 OSD::op_tp worker waiting -7147> 2014-05-19 10:46:32.770783 7f55581ab700 20 OSD::op_tp worker waiting -7146> 2014-05-19 10:46:32.770797 7f55559a6700 20 OSD::op_tp worker waiting -7145> 2014-05-19 10:46:32.770810 7f55599ae700 20 OSD::op_tp worker waiting -7144> 2014-05-19 10:46:32.770833 7f55539a2700 20 OSD::op_tp worker waiting -7143> 2014-05-19 10:46:32.770843 7f555219f700 20 OSD::op_tp worker waiting -7142> 2014-05-19 10:46:32.770877 7f55561a7700 20 OSD::op_tp worker waiting -7141> 2014-05-19 10:46:32.770892 7f55529a0700 20 OSD::op_tp worker waiting -7140> 2014-05-19 10:46:32.770920 7f55591ad700 20 OSD::op_tp worker waiting -7139> 2014-05-19 10:46:32.770932 7f555199e700 20 OSD::op_tp worker waiting -7138> 2014-05-19 10:46:32.770953 7f55531a1700 20 OSD::op_tp worker waiting -7137> 2014-05-19 10:46:32.802977 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:36.747011) v2 ==== 47+0+0 (4211137579 0 0) 0x9f19c00 con 0x966e000 -7136> 2014-05-19 10:46:32.802990 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:36.747011) v2 ==== 47+0+0 (4211137579 0 0) 0xa0bcfc0 con 0x9743600 -7135> 2014-05-19 10:46:32.803029 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:36.747011) v2 -- ?+0 0xa1ee8c0 con 0x966e000 -7134> 2014-05-19 10:46:32.803126 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -7133> 2014-05-19 10:46:32.803185 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:36.747011) v2 -- ?+0 0xac29dc0 con 0x9743600 -7132> 2014-05-19 10:46:32.803280 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -7131> 2014-05-19 10:46:32.859281 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:36.803306) v2 ==== 47+0+0 (3290558384 0 0) 0xa264e00 con 0x97434a0 -7130> 2014-05-19 10:46:32.859288 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:36.803306) v2 ==== 47+0+0 (3290558384 0 0) 0xa092fc0 con 0x9970840 -7129> 2014-05-19 10:46:32.859432 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:36.803306) v2 -- ?+0 0xa0bcfc0 con 0x97434a0 -7128> 2014-05-19 10:46:32.859663 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -7127> 2014-05-19 10:46:32.859870 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:36.803306) v2 -- ?+0 0x9f19c00 con 0x9970840 -7126> 2014-05-19 10:46:32.859910 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -7125> 2014-05-19 10:46:32.871199 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:36.815233) v2 ==== 47+0+0 (1849149799 0 0) 0x9b2efc0 con 0x99d31e0 -7124> 2014-05-19 10:46:32.871206 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:36.815233) v2 ==== 47+0+0 (1849149799 0 0) 0x9cd0fc0 con 0x95142c0 -7123> 2014-05-19 10:46:32.871241 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:36.815233) v2 -- ?+0 0xa092fc0 con 0x99d31e0 -7122> 2014-05-19 10:46:32.871347 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -7121> 2014-05-19 10:46:32.871552 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:36.815233) v2 -- ?+0 0xa264e00 con 0x95142c0 -7120> 2014-05-19 10:46:32.871684 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -7119> 2014-05-19 10:46:32.917397 7f5566602700 5 osd.0 245 tick -7118> 2014-05-19 10:46:32.917419 7f5566602700 7 osd.0 245 do_mon_report -7117> 2014-05-19 10:46:32.917425 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 -7116> 2014-05-19 10:46:32.917431 7f5566602700 20 osd.0 245 send_pg_stats -7115> 2014-05-19 10:46:32.917443 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -7114> 2014-05-19 10:46:32.917450 7f5566602700 10 osd.0 245 do_waiters -- start -7113> 2014-05-19 10:46:32.917453 7f5566602700 10 osd.0 245 do_waiters -- finish -7112> 2014-05-19 10:46:32.917482 7f555119d700 20 OSD::recovery_tp worker waiting -7111> 2014-05-19 10:46:32.988346 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:36.932388) v2 ==== 47+0+0 (1573614890 0 0) 0xac2aa80 con 0x9bb7b80 -7110> 2014-05-19 10:46:32.988398 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:36.932388) v2 -- ?+0 0x9b2efc0 con 0x9bb7b80 -7109> 2014-05-19 10:46:32.988484 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -7108> 2014-05-19 10:46:32.988346 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:36.932388) v2 ==== 47+0+0 (1573614890 0 0) 0xac28a80 con 0x95151e0 -7107> 2014-05-19 10:46:32.988688 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:36.932388) v2 -- ?+0 0x9cd0fc0 con 0x95151e0 -7106> 2014-05-19 10:46:32.988889 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -7105> 2014-05-19 10:46:33.109846 7f5564dff700 20 KeyValueStore::op_tp worker waiting -7104> 2014-05-19 10:46:33.448810 7f555019b700 20 OSD::command_tp worker waiting -7103> 2014-05-19 10:46:33.452082 7f555099c700 20 OSD::disk_tp worker waiting -7102> 2014-05-19 10:46:33.791738 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:37.735777) v2 ==== 47+0+0 (3498353616 0 0) 0xa23fa40 con 0x9bb69a0 -7101> 2014-05-19 10:46:33.791814 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:37.735777) v2 -- ?+0 0xac2aa80 con 0x9bb69a0 -7100> 2014-05-19 10:46:33.791848 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -7099> 2014-05-19 10:46:33.792158 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:37.735777) v2 ==== 47+0+0 (3498353616 0 0) 0xa856540 con 0x94e3e40 -7098> 2014-05-19 10:46:33.792212 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:37.735777) v2 -- ?+0 0xac28a80 con 0x94e3e40 -7097> 2014-05-19 10:46:33.792278 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -7096> 2014-05-19 10:46:33.917539 7f5566602700 5 osd.0 245 tick -7095> 2014-05-19 10:46:33.917566 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -7094> 2014-05-19 10:46:33.917575 7f5566602700 10 osd.0 245 do_waiters -- start -7093> 2014-05-19 10:46:33.917578 7f5566602700 10 osd.0 245 do_waiters -- finish -7092> 2014-05-19 10:46:33.917605 7f555119d700 20 OSD::recovery_tp worker waiting -7091> 2014-05-19 10:46:34.002394 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:36.608778) v2 ==== 47+0+0 (2153715376 0 0) 0xac31180 con 0x996fb80 -7090> 2014-05-19 10:46:34.002442 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:36.608778) v2 ==== 47+0+0 (2153715376 0 0) 0xa0cb500 con 0x9a0cdc0 -7089> 2014-05-19 10:46:34.002471 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:36.608778) v2 -- ?+0 0xa23fa40 con 0x996fb80 -7088> 2014-05-19 10:46:34.002550 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -7087> 2014-05-19 10:46:34.002740 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:36.608778) v2 -- ?+0 0xa856540 con 0x9a0cdc0 -7086> 2014-05-19 10:46:34.002775 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -7085> 2014-05-19 10:46:34.309147 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:38.253179) v2 ==== 47+0+0 (4294149357 0 0) 0x9ad2e00 con 0x94e26e0 -7084> 2014-05-19 10:46:34.309192 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:38.253179) v2 -- ?+0 0xa0cb500 con 0x94e26e0 -7083> 2014-05-19 10:46:34.309247 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:38.253179) v2 ==== 47+0+0 (4294149357 0 0) 0xa0ba700 con 0x987b340 -7082> 2014-05-19 10:46:34.309413 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -7081> 2014-05-19 10:46:34.309550 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:38.253179) v2 -- ?+0 0xac31180 con 0x987b340 -7080> 2014-05-19 10:46:34.309610 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -7079> 2014-05-19 10:46:34.352980 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:36.959511) v2 ==== 47+0+0 (3022444594 0 0) 0xa092380 con 0x9656160 -7078> 2014-05-19 10:46:34.353008 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:36.959511) v2 ==== 47+0+0 (3022444594 0 0) 0xa1efc00 con 0x9656f20 -7077> 2014-05-19 10:46:34.353023 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:36.959511) v2 -- ?+0 0xa0ba700 con 0x9656160 -7076> 2014-05-19 10:46:34.353091 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -7075> 2014-05-19 10:46:34.353133 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:36.959511) v2 -- ?+0 0x9ad2e00 con 0x9656f20 -7074> 2014-05-19 10:46:34.353241 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -7073> 2014-05-19 10:46:34.448331 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -7072> 2014-05-19 10:46:34.448352 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -7071> 2014-05-19 10:46:34.448361 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xac14a80 con 0x9bdc840 -7070> 2014-05-19 10:46:34.448387 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xa6d4c40 con 0x9ad4420 -7069> 2014-05-19 10:46:34.448427 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xac1b340 con 0x9bf31e0 -7068> 2014-05-19 10:46:34.448442 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xac1a540 con 0x998b340 -7067> 2014-05-19 10:46:34.448457 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xa23f6c0 con 0x9b92840 -7066> 2014-05-19 10:46:34.448538 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xa6136c0 con 0x9ad49a0 -7065> 2014-05-19 10:46:34.448564 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xa2bc1c0 con 0x7b911e0 -7064> 2014-05-19 10:46:34.448590 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0x9ef41c0 con 0x7b918c0 -7063> 2014-05-19 10:46:34.448623 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xa106540 con 0x9aa8c60 -7062> 2014-05-19 10:46:34.448650 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0x9fa4c40 con 0x9bfa000 -7061> 2014-05-19 10:46:34.448675 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xa4a8c40 con 0x7c23e40 -7060> 2014-05-19 10:46:34.448706 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0x9ed1dc0 con 0x998b760 -7059> 2014-05-19 10:46:34.448725 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0x951c380 con 0x7b91080 -7058> 2014-05-19 10:46:34.448740 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xa44ca80 con 0xa28fb80 -7057> 2014-05-19 10:46:34.448735 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0x9e77dc0 con 0x9bdc840 -7056> 2014-05-19 10:46:34.448770 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xac16fc0 con 0x76bdce0 -7055> 2014-05-19 10:46:34.448799 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0x9ec1880 con 0x994ab00 -7054> 2014-05-19 10:46:34.448828 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0x9123c00 con 0x9ac8b00 -7053> 2014-05-19 10:46:34.448870 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xa872e00 con 0x938de40 -7052> 2014-05-19 10:46:34.448904 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0x9f7afc0 con 0x9970b00 -7051> 2014-05-19 10:46:34.448930 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xa616c40 con 0x99706e0 -7050> 2014-05-19 10:46:34.448985 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0x9c6e8c0 con 0x9bb6f20 -7049> 2014-05-19 10:46:34.449013 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xac088c0 con 0x994b340 -7048> 2014-05-19 10:46:34.449074 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0x9ed1c00 con 0x98fa2c0 -7047> 2014-05-19 10:46:34.449097 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xa208000 con 0x996f8c0 -7046> 2014-05-19 10:46:34.449134 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0x9e6c540 con 0x996fa20 -7045> 2014-05-19 10:46:34.449151 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xa872c40 con 0x9ac8160 -7044> 2014-05-19 10:46:34.449168 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0x99e0540 con 0x7b90420 -7043> 2014-05-19 10:46:34.449196 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xa4ff340 con 0x919fe40 -7042> 2014-05-19 10:46:34.449222 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xac17dc0 con 0x9971760 -7041> 2014-05-19 10:46:34.449237 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xa05e380 con 0x994af20 -7040> 2014-05-19 10:46:34.449252 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0x96bee00 con 0x989be40 -7039> 2014-05-19 10:46:34.449266 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xa664e00 con 0x9adf4a0 -7038> 2014-05-19 10:46:34.449293 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xa446700 con 0x9776160 -7037> 2014-05-19 10:46:34.449367 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0x95e6540 con 0x96bd8c0 -7036> 2014-05-19 10:46:34.449405 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xa0bc380 con 0x96bcdc0 -7035> 2014-05-19 10:46:34.449436 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xa516e00 con 0x96954a0 -7034> 2014-05-19 10:46:34.449465 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0x9ba4c40 con 0x76bd8c0 -7033> 2014-05-19 10:46:34.449494 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xa1721c0 con 0x7b90dc0 -7032> 2014-05-19 10:46:34.449521 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xa23e380 con 0x978d8c0 -7031> 2014-05-19 10:46:34.449537 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xa8736c0 con 0x978c580 -7030> 2014-05-19 10:46:34.449562 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0x9cb4e00 con 0x978d340 -7029> 2014-05-19 10:46:34.449579 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:34.448359) v2 -- ?+0 0xa1de1c0 con 0x96374a0 -7028> 2014-05-19 10:46:34.449634 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -7027> 2014-05-19 10:46:34.449660 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0x9c6e000 con 0x9ad4420 -7026> 2014-05-19 10:46:34.449718 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -7025> 2014-05-19 10:46:34.449737 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0xac31dc0 con 0x9bf31e0 -7024> 2014-05-19 10:46:34.449769 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -7023> 2014-05-19 10:46:34.449782 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0x9e6d880 con 0x998b340 -7022> 2014-05-19 10:46:34.449815 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -7021> 2014-05-19 10:46:34.449835 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0x97c28c0 con 0x9b92840 -7020> 2014-05-19 10:46:34.449868 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -7019> 2014-05-19 10:46:34.449891 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0xa2088c0 con 0x9ad49a0 -7018> 2014-05-19 10:46:34.449918 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -7017> 2014-05-19 10:46:34.449930 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0xa172380 con 0x7b911e0 -7016> 2014-05-19 10:46:34.449946 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -7015> 2014-05-19 10:46:34.449952 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0xac15a40 con 0x7b918c0 -7014> 2014-05-19 10:46:34.449977 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -7013> 2014-05-19 10:46:34.449986 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0xa236a80 con 0x9aa8c60 -7012> 2014-05-19 10:46:34.450017 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -7011> 2014-05-19 10:46:34.450037 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0xa267500 con 0x9bfa000 -7010> 2014-05-19 10:46:34.450070 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -7009> 2014-05-19 10:46:34.450081 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0x9e77880 con 0x7c23e40 -7008> 2014-05-19 10:46:34.450100 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -7007> 2014-05-19 10:46:34.450108 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0x9f74e00 con 0x998b760 -7006> 2014-05-19 10:46:34.450123 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -7005> 2014-05-19 10:46:34.450130 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0x9c0e700 con 0x7b91080 -7004> 2014-05-19 10:46:34.450147 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -7003> 2014-05-19 10:46:34.450155 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0xa4dee00 con 0xa28fb80 -7002> 2014-05-19 10:46:34.450169 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -7001> 2014-05-19 10:46:34.450178 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0xa8728c0 con 0x76bdce0 -7000> 2014-05-19 10:46:34.450195 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -6999> 2014-05-19 10:46:34.450203 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0xa74aa80 con 0x994ab00 -6998> 2014-05-19 10:46:34.450217 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -6997> 2014-05-19 10:46:34.450224 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0x9f6fc00 con 0x9ac8b00 -6996> 2014-05-19 10:46:34.450239 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -6995> 2014-05-19 10:46:34.450246 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0xa0dd880 con 0x938de40 -6994> 2014-05-19 10:46:34.450260 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -6993> 2014-05-19 10:46:34.450265 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0x9388e00 con 0x9970b00 -6992> 2014-05-19 10:46:34.450279 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -6991> 2014-05-19 10:46:34.450287 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0x95bcc40 con 0x99706e0 -6990> 2014-05-19 10:46:34.450304 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -6989> 2014-05-19 10:46:34.450313 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0x9fd81c0 con 0x9bb6f20 -6988> 2014-05-19 10:46:34.450330 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -6987> 2014-05-19 10:46:34.450338 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0x9ba5dc0 con 0x994b340 -6986> 2014-05-19 10:46:34.450351 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -6985> 2014-05-19 10:46:34.450360 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0xa3dbdc0 con 0x98fa2c0 -6984> 2014-05-19 10:46:34.450377 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -6983> 2014-05-19 10:46:34.450385 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0xa0bda40 con 0x996f8c0 -6982> 2014-05-19 10:46:34.450399 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -6981> 2014-05-19 10:46:34.450403 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0xa23f500 con 0x996fa20 -6980> 2014-05-19 10:46:34.450420 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -6979> 2014-05-19 10:46:34.450428 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0x95621c0 con 0x9ac8160 -6978> 2014-05-19 10:46:34.450443 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -6977> 2014-05-19 10:46:34.450450 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0x9f20fc0 con 0x7b90420 -6976> 2014-05-19 10:46:34.450465 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -6975> 2014-05-19 10:46:34.450472 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0x95e7500 con 0x919fe40 -6974> 2014-05-19 10:46:34.450486 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -6973> 2014-05-19 10:46:34.450493 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0xa173a40 con 0x9971760 -6972> 2014-05-19 10:46:34.450508 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -6971> 2014-05-19 10:46:34.450515 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0x9b51dc0 con 0x994af20 -6970> 2014-05-19 10:46:34.450529 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -6969> 2014-05-19 10:46:34.450543 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0xa517880 con 0x989be40 -6968> 2014-05-19 10:46:34.450560 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -6967> 2014-05-19 10:46:34.450568 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0xa0bc700 con 0x9adf4a0 -6966> 2014-05-19 10:46:34.450584 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -6965> 2014-05-19 10:46:34.450592 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0x95e61c0 con 0x9776160 -6964> 2014-05-19 10:46:34.450608 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -6963> 2014-05-19 10:46:34.450615 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0x9ebbdc0 con 0x96bd8c0 -6962> 2014-05-19 10:46:34.450630 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -6961> 2014-05-19 10:46:34.450637 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0xa664fc0 con 0x96bcdc0 -6960> 2014-05-19 10:46:34.450651 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -6959> 2014-05-19 10:46:34.450658 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0xa4ef6c0 con 0x96954a0 -6958> 2014-05-19 10:46:34.450672 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -6957> 2014-05-19 10:46:34.450680 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0xa36c1c0 con 0x76bd8c0 -6956> 2014-05-19 10:46:34.450698 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -6955> 2014-05-19 10:46:34.450705 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0x9d76540 con 0x7b90dc0 -6954> 2014-05-19 10:46:34.450719 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -6953> 2014-05-19 10:46:34.450727 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0xa4ffa40 con 0x978d8c0 -6952> 2014-05-19 10:46:34.450744 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -6951> 2014-05-19 10:46:34.450752 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0x99e1180 con 0x978c580 -6950> 2014-05-19 10:46:34.450766 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -6949> 2014-05-19 10:46:34.450773 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0xac32e00 con 0x978d340 -6948> 2014-05-19 10:46:34.450787 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -6947> 2014-05-19 10:46:34.450795 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 37 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.448359) v2 ==== 47+0+0 (1996722096 0 0) 0x99e0540 con 0x96374a0 -6946> 2014-05-19 10:46:34.450813 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -6945> 2014-05-19 10:46:34.484336 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:34.484152) v2 ==== 47+0+0 (735959469 0 0) 0xa2e1880 con 0x9656580 -6944> 2014-05-19 10:46:34.484379 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:34.484152) v2 ==== 47+0+0 (735959469 0 0) 0xa078c40 con 0x9657340 -6943> 2014-05-19 10:46:34.484408 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.484152) v2 -- ?+0 0xa092380 con 0x9656580 -6942> 2014-05-19 10:46:34.484445 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -6941> 2014-05-19 10:46:34.484471 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:34.484152) v2 -- ?+0 0xa1efc00 con 0x9657340 -6940> 2014-05-19 10:46:34.484504 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -6939> 2014-05-19 10:46:34.526576 7f5565600700 20 KeyValueStore::op_tp worker waiting -6938> 2014-05-19 10:46:34.528756 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:37.135142) v2 ==== 47+0+0 (3220086017 0 0) 0xac2bc00 con 0x9aa3600 -6937> 2014-05-19 10:46:34.528828 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:37.135142) v2 -- ?+0 0xa078c40 con 0x9aa3600 -6936> 2014-05-19 10:46:34.528838 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:37.135142) v2 ==== 47+0+0 (3220086017 0 0) 0xac29a40 con 0x9b8c160 -6935> 2014-05-19 10:46:34.528902 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -6934> 2014-05-19 10:46:34.529079 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:37.135142) v2 -- ?+0 0xa2e1880 con 0x9b8c160 -6933> 2014-05-19 10:46:34.529183 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -6932> 2014-05-19 10:46:34.755565 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:37.362007) v2 ==== 47+0+0 (2980959207 0 0) 0xa36c8c0 con 0x9937760 -6931> 2014-05-19 10:46:34.755594 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:37.362007) v2 ==== 47+0+0 (2980959207 0 0) 0xa0b6c40 con 0x9656000 -6930> 2014-05-19 10:46:34.755618 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:37.362007) v2 -- ?+0 0xac2bc00 con 0x9937760 -6929> 2014-05-19 10:46:34.755678 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -6928> 2014-05-19 10:46:34.755724 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:37.362007) v2 -- ?+0 0xac29a40 con 0x9656000 -6927> 2014-05-19 10:46:34.756127 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -6926> 2014-05-19 10:46:34.768155 7f55551a5700 20 OSD::op_tp worker waiting -6925> 2014-05-19 10:46:34.768174 7f55579aa700 20 OSD::op_tp worker waiting -6924> 2014-05-19 10:46:34.768198 7f555a1af700 20 OSD::op_tp worker waiting -6923> 2014-05-19 10:46:34.769744 7f55589ac700 20 OSD::op_tp worker waiting -6922> 2014-05-19 10:46:34.769768 7f555a9b0700 20 OSD::op_tp worker waiting -6921> 2014-05-19 10:46:34.769796 7f55549a4700 20 OSD::op_tp worker waiting -6920> 2014-05-19 10:46:34.769830 7f55541a3700 20 OSD::op_tp worker waiting -6919> 2014-05-19 10:46:34.769854 7f55569a8700 20 OSD::op_tp worker waiting -6918> 2014-05-19 10:46:34.769896 7f555b1b1700 20 OSD::op_tp worker waiting -6917> 2014-05-19 10:46:34.770850 7f55571a9700 20 OSD::op_tp worker waiting -6916> 2014-05-19 10:46:34.770873 7f55581ab700 20 OSD::op_tp worker waiting -6915> 2014-05-19 10:46:34.770893 7f55599ae700 20 OSD::op_tp worker waiting -6914> 2014-05-19 10:46:34.770910 7f55539a2700 20 OSD::op_tp worker waiting -6913> 2014-05-19 10:46:34.770927 7f55559a6700 20 OSD::op_tp worker waiting -6912> 2014-05-19 10:46:34.770954 7f55561a7700 20 OSD::op_tp worker waiting -6911> 2014-05-19 10:46:34.770983 7f55529a0700 20 OSD::op_tp worker waiting -6910> 2014-05-19 10:46:34.770997 7f555199e700 20 OSD::op_tp worker waiting -6909> 2014-05-19 10:46:34.771009 7f55591ad700 20 OSD::op_tp worker waiting -6908> 2014-05-19 10:46:34.771025 7f55531a1700 20 OSD::op_tp worker waiting -6907> 2014-05-19 10:46:34.771063 7f555219f700 20 OSD::op_tp worker waiting -6906> 2014-05-19 10:46:34.917670 7f5566602700 5 osd.0 245 tick -6905> 2014-05-19 10:46:34.917695 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -6904> 2014-05-19 10:46:34.917700 7f5566602700 10 osd.0 245 do_waiters -- start -6903> 2014-05-19 10:46:34.917702 7f5566602700 10 osd.0 245 do_waiters -- finish -6902> 2014-05-19 10:46:34.917724 7f555119d700 20 OSD::recovery_tp worker waiting -6901> 2014-05-19 10:46:35.109943 7f5564dff700 20 KeyValueStore::op_tp worker waiting -6900> 2014-05-19 10:46:35.213293 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 34 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:39.157406) v2 ==== 47+0+0 (3270299505 0 0) 0xa1728c0 con 0x94802c0 -6899> 2014-05-19 10:46:35.213345 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.157406) v2 -- ?+0 0xa36c8c0 con 0x94802c0 -6898> 2014-05-19 10:46:35.213427 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -6897> 2014-05-19 10:46:35.213460 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 34 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:39.157406) v2 ==== 47+0+0 (3270299505 0 0) 0x9d0b6c0 con 0x987b760 -6896> 2014-05-19 10:46:35.213495 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.157406) v2 -- ?+0 0xa0b6c40 con 0x987b760 -6895> 2014-05-19 10:46:35.213526 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -6894> 2014-05-19 10:46:35.257168 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:37.863578) v2 ==== 47+0+0 (1874554405 0 0) 0xac33dc0 con 0x9937760 -6893> 2014-05-19 10:46:35.257219 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:37.863578) v2 -- ?+0 0xa1728c0 con 0x9937760 -6892> 2014-05-19 10:46:35.257251 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:37.863578) v2 ==== 47+0+0 (1874554405 0 0) 0x9fa8fc0 con 0x9656000 -6891> 2014-05-19 10:46:35.257295 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -6890> 2014-05-19 10:46:35.257395 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:37.863578) v2 -- ?+0 0x9d0b6c0 con 0x9656000 -6889> 2014-05-19 10:46:35.257467 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -6888> 2014-05-19 10:46:35.279269 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:39.223381) v2 ==== 47+0+0 (315088893 0 0) 0xa36d340 con 0x99f1080 -6887> 2014-05-19 10:46:35.279302 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:39.223381) v2 ==== 47+0+0 (315088893 0 0) 0xac34e00 con 0x987af20 -6886> 2014-05-19 10:46:35.279313 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.223381) v2 -- ?+0 0xac33dc0 con 0x99f1080 -6885> 2014-05-19 10:46:35.279522 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -6884> 2014-05-19 10:46:35.279742 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.223381) v2 -- ?+0 0x9fa8fc0 con 0x987af20 -6883> 2014-05-19 10:46:35.279830 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -6882> 2014-05-19 10:46:35.448907 7f555019b700 20 OSD::command_tp worker waiting -6881> 2014-05-19 10:46:35.452179 7f555099c700 20 OSD::disk_tp worker waiting -6880> 2014-05-19 10:46:35.499874 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:38.106297) v2 ==== 47+0+0 (1281108921 0 0) 0xa0ca000 con 0x9657080 -6879> 2014-05-19 10:46:35.499915 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:38.106297) v2 -- ?+0 0xa36d340 con 0x9657080 -6878> 2014-05-19 10:46:35.499952 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -6877> 2014-05-19 10:46:35.499929 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:38.106297) v2 ==== 47+0+0 (1281108921 0 0) 0x9e6c1c0 con 0x96562c0 -6876> 2014-05-19 10:46:35.499971 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:38.106297) v2 -- ?+0 0xac34e00 con 0x96562c0 -6875> 2014-05-19 10:46:35.500002 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -6874> 2014-05-19 10:46:35.704218 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:39.648375) v2 ==== 47+0+0 (2846530681 0 0) 0xa0bddc0 con 0x9743600 -6873> 2014-05-19 10:46:35.704269 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.648375) v2 -- ?+0 0xa0ca000 con 0x9743600 -6872> 2014-05-19 10:46:35.704296 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -6871> 2014-05-19 10:46:35.704525 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:39.648375) v2 ==== 47+0+0 (2846530681 0 0) 0x9f19dc0 con 0x966e000 -6870> 2014-05-19 10:46:35.704563 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.648375) v2 -- ?+0 0x9e6c1c0 con 0x966e000 -6869> 2014-05-19 10:46:35.704637 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -6868> 2014-05-19 10:46:35.714734 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 35 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:39.658886) v2 ==== 47+0+0 (1305253609 0 0) 0xa0928c0 con 0x987b760 -6867> 2014-05-19 10:46:35.714785 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.658886) v2 -- ?+0 0x9f19dc0 con 0x987b760 -6866> 2014-05-19 10:46:35.714820 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -6865> 2014-05-19 10:46:35.714767 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 35 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:39.658886) v2 ==== 47+0+0 (1305253609 0 0) 0xa172fc0 con 0x94802c0 -6864> 2014-05-19 10:46:35.714833 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.658886) v2 -- ?+0 0xa0bddc0 con 0x94802c0 -6863> 2014-05-19 10:46:35.714935 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -6862> 2014-05-19 10:46:35.917778 7f5566602700 5 osd.0 245 tick -6861> 2014-05-19 10:46:35.917832 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 2.97 >= max 0.5 = no, load too high -6860> 2014-05-19 10:46:35.917845 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -6859> 2014-05-19 10:46:35.917848 7f555119d700 20 OSD::recovery_tp worker waiting -6858> 2014-05-19 10:46:35.917848 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2216.45 < min (86400 seconds) -6857> 2014-05-19 10:46:35.917867 7f5566602700 20 osd.0 245 sched_scrub done -6856> 2014-05-19 10:46:35.917870 7f5566602700 10 osd.0 245 do_waiters -- start -6855> 2014-05-19 10:46:35.917872 7f5566602700 10 osd.0 245 do_waiters -- finish -6854> 2014-05-19 10:46:35.972002 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:39.916162) v2 ==== 47+0+0 (444788443 0 0) 0x93ad500 con 0x99d3340 -6853> 2014-05-19 10:46:35.972022 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:39.916162) v2 ==== 47+0+0 (444788443 0 0) 0x9b448c0 con 0x94a5a20 -6852> 2014-05-19 10:46:35.972049 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.916162) v2 -- ?+0 0xa0928c0 con 0x99d3340 -6851> 2014-05-19 10:46:35.972084 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -6850> 2014-05-19 10:46:35.972467 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.916162) v2 -- ?+0 0xa172fc0 con 0x94a5a20 -6849> 2014-05-19 10:46:35.972620 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -6848> 2014-05-19 10:46:36.352243 7f555c1b3700 10 monclient: tick -6847> 2014-05-19 10:46:36.352257 7f555c1b3700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2014-05-19 10:46:06.352256) -6846> 2014-05-19 10:46:36.352275 7f555c1b3700 10 monclient: renew subs? (now: 2014-05-19 10:46:36.352274; renew after: 2014-05-19 10:47:03.081841) -- no -6845> 2014-05-19 10:46:36.360522 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:40.304653) v2 ==== 47+0+0 (3293573685 0 0) 0xa092700 con 0x9970840 -6844> 2014-05-19 10:46:36.360573 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:40.304653) v2 -- ?+0 0x93ad500 con 0x9970840 -6843> 2014-05-19 10:46:36.360604 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -6842> 2014-05-19 10:46:36.360544 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:40.304653) v2 ==== 47+0+0 (3293573685 0 0) 0xa264c40 con 0x97434a0 -6841> 2014-05-19 10:46:36.360723 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:40.304653) v2 -- ?+0 0x9b448c0 con 0x97434a0 -6840> 2014-05-19 10:46:36.360799 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -6839> 2014-05-19 10:46:36.380518 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:40.324681) v2 ==== 47+0+0 (926893929 0 0) 0xac34c40 con 0x987af20 -6838> 2014-05-19 10:46:36.380531 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:40.324681) v2 ==== 47+0+0 (926893929 0 0) 0xa7d4a80 con 0x99f1080 -6837> 2014-05-19 10:46:36.380565 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:40.324681) v2 -- ?+0 0xa092700 con 0x987af20 -6836> 2014-05-19 10:46:36.380667 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -6835> 2014-05-19 10:46:36.381005 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:40.324681) v2 -- ?+0 0xa264c40 con 0x99f1080 -6834> 2014-05-19 10:46:36.381046 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -6833> 2014-05-19 10:46:36.526657 7f5565600700 20 KeyValueStore::op_tp worker waiting -6832> 2014-05-19 10:46:36.654421 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:39.260911) v2 ==== 47+0+0 (1147535499 0 0) 0xa664700 con 0x9656160 -6831> 2014-05-19 10:46:36.654504 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.260911) v2 -- ?+0 0xac34c40 con 0x9656160 -6830> 2014-05-19 10:46:36.654435 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:39.260911) v2 ==== 47+0+0 (1147535499 0 0) 0xa1ee1c0 con 0x9656f20 -6829> 2014-05-19 10:46:36.654600 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -6828> 2014-05-19 10:46:36.654644 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.260911) v2 -- ?+0 0xa7d4a80 con 0x9656f20 -6827> 2014-05-19 10:46:36.654684 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -6826> 2014-05-19 10:46:36.768237 7f55551a5700 20 OSD::op_tp worker waiting -6825> 2014-05-19 10:46:36.768257 7f55579aa700 20 OSD::op_tp worker waiting -6824> 2014-05-19 10:46:36.768272 7f555a1af700 20 OSD::op_tp worker waiting -6823> 2014-05-19 10:46:36.769843 7f55589ac700 20 OSD::op_tp worker waiting -6822> 2014-05-19 10:46:36.769876 7f55549a4700 20 OSD::op_tp worker waiting -6821> 2014-05-19 10:46:36.769897 7f555a9b0700 20 OSD::op_tp worker waiting -6820> 2014-05-19 10:46:36.769917 7f55541a3700 20 OSD::op_tp worker waiting -6819> 2014-05-19 10:46:36.769938 7f55569a8700 20 OSD::op_tp worker waiting -6818> 2014-05-19 10:46:36.769995 7f555b1b1700 20 OSD::op_tp worker waiting -6817> 2014-05-19 10:46:36.770954 7f55581ab700 20 OSD::op_tp worker waiting -6816> 2014-05-19 10:46:36.770978 7f55571a9700 20 OSD::op_tp worker waiting -6815> 2014-05-19 10:46:36.770996 7f55539a2700 20 OSD::op_tp worker waiting -6814> 2014-05-19 10:46:36.771022 7f55599ae700 20 OSD::op_tp worker waiting -6813> 2014-05-19 10:46:36.771044 7f55559a6700 20 OSD::op_tp worker waiting -6812> 2014-05-19 10:46:36.771060 7f55561a7700 20 OSD::op_tp worker waiting -6811> 2014-05-19 10:46:36.771074 7f55529a0700 20 OSD::op_tp worker waiting -6810> 2014-05-19 10:46:36.771087 7f555199e700 20 OSD::op_tp worker waiting -6809> 2014-05-19 10:46:36.771094 7f55531a1700 20 OSD::op_tp worker waiting -6808> 2014-05-19 10:46:36.771100 7f55591ad700 20 OSD::op_tp worker waiting -6807> 2014-05-19 10:46:36.771127 7f555219f700 20 OSD::op_tp worker waiting -6806> 2014-05-19 10:46:36.837423 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:39.443867) v2 ==== 47+0+0 (1482839326 0 0) 0xa0b6fc0 con 0x9983600 -6805> 2014-05-19 10:46:36.837474 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.443867) v2 -- ?+0 0xa1ee1c0 con 0x9983600 -6804> 2014-05-19 10:46:36.837723 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -6803> 2014-05-19 10:46:36.837519 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:39.443867) v2 ==== 47+0+0 (1482839326 0 0) 0x9cd1500 con 0x95846e0 -6802> 2014-05-19 10:46:36.837767 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.443867) v2 -- ?+0 0xa664700 con 0x95846e0 -6801> 2014-05-19 10:46:36.837812 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -6800> 2014-05-19 10:46:36.917961 7f5566602700 5 osd.0 245 tick -6799> 2014-05-19 10:46:36.917988 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -6798> 2014-05-19 10:46:36.917996 7f5566602700 10 osd.0 245 do_waiters -- start -6797> 2014-05-19 10:46:36.917999 7f5566602700 10 osd.0 245 do_waiters -- finish -6796> 2014-05-19 10:46:36.918025 7f555119d700 20 OSD::recovery_tp worker waiting -6795> 2014-05-19 10:46:37.047767 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:39.654264) v2 ==== 47+0+0 (2344807354 0 0) 0xa36d500 con 0x9b8de40 -6794> 2014-05-19 10:46:37.047778 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:39.654264) v2 ==== 47+0+0 (2344807354 0 0) 0xac1bc00 con 0x94e2160 -6793> 2014-05-19 10:46:37.047819 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.654264) v2 -- ?+0 0x9cd1500 con 0x9b8de40 -6792> 2014-05-19 10:46:37.047857 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -6791> 2014-05-19 10:46:37.047881 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.654264) v2 -- ?+0 0xa0b6fc0 con 0x94e2160 -6790> 2014-05-19 10:46:37.048453 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -6789> 2014-05-19 10:46:37.110040 7f5564dff700 20 KeyValueStore::op_tp worker waiting -6788> 2014-05-19 10:46:37.201349 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:39.807844) v2 ==== 47+0+0 (1079881524 0 0) 0x9e6d180 con 0x96562c0 -6787> 2014-05-19 10:46:37.201439 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.807844) v2 -- ?+0 0xa36d500 con 0x96562c0 -6786> 2014-05-19 10:46:37.201476 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -6785> 2014-05-19 10:46:37.201365 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:39.807844) v2 ==== 47+0+0 (1079881524 0 0) 0xa0ca380 con 0x9657080 -6784> 2014-05-19 10:46:37.201942 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.807844) v2 -- ?+0 0xac1bc00 con 0x9657080 -6783> 2014-05-19 10:46:37.201978 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -6782> 2014-05-19 10:46:37.385940 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:37.385767) v2 ==== 47+0+0 (131704412 0 0) 0x9c08e00 con 0x9656580 -6781> 2014-05-19 10:46:37.385964 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:37.385767) v2 ==== 47+0+0 (131704412 0 0) 0xac35880 con 0x9657340 -6780> 2014-05-19 10:46:37.385987 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:37.385767) v2 -- ?+0 0x9e6d180 con 0x9656580 -6779> 2014-05-19 10:46:37.386021 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -6778> 2014-05-19 10:46:37.386063 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:37.385767) v2 -- ?+0 0xa0ca380 con 0x9657340 -6777> 2014-05-19 10:46:37.386109 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -6776> 2014-05-19 10:46:37.449003 7f555019b700 20 OSD::command_tp worker waiting -6775> 2014-05-19 10:46:37.452276 7f555099c700 20 OSD::disk_tp worker waiting -6774> 2014-05-19 10:46:37.558564 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:40.165017) v2 ==== 47+0+0 (1988778074 0 0) 0xac33c00 con 0x9937760 -6773> 2014-05-19 10:46:37.558568 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:40.165017) v2 ==== 47+0+0 (1988778074 0 0) 0xa102c40 con 0x9656000 -6772> 2014-05-19 10:46:37.558608 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:40.165017) v2 -- ?+0 0xac35880 con 0x9937760 -6771> 2014-05-19 10:46:37.558640 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -6770> 2014-05-19 10:46:37.558674 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:40.165017) v2 -- ?+0 0x9c08e00 con 0x9656000 -6769> 2014-05-19 10:46:37.558706 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -6768> 2014-05-19 10:46:37.605239 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:40.211697) v2 ==== 47+0+0 (2559229668 0 0) 0xac22a80 con 0x9b8db80 -6767> 2014-05-19 10:46:37.605292 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:40.211697) v2 -- ?+0 0xa102c40 con 0x9b8db80 -6766> 2014-05-19 10:46:37.605321 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -6765> 2014-05-19 10:46:37.605321 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:40.211697) v2 ==== 47+0+0 (2559229668 0 0) 0xac23880 con 0x7b90160 -6764> 2014-05-19 10:46:37.605355 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:40.211697) v2 -- ?+0 0xac33c00 con 0x7b90160 -6763> 2014-05-19 10:46:37.605429 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -6762> 2014-05-19 10:46:37.757057 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:41.701280) v2 ==== 47+0+0 (490745380 0 0) 0x9fb4c40 con 0x99718c0 -6761> 2014-05-19 10:46:37.757148 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.701280) v2 -- ?+0 0xac22a80 con 0x99718c0 -6760> 2014-05-19 10:46:37.757187 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -6759> 2014-05-19 10:46:37.757621 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:41.701280) v2 ==== 47+0+0 (490745380 0 0) 0x92a1500 con 0x97431e0 -6758> 2014-05-19 10:46:37.757677 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.701280) v2 -- ?+0 0xac23880 con 0x97431e0 -6757> 2014-05-19 10:46:37.757714 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -6756> 2014-05-19 10:46:37.918087 7f5566602700 5 osd.0 245 tick -6755> 2014-05-19 10:46:37.918108 7f5566602700 7 osd.0 245 do_mon_report -6754> 2014-05-19 10:46:37.918112 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 -6753> 2014-05-19 10:46:37.918116 7f5566602700 20 osd.0 245 send_pg_stats -6752> 2014-05-19 10:46:37.918124 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -6751> 2014-05-19 10:46:37.918128 7f5566602700 10 osd.0 245 do_waiters -- start -6750> 2014-05-19 10:46:37.918130 7f5566602700 10 osd.0 245 do_waiters -- finish -6749> 2014-05-19 10:46:37.918165 7f555119d700 20 OSD::recovery_tp worker waiting -6748> 2014-05-19 10:46:37.934977 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:40.541458) v2 ==== 47+0+0 (167749646 0 0) 0xac35dc0 con 0x96571e0 -6747> 2014-05-19 10:46:37.935027 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:40.541458) v2 -- ?+0 0x92a1500 con 0x96571e0 -6746> 2014-05-19 10:46:37.935180 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -6745> 2014-05-19 10:46:37.935511 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:40.541458) v2 ==== 47+0+0 (167749646 0 0) 0xac37180 con 0x9656420 -6744> 2014-05-19 10:46:37.935556 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:40.541458) v2 -- ?+0 0x9fb4c40 con 0x9656420 -6743> 2014-05-19 10:46:37.935632 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -6742> 2014-05-19 10:46:38.040877 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:40.647238) v2 ==== 47+0+0 (829380676 0 0) 0xac28fc0 con 0x9a0c9a0 -6741> 2014-05-19 10:46:38.040740 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:40.647238) v2 ==== 47+0+0 (829380676 0 0) 0xa209500 con 0x996e000 -6740> 2014-05-19 10:46:38.040989 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:40.647238) v2 -- ?+0 0xac37180 con 0x996e000 -6739> 2014-05-19 10:46:38.041077 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -6738> 2014-05-19 10:46:38.041204 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:40.647238) v2 -- ?+0 0xac35dc0 con 0x9a0c9a0 -6737> 2014-05-19 10:46:38.041286 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -6736> 2014-05-19 10:46:38.492959 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:42.437132) v2 ==== 47+0+0 (3378207473 0 0) 0xa3dac40 con 0x9bb69a0 -6735> 2014-05-19 10:46:38.493004 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:42.437132) v2 -- ?+0 0xa209500 con 0x9bb69a0 -6734> 2014-05-19 10:46:38.493276 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -6733> 2014-05-19 10:46:38.493284 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:42.437132) v2 ==== 47+0+0 (3378207473 0 0) 0xa0b7500 con 0x94e3e40 -6732> 2014-05-19 10:46:38.493331 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:42.437132) v2 -- ?+0 0xac28fc0 con 0x94e3e40 -6731> 2014-05-19 10:46:38.493362 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -6730> 2014-05-19 10:46:38.526743 7f5565600700 20 KeyValueStore::op_tp worker waiting -6729> 2014-05-19 10:46:38.768321 7f55551a5700 20 OSD::op_tp worker waiting -6728> 2014-05-19 10:46:38.768350 7f55579aa700 20 OSD::op_tp worker waiting -6727> 2014-05-19 10:46:38.768374 7f555a1af700 20 OSD::op_tp worker waiting -6726> 2014-05-19 10:46:38.769926 7f55589ac700 20 OSD::op_tp worker waiting -6725> 2014-05-19 10:46:38.769946 7f55549a4700 20 OSD::op_tp worker waiting -6724> 2014-05-19 10:46:38.769976 7f555a9b0700 20 OSD::op_tp worker waiting -6723> 2014-05-19 10:46:38.770000 7f55541a3700 20 OSD::op_tp worker waiting -6722> 2014-05-19 10:46:38.770012 7f55569a8700 20 OSD::op_tp worker waiting -6721> 2014-05-19 10:46:38.770067 7f555b1b1700 20 OSD::op_tp worker waiting -6720> 2014-05-19 10:46:38.771059 7f55581ab700 20 OSD::op_tp worker waiting -6719> 2014-05-19 10:46:38.771083 7f55571a9700 20 OSD::op_tp worker waiting -6718> 2014-05-19 10:46:38.771107 7f55539a2700 20 OSD::op_tp worker waiting -6717> 2014-05-19 10:46:38.771128 7f55531a1700 20 OSD::op_tp worker waiting -6716> 2014-05-19 10:46:38.771140 7f55529a0700 20 OSD::op_tp worker waiting -6715> 2014-05-19 10:46:38.771151 7f55561a7700 20 OSD::op_tp worker waiting -6714> 2014-05-19 10:46:38.771169 7f55559a6700 20 OSD::op_tp worker waiting -6713> 2014-05-19 10:46:38.771187 7f555219f700 20 OSD::op_tp worker waiting -6712> 2014-05-19 10:46:38.771220 7f55599ae700 20 OSD::op_tp worker waiting -6711> 2014-05-19 10:46:38.771246 7f55591ad700 20 OSD::op_tp worker waiting -6710> 2014-05-19 10:46:38.771268 7f555199e700 20 OSD::op_tp worker waiting -6709> 2014-05-19 10:46:38.772361 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:42.716655) v2 ==== 47+0+0 (4073260130 0 0) 0x97c2e00 con 0x95142c0 -6708> 2014-05-19 10:46:38.772387 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:42.716655) v2 ==== 47+0+0 (4073260130 0 0) 0x9c08c40 con 0x99d31e0 -6707> 2014-05-19 10:46:38.772413 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:42.716655) v2 -- ?+0 0xa0b7500 con 0x95142c0 -6706> 2014-05-19 10:46:38.772531 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -6705> 2014-05-19 10:46:38.772598 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:42.716655) v2 -- ?+0 0xa3dac40 con 0x99d31e0 -6704> 2014-05-19 10:46:38.772645 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -6703> 2014-05-19 10:46:38.889552 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:42.833834) v2 ==== 47+0+0 (2867828055 0 0) 0xac2a8c0 con 0x9bb7b80 -6702> 2014-05-19 10:46:38.889596 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:42.833834) v2 -- ?+0 0x9c08c40 con 0x9bb7b80 -6701> 2014-05-19 10:46:38.889597 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:42.833834) v2 ==== 47+0+0 (2867828055 0 0) 0xac288c0 con 0x95151e0 -6700> 2014-05-19 10:46:38.889713 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -6699> 2014-05-19 10:46:38.890054 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:42.833834) v2 -- ?+0 0x97c2e00 con 0x95151e0 -6698> 2014-05-19 10:46:38.890096 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -6697> 2014-05-19 10:46:38.918218 7f5566602700 5 osd.0 245 tick -6696> 2014-05-19 10:46:38.918242 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -6695> 2014-05-19 10:46:38.918247 7f5566602700 10 osd.0 245 do_waiters -- start -6694> 2014-05-19 10:46:38.918249 7f5566602700 10 osd.0 245 do_waiters -- finish -6693> 2014-05-19 10:46:38.918287 7f555119d700 20 OSD::recovery_tp worker waiting -6692> 2014-05-19 10:46:39.010434 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:42.954646) v2 ==== 47+0+0 (425845148 0 0) 0xa0bafc0 con 0x987b340 -6691> 2014-05-19 10:46:39.010525 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:42.954646) v2 -- ?+0 0xac2a8c0 con 0x987b340 -6690> 2014-05-19 10:46:39.010449 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:42.954646) v2 ==== 47+0+0 (425845148 0 0) 0x9ad3880 con 0x94e26e0 -6689> 2014-05-19 10:46:39.010624 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -6688> 2014-05-19 10:46:39.010652 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:42.954646) v2 -- ?+0 0xac288c0 con 0x94e26e0 -6687> 2014-05-19 10:46:39.010719 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -6686> 2014-05-19 10:46:39.110136 7f5564dff700 20 KeyValueStore::op_tp worker waiting -6685> 2014-05-19 10:46:39.304182 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:41.910235) v2 ==== 47+0+0 (1722683687 0 0) 0x9d52380 con 0x9a0cdc0 -6684> 2014-05-19 10:46:39.304271 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.910235) v2 -- ?+0 0x9ad3880 con 0x9a0cdc0 -6683> 2014-05-19 10:46:39.304301 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:41.910235) v2 ==== 47+0+0 (1722683687 0 0) 0xac30fc0 con 0x996fb80 -6682> 2014-05-19 10:46:39.304361 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -6681> 2014-05-19 10:46:39.304400 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.910235) v2 -- ?+0 0xa0bafc0 con 0x996fb80 -6680> 2014-05-19 10:46:39.304456 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -6679> 2014-05-19 10:46:39.449091 7f555019b700 20 OSD::command_tp worker waiting -6678> 2014-05-19 10:46:39.452349 7f555099c700 20 OSD::disk_tp worker waiting -6677> 2014-05-19 10:46:39.749743 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -6676> 2014-05-19 10:46:39.749764 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -6675> 2014-05-19 10:46:39.749772 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa4ff500 con 0x9bdc840 -6674> 2014-05-19 10:46:39.749799 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0x9faa380 con 0x9ad4420 -6673> 2014-05-19 10:46:39.749838 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0x9ba56c0 con 0x9bf31e0 -6672> 2014-05-19 10:46:39.749853 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0x9fd8700 con 0x998b340 -6671> 2014-05-19 10:46:39.749867 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa0ba8c0 con 0x9b92840 -6670> 2014-05-19 10:46:39.749883 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa6441c0 con 0x9ad49a0 -6669> 2014-05-19 10:46:39.749967 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa0bd180 con 0x7b911e0 -6668> 2014-05-19 10:46:39.750011 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa856c40 con 0x7b918c0 -6667> 2014-05-19 10:46:39.750043 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa1e5340 con 0x9aa8c60 -6666> 2014-05-19 10:46:39.750072 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa872540 con 0x9bfa000 -6665> 2014-05-19 10:46:39.750101 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa4dea80 con 0x7c23e40 -6664> 2014-05-19 10:46:39.750129 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa2df180 con 0x998b760 -6663> 2014-05-19 10:46:39.750128 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa1dec40 con 0x9ad4420 -6662> 2014-05-19 10:46:39.750163 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa05ee00 con 0x7b91080 -6661> 2014-05-19 10:46:39.750195 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa2bca80 con 0xa28fb80 -6660> 2014-05-19 10:46:39.750214 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0x9e9f340 con 0x76bdce0 -6659> 2014-05-19 10:46:39.750247 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa07a540 con 0x994ab00 -6658> 2014-05-19 10:46:39.750266 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0x9b51dc0 con 0x9ac8b00 -6657> 2014-05-19 10:46:39.750294 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa173a40 con 0x938de40 -6656> 2014-05-19 10:46:39.750322 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0x95e7500 con 0x9970b00 -6655> 2014-05-19 10:46:39.750339 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0x9f20fc0 con 0x99706e0 -6654> 2014-05-19 10:46:39.750356 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0x95621c0 con 0x9bb6f20 -6653> 2014-05-19 10:46:39.750370 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa23f500 con 0x994b340 -6652> 2014-05-19 10:46:39.750386 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa0bda40 con 0x98fa2c0 -6651> 2014-05-19 10:46:39.750403 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa3dbdc0 con 0x996f8c0 -6650> 2014-05-19 10:46:39.750418 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0x9ba5dc0 con 0x996fa20 -6649> 2014-05-19 10:46:39.750446 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0x9fd81c0 con 0x9ac8160 -6648> 2014-05-19 10:46:39.750503 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0x95bcc40 con 0x7b90420 -6647> 2014-05-19 10:46:39.750553 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0x9388e00 con 0x919fe40 -6646> 2014-05-19 10:46:39.750589 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa0dd880 con 0x9971760 -6645> 2014-05-19 10:46:39.750608 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0x9f6fc00 con 0x994af20 -6644> 2014-05-19 10:46:39.750627 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa74aa80 con 0x989be40 -6643> 2014-05-19 10:46:39.750643 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa8728c0 con 0x9adf4a0 -6642> 2014-05-19 10:46:39.750659 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa4dee00 con 0x9776160 -6641> 2014-05-19 10:46:39.750675 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0x9c0e700 con 0x96bd8c0 -6640> 2014-05-19 10:46:39.750689 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0x9f74e00 con 0x96bcdc0 -6639> 2014-05-19 10:46:39.750712 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0x9e77880 con 0x96954a0 -6638> 2014-05-19 10:46:39.750740 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa267500 con 0x76bd8c0 -6637> 2014-05-19 10:46:39.750809 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa236a80 con 0x7b90dc0 -6636> 2014-05-19 10:46:39.750843 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xac15a40 con 0x978d8c0 -6635> 2014-05-19 10:46:39.750871 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa172380 con 0x978c580 -6634> 2014-05-19 10:46:39.750899 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0xa2088c0 con 0x978d340 -6633> 2014-05-19 10:46:39.750924 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:39.749771) v2 -- ?+0 0x97c28c0 con 0x96374a0 -6632> 2014-05-19 10:46:39.751029 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -6631> 2014-05-19 10:46:39.751078 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa45e700 con 0x9bdc840 -6630> 2014-05-19 10:46:39.751118 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -6629> 2014-05-19 10:46:39.751130 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xac31c00 con 0x9bf31e0 -6628> 2014-05-19 10:46:39.751152 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -6627> 2014-05-19 10:46:39.751168 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0x9f6f6c0 con 0x998b340 -6626> 2014-05-19 10:46:39.751183 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -6625> 2014-05-19 10:46:39.751194 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0x9ed2a80 con 0x9b92840 -6624> 2014-05-19 10:46:39.751226 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -6623> 2014-05-19 10:46:39.751233 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xac23dc0 con 0x9ad49a0 -6622> 2014-05-19 10:46:39.751253 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -6621> 2014-05-19 10:46:39.751262 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa0b7880 con 0x7b911e0 -6620> 2014-05-19 10:46:39.751284 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -6619> 2014-05-19 10:46:39.751290 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xac17180 con 0x7b918c0 -6618> 2014-05-19 10:46:39.751392 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -6617> 2014-05-19 10:46:39.751406 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa237500 con 0x9aa8c60 -6616> 2014-05-19 10:46:39.751438 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -6615> 2014-05-19 10:46:39.751448 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa115a40 con 0x9bfa000 -6614> 2014-05-19 10:46:39.751476 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -6613> 2014-05-19 10:46:39.751501 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0x9ccec40 con 0x7c23e40 -6612> 2014-05-19 10:46:39.751531 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -6611> 2014-05-19 10:46:39.751542 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0x9f74fc0 con 0x998b760 -6610> 2014-05-19 10:46:39.751556 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -6609> 2014-05-19 10:46:39.751566 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa665500 con 0x7b91080 -6608> 2014-05-19 10:46:39.751581 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -6607> 2014-05-19 10:46:39.751589 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0x9547a40 con 0xa28fb80 -6606> 2014-05-19 10:46:39.751603 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -6605> 2014-05-19 10:46:39.751608 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa873500 con 0x76bdce0 -6604> 2014-05-19 10:46:39.751624 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -6603> 2014-05-19 10:46:39.751631 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa74ac40 con 0x994ab00 -6602> 2014-05-19 10:46:39.751648 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -6601> 2014-05-19 10:46:39.751653 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xac14e00 con 0x9ac8b00 -6600> 2014-05-19 10:46:39.751670 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -6599> 2014-05-19 10:46:39.751678 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa665c00 con 0x938de40 -6598> 2014-05-19 10:46:39.751692 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -6597> 2014-05-19 10:46:39.751699 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa65bc00 con 0x9970b00 -6596> 2014-05-19 10:46:39.751714 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -6595> 2014-05-19 10:46:39.751721 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa079880 con 0x99706e0 -6594> 2014-05-19 10:46:39.751736 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -6593> 2014-05-19 10:46:39.751751 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0x9b50a80 con 0x9bb6f20 -6592> 2014-05-19 10:46:39.751768 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -6591> 2014-05-19 10:46:39.751775 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0x9ba5880 con 0x994b340 -6590> 2014-05-19 10:46:39.751790 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -6589> 2014-05-19 10:46:39.751798 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0x9b501c0 con 0x98fa2c0 -6588> 2014-05-19 10:46:39.751812 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -6587> 2014-05-19 10:46:39.751819 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa162a80 con 0x996f8c0 -6586> 2014-05-19 10:46:39.751834 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -6585> 2014-05-19 10:46:39.751842 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa2e08c0 con 0x996fa20 -6584> 2014-05-19 10:46:39.751857 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -6583> 2014-05-19 10:46:39.751864 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0x99e0000 con 0x9ac8160 -6582> 2014-05-19 10:46:39.751878 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -6581> 2014-05-19 10:46:39.751887 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0x9ba4540 con 0x7b90420 -6580> 2014-05-19 10:46:39.751904 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -6579> 2014-05-19 10:46:39.751912 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa664000 con 0x919fe40 -6578> 2014-05-19 10:46:39.751926 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -6577> 2014-05-19 10:46:39.751934 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa1e5500 con 0x9971760 -6576> 2014-05-19 10:46:39.751951 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -6575> 2014-05-19 10:46:39.751958 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0x9f43a40 con 0x994af20 -6574> 2014-05-19 10:46:39.751977 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -6573> 2014-05-19 10:46:39.751984 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa5168c0 con 0x989be40 -6572> 2014-05-19 10:46:39.751999 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -6571> 2014-05-19 10:46:39.752007 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa0bc1c0 con 0x9adf4a0 -6570> 2014-05-19 10:46:39.752021 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -6569> 2014-05-19 10:46:39.752028 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa2e0540 con 0x9776160 -6568> 2014-05-19 10:46:39.752043 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -6567> 2014-05-19 10:46:39.752051 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0x9cd0000 con 0x96bd8c0 -6566> 2014-05-19 10:46:39.752065 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -6565> 2014-05-19 10:46:39.752072 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa1e41c0 con 0x96bcdc0 -6564> 2014-05-19 10:46:39.752087 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -6563> 2014-05-19 10:46:39.752094 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa4ee8c0 con 0x96954a0 -6562> 2014-05-19 10:46:39.752108 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -6561> 2014-05-19 10:46:39.752116 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa36c700 con 0x76bd8c0 -6560> 2014-05-19 10:46:39.752134 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -6559> 2014-05-19 10:46:39.752141 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa243500 con 0x7b90dc0 -6558> 2014-05-19 10:46:39.752155 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -6557> 2014-05-19 10:46:39.752162 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xa172000 con 0x978d8c0 -6556> 2014-05-19 10:46:39.752177 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -6555> 2014-05-19 10:46:39.752184 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0x99e16c0 con 0x978c580 -6554> 2014-05-19 10:46:39.752198 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -6553> 2014-05-19 10:46:39.752205 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0xac32c40 con 0x978d340 -6552> 2014-05-19 10:46:39.752219 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -6551> 2014-05-19 10:46:39.752227 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 38 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:39.749771) v2 ==== 47+0+0 (2425912273 0 0) 0x9f18c40 con 0x96374a0 -6550> 2014-05-19 10:46:39.752241 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -6549> 2014-05-19 10:46:39.805425 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:43.749770) v2 ==== 47+0+0 (3652382206 0 0) 0xa0bd340 con 0x9743600 -6548> 2014-05-19 10:46:39.805475 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:43.749770) v2 -- ?+0 0x9d52380 con 0x9743600 -6547> 2014-05-19 10:46:39.805510 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -6546> 2014-05-19 10:46:39.805723 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:43.749770) v2 ==== 47+0+0 (3652382206 0 0) 0xa447500 con 0x966e000 -6545> 2014-05-19 10:46:39.805765 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:43.749770) v2 -- ?+0 0xac30fc0 con 0x966e000 -6544> 2014-05-19 10:46:39.805852 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -6543> 2014-05-19 10:46:39.815871 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 36 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:43.760164) v2 ==== 47+0+0 (744827292 0 0) 0xa0dd6c0 con 0x987b760 -6542> 2014-05-19 10:46:39.815909 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:43.760164) v2 -- ?+0 0xa447500 con 0x987b760 -6541> 2014-05-19 10:46:39.815933 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -6540> 2014-05-19 10:46:39.816171 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 36 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:43.760164) v2 ==== 47+0+0 (744827292 0 0) 0x9e9f6c0 con 0x94802c0 -6539> 2014-05-19 10:46:39.816236 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:43.760164) v2 -- ?+0 0xa0bd340 con 0x94802c0 -6538> 2014-05-19 10:46:39.816273 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -6537> 2014-05-19 10:46:39.830196 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:42.436684) v2 ==== 47+0+0 (432682175 0 0) 0xac2ba40 con 0x9aa3600 -6536> 2014-05-19 10:46:39.830245 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:42.436684) v2 -- ?+0 0x9e9f6c0 con 0x9aa3600 -6535> 2014-05-19 10:46:39.830267 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:42.436684) v2 ==== 47+0+0 (432682175 0 0) 0xac29880 con 0x9b8c160 -6534> 2014-05-19 10:46:39.830397 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -6533> 2014-05-19 10:46:39.830436 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:42.436684) v2 -- ?+0 0xa0dd6c0 con 0x9b8c160 -6532> 2014-05-19 10:46:39.830472 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -6531> 2014-05-19 10:46:39.918327 7f5566602700 5 osd.0 245 tick -6530> 2014-05-19 10:46:39.918350 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -6529> 2014-05-19 10:46:39.918354 7f5566602700 10 osd.0 245 do_waiters -- start -6528> 2014-05-19 10:46:39.918357 7f5566602700 10 osd.0 245 do_waiters -- finish -6527> 2014-05-19 10:46:39.918396 7f555119d700 20 OSD::recovery_tp worker waiting -6526> 2014-05-19 10:46:39.949206 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:42.555716) v2 ==== 47+0+0 (1753604298 0 0) 0xa507dc0 con 0x9b8de40 -6525> 2014-05-19 10:46:39.949270 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:42.555716) v2 -- ?+0 0xac29880 con 0x9b8de40 -6524> 2014-05-19 10:46:39.949193 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:42.555716) v2 ==== 47+0+0 (1753604298 0 0) 0xac1afc0 con 0x94e2160 -6523> 2014-05-19 10:46:39.949305 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -6522> 2014-05-19 10:46:39.949352 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:42.555716) v2 -- ?+0 0xac2ba40 con 0x94e2160 -6521> 2014-05-19 10:46:39.949436 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -6520> 2014-05-19 10:46:40.102847 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:42.709318) v2 ==== 47+0+0 (3088657660 0 0) 0xa0ca700 con 0x9657080 -6519> 2014-05-19 10:46:40.102859 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:42.709318) v2 ==== 47+0+0 (3088657660 0 0) 0x9e6da40 con 0x96562c0 -6518> 2014-05-19 10:46:40.102900 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:42.709318) v2 -- ?+0 0xac1afc0 con 0x9657080 -6517> 2014-05-19 10:46:40.103440 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -6516> 2014-05-19 10:46:40.103514 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:42.709318) v2 -- ?+0 0xa507dc0 con 0x96562c0 -6515> 2014-05-19 10:46:40.103558 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -6514> 2014-05-19 10:46:40.526841 7f5565600700 20 KeyValueStore::op_tp worker waiting -6513> 2014-05-19 10:46:40.658211 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:44.602589) v2 ==== 47+0+0 (1263874671 0 0) 0xa1ee000 con 0x99718c0 -6512> 2014-05-19 10:46:40.658257 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:44.602589) v2 ==== 47+0+0 (1263874671 0 0) 0x9562000 con 0x97431e0 -6511> 2014-05-19 10:46:40.658269 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.602589) v2 -- ?+0 0x9e6da40 con 0x99718c0 -6510> 2014-05-19 10:46:40.658392 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -6509> 2014-05-19 10:46:40.658807 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.602589) v2 -- ?+0 0xa0ca700 con 0x97431e0 -6508> 2014-05-19 10:46:40.658842 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -6507> 2014-05-19 10:46:40.768399 7f55551a5700 20 OSD::op_tp worker waiting -6506> 2014-05-19 10:46:40.768431 7f55579aa700 20 OSD::op_tp worker waiting -6505> 2014-05-19 10:46:40.768451 7f555a1af700 20 OSD::op_tp worker waiting -6504> 2014-05-19 10:46:40.770014 7f55589ac700 20 OSD::op_tp worker waiting -6503> 2014-05-19 10:46:40.770046 7f555a9b0700 20 OSD::op_tp worker waiting -6502> 2014-05-19 10:46:40.770065 7f55541a3700 20 OSD::op_tp worker waiting -6501> 2014-05-19 10:46:40.770083 7f55569a8700 20 OSD::op_tp worker waiting -6500> 2014-05-19 10:46:40.770139 7f55549a4700 20 OSD::op_tp worker waiting -6499> 2014-05-19 10:46:40.770201 7f555b1b1700 20 OSD::op_tp worker waiting -6498> 2014-05-19 10:46:40.771134 7f55581ab700 20 OSD::op_tp worker waiting -6497> 2014-05-19 10:46:40.771157 7f55571a9700 20 OSD::op_tp worker waiting -6496> 2014-05-19 10:46:40.771171 7f55531a1700 20 OSD::op_tp worker waiting -6495> 2014-05-19 10:46:40.771202 7f55539a2700 20 OSD::op_tp worker waiting -6494> 2014-05-19 10:46:40.771221 7f55561a7700 20 OSD::op_tp worker waiting -6493> 2014-05-19 10:46:40.771240 7f555219f700 20 OSD::op_tp worker waiting -6492> 2014-05-19 10:46:40.771262 7f55529a0700 20 OSD::op_tp worker waiting -6491> 2014-05-19 10:46:40.771277 7f55559a6700 20 OSD::op_tp worker waiting -6490> 2014-05-19 10:46:40.771285 7f55599ae700 20 OSD::op_tp worker waiting -6489> 2014-05-19 10:46:40.771311 7f55591ad700 20 OSD::op_tp worker waiting -6488> 2014-05-19 10:46:40.771338 7f555199e700 20 OSD::op_tp worker waiting -6487> 2014-05-19 10:46:40.917051 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:44.861451) v2 ==== 47+0+0 (3325980990 0 0) 0xa2bd340 con 0x987b760 -6486> 2014-05-19 10:46:40.917142 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 37 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:44.861451) v2 ==== 47+0+0 (3325980990 0 0) 0xa856700 con 0x94802c0 -6485> 2014-05-19 10:46:40.917153 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.861451) v2 -- ?+0 0xa1ee000 con 0x987b760 -6484> 2014-05-19 10:46:40.917191 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -6483> 2014-05-19 10:46:40.917412 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.861451) v2 -- ?+0 0x9562000 con 0x94802c0 -6482> 2014-05-19 10:46:40.917689 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -6481> 2014-05-19 10:46:40.918422 7f5566602700 5 osd.0 245 tick -6480> 2014-05-19 10:46:40.918443 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -6479> 2014-05-19 10:46:40.918446 7f5566602700 10 osd.0 245 do_waiters -- start -6478> 2014-05-19 10:46:40.918448 7f5566602700 10 osd.0 245 do_waiters -- finish -6477> 2014-05-19 10:46:40.918487 7f555119d700 20 OSD::recovery_tp worker waiting -6476> 2014-05-19 10:46:41.060050 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:43.666552) v2 ==== 47+0+0 (3085021014 0 0) 0xa102380 con 0x9656000 -6475> 2014-05-19 10:46:41.060066 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:43.666552) v2 ==== 47+0+0 (3085021014 0 0) 0xac33a40 con 0x9937760 -6474> 2014-05-19 10:46:41.060122 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:43.666552) v2 -- ?+0 0xa2bd340 con 0x9656000 -6473> 2014-05-19 10:46:41.060207 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -6472> 2014-05-19 10:46:41.060242 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:43.666552) v2 -- ?+0 0xa856700 con 0x9937760 -6471> 2014-05-19 10:46:41.060319 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -6470> 2014-05-19 10:46:41.110232 7f5564dff700 20 KeyValueStore::op_tp worker waiting -6469> 2014-05-19 10:46:41.449185 7f555019b700 20 OSD::command_tp worker waiting -6468> 2014-05-19 10:46:41.451094 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -6467> 2014-05-19 10:46:41.451116 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -6466> 2014-05-19 10:46:41.451124 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0x9e6d880 con 0x9bdc840 -6465> 2014-05-19 10:46:41.451151 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xac31dc0 con 0x9ad4420 -6464> 2014-05-19 10:46:41.451189 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0x9c6e000 con 0x9bf31e0 -6463> 2014-05-19 10:46:41.451204 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0x9e77dc0 con 0x998b340 -6462> 2014-05-19 10:46:41.451218 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0x9209c00 con 0x9b92840 -6461> 2014-05-19 10:46:41.451236 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xa0ebc00 con 0x9ad49a0 -6460> 2014-05-19 10:46:41.451257 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xa079880 con 0x7b911e0 -6459> 2014-05-19 10:46:41.451335 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xa65bc00 con 0x7b918c0 -6458> 2014-05-19 10:46:41.451366 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xa665c00 con 0x9aa8c60 -6457> 2014-05-19 10:46:41.451395 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xac14e00 con 0x9bfa000 -6456> 2014-05-19 10:46:41.451424 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xa74ac40 con 0x7c23e40 -6455> 2014-05-19 10:46:41.451452 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xa873500 con 0x998b760 -6454> 2014-05-19 10:46:41.451480 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0x9547a40 con 0x7b91080 -6453> 2014-05-19 10:46:41.451508 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xa665500 con 0xa28fb80 -6452> 2014-05-19 10:46:41.451533 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0x9f74fc0 con 0x76bdce0 -6451> 2014-05-19 10:46:41.451571 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xa1df180 con 0x9ad4420 -6450> 2014-05-19 10:46:41.451576 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0x9ccec40 con 0x994ab00 -6449> 2014-05-19 10:46:41.451629 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xa115a40 con 0x9ac8b00 -6448> 2014-05-19 10:46:41.451672 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xa237500 con 0x938de40 -6447> 2014-05-19 10:46:41.451704 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xac17180 con 0x9970b00 -6446> 2014-05-19 10:46:41.451728 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xa0b7880 con 0x99706e0 -6445> 2014-05-19 10:46:41.451752 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xac23dc0 con 0x9bb6f20 -6444> 2014-05-19 10:46:41.451775 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0x9ed2a80 con 0x994b340 -6443> 2014-05-19 10:46:41.451805 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0x9f6f6c0 con 0x98fa2c0 -6442> 2014-05-19 10:46:41.451898 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xac31c00 con 0x996f8c0 -6441> 2014-05-19 10:46:41.451927 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xa45e700 con 0x996fa20 -6440> 2014-05-19 10:46:41.451950 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xa1dec40 con 0x9ac8160 -6439> 2014-05-19 10:46:41.451973 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0x99e0540 con 0x7b90420 -6438> 2014-05-19 10:46:41.451996 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xac32e00 con 0x919fe40 -6437> 2014-05-19 10:46:41.452020 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0x99e1180 con 0x9971760 -6436> 2014-05-19 10:46:41.452042 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xa4ffa40 con 0x994af20 -6435> 2014-05-19 10:46:41.452083 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0x9d76540 con 0x989be40 -6434> 2014-05-19 10:46:41.452115 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xa36c1c0 con 0x9adf4a0 -6433> 2014-05-19 10:46:41.452137 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xa4ef6c0 con 0x9776160 -6432> 2014-05-19 10:46:41.452170 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xa664fc0 con 0x96bd8c0 -6431> 2014-05-19 10:46:41.452204 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0x9ebbdc0 con 0x96bcdc0 -6430> 2014-05-19 10:46:41.452222 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0x95e61c0 con 0x96954a0 -6429> 2014-05-19 10:46:41.452236 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xa0bc700 con 0x76bd8c0 -6428> 2014-05-19 10:46:41.452261 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0xa517880 con 0x7b90dc0 -6427> 2014-05-19 10:46:41.452287 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0x9e10c40 con 0x978d8c0 -6426> 2014-05-19 10:46:41.452314 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0x9f75a40 con 0x978c580 -6425> 2014-05-19 10:46:41.452334 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0x9e76e00 con 0x978d340 -6424> 2014-05-19 10:46:41.452350 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:41.451123) v2 -- ?+0 0x9ebb880 con 0x96374a0 -6423> 2014-05-19 10:46:41.452384 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -6422> 2014-05-19 10:46:41.452421 7f555099c700 20 OSD::disk_tp worker waiting -6421> 2014-05-19 10:46:41.452437 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xa2bc8c0 con 0x7b911e0 -6420> 2014-05-19 10:46:41.452476 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -6419> 2014-05-19 10:46:41.452501 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0x94b7340 con 0x7b918c0 -6418> 2014-05-19 10:46:41.452533 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -6417> 2014-05-19 10:46:41.452545 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0x9faa540 con 0x9aa8c60 -6416> 2014-05-19 10:46:41.452579 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -6415> 2014-05-19 10:46:41.452593 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0x97c21c0 con 0x9bfa000 -6414> 2014-05-19 10:46:41.452621 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -6413> 2014-05-19 10:46:41.452642 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0x9cabc00 con 0x7c23e40 -6412> 2014-05-19 10:46:41.452677 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -6411> 2014-05-19 10:46:41.452690 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xa4df340 con 0x998b760 -6410> 2014-05-19 10:46:41.452836 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -6409> 2014-05-19 10:46:41.452865 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xa6656c0 con 0x7b91080 -6408> 2014-05-19 10:46:41.452897 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -6407> 2014-05-19 10:46:41.452911 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0x9fece00 con 0xa28fb80 -6406> 2014-05-19 10:46:41.452942 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -6405> 2014-05-19 10:46:41.452955 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0x9455500 con 0x76bdce0 -6404> 2014-05-19 10:46:41.452987 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -6403> 2014-05-19 10:46:41.453014 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xa107dc0 con 0x994ab00 -6402> 2014-05-19 10:46:41.453043 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -6401> 2014-05-19 10:46:41.453058 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xac148c0 con 0x9ac8b00 -6400> 2014-05-19 10:46:41.453089 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -6399> 2014-05-19 10:46:41.453102 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0x9209500 con 0x938de40 -6398> 2014-05-19 10:46:41.453157 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -6397> 2014-05-19 10:46:41.453172 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0x9e77c00 con 0x9970b00 -6396> 2014-05-19 10:46:41.453203 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -6395> 2014-05-19 10:46:41.453217 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xa6d4a80 con 0x99706e0 -6394> 2014-05-19 10:46:41.453247 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -6393> 2014-05-19 10:46:41.453261 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0x9b51880 con 0x9bb6f20 -6392> 2014-05-19 10:46:41.453292 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -6391> 2014-05-19 10:46:41.453307 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xa05e540 con 0x994b340 -6390> 2014-05-19 10:46:41.453337 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -6389> 2014-05-19 10:46:41.453351 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0x9caa380 con 0x98fa2c0 -6388> 2014-05-19 10:46:41.453382 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -6387> 2014-05-19 10:46:41.453398 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0x97d28c0 con 0x996f8c0 -6386> 2014-05-19 10:46:41.453428 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -6385> 2014-05-19 10:46:41.453443 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0x9c6f340 con 0x996fa20 -6384> 2014-05-19 10:46:41.453473 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -6383> 2014-05-19 10:46:41.453486 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xa517c00 con 0x9ac8160 -6382> 2014-05-19 10:46:41.453517 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -6381> 2014-05-19 10:46:41.453531 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xa872700 con 0x7b90420 -6380> 2014-05-19 10:46:41.453561 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -6379> 2014-05-19 10:46:41.453575 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xa0dcc40 con 0x919fe40 -6378> 2014-05-19 10:46:41.453605 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -6377> 2014-05-19 10:46:41.453618 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0x9ad68c0 con 0x9971760 -6376> 2014-05-19 10:46:41.453648 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -6375> 2014-05-19 10:46:41.453663 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0x9fdc380 con 0x994af20 -6374> 2014-05-19 10:46:41.453692 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -6373> 2014-05-19 10:46:41.453706 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xa517340 con 0x989be40 -6372> 2014-05-19 10:46:41.453735 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -6371> 2014-05-19 10:46:41.453751 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0x9ad2380 con 0x9adf4a0 -6370> 2014-05-19 10:46:41.453781 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -6369> 2014-05-19 10:46:41.453794 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xa2e1c00 con 0x9776160 -6368> 2014-05-19 10:46:41.453824 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -6367> 2014-05-19 10:46:41.453837 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xa6641c0 con 0x96bd8c0 -6366> 2014-05-19 10:46:41.453868 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -6365> 2014-05-19 10:46:41.453881 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xac16c40 con 0x96bcdc0 -6364> 2014-05-19 10:46:41.453910 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -6363> 2014-05-19 10:46:41.453923 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0x9e9fc00 con 0x96954a0 -6362> 2014-05-19 10:46:41.453952 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -6361> 2014-05-19 10:46:41.453965 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xa102700 con 0x76bd8c0 -6360> 2014-05-19 10:46:41.453995 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -6359> 2014-05-19 10:46:41.454009 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xa2421c0 con 0x7b90dc0 -6358> 2014-05-19 10:46:41.454040 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -6357> 2014-05-19 10:46:41.454055 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xa1736c0 con 0x978d8c0 -6356> 2014-05-19 10:46:41.454082 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -6355> 2014-05-19 10:46:41.454100 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0x9cd1880 con 0x978c580 -6354> 2014-05-19 10:46:41.454131 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -6353> 2014-05-19 10:46:41.454145 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xac32a80 con 0x978d340 -6352> 2014-05-19 10:46:41.454175 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -6351> 2014-05-19 10:46:41.454189 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 39 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xa1e56c0 con 0x96374a0 -6350> 2014-05-19 10:46:41.454219 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -6349> 2014-05-19 10:46:41.454233 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xa665340 con 0x9bdc840 -6348> 2014-05-19 10:46:41.454265 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -6347> 2014-05-19 10:46:41.454277 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xac31a40 con 0x9bf31e0 -6346> 2014-05-19 10:46:41.454308 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -6345> 2014-05-19 10:46:41.454321 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0x9faa1c0 con 0x998b340 -6344> 2014-05-19 10:46:41.454350 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -6343> 2014-05-19 10:46:41.454364 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0x9fd8540 con 0x9b92840 -6342> 2014-05-19 10:46:41.454394 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -6341> 2014-05-19 10:46:41.454408 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:41.451123) v2 ==== 47+0+0 (2992698285 0 0) 0xac22fc0 con 0x9ad49a0 -6340> 2014-05-19 10:46:41.454439 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -6339> 2014-05-19 10:46:41.605215 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:44.211714) v2 ==== 47+0+0 (2872631602 0 0) 0xac30e00 con 0x996fb80 -6338> 2014-05-19 10:46:41.605274 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.211714) v2 -- ?+0 0xa102380 con 0x996fb80 -6337> 2014-05-19 10:46:41.605212 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:44.211714) v2 ==== 47+0+0 (2872631602 0 0) 0x9ed0540 con 0x9a0cdc0 -6336> 2014-05-19 10:46:41.605403 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -6335> 2014-05-19 10:46:41.605653 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.211714) v2 -- ?+0 0xac33a40 con 0x9a0cdc0 -6334> 2014-05-19 10:46:41.605691 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -6333> 2014-05-19 10:46:41.661905 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:45.606230) v2 ==== 47+0+0 (1630307149 0 0) 0xa093180 con 0x9970840 -6332> 2014-05-19 10:46:41.661956 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:45.606230) v2 -- ?+0 0xac30e00 con 0x9970840 -6331> 2014-05-19 10:46:41.661910 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:45.606230) v2 ==== 47+0+0 (1630307149 0 0) 0xac1b880 con 0x97434a0 -6330> 2014-05-19 10:46:41.662080 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -6329> 2014-05-19 10:46:41.662117 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:45.606230) v2 -- ?+0 0x9ed0540 con 0x97434a0 -6328> 2014-05-19 10:46:41.662149 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -6327> 2014-05-19 10:46:41.706576 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:44.313099) v2 ==== 47+0+0 (3526773876 0 0) 0xac228c0 con 0x9b8db80 -6326> 2014-05-19 10:46:41.706610 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:44.313099) v2 ==== 47+0+0 (3526773876 0 0) 0xac236c0 con 0x7b90160 -6325> 2014-05-19 10:46:41.706632 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.313099) v2 -- ?+0 0xa093180 con 0x9b8db80 -6324> 2014-05-19 10:46:41.706833 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -6323> 2014-05-19 10:46:41.706906 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.313099) v2 -- ?+0 0xac1b880 con 0x7b90160 -6322> 2014-05-19 10:46:41.707268 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -6321> 2014-05-19 10:46:41.873175 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:45.817625) v2 ==== 47+0+0 (1842532588 0 0) 0xa644c40 con 0x99d3340 -6320> 2014-05-19 10:46:41.873223 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:45.817625) v2 ==== 47+0+0 (1842532588 0 0) 0xa2bda40 con 0x94a5a20 -6319> 2014-05-19 10:46:41.873241 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:45.817625) v2 -- ?+0 0xac228c0 con 0x99d3340 -6318> 2014-05-19 10:46:41.873330 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -6317> 2014-05-19 10:46:41.873404 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:45.817625) v2 -- ?+0 0xac236c0 con 0x94a5a20 -6316> 2014-05-19 10:46:41.873493 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -6315> 2014-05-19 10:46:41.918538 7f5566602700 5 osd.0 245 tick -6314> 2014-05-19 10:46:41.918563 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -6313> 2014-05-19 10:46:41.918568 7f5566602700 10 osd.0 245 do_waiters -- start -6312> 2014-05-19 10:46:41.918570 7f5566602700 10 osd.0 245 do_waiters -- finish -6311> 2014-05-19 10:46:41.918608 7f555119d700 20 OSD::recovery_tp worker waiting -6310> 2014-05-19 10:46:42.138798 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:44.745306) v2 ==== 47+0+0 (2074939486 0 0) 0xa74b180 con 0x9983600 -6309> 2014-05-19 10:46:42.138850 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.745306) v2 -- ?+0 0xa2bda40 con 0x9983600 -6308> 2014-05-19 10:46:42.138795 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:44.745306) v2 ==== 47+0+0 (2074939486 0 0) 0xa464a80 con 0x95846e0 -6307> 2014-05-19 10:46:42.138974 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -6306> 2014-05-19 10:46:42.139011 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.745306) v2 -- ?+0 0xa644c40 con 0x95846e0 -6305> 2014-05-19 10:46:42.139044 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -6304> 2014-05-19 10:46:42.281419 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:46.225887) v2 ==== 47+0+0 (2657884676 0 0) 0xa856fc0 con 0x99f1080 -6303> 2014-05-19 10:46:42.281471 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:46.225887) v2 -- ?+0 0xa74b180 con 0x99f1080 -6302> 2014-05-19 10:46:42.281591 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -6301> 2014-05-19 10:46:42.281440 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:46.225887) v2 ==== 47+0+0 (2657884676 0 0) 0xac34a80 con 0x987af20 -6300> 2014-05-19 10:46:42.281664 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:46.225887) v2 -- ?+0 0xa464a80 con 0x987af20 -6299> 2014-05-19 10:46:42.281747 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -6298> 2014-05-19 10:46:42.526917 7f5565600700 20 KeyValueStore::op_tp worker waiting -6297> 2014-05-19 10:46:42.555928 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:45.162413) v2 ==== 47+0+0 (2655993503 0 0) 0x9f21c00 con 0x9656f20 -6296> 2014-05-19 10:46:42.556001 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:45.162413) v2 -- ?+0 0xa856fc0 con 0x9656f20 -6295> 2014-05-19 10:46:42.556081 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -6294> 2014-05-19 10:46:42.556140 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:45.162413) v2 ==== 47+0+0 (2655993503 0 0) 0xac096c0 con 0x9656160 -6293> 2014-05-19 10:46:42.556179 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:45.162413) v2 -- ?+0 0xac34a80 con 0x9656160 -6292> 2014-05-19 10:46:42.556205 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -6291> 2014-05-19 10:46:42.636545 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:45.243060) v2 ==== 47+0+0 (3452736333 0 0) 0xac35c00 con 0x96571e0 -6290> 2014-05-19 10:46:42.636563 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:45.243060) v2 ==== 47+0+0 (3452736333 0 0) 0xac36fc0 con 0x9656420 -6289> 2014-05-19 10:46:42.636598 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:45.243060) v2 -- ?+0 0x9f21c00 con 0x96571e0 -6288> 2014-05-19 10:46:42.636700 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -6287> 2014-05-19 10:46:42.636912 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:45.243060) v2 -- ?+0 0xac096c0 con 0x9656420 -6286> 2014-05-19 10:46:42.637001 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -6285> 2014-05-19 10:46:42.687673 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:42.687528) v2 ==== 47+0+0 (2486916150 0 0) 0xa6ab500 con 0x9656580 -6284> 2014-05-19 10:46:42.687717 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:42.687528) v2 -- ?+0 0xac36fc0 con 0x9656580 -6283> 2014-05-19 10:46:42.687757 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -6282> 2014-05-19 10:46:42.687742 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:42.687528) v2 ==== 47+0+0 (2486916150 0 0) 0xac356c0 con 0x9657340 -6281> 2014-05-19 10:46:42.687829 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:42.687528) v2 -- ?+0 0xac35c00 con 0x9657340 -6280> 2014-05-19 10:46:42.687861 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -6279> 2014-05-19 10:46:42.768496 7f55551a5700 20 OSD::op_tp worker waiting -6278> 2014-05-19 10:46:42.768522 7f555a1af700 20 OSD::op_tp worker waiting -6277> 2014-05-19 10:46:42.768576 7f55579aa700 20 OSD::op_tp worker waiting -6276> 2014-05-19 10:46:42.770117 7f55589ac700 20 OSD::op_tp worker waiting -6275> 2014-05-19 10:46:42.770139 7f555a9b0700 20 OSD::op_tp worker waiting -6274> 2014-05-19 10:46:42.770159 7f55541a3700 20 OSD::op_tp worker waiting -6273> 2014-05-19 10:46:42.770189 7f55569a8700 20 OSD::op_tp worker waiting -6272> 2014-05-19 10:46:42.770213 7f55549a4700 20 OSD::op_tp worker waiting -6271> 2014-05-19 10:46:42.770274 7f555b1b1700 20 OSD::op_tp worker waiting -6270> 2014-05-19 10:46:42.771202 7f55581ab700 20 OSD::op_tp worker waiting -6269> 2014-05-19 10:46:42.771223 7f55571a9700 20 OSD::op_tp worker waiting -6268> 2014-05-19 10:46:42.771258 7f55531a1700 20 OSD::op_tp worker waiting -6267> 2014-05-19 10:46:42.771281 7f55539a2700 20 OSD::op_tp worker waiting -6266> 2014-05-19 10:46:42.771302 7f55561a7700 20 OSD::op_tp worker waiting -6265> 2014-05-19 10:46:42.771328 7f55591ad700 20 OSD::op_tp worker waiting -6264> 2014-05-19 10:46:42.771344 7f55529a0700 20 OSD::op_tp worker waiting -6263> 2014-05-19 10:46:42.771359 7f555219f700 20 OSD::op_tp worker waiting -6262> 2014-05-19 10:46:42.771385 7f55559a6700 20 OSD::op_tp worker waiting -6261> 2014-05-19 10:46:42.771402 7f555199e700 20 OSD::op_tp worker waiting -6260> 2014-05-19 10:46:42.771433 7f55599ae700 20 OSD::op_tp worker waiting -6259> 2014-05-19 10:46:42.782672 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:46.727125) v2 ==== 47+0+0 (501093452 0 0) 0xa857c00 con 0x99f1080 -6258> 2014-05-19 10:46:42.782725 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:46.727125) v2 -- ?+0 0xac356c0 con 0x99f1080 -6257> 2014-05-19 10:46:42.782764 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -6256> 2014-05-19 10:46:42.782726 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:46.727125) v2 ==== 47+0+0 (501093452 0 0) 0xac348c0 con 0x987af20 -6255> 2014-05-19 10:46:42.782847 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:46.727125) v2 -- ?+0 0xa6ab500 con 0x987af20 -6254> 2014-05-19 10:46:42.782882 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -6253> 2014-05-19 10:46:42.918646 7f5566602700 5 osd.0 245 tick -6252> 2014-05-19 10:46:42.918666 7f5566602700 7 osd.0 245 do_mon_report -6251> 2014-05-19 10:46:42.918670 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 -6250> 2014-05-19 10:46:42.918673 7f5566602700 20 osd.0 245 send_pg_stats -6249> 2014-05-19 10:46:42.918682 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -6248> 2014-05-19 10:46:42.918686 7f5566602700 10 osd.0 245 do_waiters -- start -6247> 2014-05-19 10:46:42.918688 7f5566602700 10 osd.0 245 do_waiters -- finish -6246> 2014-05-19 10:46:42.918724 7f555119d700 20 OSD::recovery_tp worker waiting -6245> 2014-05-19 10:46:42.959451 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:46.903885) v2 ==== 47+0+0 (2927085474 0 0) 0x9e9fdc0 con 0x97431e0 -6244> 2014-05-19 10:46:42.959598 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:46.903885) v2 -- ?+0 0xa857c00 con 0x97431e0 -6243> 2014-05-19 10:46:42.959690 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:46.903885) v2 ==== 47+0+0 (2927085474 0 0) 0xa36d6c0 con 0x99718c0 -6242> 2014-05-19 10:46:42.959750 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -6241> 2014-05-19 10:46:42.959814 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:46.903885) v2 -- ?+0 0xac348c0 con 0x99718c0 -6240> 2014-05-19 10:46:42.959897 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -6239> 2014-05-19 10:46:43.004362 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:45.610862) v2 ==== 47+0+0 (4195908299 0 0) 0xa0cac40 con 0x9657080 -6238> 2014-05-19 10:46:43.004599 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:45.610862) v2 -- ?+0 0x9e9fdc0 con 0x9657080 -6237> 2014-05-19 10:46:43.004361 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:45.610862) v2 ==== 47+0+0 (4195908299 0 0) 0xa447340 con 0x96562c0 -6236> 2014-05-19 10:46:43.004788 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -6235> 2014-05-19 10:46:43.004863 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:45.610862) v2 -- ?+0 0xa36d6c0 con 0x96562c0 -6234> 2014-05-19 10:46:43.004904 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -6233> 2014-05-19 10:46:43.110312 7f5564dff700 20 KeyValueStore::op_tp worker waiting -6232> 2014-05-19 10:46:43.193900 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:47.138329) v2 ==== 47+0+0 (2190549640 0 0) 0xac09340 con 0x9bb69a0 -6231> 2014-05-19 10:46:43.193903 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:47.138329) v2 ==== 47+0+0 (2190549640 0 0) 0xa0b76c0 con 0x94e3e40 -6230> 2014-05-19 10:46:43.193954 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:47.138329) v2 -- ?+0 0xa447340 con 0x9bb69a0 -6229> 2014-05-19 10:46:43.193992 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -6228> 2014-05-19 10:46:43.194030 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:47.138329) v2 -- ?+0 0xa0cac40 con 0x94e3e40 -6227> 2014-05-19 10:46:43.194070 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -6226> 2014-05-19 10:46:43.342116 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:45.948693) v2 ==== 47+0+0 (516120626 0 0) 0xa208c40 con 0x996e000 -6225> 2014-05-19 10:46:43.342159 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:45.948693) v2 ==== 47+0+0 (516120626 0 0) 0xac28e00 con 0x9a0c9a0 -6224> 2014-05-19 10:46:43.342437 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:45.948693) v2 -- ?+0 0xac09340 con 0x996e000 -6223> 2014-05-19 10:46:43.342702 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -6222> 2014-05-19 10:46:43.342767 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:45.948693) v2 -- ?+0 0xa0b76c0 con 0x9a0c9a0 -6221> 2014-05-19 10:46:43.342851 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -6220> 2014-05-19 10:46:43.449259 7f555019b700 20 OSD::command_tp worker waiting -6219> 2014-05-19 10:46:43.452512 7f555099c700 20 OSD::disk_tp worker waiting -6218> 2014-05-19 10:46:43.473582 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:47.418061) v2 ==== 47+0+0 (1196917877 0 0) 0x9f6c380 con 0x99d31e0 -6217> 2014-05-19 10:46:43.473717 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:47.418061) v2 -- ?+0 0xa208c40 con 0x99d31e0 -6216> 2014-05-19 10:46:43.473582 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:47.418061) v2 ==== 47+0+0 (1196917877 0 0) 0x9fb4540 con 0x95142c0 -6215> 2014-05-19 10:46:43.473825 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -6214> 2014-05-19 10:46:43.473890 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:47.418061) v2 -- ?+0 0xac28e00 con 0x95142c0 -6213> 2014-05-19 10:46:43.473922 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -6212> 2014-05-19 10:46:43.591080 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:47.535602) v2 ==== 47+0+0 (597782361 0 0) 0xac2a700 con 0x9bb7b80 -6211> 2014-05-19 10:46:43.591103 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:47.535602) v2 ==== 47+0+0 (597782361 0 0) 0xac28700 con 0x95151e0 -6210> 2014-05-19 10:46:43.591132 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:47.535602) v2 -- ?+0 0x9f6c380 con 0x9bb7b80 -6209> 2014-05-19 10:46:43.591172 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -6208> 2014-05-19 10:46:43.591323 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:47.535602) v2 -- ?+0 0x9fb4540 con 0x95151e0 -6207> 2014-05-19 10:46:43.591579 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -6206> 2014-05-19 10:46:43.918764 7f5566602700 5 osd.0 245 tick -6205> 2014-05-19 10:46:43.918818 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 2.52 >= max 0.5 = no, load too high -6204> 2014-05-19 10:46:43.918831 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -6203> 2014-05-19 10:46:43.918833 7f555119d700 20 OSD::recovery_tp worker waiting -6202> 2014-05-19 10:46:43.918835 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2224.45 < min (86400 seconds) -6201> 2014-05-19 10:46:43.918853 7f5566602700 20 osd.0 245 sched_scrub done -6200> 2014-05-19 10:46:43.918856 7f5566602700 10 osd.0 245 do_waiters -- start -6199> 2014-05-19 10:46:43.918858 7f5566602700 10 osd.0 245 do_waiters -- finish -6198> 2014-05-19 10:46:44.337976 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:46.944484) v2 ==== 47+0+0 (2756055866 0 0) 0xac35a40 con 0x96571e0 -6197> 2014-05-19 10:46:44.338026 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:46.944484) v2 -- ?+0 0xac28700 con 0x96571e0 -6196> 2014-05-19 10:46:44.338064 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:46.944484) v2 ==== 47+0+0 (2756055866 0 0) 0xac36e00 con 0x9656420 -6195> 2014-05-19 10:46:44.338143 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -6194> 2014-05-19 10:46:44.338224 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:46.944484) v2 -- ?+0 0xac2a700 con 0x9656420 -6193> 2014-05-19 10:46:44.338258 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -6192> 2014-05-19 10:46:44.389472 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:44.389268) v2 ==== 47+0+0 (3100861596 0 0) 0xac35500 con 0x9657340 -6191> 2014-05-19 10:46:44.389515 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.389268) v2 -- ?+0 0xac35a40 con 0x9657340 -6190> 2014-05-19 10:46:44.389550 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -6189> 2014-05-19 10:46:44.389567 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:44.389268) v2 ==== 47+0+0 (3100861596 0 0) 0x9ed01c0 con 0x9656580 -6188> 2014-05-19 10:46:44.389596 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.389268) v2 -- ?+0 0xac36e00 con 0x9656580 -6187> 2014-05-19 10:46:44.389677 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -6186> 2014-05-19 10:46:44.418282 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:48.362832) v2 ==== 47+0+0 (1789276883 0 0) 0xac30fc0 con 0x987b760 -6185> 2014-05-19 10:46:44.418313 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 38 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:48.362832) v2 ==== 47+0+0 (1789276883 0 0) 0xa856e00 con 0x94802c0 -6184> 2014-05-19 10:46:44.418335 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.362832) v2 -- ?+0 0x9ed01c0 con 0x987b760 -6183> 2014-05-19 10:46:44.418362 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -6182> 2014-05-19 10:46:44.418444 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.362832) v2 -- ?+0 0xac35500 con 0x94802c0 -6181> 2014-05-19 10:46:44.418828 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -6180> 2014-05-19 10:46:44.440226 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:47.046766) v2 ==== 47+0+0 (2406440603 0 0) 0xa44d6c0 con 0x95846e0 -6179> 2014-05-19 10:46:44.440263 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:47.046766) v2 -- ?+0 0xac30fc0 con 0x95846e0 -6178> 2014-05-19 10:46:44.440290 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -6177> 2014-05-19 10:46:44.440382 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:47.046766) v2 ==== 47+0+0 (2406440603 0 0) 0x97c2fc0 con 0x9983600 -6176> 2014-05-19 10:46:44.440422 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:47.046766) v2 -- ?+0 0xa856e00 con 0x9983600 -6175> 2014-05-19 10:46:44.440508 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -6174> 2014-05-19 10:46:44.527013 7f5565600700 20 KeyValueStore::op_tp worker waiting -6173> 2014-05-19 10:46:44.563202 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:48.507707) v2 ==== 47+0+0 (2354308202 0 0) 0xa092a80 con 0x9970840 -6172> 2014-05-19 10:46:44.563249 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.507707) v2 -- ?+0 0xa44d6c0 con 0x9970840 -6171> 2014-05-19 10:46:44.563285 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -6170> 2014-05-19 10:46:44.563349 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:48.507707) v2 ==== 47+0+0 (2354308202 0 0) 0xac1aa80 con 0x97434a0 -6169> 2014-05-19 10:46:44.563385 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.507707) v2 -- ?+0 0x97c2fc0 con 0x97434a0 -6168> 2014-05-19 10:46:44.563467 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -6167> 2014-05-19 10:46:44.768600 7f55551a5700 20 OSD::op_tp worker waiting -6166> 2014-05-19 10:46:44.768626 7f555a1af700 20 OSD::op_tp worker waiting -6165> 2014-05-19 10:46:44.768681 7f55579aa700 20 OSD::op_tp worker waiting -6164> 2014-05-19 10:46:44.770217 7f55589ac700 20 OSD::op_tp worker waiting -6163> 2014-05-19 10:46:44.770258 7f555a9b0700 20 OSD::op_tp worker waiting -6162> 2014-05-19 10:46:44.770316 7f55541a3700 20 OSD::op_tp worker waiting -6161> 2014-05-19 10:46:44.770342 7f555b1b1700 20 OSD::op_tp worker waiting -6160> 2014-05-19 10:46:44.770376 7f55549a4700 20 OSD::op_tp worker waiting -6159> 2014-05-19 10:46:44.770401 7f55569a8700 20 OSD::op_tp worker waiting -6158> 2014-05-19 10:46:44.771272 7f55581ab700 20 OSD::op_tp worker waiting -6157> 2014-05-19 10:46:44.771290 7f55571a9700 20 OSD::op_tp worker waiting -6156> 2014-05-19 10:46:44.771330 7f55531a1700 20 OSD::op_tp worker waiting -6155> 2014-05-19 10:46:44.771355 7f55539a2700 20 OSD::op_tp worker waiting -6154> 2014-05-19 10:46:44.771382 7f55529a0700 20 OSD::op_tp worker waiting -6153> 2014-05-19 10:46:44.771404 7f55561a7700 20 OSD::op_tp worker waiting -6152> 2014-05-19 10:46:44.771422 7f55591ad700 20 OSD::op_tp worker waiting -6151> 2014-05-19 10:46:44.771432 7f555219f700 20 OSD::op_tp worker waiting -6150> 2014-05-19 10:46:44.771454 7f55559a6700 20 OSD::op_tp worker waiting -6149> 2014-05-19 10:46:44.771468 7f555199e700 20 OSD::op_tp worker waiting -6148> 2014-05-19 10:46:44.771506 7f55599ae700 20 OSD::op_tp worker waiting -6147> 2014-05-19 10:46:44.911472 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:48.856042) v2 ==== 47+0+0 (2325907263 0 0) 0x9ad21c0 con 0x94e26e0 -6146> 2014-05-19 10:46:44.911532 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.856042) v2 -- ?+0 0xac1aa80 con 0x94e26e0 -6145> 2014-05-19 10:46:44.911640 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -6144> 2014-05-19 10:46:44.911475 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:48.856042) v2 ==== 47+0+0 (2325907263 0 0) 0x9c6ec40 con 0x987b340 -6143> 2014-05-19 10:46:44.911756 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.856042) v2 -- ?+0 0xa092a80 con 0x987b340 -6142> 2014-05-19 10:46:44.912105 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -6141> 2014-05-19 10:46:44.918949 7f5566602700 5 osd.0 245 tick -6140> 2014-05-19 10:46:44.918975 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -6139> 2014-05-19 10:46:44.918980 7f5566602700 10 osd.0 245 do_waiters -- start -6138> 2014-05-19 10:46:44.918982 7f5566602700 10 osd.0 245 do_waiters -- finish -6137> 2014-05-19 10:46:44.919019 7f555119d700 20 OSD::recovery_tp worker waiting -6136> 2014-05-19 10:46:44.941724 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:47.548287) v2 ==== 47+0+0 (2519025808 0 0) 0xa23f880 con 0x95846e0 -6135> 2014-05-19 10:46:44.941781 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:47.548287) v2 -- ?+0 0x9c6ec40 con 0x95846e0 -6134> 2014-05-19 10:46:44.941818 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -6133> 2014-05-19 10:46:44.941844 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:47.548287) v2 ==== 47+0+0 (2519025808 0 0) 0x9fd8e00 con 0x9983600 -6132> 2014-05-19 10:46:44.942031 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:47.548287) v2 -- ?+0 0x9ad21c0 con 0x9983600 -6131> 2014-05-19 10:46:44.942116 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -6130> 2014-05-19 10:46:44.952493 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -6129> 2014-05-19 10:46:44.952514 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -6128> 2014-05-19 10:46:44.952523 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xa857a40 con 0x9bdc840 -6127> 2014-05-19 10:46:44.952549 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xac16000 con 0x9ad4420 -6126> 2014-05-19 10:46:44.952592 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0x9d0a1c0 con 0x9bf31e0 -6125> 2014-05-19 10:46:44.952608 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0x9f19500 con 0x998b340 -6124> 2014-05-19 10:46:44.952623 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0x9fd9180 con 0x9b92840 -6123> 2014-05-19 10:46:44.952637 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0x9cb7dc0 con 0x9ad49a0 -6122> 2014-05-19 10:46:44.952658 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xac1ae00 con 0x7b911e0 -6121> 2014-05-19 10:46:44.952728 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xac1a000 con 0x7b918c0 -6120> 2014-05-19 10:46:44.952754 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xac17c00 con 0x9aa8c60 -6119> 2014-05-19 10:46:44.952771 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xa1dfdc0 con 0x9bfa000 -6118> 2014-05-19 10:46:44.952799 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0x9ffc000 con 0x7c23e40 -6117> 2014-05-19 10:46:44.952830 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xa3dba40 con 0x998b760 -6116> 2014-05-19 10:46:44.952862 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xa103180 con 0x7b91080 -6115> 2014-05-19 10:46:44.952878 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0x95e7180 con 0xa28fb80 -6114> 2014-05-19 10:46:44.952893 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xa816a80 con 0x76bdce0 -6113> 2014-05-19 10:46:44.952890 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa857500 con 0x9bdc840 -6112> 2014-05-19 10:46:44.952907 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0x9fa5c00 con 0x994ab00 -6111> 2014-05-19 10:46:44.952968 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xa1ef180 con 0x9ac8b00 -6110> 2014-05-19 10:46:44.952985 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xa030380 con 0x938de40 -6109> 2014-05-19 10:46:44.953001 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xa209180 con 0x9970b00 -6108> 2014-05-19 10:46:44.953016 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xa872fc0 con 0x99706e0 -6107> 2014-05-19 10:46:44.953034 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xa645c00 con 0x9bb6f20 -6106> 2014-05-19 10:46:44.953052 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xa817a40 con 0x994b340 -6105> 2014-05-19 10:46:44.953067 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0x9cb6700 con 0x98fa2c0 -6104> 2014-05-19 10:46:44.953083 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0x9c6efc0 con 0x996f8c0 -6103> 2014-05-19 10:46:44.953099 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0x97d2a80 con 0x996fa20 -6102> 2014-05-19 10:46:44.953130 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xa2bd500 con 0x9ac8160 -6101> 2014-05-19 10:46:44.953147 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xa4a96c0 con 0x7b90420 -6100> 2014-05-19 10:46:44.953166 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xa236700 con 0x919fe40 -6099> 2014-05-19 10:46:44.953194 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xac22fc0 con 0x9971760 -6098> 2014-05-19 10:46:44.953224 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0x9fd8540 con 0x994af20 -6097> 2014-05-19 10:46:44.953280 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0x9faa1c0 con 0x989be40 -6096> 2014-05-19 10:46:44.953314 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xac31a40 con 0x9adf4a0 -6095> 2014-05-19 10:46:44.953345 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xa665340 con 0x9776160 -6094> 2014-05-19 10:46:44.953387 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xa1e56c0 con 0x96bd8c0 -6093> 2014-05-19 10:46:44.953410 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xac32a80 con 0x96bcdc0 -6092> 2014-05-19 10:46:44.953424 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0x9cd1880 con 0x96954a0 -6091> 2014-05-19 10:46:44.953440 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xa1736c0 con 0x76bd8c0 -6090> 2014-05-19 10:46:44.953468 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xa2421c0 con 0x7b90dc0 -6089> 2014-05-19 10:46:44.953495 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xa102700 con 0x978d8c0 -6088> 2014-05-19 10:46:44.953522 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0x9e9fc00 con 0x978c580 -6087> 2014-05-19 10:46:44.953549 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xac16c40 con 0x978d340 -6086> 2014-05-19 10:46:44.953575 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:44.952521) v2 -- ?+0 0xa6641c0 con 0x96374a0 -6085> 2014-05-19 10:46:44.953632 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -6084> 2014-05-19 10:46:44.953653 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa65ac40 con 0x9ad4420 -6083> 2014-05-19 10:46:44.953688 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -6082> 2014-05-19 10:46:44.953699 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xac31880 con 0x9bf31e0 -6081> 2014-05-19 10:46:44.953722 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -6080> 2014-05-19 10:46:44.953729 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0x9fa9dc0 con 0x998b340 -6079> 2014-05-19 10:46:44.953743 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -6078> 2014-05-19 10:46:44.953749 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa0ba540 con 0x9b92840 -6077> 2014-05-19 10:46:44.953763 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -6076> 2014-05-19 10:46:44.953768 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0x9cd0a80 con 0x9ad49a0 -6075> 2014-05-19 10:46:44.953781 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -6074> 2014-05-19 10:46:44.953789 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0x9448380 con 0x7b911e0 -6073> 2014-05-19 10:46:44.953803 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -6072> 2014-05-19 10:46:44.953825 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0x9d23500 con 0x7b918c0 -6071> 2014-05-19 10:46:44.953889 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -6070> 2014-05-19 10:46:44.953913 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa618a80 con 0x9aa8c60 -6069> 2014-05-19 10:46:44.953945 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -6068> 2014-05-19 10:46:44.953955 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0x94488c0 con 0x9bfa000 -6067> 2014-05-19 10:46:44.954011 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -6066> 2014-05-19 10:46:44.954045 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa6d4000 con 0x7c23e40 -6065> 2014-05-19 10:46:44.954067 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -6064> 2014-05-19 10:46:44.954073 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xac08c40 con 0x998b760 -6063> 2014-05-19 10:46:44.954090 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -6062> 2014-05-19 10:46:44.954100 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa665180 con 0x7b91080 -6061> 2014-05-19 10:46:44.954118 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -6060> 2014-05-19 10:46:44.954125 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0x9fecfc0 con 0xa28fb80 -6059> 2014-05-19 10:46:44.954139 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -6058> 2014-05-19 10:46:44.954144 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa506700 con 0x76bdce0 -6057> 2014-05-19 10:46:44.954161 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -6056> 2014-05-19 10:46:44.954165 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa7d4700 con 0x994ab00 -6055> 2014-05-19 10:46:44.954179 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -6054> 2014-05-19 10:46:44.954188 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xac09a40 con 0x9ac8b00 -6053> 2014-05-19 10:46:44.954206 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -6052> 2014-05-19 10:46:44.954211 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa1076c0 con 0x938de40 -6051> 2014-05-19 10:46:44.954227 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -6050> 2014-05-19 10:46:44.954234 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0x9b50000 con 0x9970b00 -6049> 2014-05-19 10:46:44.954252 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -6048> 2014-05-19 10:46:44.954259 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa6d5a40 con 0x99706e0 -6047> 2014-05-19 10:46:44.954273 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -6046> 2014-05-19 10:46:44.954281 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0x9cb5340 con 0x9bb6f20 -6045> 2014-05-19 10:46:44.954295 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -6044> 2014-05-19 10:46:44.954303 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa05e8c0 con 0x994b340 -6043> 2014-05-19 10:46:44.954316 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -6042> 2014-05-19 10:46:44.954326 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa385340 con 0x98fa2c0 -6041> 2014-05-19 10:46:44.954342 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -6040> 2014-05-19 10:46:44.954350 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa4ff340 con 0x996f8c0 -6039> 2014-05-19 10:46:44.954364 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -6038> 2014-05-19 10:46:44.954372 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0x9c6e700 con 0x996fa20 -6037> 2014-05-19 10:46:44.954387 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -6036> 2014-05-19 10:46:44.954395 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0x9ed0000 con 0x9ac8160 -6035> 2014-05-19 10:46:44.954409 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -6034> 2014-05-19 10:46:44.954416 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa873340 con 0x7b90420 -6033> 2014-05-19 10:46:44.954430 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -6032> 2014-05-19 10:46:44.954438 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa05e000 con 0x919fe40 -6031> 2014-05-19 10:46:44.954455 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -6030> 2014-05-19 10:46:44.954462 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa093880 con 0x9971760 -6029> 2014-05-19 10:46:44.954477 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -6028> 2014-05-19 10:46:44.954484 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0x9ad2000 con 0x994af20 -6027> 2014-05-19 10:46:44.954498 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -6026> 2014-05-19 10:46:44.954505 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa28d180 con 0x989be40 -6025> 2014-05-19 10:46:44.954519 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -6024> 2014-05-19 10:46:44.954526 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0x9ad3c00 con 0x9adf4a0 -6023> 2014-05-19 10:46:44.954540 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -6022> 2014-05-19 10:46:44.954553 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa2e1340 con 0x9776160 -6021> 2014-05-19 10:46:44.954571 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -6020> 2014-05-19 10:46:44.954578 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa0ba1c0 con 0x96bd8c0 -6019> 2014-05-19 10:46:44.954592 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -6018> 2014-05-19 10:46:44.954600 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xac176c0 con 0x96bcdc0 -6017> 2014-05-19 10:46:44.954614 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -6016> 2014-05-19 10:46:44.954622 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0x97c3880 con 0x96954a0 -6015> 2014-05-19 10:46:44.954636 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -6014> 2014-05-19 10:46:44.954643 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa102fc0 con 0x76bd8c0 -6013> 2014-05-19 10:46:44.954657 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -6012> 2014-05-19 10:46:44.954665 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa243340 con 0x7b90dc0 -6011> 2014-05-19 10:46:44.954678 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -6010> 2014-05-19 10:46:44.954687 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0x9ef4540 con 0x978d8c0 -6009> 2014-05-19 10:46:44.954704 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -6008> 2014-05-19 10:46:44.954711 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0x9b44540 con 0x978c580 -6007> 2014-05-19 10:46:44.954725 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -6006> 2014-05-19 10:46:44.954734 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xac328c0 con 0x978d340 -6005> 2014-05-19 10:46:44.954751 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -6004> 2014-05-19 10:46:44.954766 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 40 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:44.952521) v2 ==== 47+0+0 (1307793623 0 0) 0xa1e4a80 con 0x96374a0 -6003> 2014-05-19 10:46:44.954783 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -6002> 2014-05-19 10:46:45.110412 7f5564dff700 20 KeyValueStore::op_tp worker waiting -6001> 2014-05-19 10:46:45.131708 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:47.738243) v2 ==== 47+0+0 (1333356213 0 0) 0xac2b880 con 0x9aa3600 -6000> 2014-05-19 10:46:45.131771 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:47.738243) v2 -- ?+0 0x9fd8e00 con 0x9aa3600 -5999> 2014-05-19 10:46:45.131849 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -5998> 2014-05-19 10:46:45.131712 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:47.738243) v2 ==== 47+0+0 (1333356213 0 0) 0xac296c0 con 0x9b8c160 -5997> 2014-05-19 10:46:45.131976 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:47.738243) v2 -- ?+0 0xa23f880 con 0x9b8c160 -5996> 2014-05-19 10:46:45.132054 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -5995> 2014-05-19 10:46:45.250707 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:47.857233) v2 ==== 47+0+0 (1785848005 0 0) 0xac1a1c0 con 0x94e2160 -5994> 2014-05-19 10:46:45.250758 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:47.857233) v2 -- ?+0 0xac2b880 con 0x94e2160 -5993> 2014-05-19 10:46:45.250684 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:47.857233) v2 ==== 47+0+0 (1785848005 0 0) 0x9b44a80 con 0x9b8de40 -5992> 2014-05-19 10:46:45.250838 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -5991> 2014-05-19 10:46:45.250885 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:47.857233) v2 -- ?+0 0xac296c0 con 0x9b8de40 -5990> 2014-05-19 10:46:45.251175 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -5989> 2014-05-19 10:46:45.449353 7f555019b700 20 OSD::command_tp worker waiting -5988> 2014-05-19 10:46:45.452605 7f555099c700 20 OSD::disk_tp worker waiting -5987> 2014-05-19 10:46:45.457724 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:48.063742) v2 ==== 47+0+0 (804785701 0 0) 0xa102a80 con 0x9656160 -5986> 2014-05-19 10:46:45.457746 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:48.063742) v2 ==== 47+0+0 (804785701 0 0) 0x9f20a80 con 0x9656f20 -5985> 2014-05-19 10:46:45.457774 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.063742) v2 -- ?+0 0x9b44a80 con 0x9656160 -5984> 2014-05-19 10:46:45.457810 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -5983> 2014-05-19 10:46:45.457838 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.063742) v2 -- ?+0 0xac1a1c0 con 0x9656f20 -5982> 2014-05-19 10:46:45.457879 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -5981> 2014-05-19 10:46:45.495277 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:49.439808) v2 ==== 47+0+0 (2036722284 0 0) 0xac16e00 con 0x9bb69a0 -5980> 2014-05-19 10:46:45.495398 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:49.439808) v2 -- ?+0 0xa102a80 con 0x9bb69a0 -5979> 2014-05-19 10:46:45.495272 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:49.439808) v2 ==== 47+0+0 (2036722284 0 0) 0x9c0f500 con 0x94e3e40 -5978> 2014-05-19 10:46:45.495475 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -5977> 2014-05-19 10:46:45.495510 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:49.439808) v2 -- ?+0 0x9f20a80 con 0x94e3e40 -5976> 2014-05-19 10:46:45.495624 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -5975> 2014-05-19 10:46:45.643617 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:48.250205) v2 ==== 47+0+0 (1836910556 0 0) 0xa2096c0 con 0x996e000 -5974> 2014-05-19 10:46:45.643733 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.250205) v2 -- ?+0 0xac16e00 con 0x996e000 -5973> 2014-05-19 10:46:45.643771 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -5972> 2014-05-19 10:46:45.643633 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:48.250205) v2 ==== 47+0+0 (1836910556 0 0) 0xa5fca80 con 0x9a0c9a0 -5971> 2014-05-19 10:46:45.643807 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.250205) v2 -- ?+0 0x9c0f500 con 0x9a0c9a0 -5970> 2014-05-19 10:46:45.643835 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -5969> 2014-05-19 10:46:45.683871 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:49.628451) v2 ==== 47+0+0 (1827930837 0 0) 0xa856a80 con 0x99f1080 -5968> 2014-05-19 10:46:45.683953 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:49.628451) v2 -- ?+0 0xa5fca80 con 0x99f1080 -5967> 2014-05-19 10:46:45.683988 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -5966> 2014-05-19 10:46:45.684053 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:49.628451) v2 ==== 47+0+0 (1827930837 0 0) 0xac34700 con 0x987af20 -5965> 2014-05-19 10:46:45.684356 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:49.628451) v2 -- ?+0 0xa2096c0 con 0x987af20 -5964> 2014-05-19 10:46:45.684432 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -5963> 2014-05-19 10:46:45.706705 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:49.651258) v2 ==== 47+0+0 (2112304825 0 0) 0xa3db180 con 0x9743600 -5962> 2014-05-19 10:46:45.706753 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:49.651258) v2 -- ?+0 0xa856a80 con 0x9743600 -5961> 2014-05-19 10:46:45.706913 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:49.651258) v2 ==== 47+0+0 (2112304825 0 0) 0x9e116c0 con 0x966e000 -5960> 2014-05-19 10:46:45.707101 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -5959> 2014-05-19 10:46:45.707133 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:49.651258) v2 -- ?+0 0xac34700 con 0x966e000 -5958> 2014-05-19 10:46:45.707286 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -5957> 2014-05-19 10:46:45.919075 7f5566602700 5 osd.0 245 tick -5956> 2014-05-19 10:46:45.919129 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 2.52 >= max 0.5 = no, load too high -5955> 2014-05-19 10:46:45.919142 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -5954> 2014-05-19 10:46:45.919144 7f555119d700 20 OSD::recovery_tp worker waiting -5953> 2014-05-19 10:46:45.919145 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2226.45 < min (86400 seconds) -5952> 2014-05-19 10:46:45.919164 7f5566602700 20 osd.0 245 sched_scrub done -5951> 2014-05-19 10:46:45.919167 7f5566602700 10 osd.0 245 do_waiters -- start -5950> 2014-05-19 10:46:45.919169 7f5566602700 10 osd.0 245 do_waiters -- finish -5949> 2014-05-19 10:46:46.352377 7f555c1b3700 10 monclient: tick -5948> 2014-05-19 10:46:46.352392 7f555c1b3700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2014-05-19 10:46:16.352390) -5947> 2014-05-19 10:46:46.352419 7f555c1b3700 10 monclient: renew subs? (now: 2014-05-19 10:46:46.352419; renew after: 2014-05-19 10:47:03.081841) -- no -5946> 2014-05-19 10:46:46.460777 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:50.405261) v2 ==== 47+0+0 (2263313260 0 0) 0x9e9f500 con 0x97431e0 -5945> 2014-05-19 10:46:46.460844 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:50.405261) v2 -- ?+0 0xa3db180 con 0x97431e0 -5944> 2014-05-19 10:46:46.460908 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:50.405261) v2 ==== 47+0+0 (2263313260 0 0) 0xa36d880 con 0x99718c0 -5943> 2014-05-19 10:46:46.460986 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -5942> 2014-05-19 10:46:46.461020 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:50.405261) v2 -- ?+0 0x9e116c0 con 0x99718c0 -5941> 2014-05-19 10:46:46.461098 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -5940> 2014-05-19 10:46:46.527093 7f5565600700 20 KeyValueStore::op_tp worker waiting -5939> 2014-05-19 10:46:46.574482 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:50.519126) v2 ==== 47+0+0 (1115174368 0 0) 0xa2bc700 con 0x94a5a20 -5938> 2014-05-19 10:46:46.574538 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:50.519126) v2 -- ?+0 0x9e9f500 con 0x94a5a20 -5937> 2014-05-19 10:46:46.574628 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -5936> 2014-05-19 10:46:46.575021 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:50.519126) v2 ==== 47+0+0 (1115174368 0 0) 0x9fd8c40 con 0x99d3340 -5935> 2014-05-19 10:46:46.575066 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:50.519126) v2 -- ?+0 0xa36d880 con 0x99d3340 -5934> 2014-05-19 10:46:46.575146 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -5933> 2014-05-19 10:46:46.643215 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:49.249737) v2 ==== 47+0+0 (20825646 0 0) 0x9fd9500 con 0x9983600 -5932> 2014-05-19 10:46:46.643266 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:49.249737) v2 -- ?+0 0xa2bc700 con 0x9983600 -5931> 2014-05-19 10:46:46.643300 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -5930> 2014-05-19 10:46:46.643601 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:49.249737) v2 ==== 47+0+0 (20825646 0 0) 0xa664540 con 0x95846e0 -5929> 2014-05-19 10:46:46.643640 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:49.249737) v2 -- ?+0 0x9fd8c40 con 0x95846e0 -5928> 2014-05-19 10:46:46.643670 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -5927> 2014-05-19 10:46:46.768688 7f55551a5700 20 OSD::op_tp worker waiting -5926> 2014-05-19 10:46:46.768715 7f555a1af700 20 OSD::op_tp worker waiting -5925> 2014-05-19 10:46:46.768764 7f55579aa700 20 OSD::op_tp worker waiting -5924> 2014-05-19 10:46:46.770317 7f55589ac700 20 OSD::op_tp worker waiting -5923> 2014-05-19 10:46:46.770339 7f555a9b0700 20 OSD::op_tp worker waiting -5922> 2014-05-19 10:46:46.770404 7f55541a3700 20 OSD::op_tp worker waiting -5921> 2014-05-19 10:46:46.770423 7f555b1b1700 20 OSD::op_tp worker waiting -5920> 2014-05-19 10:46:46.770450 7f55549a4700 20 OSD::op_tp worker waiting -5919> 2014-05-19 10:46:46.770475 7f55569a8700 20 OSD::op_tp worker waiting -5918> 2014-05-19 10:46:46.771352 7f55581ab700 20 OSD::op_tp worker waiting -5917> 2014-05-19 10:46:46.771378 7f55571a9700 20 OSD::op_tp worker waiting -5916> 2014-05-19 10:46:46.771410 7f55531a1700 20 OSD::op_tp worker waiting -5915> 2014-05-19 10:46:46.771428 7f55539a2700 20 OSD::op_tp worker waiting -5914> 2014-05-19 10:46:46.771448 7f55529a0700 20 OSD::op_tp worker waiting -5913> 2014-05-19 10:46:46.771479 7f55561a7700 20 OSD::op_tp worker waiting -5912> 2014-05-19 10:46:46.771496 7f555219f700 20 OSD::op_tp worker waiting -5911> 2014-05-19 10:46:46.771508 7f55591ad700 20 OSD::op_tp worker waiting -5910> 2014-05-19 10:46:46.771520 7f555199e700 20 OSD::op_tp worker waiting -5909> 2014-05-19 10:46:46.771530 7f55559a6700 20 OSD::op_tp worker waiting -5908> 2014-05-19 10:46:46.771571 7f55599ae700 20 OSD::op_tp worker waiting -5907> 2014-05-19 10:46:46.864613 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:50.809179) v2 ==== 47+0+0 (2467758240 0 0) 0xac1a700 con 0x97434a0 -5906> 2014-05-19 10:46:46.864664 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:50.809179) v2 -- ?+0 0x9fd9500 con 0x97434a0 -5905> 2014-05-19 10:46:46.864702 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:50.809179) v2 ==== 47+0+0 (2467758240 0 0) 0xa0921c0 con 0x9970840 -5904> 2014-05-19 10:46:46.864746 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -5903> 2014-05-19 10:46:46.864826 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:50.809179) v2 -- ?+0 0xa664540 con 0x9970840 -5902> 2014-05-19 10:46:46.864912 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -5901> 2014-05-19 10:46:46.919259 7f5566602700 5 osd.0 245 tick -5900> 2014-05-19 10:46:46.919287 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -5899> 2014-05-19 10:46:46.919294 7f5566602700 10 osd.0 245 do_waiters -- start -5898> 2014-05-19 10:46:46.919298 7f5566602700 10 osd.0 245 do_waiters -- finish -5897> 2014-05-19 10:46:46.919324 7f555119d700 20 OSD::recovery_tp worker waiting -5896> 2014-05-19 10:46:46.961383 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:49.568024) v2 ==== 47+0+0 (712378675 0 0) 0x9388700 con 0x9656000 -5895> 2014-05-19 10:46:46.961379 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:49.568024) v2 ==== 47+0+0 (712378675 0 0) 0xac33880 con 0x9937760 -5894> 2014-05-19 10:46:46.961433 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:49.568024) v2 -- ?+0 0xa0921c0 con 0x9656000 -5893> 2014-05-19 10:46:46.961526 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -5892> 2014-05-19 10:46:46.961777 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:49.568024) v2 -- ?+0 0xac1a700 con 0x9937760 -5891> 2014-05-19 10:46:46.961987 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -5890> 2014-05-19 10:46:47.008037 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:49.614583) v2 ==== 47+0+0 (1533767826 0 0) 0xac23500 con 0x7b90160 -5889> 2014-05-19 10:46:47.008048 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:49.614583) v2 ==== 47+0+0 (1533767826 0 0) 0xac22700 con 0x9b8db80 -5888> 2014-05-19 10:46:47.008077 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:49.614583) v2 -- ?+0 0xac33880 con 0x7b90160 -5887> 2014-05-19 10:46:47.008148 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -5886> 2014-05-19 10:46:47.008257 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:49.614583) v2 -- ?+0 0x9388700 con 0x9b8db80 -5885> 2014-05-19 10:46:47.008341 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -5884> 2014-05-19 10:46:47.110510 7f5564dff700 20 KeyValueStore::op_tp worker waiting -5883> 2014-05-19 10:46:47.144710 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:49.751248) v2 ==== 47+0+0 (422634270 0 0) 0xa0ea700 con 0x95846e0 -5882> 2014-05-19 10:46:47.144785 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:49.751248) v2 -- ?+0 0xac22700 con 0x95846e0 -5881> 2014-05-19 10:46:47.144826 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -5880> 2014-05-19 10:46:47.144869 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:49.751248) v2 ==== 47+0+0 (422634270 0 0) 0x9bcea80 con 0x9983600 -5879> 2014-05-19 10:46:47.144907 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:49.751248) v2 -- ?+0 0xac23500 con 0x9983600 -5878> 2014-05-19 10:46:47.145005 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -5877> 2014-05-19 10:46:47.158507 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:49.765145) v2 ==== 47+0+0 (3669527088 0 0) 0xa2e01c0 con 0x9656160 -5876> 2014-05-19 10:46:47.158542 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:49.765145) v2 ==== 47+0+0 (3669527088 0 0) 0x9c08fc0 con 0x9656f20 -5875> 2014-05-19 10:46:47.158559 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:49.765145) v2 -- ?+0 0xa0ea700 con 0x9656160 -5874> 2014-05-19 10:46:47.158807 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -5873> 2014-05-19 10:46:47.158874 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:49.765145) v2 -- ?+0 0x9bcea80 con 0x9656f20 -5872> 2014-05-19 10:46:47.158908 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -5871> 2014-05-19 10:46:47.433184 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:50.039719) v2 ==== 47+0+0 (1018074537 0 0) 0xac29500 con 0x9b8c160 -5870> 2014-05-19 10:46:47.433233 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:50.039719) v2 -- ?+0 0xa2e01c0 con 0x9b8c160 -5869> 2014-05-19 10:46:47.433346 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -5868> 2014-05-19 10:46:47.433565 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:50.039719) v2 ==== 47+0+0 (1018074537 0 0) 0xac2b6c0 con 0x9aa3600 -5867> 2014-05-19 10:46:47.433611 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:50.039719) v2 -- ?+0 0x9c08fc0 con 0x9aa3600 -5866> 2014-05-19 10:46:47.433696 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -5865> 2014-05-19 10:46:47.449450 7f555019b700 20 OSD::command_tp worker waiting -5864> 2014-05-19 10:46:47.452701 7f555099c700 20 OSD::disk_tp worker waiting -5863> 2014-05-19 10:46:47.506831 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:50.113316) v2 ==== 47+0+0 (3913831355 0 0) 0xac30c40 con 0x996fb80 -5862> 2014-05-19 10:46:47.506878 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:50.113316) v2 -- ?+0 0xac29500 con 0x996fb80 -5861> 2014-05-19 10:46:47.506910 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -5860> 2014-05-19 10:46:47.507130 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:50.113316) v2 ==== 47+0+0 (3913831355 0 0) 0x9ed0c40 con 0x9a0cdc0 -5859> 2014-05-19 10:46:47.507174 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:50.113316) v2 -- ?+0 0xac2b6c0 con 0x9a0cdc0 -5858> 2014-05-19 10:46:47.507205 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -5857> 2014-05-19 10:46:47.561982 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:51.506617) v2 ==== 47+0+0 (3709881915 0 0) 0x9fa8c40 con 0x99718c0 -5856> 2014-05-19 10:46:47.562008 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:51.506617) v2 ==== 47+0+0 (3709881915 0 0) 0xac168c0 con 0x97431e0 -5855> 2014-05-19 10:46:47.562033 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:51.506617) v2 -- ?+0 0xac30c40 con 0x99718c0 -5854> 2014-05-19 10:46:47.562111 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -5853> 2014-05-19 10:46:47.562499 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:51.506617) v2 -- ?+0 0x9ed0c40 con 0x97431e0 -5852> 2014-05-19 10:46:47.562608 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -5851> 2014-05-19 10:46:47.890996 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:47.890848) v2 ==== 47+0+0 (2659777598 0 0) 0x9e11500 con 0x9656580 -5850> 2014-05-19 10:46:47.891046 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:47.890848) v2 -- ?+0 0x9fa8c40 con 0x9656580 -5849> 2014-05-19 10:46:47.891080 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -5848> 2014-05-19 10:46:47.891085 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:47.890848) v2 ==== 47+0+0 (2659777598 0 0) 0xac35340 con 0x9657340 -5847> 2014-05-19 10:46:47.891124 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:47.890848) v2 -- ?+0 0xac168c0 con 0x9657340 -5846> 2014-05-19 10:46:47.891156 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -5845> 2014-05-19 10:46:47.919373 7f5566602700 5 osd.0 245 tick -5844> 2014-05-19 10:46:47.919394 7f5566602700 7 osd.0 245 do_mon_report -5843> 2014-05-19 10:46:47.919398 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 -5842> 2014-05-19 10:46:47.919402 7f5566602700 20 osd.0 245 send_pg_stats -5841> 2014-05-19 10:46:47.919411 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -5840> 2014-05-19 10:46:47.919415 7f5566602700 10 osd.0 245 do_waiters -- start -5839> 2014-05-19 10:46:47.919417 7f5566602700 10 osd.0 245 do_waiters -- finish -5838> 2014-05-19 10:46:47.919418 7f555119d700 20 OSD::recovery_tp worker waiting -5837> 2014-05-19 10:46:47.934661 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:50.541319) v2 ==== 47+0+0 (36834596 0 0) 0xac2b500 con 0x9aa3600 -5836> 2014-05-19 10:46:47.934704 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:50.541319) v2 -- ?+0 0xac35340 con 0x9aa3600 -5835> 2014-05-19 10:46:47.934748 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -5834> 2014-05-19 10:46:47.934697 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:50.541319) v2 ==== 47+0+0 (36834596 0 0) 0xac29340 con 0x9b8c160 -5833> 2014-05-19 10:46:47.935258 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:50.541319) v2 -- ?+0 0x9e11500 con 0x9b8c160 -5832> 2014-05-19 10:46:47.935342 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -5831> 2014-05-19 10:46:48.174486 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:52.119127) v2 ==== 47+0+0 (3590081801 0 0) 0xac08e00 con 0x95142c0 -5830> 2014-05-19 10:46:48.174555 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.119127) v2 -- ?+0 0xac2b500 con 0x95142c0 -5829> 2014-05-19 10:46:48.174427 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:52.119127) v2 ==== 47+0+0 (3590081801 0 0) 0xa464380 con 0x99d31e0 -5828> 2014-05-19 10:46:48.174657 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -5827> 2014-05-19 10:46:48.175058 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.119127) v2 -- ?+0 0xac29340 con 0x99d31e0 -5826> 2014-05-19 10:46:48.175107 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -5825> 2014-05-19 10:46:48.292433 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:52.237143) v2 ==== 47+0+0 (3980678972 0 0) 0xac28540 con 0x95151e0 -5824> 2014-05-19 10:46:48.292465 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:52.237143) v2 ==== 47+0+0 (3980678972 0 0) 0xac2a540 con 0x9bb7b80 -5823> 2014-05-19 10:46:48.292489 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.237143) v2 -- ?+0 0xac08e00 con 0x95151e0 -5822> 2014-05-19 10:46:48.292527 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -5821> 2014-05-19 10:46:48.292574 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.237143) v2 -- ?+0 0xa464380 con 0x9bb7b80 -5820> 2014-05-19 10:46:48.292641 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -5819> 2014-05-19 10:46:48.305783 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:50.912338) v2 ==== 47+0+0 (2915904734 0 0) 0xa447c00 con 0x96562c0 -5818> 2014-05-19 10:46:48.305805 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:50.912338) v2 ==== 47+0+0 (2915904734 0 0) 0xa2bd180 con 0x9657080 -5817> 2014-05-19 10:46:48.305834 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:50.912338) v2 -- ?+0 0xac2a540 con 0x96562c0 -5816> 2014-05-19 10:46:48.305923 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -5815> 2014-05-19 10:46:48.306005 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:50.912338) v2 -- ?+0 0xac28540 con 0x9657080 -5814> 2014-05-19 10:46:48.306090 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -5813> 2014-05-19 10:46:48.453736 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -5812> 2014-05-19 10:46:48.453757 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -5811> 2014-05-19 10:46:48.453766 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa2e1c00 con 0x9bdc840 -5810> 2014-05-19 10:46:48.453791 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0x9ad2380 con 0x9ad4420 -5809> 2014-05-19 10:46:48.453832 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa517340 con 0x9bf31e0 -5808> 2014-05-19 10:46:48.453858 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0x9fdc380 con 0x998b340 -5807> 2014-05-19 10:46:48.453873 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0x9ad68c0 con 0x9b92840 -5806> 2014-05-19 10:46:48.453887 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa0dcc40 con 0x9ad49a0 -5805> 2014-05-19 10:46:48.453964 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa872700 con 0x7b911e0 -5804> 2014-05-19 10:46:48.454001 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa517c00 con 0x7b918c0 -5803> 2014-05-19 10:46:48.454030 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0x9c6f340 con 0x9aa8c60 -5802> 2014-05-19 10:46:48.454059 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0x97d28c0 con 0x9bfa000 -5801> 2014-05-19 10:46:48.454089 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0x9caa380 con 0x7c23e40 -5800> 2014-05-19 10:46:48.454119 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa05e540 con 0x998b760 -5799> 2014-05-19 10:46:48.454141 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0x9b51880 con 0x7b91080 -5798> 2014-05-19 10:46:48.454158 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa6d4a80 con 0xa28fb80 -5797> 2014-05-19 10:46:48.454175 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0x9e77c00 con 0x76bdce0 -5796> 2014-05-19 10:46:48.454190 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0x9209500 con 0x994ab00 -5795> 2014-05-19 10:46:48.454130 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0x9562700 con 0x9bdc840 -5794> 2014-05-19 10:46:48.454226 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xac148c0 con 0x9ac8b00 -5793> 2014-05-19 10:46:48.454254 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa107dc0 con 0x938de40 -5792> 2014-05-19 10:46:48.454269 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0x9ad3c00 con 0x9970b00 -5791> 2014-05-19 10:46:48.454284 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa28d180 con 0x99706e0 -5790> 2014-05-19 10:46:48.454300 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0x9ad2000 con 0x9bb6f20 -5789> 2014-05-19 10:46:48.454314 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa093880 con 0x994b340 -5788> 2014-05-19 10:46:48.454330 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa05e000 con 0x98fa2c0 -5787> 2014-05-19 10:46:48.454346 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa873340 con 0x996f8c0 -5786> 2014-05-19 10:46:48.454363 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0x9ed0000 con 0x996fa20 -5785> 2014-05-19 10:46:48.454376 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0x9c6e700 con 0x9ac8160 -5784> 2014-05-19 10:46:48.454419 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa4ff340 con 0x7b90420 -5783> 2014-05-19 10:46:48.454451 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa385340 con 0x919fe40 -5782> 2014-05-19 10:46:48.454480 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa05e8c0 con 0x9971760 -5781> 2014-05-19 10:46:48.454511 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0x9cb5340 con 0x994af20 -5780> 2014-05-19 10:46:48.454538 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa6d5a40 con 0x989be40 -5779> 2014-05-19 10:46:48.454565 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0x9b50000 con 0x9adf4a0 -5778> 2014-05-19 10:46:48.454595 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa1076c0 con 0x9776160 -5777> 2014-05-19 10:46:48.454620 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xac09a40 con 0x96bd8c0 -5776> 2014-05-19 10:46:48.454638 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa7d4700 con 0x96bcdc0 -5775> 2014-05-19 10:46:48.454657 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa506700 con 0x96954a0 -5774> 2014-05-19 10:46:48.454673 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0x9fecfc0 con 0x76bd8c0 -5773> 2014-05-19 10:46:48.454701 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa665180 con 0x7b90dc0 -5772> 2014-05-19 10:46:48.454729 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xac08c40 con 0x978d8c0 -5771> 2014-05-19 10:46:48.454746 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa6d4000 con 0x978c580 -5770> 2014-05-19 10:46:48.454760 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0x94488c0 con 0x978d340 -5769> 2014-05-19 10:46:48.454774 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:48.453764) v2 -- ?+0 0xa618a80 con 0x96374a0 -5768> 2014-05-19 10:46:48.454808 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -5767> 2014-05-19 10:46:48.454830 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0x9e9e8c0 con 0x9ad4420 -5766> 2014-05-19 10:46:48.454867 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -5765> 2014-05-19 10:46:48.454875 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xac316c0 con 0x9bf31e0 -5764> 2014-05-19 10:46:48.454890 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -5763> 2014-05-19 10:46:48.454895 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0x9fb5880 con 0x998b340 -5762> 2014-05-19 10:46:48.454909 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -5761> 2014-05-19 10:46:48.454920 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0x9fa5180 con 0x9b92840 -5760> 2014-05-19 10:46:48.454968 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -5759> 2014-05-19 10:46:48.454980 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xa05e1c0 con 0x9ad49a0 -5758> 2014-05-19 10:46:48.455003 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -5757> 2014-05-19 10:46:48.455019 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xa3dba40 con 0x7b911e0 -5756> 2014-05-19 10:46:48.455060 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -5755> 2014-05-19 10:46:48.455068 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xa102540 con 0x7b918c0 -5754> 2014-05-19 10:46:48.455083 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -5753> 2014-05-19 10:46:48.455088 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xa2de700 con 0x9aa8c60 -5752> 2014-05-19 10:46:48.455103 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -5751> 2014-05-19 10:46:48.455108 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0x9cb41c0 con 0x9bfa000 -5750> 2014-05-19 10:46:48.455122 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -5749> 2014-05-19 10:46:48.455127 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0x95c0540 con 0x7c23e40 -5748> 2014-05-19 10:46:48.455144 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -5747> 2014-05-19 10:46:48.455155 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0x9cd08c0 con 0x998b760 -5746> 2014-05-19 10:46:48.455183 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -5745> 2014-05-19 10:46:48.455196 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0x9e816c0 con 0x7b91080 -5744> 2014-05-19 10:46:48.455229 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -5743> 2014-05-19 10:46:48.455240 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xa114fc0 con 0xa28fb80 -5742> 2014-05-19 10:46:48.455286 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -5741> 2014-05-19 10:46:48.455303 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0x9ba4a80 con 0x76bdce0 -5740> 2014-05-19 10:46:48.455325 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -5739> 2014-05-19 10:46:48.455337 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0x9fd96c0 con 0x994ab00 -5738> 2014-05-19 10:46:48.455354 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -5737> 2014-05-19 10:46:48.455362 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xa3da380 con 0x9ac8b00 -5736> 2014-05-19 10:46:48.455378 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -5735> 2014-05-19 10:46:48.455388 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xa45f6c0 con 0x938de40 -5734> 2014-05-19 10:46:48.455405 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -5733> 2014-05-19 10:46:48.455412 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xa1156c0 con 0x9970b00 -5732> 2014-05-19 10:46:48.455430 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -5731> 2014-05-19 10:46:48.455437 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0x9236380 con 0x99706e0 -5730> 2014-05-19 10:46:48.455451 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -5729> 2014-05-19 10:46:48.455458 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xa4ef180 con 0x9bb6f20 -5728> 2014-05-19 10:46:48.455473 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -5727> 2014-05-19 10:46:48.455480 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xa05ec40 con 0x994b340 -5726> 2014-05-19 10:46:48.455494 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -5725> 2014-05-19 10:46:48.455510 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xa6abc00 con 0x98fa2c0 -5724> 2014-05-19 10:46:48.455527 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -5723> 2014-05-19 10:46:48.455535 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0x9c6e1c0 con 0x996f8c0 -5722> 2014-05-19 10:46:48.455549 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -5721> 2014-05-19 10:46:48.455556 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xa0b7500 con 0x996fa20 -5720> 2014-05-19 10:46:48.455570 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -5719> 2014-05-19 10:46:48.455577 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0x9f6fc00 con 0x9ac8160 -5718> 2014-05-19 10:46:48.455591 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -5717> 2014-05-19 10:46:48.455599 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xa65bc00 con 0x7b90420 -5716> 2014-05-19 10:46:48.455613 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -5715> 2014-05-19 10:46:48.455620 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0x9e11dc0 con 0x919fe40 -5714> 2014-05-19 10:46:48.455634 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -5713> 2014-05-19 10:46:48.455643 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xa65a000 con 0x9971760 -5712> 2014-05-19 10:46:48.455660 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -5711> 2014-05-19 10:46:48.455667 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xa6aae00 con 0x994af20 -5710> 2014-05-19 10:46:48.455681 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -5709> 2014-05-19 10:46:48.455690 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xac156c0 con 0x989be40 -5708> 2014-05-19 10:46:48.455707 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -5707> 2014-05-19 10:46:48.455714 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0x9ad3180 con 0x9adf4a0 -5706> 2014-05-19 10:46:48.455728 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -5705> 2014-05-19 10:46:48.455735 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xa192e00 con 0x9776160 -5704> 2014-05-19 10:46:48.455750 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -5703> 2014-05-19 10:46:48.455757 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xa208700 con 0x96bd8c0 -5702> 2014-05-19 10:46:48.455771 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -5701> 2014-05-19 10:46:48.455778 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0x9e81dc0 con 0x96bcdc0 -5700> 2014-05-19 10:46:48.455793 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -5699> 2014-05-19 10:46:48.455800 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xa23e8c0 con 0x96954a0 -5698> 2014-05-19 10:46:48.455814 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -5697> 2014-05-19 10:46:48.455821 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0x9cb7180 con 0x76bd8c0 -5696> 2014-05-19 10:46:48.455835 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -5695> 2014-05-19 10:46:48.455842 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0x9c6f880 con 0x7b90dc0 -5694> 2014-05-19 10:46:48.455856 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -5693> 2014-05-19 10:46:48.455864 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0x99fce00 con 0x978d8c0 -5692> 2014-05-19 10:46:48.455882 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -5691> 2014-05-19 10:46:48.455888 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0x9b44700 con 0x978c580 -5690> 2014-05-19 10:46:48.455903 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -5689> 2014-05-19 10:46:48.455907 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xac32700 con 0x978d340 -5688> 2014-05-19 10:46:48.455921 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -5687> 2014-05-19 10:46:48.455929 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 41 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:48.453764) v2 ==== 47+0+0 (681225389 0 0) 0xa856380 con 0x96374a0 -5686> 2014-05-19 10:46:48.455943 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -5685> 2014-05-19 10:46:48.527180 7f5565600700 20 KeyValueStore::op_tp worker waiting -5684> 2014-05-19 10:46:48.768774 7f55551a5700 20 OSD::op_tp worker waiting -5683> 2014-05-19 10:46:48.768805 7f555a1af700 20 OSD::op_tp worker waiting -5682> 2014-05-19 10:46:48.768839 7f55579aa700 20 OSD::op_tp worker waiting -5681> 2014-05-19 10:46:48.770419 7f55589ac700 20 OSD::op_tp worker waiting -5680> 2014-05-19 10:46:48.770488 7f55541a3700 20 OSD::op_tp worker waiting -5679> 2014-05-19 10:46:48.770516 7f555a9b0700 20 OSD::op_tp worker waiting -5678> 2014-05-19 10:46:48.770544 7f55549a4700 20 OSD::op_tp worker waiting -5677> 2014-05-19 10:46:48.770570 7f555b1b1700 20 OSD::op_tp worker waiting -5676> 2014-05-19 10:46:48.770610 7f55569a8700 20 OSD::op_tp worker waiting -5675> 2014-05-19 10:46:48.771426 7f55581ab700 20 OSD::op_tp worker waiting -5674> 2014-05-19 10:46:48.771448 7f55571a9700 20 OSD::op_tp worker waiting -5673> 2014-05-19 10:46:48.771493 7f55531a1700 20 OSD::op_tp worker waiting -5672> 2014-05-19 10:46:48.771519 7f55539a2700 20 OSD::op_tp worker waiting -5671> 2014-05-19 10:46:48.771536 7f55529a0700 20 OSD::op_tp worker waiting -5670> 2014-05-19 10:46:48.771547 7f55561a7700 20 OSD::op_tp worker waiting -5669> 2014-05-19 10:46:48.771565 7f555219f700 20 OSD::op_tp worker waiting -5668> 2014-05-19 10:46:48.771574 7f55591ad700 20 OSD::op_tp worker waiting -5667> 2014-05-19 10:46:48.771583 7f555199e700 20 OSD::op_tp worker waiting -5666> 2014-05-19 10:46:48.771602 7f55559a6700 20 OSD::op_tp worker waiting -5665> 2014-05-19 10:46:48.771633 7f55599ae700 20 OSD::op_tp worker waiting -5664> 2014-05-19 10:46:48.919499 7f5566602700 5 osd.0 245 tick -5663> 2014-05-19 10:46:48.919553 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 2.32 >= max 0.5 = no, load too high -5662> 2014-05-19 10:46:48.919567 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -5661> 2014-05-19 10:46:48.919569 7f555119d700 20 OSD::recovery_tp worker waiting -5660> 2014-05-19 10:46:48.919570 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2229.45 < min (86400 seconds) -5659> 2014-05-19 10:46:48.919592 7f5566602700 20 osd.0 245 sched_scrub done -5658> 2014-05-19 10:46:48.919595 7f5566602700 10 osd.0 245 do_waiters -- start -5657> 2014-05-19 10:46:48.919597 7f5566602700 10 osd.0 245 do_waiters -- finish -5656> 2014-05-19 10:46:49.110605 7f5564dff700 20 KeyValueStore::op_tp worker waiting -5655> 2014-05-19 10:46:49.309399 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:51.915983) v2 ==== 47+0+0 (1562913775 0 0) 0xac23340 con 0x7b90160 -5654> 2014-05-19 10:46:49.309445 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:51.915983) v2 -- ?+0 0xa2bd180 con 0x7b90160 -5653> 2014-05-19 10:46:49.309518 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -5652> 2014-05-19 10:46:49.309353 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:51.915983) v2 ==== 47+0+0 (1562913775 0 0) 0xac22540 con 0x9b8db80 -5651> 2014-05-19 10:46:49.309706 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:51.915983) v2 -- ?+0 0xa447c00 con 0x9b8db80 -5650> 2014-05-19 10:46:49.309786 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -5649> 2014-05-19 10:46:49.449540 7f555019b700 20 OSD::command_tp worker waiting -5648> 2014-05-19 10:46:49.452788 7f555099c700 20 OSD::disk_tp worker waiting -5647> 2014-05-19 10:46:49.596297 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:53.540999) v2 ==== 47+0+0 (690311085 0 0) 0x9c0e700 con 0x94e3e40 -5646> 2014-05-19 10:46:49.596367 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:53.540999) v2 ==== 47+0+0 (690311085 0 0) 0xa665c00 con 0x9bb69a0 -5645> 2014-05-19 10:46:49.596756 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:53.540999) v2 -- ?+0 0xac23340 con 0x94e3e40 -5644> 2014-05-19 10:46:49.596841 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -5643> 2014-05-19 10:46:49.596884 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:53.540999) v2 -- ?+0 0xac22540 con 0x9bb69a0 -5642> 2014-05-19 10:46:49.596925 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -5641> 2014-05-19 10:46:49.612621 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:53.557374) v2 ==== 47+0+0 (2918328939 0 0) 0xa4df880 con 0x94e26e0 -5640> 2014-05-19 10:46:49.612664 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:53.557374) v2 -- ?+0 0x9c0e700 con 0x94e26e0 -5639> 2014-05-19 10:46:49.612698 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -5638> 2014-05-19 10:46:49.612724 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:53.557374) v2 ==== 47+0+0 (2918328939 0 0) 0x9c6e540 con 0x987b340 -5637> 2014-05-19 10:46:49.612795 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:53.557374) v2 -- ?+0 0xa665c00 con 0x987b340 -5636> 2014-05-19 10:46:49.612841 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -5635> 2014-05-19 10:46:49.636333 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:52.242898) v2 ==== 47+0+0 (1551296417 0 0) 0xac29180 con 0x9b8c160 -5634> 2014-05-19 10:46:49.636373 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:52.242898) v2 ==== 47+0+0 (1551296417 0 0) 0xac2b340 con 0x9aa3600 -5633> 2014-05-19 10:46:49.636381 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.242898) v2 -- ?+0 0x9c6e540 con 0x9b8c160 -5632> 2014-05-19 10:46:49.636457 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -5631> 2014-05-19 10:46:49.636921 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.242898) v2 -- ?+0 0xa4df880 con 0x9aa3600 -5630> 2014-05-19 10:46:49.636963 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -5629> 2014-05-19 10:46:49.719466 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:53.664207) v2 ==== 47+0+0 (4154173358 0 0) 0x9e6c1c0 con 0x987b760 -5628> 2014-05-19 10:46:49.719517 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:53.664207) v2 -- ?+0 0xac29180 con 0x987b760 -5627> 2014-05-19 10:46:49.719912 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -5626> 2014-05-19 10:46:49.719595 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 39 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:53.664207) v2 ==== 47+0+0 (4154173358 0 0) 0xa857340 con 0x94802c0 -5625> 2014-05-19 10:46:49.719944 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:53.664207) v2 -- ?+0 0xac2b340 con 0x94802c0 -5624> 2014-05-19 10:46:49.720017 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -5623> 2014-05-19 10:46:49.785053 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:53.729769) v2 ==== 47+0+0 (2943084230 0 0) 0xac34540 con 0x987af20 -5622> 2014-05-19 10:46:49.785123 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:53.729769) v2 -- ?+0 0x9e6c1c0 con 0x987af20 -5621> 2014-05-19 10:46:49.785155 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -5620> 2014-05-19 10:46:49.785167 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:53.729769) v2 ==== 47+0+0 (2943084230 0 0) 0xa665c00 con 0x99f1080 -5619> 2014-05-19 10:46:49.785399 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:53.729769) v2 -- ?+0 0xa857340 con 0x99f1080 -5618> 2014-05-19 10:46:49.785476 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -5617> 2014-05-19 10:46:49.810787 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:52.417387) v2 ==== 47+0+0 (3618095229 0 0) 0xac22380 con 0x9b8db80 -5616> 2014-05-19 10:46:49.810858 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:52.417387) v2 ==== 47+0+0 (3618095229 0 0) 0xac23180 con 0x7b90160 -5615> 2014-05-19 10:46:49.810863 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.417387) v2 -- ?+0 0xac34540 con 0x9b8db80 -5614> 2014-05-19 10:46:49.811253 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -5613> 2014-05-19 10:46:49.811281 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.417387) v2 -- ?+0 0xa665c00 con 0x7b90160 -5612> 2014-05-19 10:46:49.811358 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -5611> 2014-05-19 10:46:49.919671 7f5566602700 5 osd.0 245 tick -5610> 2014-05-19 10:46:49.919699 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -5609> 2014-05-19 10:46:49.919706 7f5566602700 10 osd.0 245 do_waiters -- start -5608> 2014-05-19 10:46:49.919710 7f5566602700 10 osd.0 245 do_waiters -- finish -5607> 2014-05-19 10:46:49.919737 7f555119d700 20 OSD::recovery_tp worker waiting -5606> 2014-05-19 10:46:50.007485 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:52.613935) v2 ==== 47+0+0 (1407672379 0 0) 0xa2bc380 con 0x9657080 -5605> 2014-05-19 10:46:50.007545 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.613935) v2 -- ?+0 0xac23180 con 0x9657080 -5604> 2014-05-19 10:46:50.007618 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -5603> 2014-05-19 10:46:50.007789 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:52.613935) v2 ==== 47+0+0 (1407672379 0 0) 0xa865880 con 0x96562c0 -5602> 2014-05-19 10:46:50.007834 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.613935) v2 -- ?+0 0xac22380 con 0x96562c0 -5601> 2014-05-19 10:46:50.007861 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -5600> 2014-05-19 10:46:50.137903 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:52.744476) v2 ==== 47+0+0 (3884384485 0 0) 0xac2b180 con 0x9aa3600 -5599> 2014-05-19 10:46:50.138046 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.744476) v2 -- ?+0 0xa2bc380 con 0x9aa3600 -5598> 2014-05-19 10:46:50.138129 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -5597> 2014-05-19 10:46:50.138271 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:52.744476) v2 ==== 47+0+0 (3884384485 0 0) 0x9fd9340 con 0x9b8c160 -5596> 2014-05-19 10:46:50.138311 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.744476) v2 -- ?+0 0xa865880 con 0x9b8c160 -5595> 2014-05-19 10:46:50.138401 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -5594> 2014-05-19 10:46:50.239363 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:52.845890) v2 ==== 47+0+0 (338463463 0 0) 0xac36c40 con 0x9656420 -5593> 2014-05-19 10:46:50.239403 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.845890) v2 -- ?+0 0x9fd9340 con 0x9656420 -5592> 2014-05-19 10:46:50.239381 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:52.845890) v2 ==== 47+0+0 (338463463 0 0) 0x9e9f6c0 con 0x96571e0 -5591> 2014-05-19 10:46:50.239476 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -5590> 2014-05-19 10:46:50.239524 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.845890) v2 -- ?+0 0xac2b180 con 0x96571e0 -5589> 2014-05-19 10:46:50.239571 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -5588> 2014-05-19 10:46:50.365962 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.310727) v2 ==== 47+0+0 (4247479377 0 0) 0xa093340 con 0x9970840 -5587> 2014-05-19 10:46:50.365973 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.310727) v2 ==== 47+0+0 (4247479377 0 0) 0xac1b500 con 0x97434a0 -5586> 2014-05-19 10:46:50.366027 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.310727) v2 -- ?+0 0xac36c40 con 0x9970840 -5585> 2014-05-19 10:46:50.366076 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -5584> 2014-05-19 10:46:50.366102 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.310727) v2 -- ?+0 0x9e9f6c0 con 0x97434a0 -5583> 2014-05-19 10:46:50.366135 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -5582> 2014-05-19 10:46:50.407650 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.352423) v2 ==== 47+0+0 (2743474478 0 0) 0x9ba48c0 con 0x9743600 -5581> 2014-05-19 10:46:50.407700 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.352423) v2 -- ?+0 0xac1b500 con 0x9743600 -5580> 2014-05-19 10:46:50.407779 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -5579> 2014-05-19 10:46:50.407996 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.352423) v2 ==== 47+0+0 (2743474478 0 0) 0x9ffc000 con 0x966e000 -5578> 2014-05-19 10:46:50.408053 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.352423) v2 -- ?+0 0xa093340 con 0x966e000 -5577> 2014-05-19 10:46:50.408086 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -5576> 2014-05-19 10:46:50.475890 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.420643) v2 ==== 47+0+0 (1833670506 0 0) 0xac08380 con 0x95142c0 -5575> 2014-05-19 10:46:50.475884 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.420643) v2 ==== 47+0+0 (1833670506 0 0) 0x9e6da40 con 0x99d31e0 -5574> 2014-05-19 10:46:50.475942 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.420643) v2 -- ?+0 0x9ba48c0 con 0x95142c0 -5573> 2014-05-19 10:46:50.476368 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -5572> 2014-05-19 10:46:50.476398 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.420643) v2 -- ?+0 0x9ffc000 con 0x99d31e0 -5571> 2014-05-19 10:46:50.476481 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -5570> 2014-05-19 10:46:50.527277 7f5565600700 20 KeyValueStore::op_tp worker waiting -5569> 2014-05-19 10:46:50.552157 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:53.158579) v2 ==== 47+0+0 (1798932743 0 0) 0xa74ae00 con 0x9b8de40 -5568> 2014-05-19 10:46:50.552195 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:53.158579) v2 -- ?+0 0x9e6da40 con 0x9b8de40 -5567> 2014-05-19 10:46:50.552288 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -5566> 2014-05-19 10:46:50.551994 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:53.158579) v2 ==== 47+0+0 (1798932743 0 0) 0xa4fe000 con 0x94e2160 -5565> 2014-05-19 10:46:50.552375 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:53.158579) v2 -- ?+0 0xac08380 con 0x94e2160 -5564> 2014-05-19 10:46:50.552448 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -5563> 2014-05-19 10:46:50.593747 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.538497) v2 ==== 47+0+0 (1447936750 0 0) 0xac2a380 con 0x9bb7b80 -5562> 2014-05-19 10:46:50.593762 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.538497) v2 ==== 47+0+0 (1447936750 0 0) 0xac28380 con 0x95151e0 -5561> 2014-05-19 10:46:50.593796 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.538497) v2 -- ?+0 0xa74ae00 con 0x9bb7b80 -5560> 2014-05-19 10:46:50.593824 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -5559> 2014-05-19 10:46:50.593974 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.538497) v2 -- ?+0 0xa4fe000 con 0x95151e0 -5558> 2014-05-19 10:46:50.594058 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -5557> 2014-05-19 10:46:50.646075 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:53.252660) v2 ==== 47+0+0 (3822828499 0 0) 0xa242380 con 0x9983600 -5556> 2014-05-19 10:46:50.646134 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:53.252660) v2 -- ?+0 0xac28380 con 0x9983600 -5555> 2014-05-19 10:46:50.646083 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:53.252660) v2 ==== 47+0+0 (3822828499 0 0) 0xa172fc0 con 0x95846e0 -5554> 2014-05-19 10:46:50.646209 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -5553> 2014-05-19 10:46:50.646226 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:53.252660) v2 -- ?+0 0xac2a380 con 0x95846e0 -5552> 2014-05-19 10:46:50.646557 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -5551> 2014-05-19 10:46:50.740899 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:53.347243) v2 ==== 47+0+0 (2206763186 0 0) 0xa078c40 con 0x96571e0 -5550> 2014-05-19 10:46:50.740940 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:53.347243) v2 ==== 47+0+0 (2206763186 0 0) 0xac36a80 con 0x9656420 -5549> 2014-05-19 10:46:50.740957 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:53.347243) v2 -- ?+0 0xa242380 con 0x96571e0 -5548> 2014-05-19 10:46:50.741031 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -5547> 2014-05-19 10:46:50.741082 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:53.347243) v2 -- ?+0 0xa172fc0 con 0x9656420 -5546> 2014-05-19 10:46:50.741221 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -5545> 2014-05-19 10:46:50.768864 7f55551a5700 20 OSD::op_tp worker waiting -5544> 2014-05-19 10:46:50.768896 7f555a1af700 20 OSD::op_tp worker waiting -5543> 2014-05-19 10:46:50.768912 7f55579aa700 20 OSD::op_tp worker waiting -5542> 2014-05-19 10:46:50.770492 7f55589ac700 20 OSD::op_tp worker waiting -5541> 2014-05-19 10:46:50.770558 7f55541a3700 20 OSD::op_tp worker waiting -5540> 2014-05-19 10:46:50.770595 7f555a9b0700 20 OSD::op_tp worker waiting -5539> 2014-05-19 10:46:50.770621 7f55549a4700 20 OSD::op_tp worker waiting -5538> 2014-05-19 10:46:50.770640 7f555b1b1700 20 OSD::op_tp worker waiting -5537> 2014-05-19 10:46:50.770680 7f55569a8700 20 OSD::op_tp worker waiting -5536> 2014-05-19 10:46:50.771496 7f55581ab700 20 OSD::op_tp worker waiting -5535> 2014-05-19 10:46:50.771516 7f55571a9700 20 OSD::op_tp worker waiting -5534> 2014-05-19 10:46:50.771577 7f55531a1700 20 OSD::op_tp worker waiting -5533> 2014-05-19 10:46:50.771591 7f55539a2700 20 OSD::op_tp worker waiting -5532> 2014-05-19 10:46:50.771602 7f55529a0700 20 OSD::op_tp worker waiting -5531> 2014-05-19 10:46:50.771620 7f55561a7700 20 OSD::op_tp worker waiting -5530> 2014-05-19 10:46:50.771634 7f555219f700 20 OSD::op_tp worker waiting -5529> 2014-05-19 10:46:50.771657 7f555199e700 20 OSD::op_tp worker waiting -5528> 2014-05-19 10:46:50.771665 7f55591ad700 20 OSD::op_tp worker waiting -5527> 2014-05-19 10:46:50.771678 7f55559a6700 20 OSD::op_tp worker waiting -5526> 2014-05-19 10:46:50.771699 7f55599ae700 20 OSD::op_tp worker waiting -5525> 2014-05-19 10:46:50.919787 7f5566602700 5 osd.0 245 tick -5524> 2014-05-19 10:46:50.919814 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -5523> 2014-05-19 10:46:50.919819 7f5566602700 10 osd.0 245 do_waiters -- start -5522> 2014-05-19 10:46:50.919821 7f5566602700 10 osd.0 245 do_waiters -- finish -5521> 2014-05-19 10:46:50.919857 7f555119d700 20 OSD::recovery_tp worker waiting -5520> 2014-05-19 10:46:51.063127 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:55.007987) v2 ==== 47+0+0 (3425883657 0 0) 0x9ab8700 con 0x99718c0 -5519> 2014-05-19 10:46:51.063182 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:55.007987) v2 -- ?+0 0xac36a80 con 0x99718c0 -5518> 2014-05-19 10:46:51.063223 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -5517> 2014-05-19 10:46:51.063277 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:55.007987) v2 ==== 47+0+0 (3425883657 0 0) 0xac17500 con 0x97431e0 -5516> 2014-05-19 10:46:51.063431 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:55.007987) v2 -- ?+0 0xa078c40 con 0x97431e0 -5515> 2014-05-19 10:46:51.063516 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -5514> 2014-05-19 10:46:51.110700 7f5564dff700 20 KeyValueStore::op_tp worker waiting -5513> 2014-05-19 10:46:51.275745 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:55.220526) v2 ==== 47+0+0 (1097509449 0 0) 0x9fd8000 con 0x99d3340 -5512> 2014-05-19 10:46:51.275797 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:55.220526) v2 -- ?+0 0x9ab8700 con 0x99d3340 -5511> 2014-05-19 10:46:51.275934 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -5510> 2014-05-19 10:46:51.275724 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:55.220526) v2 ==== 47+0+0 (1097509449 0 0) 0xa2bc000 con 0x94a5a20 -5509> 2014-05-19 10:46:51.276309 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:55.220526) v2 -- ?+0 0xac17500 con 0x94a5a20 -5508> 2014-05-19 10:46:51.276391 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -5507> 2014-05-19 10:46:51.392571 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:51.392358) v2 ==== 47+0+0 (125416374 0 0) 0xa0bddc0 con 0x9656580 -5506> 2014-05-19 10:46:51.392619 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:51.392358) v2 -- ?+0 0x9fd8000 con 0x9656580 -5505> 2014-05-19 10:46:51.392615 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:51.392358) v2 ==== 47+0+0 (125416374 0 0) 0xac35180 con 0x9657340 -5504> 2014-05-19 10:46:51.392674 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -5503> 2014-05-19 10:46:51.392740 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:51.392358) v2 -- ?+0 0xa2bc000 con 0x9657340 -5502> 2014-05-19 10:46:51.392826 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -5501> 2014-05-19 10:46:51.449619 7f555019b700 20 OSD::command_tp worker waiting -5500> 2014-05-19 10:46:51.452856 7f555099c700 20 OSD::disk_tp worker waiting -5499> 2014-05-19 10:46:51.467364 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:55.412130) v2 ==== 47+0+0 (2277612177 0 0) 0xac1b6c0 con 0x97434a0 -5498> 2014-05-19 10:46:51.467416 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:55.412130) v2 -- ?+0 0xac35180 con 0x97434a0 -5497> 2014-05-19 10:46:51.467502 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -5496> 2014-05-19 10:46:51.467433 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:55.412130) v2 ==== 47+0+0 (2277612177 0 0) 0xa265a40 con 0x9970840 -5495> 2014-05-19 10:46:51.467807 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:55.412130) v2 -- ?+0 0xa0bddc0 con 0x9970840 -5494> 2014-05-19 10:46:51.467898 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -5493> 2014-05-19 10:46:51.512086 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.118708) v2 ==== 47+0+0 (3344925384 0 0) 0x9ed0540 con 0x7b90160 -5492> 2014-05-19 10:46:51.512136 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.118708) v2 -- ?+0 0xac1b6c0 con 0x7b90160 -5491> 2014-05-19 10:46:51.512171 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -5490> 2014-05-19 10:46:51.512139 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.118708) v2 ==== 47+0+0 (3344925384 0 0) 0xac221c0 con 0x9b8db80 -5489> 2014-05-19 10:46:51.512186 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.118708) v2 -- ?+0 0xa265a40 con 0x9b8db80 -5488> 2014-05-19 10:46:51.512222 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -5487> 2014-05-19 10:46:51.544956 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.151622) v2 ==== 47+0+0 (830656623 0 0) 0xa208540 con 0x996e000 -5486> 2014-05-19 10:46:51.545176 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.151622) v2 -- ?+0 0xac221c0 con 0x996e000 -5485> 2014-05-19 10:46:51.545166 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.151622) v2 ==== 47+0+0 (830656623 0 0) 0xa5fc1c0 con 0x9a0c9a0 -5484> 2014-05-19 10:46:51.545321 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -5483> 2014-05-19 10:46:51.545455 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.151622) v2 -- ?+0 0x9ed0540 con 0x9a0c9a0 -5482> 2014-05-19 10:46:51.545535 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -5481> 2014-05-19 10:46:51.662884 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.269519) v2 ==== 47+0+0 (3720893958 0 0) 0xac336c0 con 0x9937760 -5480> 2014-05-19 10:46:51.662933 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.269519) v2 -- ?+0 0xa5fc1c0 con 0x9937760 -5479> 2014-05-19 10:46:51.662975 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -5478> 2014-05-19 10:46:51.662884 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.269519) v2 ==== 47+0+0 (3720893958 0 0) 0xa093180 con 0x9656000 -5477> 2014-05-19 10:46:51.663305 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.269519) v2 -- ?+0 0xa208540 con 0x9656000 -5476> 2014-05-19 10:46:51.663340 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -5475> 2014-05-19 10:46:51.842057 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.448689) v2 ==== 47+0+0 (237324691 0 0) 0x9d52000 con 0x96571e0 -5474> 2014-05-19 10:46:51.842173 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.448689) v2 ==== 47+0+0 (237324691 0 0) 0xac368c0 con 0x9656420 -5473> 2014-05-19 10:46:51.842224 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.448689) v2 -- ?+0 0xac336c0 con 0x96571e0 -5472> 2014-05-19 10:46:51.842582 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -5471> 2014-05-19 10:46:51.842684 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.448689) v2 -- ?+0 0xa093180 con 0x9656420 -5470> 2014-05-19 10:46:51.842728 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -5469> 2014-05-19 10:46:51.860379 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.466626) v2 ==== 47+0+0 (1960474935 0 0) 0x9c09500 con 0x9656f20 -5468> 2014-05-19 10:46:51.860421 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.466626) v2 -- ?+0 0x9d52000 con 0x9656f20 -5467> 2014-05-19 10:46:51.860501 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.466626) v2 ==== 47+0+0 (1960474935 0 0) 0x9d0afc0 con 0x9656160 -5466> 2014-05-19 10:46:51.860596 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -5465> 2014-05-19 10:46:51.860627 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.466626) v2 -- ?+0 0xac368c0 con 0x9656160 -5464> 2014-05-19 10:46:51.860660 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -5463> 2014-05-19 10:46:51.919894 7f5566602700 5 osd.0 245 tick -5462> 2014-05-19 10:46:51.919920 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -5461> 2014-05-19 10:46:51.919925 7f5566602700 10 osd.0 245 do_waiters -- start -5460> 2014-05-19 10:46:51.919927 7f5566602700 10 osd.0 245 do_waiters -- finish -5459> 2014-05-19 10:46:51.919964 7f555119d700 20 OSD::recovery_tp worker waiting -5458> 2014-05-19 10:46:52.013437 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.620055) v2 ==== 47+0+0 (1315149055 0 0) 0xa0bcfc0 con 0x7b90160 -5457> 2014-05-19 10:46:52.013484 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.620055) v2 -- ?+0 0x9c09500 con 0x7b90160 -5456> 2014-05-19 10:46:52.013515 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -5455> 2014-05-19 10:46:52.013437 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.620055) v2 ==== 47+0+0 (1315149055 0 0) 0xac22000 con 0x9b8db80 -5454> 2014-05-19 10:46:52.013552 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.620055) v2 -- ?+0 0x9d0afc0 con 0x9b8db80 -5453> 2014-05-19 10:46:52.013656 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -5452> 2014-05-19 10:46:52.343329 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.950012) v2 ==== 47+0+0 (1980059558 0 0) 0xac36700 con 0x9656420 -5451> 2014-05-19 10:46:52.343452 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.950012) v2 -- ?+0 0xac22000 con 0x9656420 -5450> 2014-05-19 10:46:52.343339 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.950012) v2 ==== 47+0+0 (1980059558 0 0) 0x9d3d880 con 0x96571e0 -5449> 2014-05-19 10:46:52.343490 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -5448> 2014-05-19 10:46:52.343756 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.950012) v2 -- ?+0 0xa0bcfc0 con 0x96571e0 -5447> 2014-05-19 10:46:52.343848 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -5446> 2014-05-19 10:46:52.347558 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.954231) v2 ==== 47+0+0 (899087616 0 0) 0xa172a80 con 0x95846e0 -5445> 2014-05-19 10:46:52.347574 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:54.954231) v2 ==== 47+0+0 (899087616 0 0) 0xa856700 con 0x9983600 -5444> 2014-05-19 10:46:52.347617 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.954231) v2 -- ?+0 0xac36700 con 0x95846e0 -5443> 2014-05-19 10:46:52.347680 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -5442> 2014-05-19 10:46:52.347707 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.954231) v2 -- ?+0 0x9d3d880 con 0x9983600 -5441> 2014-05-19 10:46:52.347782 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -5440> 2014-05-19 10:46:52.527360 7f5565600700 20 KeyValueStore::op_tp worker waiting -5439> 2014-05-19 10:46:52.554921 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -5438> 2014-05-19 10:46:52.554945 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -5437> 2014-05-19 10:46:52.554953 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0x9d23500 con 0x9bdc840 -5436> 2014-05-19 10:46:52.554978 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0x9448380 con 0x9ad4420 -5435> 2014-05-19 10:46:52.555020 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0x9cd0a80 con 0x9bf31e0 -5434> 2014-05-19 10:46:52.555036 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xa0ba540 con 0x998b340 -5433> 2014-05-19 10:46:52.555050 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0x9fa9dc0 con 0x9b92840 -5432> 2014-05-19 10:46:52.555084 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xac31880 con 0x9ad49a0 -5431> 2014-05-19 10:46:52.555110 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xa65ac40 con 0x7b911e0 -5430> 2014-05-19 10:46:52.555134 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xa857500 con 0x7b918c0 -5429> 2014-05-19 10:46:52.555160 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xa05ec40 con 0x9aa8c60 -5428> 2014-05-19 10:46:52.555189 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xa4ef180 con 0x9bfa000 -5427> 2014-05-19 10:46:52.555216 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0x9236380 con 0x7c23e40 -5426> 2014-05-19 10:46:52.555245 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xa1156c0 con 0x998b760 -5425> 2014-05-19 10:46:52.555277 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xa45f6c0 con 0x7b91080 -5424> 2014-05-19 10:46:52.555301 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xa3da380 con 0xa28fb80 -5423> 2014-05-19 10:46:52.555327 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0x9fd96c0 con 0x76bdce0 -5422> 2014-05-19 10:46:52.555395 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0x9464000 con 0x9bdc840 -5421> 2014-05-19 10:46:52.555353 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0x9ba4a80 con 0x994ab00 -5420> 2014-05-19 10:46:52.555437 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xa114fc0 con 0x9ac8b00 -5419> 2014-05-19 10:46:52.555463 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0x9e816c0 con 0x938de40 -5418> 2014-05-19 10:46:52.555491 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0x9cd08c0 con 0x9970b00 -5417> 2014-05-19 10:46:52.555513 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0x95c0540 con 0x99706e0 -5416> 2014-05-19 10:46:52.555537 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0x9cb41c0 con 0x9bb6f20 -5415> 2014-05-19 10:46:52.555558 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xa2de700 con 0x994b340 -5414> 2014-05-19 10:46:52.555581 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xa102540 con 0x98fa2c0 -5413> 2014-05-19 10:46:52.555604 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xa3dba40 con 0x996f8c0 -5412> 2014-05-19 10:46:52.555628 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xa05e1c0 con 0x996fa20 -5411> 2014-05-19 10:46:52.555650 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0x9fa5180 con 0x9ac8160 -5410> 2014-05-19 10:46:52.555679 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0x9fb5880 con 0x7b90420 -5409> 2014-05-19 10:46:52.555708 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xac316c0 con 0x919fe40 -5408> 2014-05-19 10:46:52.555733 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0x9e9e8c0 con 0x9971760 -5407> 2014-05-19 10:46:52.555755 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0x9562700 con 0x994af20 -5406> 2014-05-19 10:46:52.555780 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xa1e4a80 con 0x989be40 -5405> 2014-05-19 10:46:52.555810 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xac328c0 con 0x9adf4a0 -5404> 2014-05-19 10:46:52.555833 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0x9b44540 con 0x9776160 -5403> 2014-05-19 10:46:52.555856 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0x9ef4540 con 0x96bd8c0 -5402> 2014-05-19 10:46:52.555879 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xa243340 con 0x96bcdc0 -5401> 2014-05-19 10:46:52.555901 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xa102fc0 con 0x96954a0 -5400> 2014-05-19 10:46:52.555929 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0x97c3880 con 0x76bd8c0 -5399> 2014-05-19 10:46:52.555958 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xac176c0 con 0x7b90dc0 -5398> 2014-05-19 10:46:52.555990 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xa0ba1c0 con 0x978d8c0 -5397> 2014-05-19 10:46:52.556018 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0xa2e1340 con 0x978c580 -5396> 2014-05-19 10:46:52.556041 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0x9455500 con 0x978d340 -5395> 2014-05-19 10:46:52.556064 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:52.554951) v2 -- ?+0 0x9fece00 con 0x96374a0 -5394> 2014-05-19 10:46:52.556135 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -5393> 2014-05-19 10:46:52.556165 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xa103c00 con 0x9ad4420 -5392> 2014-05-19 10:46:52.556191 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -5391> 2014-05-19 10:46:52.556203 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xac31500 con 0x9bf31e0 -5390> 2014-05-19 10:46:52.556219 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -5389> 2014-05-19 10:46:52.556225 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0x97c2540 con 0x998b340 -5388> 2014-05-19 10:46:52.556300 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -5387> 2014-05-19 10:46:52.556325 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xa36d180 con 0x9b92840 -5386> 2014-05-19 10:46:52.556359 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -5385> 2014-05-19 10:46:52.556375 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xa102e00 con 0x9ad49a0 -5384> 2014-05-19 10:46:52.556422 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -5383> 2014-05-19 10:46:52.556442 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xa873500 con 0x7b911e0 -5382> 2014-05-19 10:46:52.556472 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -5381> 2014-05-19 10:46:52.556518 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0x9547a40 con 0x7b918c0 -5380> 2014-05-19 10:46:52.556547 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -5379> 2014-05-19 10:46:52.556557 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0x9e77c00 con 0x9aa8c60 -5378> 2014-05-19 10:46:52.556575 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -5377> 2014-05-19 10:46:52.556583 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xa7d4a80 con 0x9bfa000 -5376> 2014-05-19 10:46:52.556598 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -5375> 2014-05-19 10:46:52.556606 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xa617180 con 0x7c23e40 -5374> 2014-05-19 10:46:52.556620 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -5373> 2014-05-19 10:46:52.556625 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0x9f428c0 con 0x998b760 -5372> 2014-05-19 10:46:52.556639 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -5371> 2014-05-19 10:46:52.556655 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xa7d4c40 con 0x7b91080 -5370> 2014-05-19 10:46:52.556673 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -5369> 2014-05-19 10:46:52.556681 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xa267340 con 0xa28fb80 -5368> 2014-05-19 10:46:52.556698 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -5367> 2014-05-19 10:46:52.556705 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0x96be700 con 0x76bdce0 -5366> 2014-05-19 10:46:52.556720 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -5365> 2014-05-19 10:46:52.556727 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xa6abdc0 con 0x994ab00 -5364> 2014-05-19 10:46:52.556741 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -5363> 2014-05-19 10:46:52.556748 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xa74a1c0 con 0x9ac8b00 -5362> 2014-05-19 10:46:52.556763 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -5361> 2014-05-19 10:46:52.556771 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xa8068c0 con 0x938de40 -5360> 2014-05-19 10:46:52.556785 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -5359> 2014-05-19 10:46:52.556793 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xa114e00 con 0x9970b00 -5358> 2014-05-19 10:46:52.556807 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -5357> 2014-05-19 10:46:52.556812 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xa873dc0 con 0x99706e0 -5356> 2014-05-19 10:46:52.556826 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -5355> 2014-05-19 10:46:52.556836 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0x9c6f180 con 0x9bb6f20 -5354> 2014-05-19 10:46:52.556853 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -5353> 2014-05-19 10:46:52.556860 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xac14fc0 con 0x994b340 -5352> 2014-05-19 10:46:52.556874 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -5351> 2014-05-19 10:46:52.556882 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0x9e101c0 con 0x98fa2c0 -5350> 2014-05-19 10:46:52.556896 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -5349> 2014-05-19 10:46:52.556904 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0x9feca80 con 0x996f8c0 -5348> 2014-05-19 10:46:52.556918 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -5347> 2014-05-19 10:46:52.556926 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xa0b68c0 con 0x996fa20 -5346> 2014-05-19 10:46:52.556940 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -5345> 2014-05-19 10:46:52.556947 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xa05e380 con 0x9ac8160 -5344> 2014-05-19 10:46:52.556961 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -5343> 2014-05-19 10:46:52.556969 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0x9ef41c0 con 0x7b90420 -5342> 2014-05-19 10:46:52.556983 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -5341> 2014-05-19 10:46:52.556991 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xa079880 con 0x919fe40 -5340> 2014-05-19 10:46:52.557006 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -5339> 2014-05-19 10:46:52.557015 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xa4dee00 con 0x9971760 -5338> 2014-05-19 10:46:52.557032 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -5337> 2014-05-19 10:46:52.557039 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0x9faa1c0 con 0x994af20 -5336> 2014-05-19 10:46:52.557055 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -5335> 2014-05-19 10:46:52.557062 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xa447c00 con 0x989be40 -5334> 2014-05-19 10:46:52.557079 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -5333> 2014-05-19 10:46:52.557087 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xac34540 con 0x9adf4a0 -5332> 2014-05-19 10:46:52.557101 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -5331> 2014-05-19 10:46:52.557130 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xa267500 con 0x9776160 -5330> 2014-05-19 10:46:52.557150 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -5329> 2014-05-19 10:46:52.557157 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0x9b44380 con 0x96bd8c0 -5328> 2014-05-19 10:46:52.557171 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -5327> 2014-05-19 10:46:52.557180 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xa506380 con 0x96bcdc0 -5326> 2014-05-19 10:46:52.557198 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -5325> 2014-05-19 10:46:52.557205 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0x9fb5c00 con 0x96954a0 -5324> 2014-05-19 10:46:52.557223 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -5323> 2014-05-19 10:46:52.557231 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0x9cb7880 con 0x76bd8c0 -5322> 2014-05-19 10:46:52.557249 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -5321> 2014-05-19 10:46:52.557256 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0x9c6ee00 con 0x7b90dc0 -5320> 2014-05-19 10:46:52.557270 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -5319> 2014-05-19 10:46:52.557278 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0x99e1500 con 0x978d8c0 -5318> 2014-05-19 10:46:52.557292 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -5317> 2014-05-19 10:46:52.557300 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0x9b44e00 con 0x978c580 -5316> 2014-05-19 10:46:52.557315 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -5315> 2014-05-19 10:46:52.557322 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0xac32540 con 0x978d340 -5314> 2014-05-19 10:46:52.557337 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -5313> 2014-05-19 10:46:52.557342 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 42 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:52.554951) v2 ==== 47+0+0 (2386264053 0 0) 0x9142a80 con 0x96374a0 -5312> 2014-05-19 10:46:52.557356 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -5311> 2014-05-19 10:46:52.620770 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:56.565604) v2 ==== 47+0+0 (1046345824 0 0) 0xa1ee8c0 con 0x987b760 -5310> 2014-05-19 10:46:52.620819 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:56.565604) v2 -- ?+0 0xa172a80 con 0x987b760 -5309> 2014-05-19 10:46:52.620865 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 40 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:56.565604) v2 ==== 47+0+0 (1046345824 0 0) 0xa2e0c40 con 0x94802c0 -5308> 2014-05-19 10:46:52.620902 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -5307> 2014-05-19 10:46:52.621402 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:56.565604) v2 -- ?+0 0xa856700 con 0x94802c0 -5306> 2014-05-19 10:46:52.621436 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -5305> 2014-05-19 10:46:52.768967 7f55551a5700 20 OSD::op_tp worker waiting -5304> 2014-05-19 10:46:52.768992 7f55579aa700 20 OSD::op_tp worker waiting -5303> 2014-05-19 10:46:52.769022 7f555a1af700 20 OSD::op_tp worker waiting -5302> 2014-05-19 10:46:52.770591 7f55589ac700 20 OSD::op_tp worker waiting -5301> 2014-05-19 10:46:52.770642 7f55541a3700 20 OSD::op_tp worker waiting -5300> 2014-05-19 10:46:52.770679 7f555a9b0700 20 OSD::op_tp worker waiting -5299> 2014-05-19 10:46:52.770701 7f55549a4700 20 OSD::op_tp worker waiting -5298> 2014-05-19 10:46:52.770739 7f555b1b1700 20 OSD::op_tp worker waiting -5297> 2014-05-19 10:46:52.770774 7f55569a8700 20 OSD::op_tp worker waiting -5296> 2014-05-19 10:46:52.771565 7f55581ab700 20 OSD::op_tp worker waiting -5295> 2014-05-19 10:46:52.771585 7f55571a9700 20 OSD::op_tp worker waiting -5294> 2014-05-19 10:46:52.771650 7f55531a1700 20 OSD::op_tp worker waiting -5293> 2014-05-19 10:46:52.771666 7f55529a0700 20 OSD::op_tp worker waiting -5292> 2014-05-19 10:46:52.771684 7f55539a2700 20 OSD::op_tp worker waiting -5291> 2014-05-19 10:46:52.771707 7f555219f700 20 OSD::op_tp worker waiting -5290> 2014-05-19 10:46:52.771721 7f555199e700 20 OSD::op_tp worker waiting -5289> 2014-05-19 10:46:52.771733 7f55591ad700 20 OSD::op_tp worker waiting -5288> 2014-05-19 10:46:52.771758 7f55561a7700 20 OSD::op_tp worker waiting -5287> 2014-05-19 10:46:52.771804 7f55599ae700 20 OSD::op_tp worker waiting -5286> 2014-05-19 10:46:52.771862 7f55559a6700 20 OSD::op_tp worker waiting -5285> 2014-05-19 10:46:52.853220 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:55.459854) v2 ==== 47+0+0 (2177311710 0 0) 0xa23efc0 con 0x94e2160 -5284> 2014-05-19 10:46:52.853246 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:55.459854) v2 ==== 47+0+0 (2177311710 0 0) 0xa4a8e00 con 0x9b8de40 -5283> 2014-05-19 10:46:52.853273 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:55.459854) v2 -- ?+0 0xa2e0c40 con 0x94e2160 -5282> 2014-05-19 10:46:52.853663 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -5281> 2014-05-19 10:46:52.853727 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:55.459854) v2 -- ?+0 0xa1ee8c0 con 0x9b8de40 -5280> 2014-05-19 10:46:52.853760 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -5279> 2014-05-19 10:46:52.919999 7f5566602700 5 osd.0 245 tick -5278> 2014-05-19 10:46:52.920019 7f5566602700 7 osd.0 245 do_mon_report -5277> 2014-05-19 10:46:52.920023 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 -5276> 2014-05-19 10:46:52.920026 7f5566602700 20 osd.0 245 send_pg_stats -5275> 2014-05-19 10:46:52.920029 7f5566602700 10 osd.0 245 send_pg_stats - 0 pgs updated -5274> 2014-05-19 10:46:52.920033 7f5566602700 10 monclient: _send_mon_message to mon.a at 172.16.96.201:6789/0 -5273> 2014-05-19 10:46:52.920041 7f5566602700 1 -- 172.16.96.201:6800/37595 --> 172.16.96.201:6789/0 -- pg_stats(0 pgs tid 9 v 0) v1 -- ?+0 0xabda280 con 0x96958c0 -5272> 2014-05-19 10:46:52.920065 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -5271> 2014-05-19 10:46:52.920069 7f5566602700 10 osd.0 245 do_waiters -- start -5270> 2014-05-19 10:46:52.920070 7f5566602700 10 osd.0 245 do_waiters -- finish -5269> 2014-05-19 10:46:52.920103 7f555119d700 20 OSD::recovery_tp worker waiting -5268> 2014-05-19 10:46:53.110797 7f5564dff700 20 KeyValueStore::op_tp worker waiting -5267> 2014-05-19 10:46:53.364351 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:55.970990) v2 ==== 47+0+0 (1584596940 0 0) 0xa102c40 con 0x9656000 -5266> 2014-05-19 10:46:53.364366 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:55.970990) v2 ==== 47+0+0 (1584596940 0 0) 0xac33500 con 0x9937760 -5265> 2014-05-19 10:46:53.364419 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:55.970990) v2 -- ?+0 0xa4a8e00 con 0x9656000 -5264> 2014-05-19 10:46:53.364456 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -5263> 2014-05-19 10:46:53.364481 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:55.970990) v2 -- ?+0 0xa23efc0 con 0x9937760 -5262> 2014-05-19 10:46:53.364512 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -5261> 2014-05-19 10:46:53.407995 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:56.014669) v2 ==== 47+0+0 (93929195 0 0) 0x9ffd340 con 0x9a0cdc0 -5260> 2014-05-19 10:46:53.408033 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:56.014669) v2 ==== 47+0+0 (93929195 0 0) 0xac30a80 con 0x996fb80 -5259> 2014-05-19 10:46:53.408073 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:56.014669) v2 -- ?+0 0xac33500 con 0x9a0cdc0 -5258> 2014-05-19 10:46:53.408156 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -5257> 2014-05-19 10:46:53.408183 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:56.014669) v2 -- ?+0 0xa102c40 con 0x996fb80 -5256> 2014-05-19 10:46:53.408217 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -5255> 2014-05-19 10:46:53.449719 7f555019b700 20 OSD::command_tp worker waiting -5254> 2014-05-19 10:46:53.452954 7f555099c700 20 OSD::disk_tp worker waiting -5253> 2014-05-19 10:46:53.508694 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:56.115369) v2 ==== 47+0+0 (2968367859 0 0) 0xa865180 con 0x96562c0 -5252> 2014-05-19 10:46:53.508682 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:56.115369) v2 ==== 47+0+0 (2968367859 0 0) 0xa2bd6c0 con 0x9657080 -5251> 2014-05-19 10:46:53.508740 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:56.115369) v2 -- ?+0 0xac30a80 con 0x96562c0 -5250> 2014-05-19 10:46:53.508840 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -5249> 2014-05-19 10:46:53.508889 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:56.115369) v2 -- ?+0 0x9ffd340 con 0x9657080 -5248> 2014-05-19 10:46:53.508977 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -5247> 2014-05-19 10:46:53.561416 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:56.168113) v2 ==== 47+0+0 (3007880618 0 0) 0x9fd9880 con 0x9656f20 -5246> 2014-05-19 10:46:53.561434 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:56.168113) v2 ==== 47+0+0 (3007880618 0 0) 0x9b456c0 con 0x9656160 -5245> 2014-05-19 10:46:53.561466 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:56.168113) v2 -- ?+0 0xa2bd6c0 con 0x9656f20 -5244> 2014-05-19 10:46:53.561500 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -5243> 2014-05-19 10:46:53.561539 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:56.168113) v2 -- ?+0 0xa865180 con 0x9656160 -5242> 2014-05-19 10:46:53.561936 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -5241> 2014-05-19 10:46:53.577129 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:57.521945) v2 ==== 47+0+0 (824284599 0 0) 0xa0cbdc0 con 0x94a5a20 -5240> 2014-05-19 10:46:53.577487 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:57.521945) v2 -- ?+0 0x9fd9880 con 0x94a5a20 -5239> 2014-05-19 10:46:53.577069 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:57.521945) v2 ==== 47+0+0 (824284599 0 0) 0xa2bca80 con 0x99d3340 -5238> 2014-05-19 10:46:53.577580 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -5237> 2014-05-19 10:46:53.577653 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:57.521945) v2 -- ?+0 0x9b456c0 con 0x99d3340 -5236> 2014-05-19 10:46:53.577739 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -5235> 2014-05-19 10:46:53.639290 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:56.245930) v2 ==== 47+0+0 (3944333835 0 0) 0x9fd88c0 con 0x9b8c160 -5234> 2014-05-19 10:46:53.639356 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:56.245930) v2 -- ?+0 0xa2bca80 con 0x9b8c160 -5233> 2014-05-19 10:46:53.639392 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -5232> 2014-05-19 10:46:53.639292 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:56.245930) v2 ==== 47+0+0 (3944333835 0 0) 0xac2afc0 con 0x9aa3600 -5231> 2014-05-19 10:46:53.639443 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:56.245930) v2 -- ?+0 0xa0cbdc0 con 0x9aa3600 -5230> 2014-05-19 10:46:53.639824 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -5229> 2014-05-19 10:46:53.783185 7f55619be700 1 -- 172.16.96.201:6800/37595 <== mon.0 172.16.96.201:6789/0 13 ==== pg_stats_ack(0 pgs tid 9) v1 ==== 4+0+0 (0 0 0) 0xa1dee00 con 0x96958c0 -5228> 2014-05-19 10:46:53.783213 7f55619be700 10 osd.0 245 do_waiters -- start -5227> 2014-05-19 10:46:53.783218 7f55619be700 10 osd.0 245 do_waiters -- finish -5226> 2014-05-19 10:46:53.783221 7f55619be700 20 osd.0 245 _dispatch 0xa1dee00 pg_stats_ack(0 pgs tid 9) v1 -5225> 2014-05-19 10:46:53.783225 7f55619be700 10 osd.0 245 handle_pg_stats_ack -5224> 2014-05-19 10:46:53.783229 7f55619be700 10 osd.0 245 do_waiters -- start -5223> 2014-05-19 10:46:53.783232 7f55619be700 10 osd.0 245 do_waiters -- finish -5222> 2014-05-19 10:46:53.920152 7f5566602700 5 osd.0 245 tick -5221> 2014-05-19 10:46:53.920177 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -5220> 2014-05-19 10:46:53.920181 7f5566602700 10 osd.0 245 do_waiters -- start -5219> 2014-05-19 10:46:53.920183 7f5566602700 10 osd.0 245 do_waiters -- finish -5218> 2014-05-19 10:46:53.920221 7f555119d700 20 OSD::recovery_tp worker waiting -5217> 2014-05-19 10:46:54.256214 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -5216> 2014-05-19 10:46:54.256233 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -5215> 2014-05-19 10:46:54.256241 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa6656c0 con 0x9bdc840 -5214> 2014-05-19 10:46:54.256265 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa4df340 con 0x9ad4420 -5213> 2014-05-19 10:46:54.256302 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0x9cabc00 con 0x9bf31e0 -5212> 2014-05-19 10:46:54.256318 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0x97c21c0 con 0x998b340 -5211> 2014-05-19 10:46:54.256332 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0x9faa540 con 0x9b92840 -5210> 2014-05-19 10:46:54.256418 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0x94b7340 con 0x9ad49a0 -5209> 2014-05-19 10:46:54.256450 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa2bc8c0 con 0x7b911e0 -5208> 2014-05-19 10:46:54.256520 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa1df180 con 0x7b918c0 -5207> 2014-05-19 10:46:54.256545 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0x9f18c40 con 0x9aa8c60 -5206> 2014-05-19 10:46:54.256569 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xac32c40 con 0x9bfa000 -5205> 2014-05-19 10:46:54.256587 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0x99e16c0 con 0x7c23e40 -5204> 2014-05-19 10:46:54.256603 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa172000 con 0x998b760 -5203> 2014-05-19 10:46:54.256620 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa243500 con 0x7b91080 -5202> 2014-05-19 10:46:54.256634 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa36c700 con 0xa28fb80 -5201> 2014-05-19 10:46:54.256653 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa4ee8c0 con 0x76bdce0 -5200> 2014-05-19 10:46:54.256614 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa103dc0 con 0x9ad4420 -5199> 2014-05-19 10:46:54.256667 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa1e41c0 con 0x994ab00 -5198> 2014-05-19 10:46:54.256721 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0x9cd0000 con 0x9ac8b00 -5197> 2014-05-19 10:46:54.256742 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa2e0540 con 0x938de40 -5196> 2014-05-19 10:46:54.256759 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa0bc1c0 con 0x9970b00 -5195> 2014-05-19 10:46:54.256774 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa5168c0 con 0x99706e0 -5194> 2014-05-19 10:46:54.256792 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0x9f43a40 con 0x9bb6f20 -5193> 2014-05-19 10:46:54.256807 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa1e5500 con 0x994b340 -5192> 2014-05-19 10:46:54.256823 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa664000 con 0x98fa2c0 -5191> 2014-05-19 10:46:54.256841 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0x9ba4540 con 0x996f8c0 -5190> 2014-05-19 10:46:54.256858 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0x99e0000 con 0x996fa20 -5189> 2014-05-19 10:46:54.256910 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa2e08c0 con 0x9ac8160 -5188> 2014-05-19 10:46:54.256938 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa162a80 con 0x7b90420 -5187> 2014-05-19 10:46:54.256955 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0x9b501c0 con 0x919fe40 -5186> 2014-05-19 10:46:54.256970 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0x9ba5880 con 0x9971760 -5185> 2014-05-19 10:46:54.256994 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0x9b50a80 con 0x994af20 -5184> 2014-05-19 10:46:54.257021 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0x9f428c0 con 0x989be40 -5183> 2014-05-19 10:46:54.257046 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa617180 con 0x9adf4a0 -5182> 2014-05-19 10:46:54.257064 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa7d4a80 con 0x9776160 -5181> 2014-05-19 10:46:54.257079 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0x9e77c00 con 0x96bd8c0 -5180> 2014-05-19 10:46:54.257093 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0x9547a40 con 0x96bcdc0 -5179> 2014-05-19 10:46:54.257147 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa873500 con 0x96954a0 -5178> 2014-05-19 10:46:54.257176 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa102e00 con 0x76bd8c0 -5177> 2014-05-19 10:46:54.257201 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa36d180 con 0x7b90dc0 -5176> 2014-05-19 10:46:54.257230 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0x97c2540 con 0x978d8c0 -5175> 2014-05-19 10:46:54.257263 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xac31500 con 0x978c580 -5174> 2014-05-19 10:46:54.257281 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0xa103c00 con 0x978d340 -5173> 2014-05-19 10:46:54.257353 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:54.256240) v2 -- ?+0 0x9464000 con 0x96374a0 -5172> 2014-05-19 10:46:54.257434 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -5171> 2014-05-19 10:46:54.257457 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0x9d22540 con 0x9bdc840 -5170> 2014-05-19 10:46:54.257479 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -5169> 2014-05-19 10:46:54.257505 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xac31340 con 0x9bf31e0 -5168> 2014-05-19 10:46:54.257523 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -5167> 2014-05-19 10:46:54.257529 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa173880 con 0x998b340 -5166> 2014-05-19 10:46:54.257546 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -5165> 2014-05-19 10:46:54.257555 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0x94256c0 con 0x9b92840 -5164> 2014-05-19 10:46:54.257590 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -5163> 2014-05-19 10:46:54.257605 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa103880 con 0x9ad49a0 -5162> 2014-05-19 10:46:54.257627 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -5161> 2014-05-19 10:46:54.257637 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa872380 con 0x7b911e0 -5160> 2014-05-19 10:46:54.257663 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -5159> 2014-05-19 10:46:54.257670 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0x951c380 con 0x7b918c0 -5158> 2014-05-19 10:46:54.257696 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -5157> 2014-05-19 10:46:54.257706 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa816a80 con 0x9aa8c60 -5156> 2014-05-19 10:46:54.257732 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -5155> 2014-05-19 10:46:54.257775 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0x9ad2e00 con 0x9bfa000 -5154> 2014-05-19 10:46:54.257809 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -5153> 2014-05-19 10:46:54.257823 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa237500 con 0x7c23e40 -5152> 2014-05-19 10:46:54.257840 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -5151> 2014-05-19 10:46:54.257845 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa115a40 con 0x998b760 -5150> 2014-05-19 10:46:54.257859 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -5149> 2014-05-19 10:46:54.257864 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa74aa80 con 0x7b91080 -5148> 2014-05-19 10:46:54.257899 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -5147> 2014-05-19 10:46:54.257908 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa28d180 con 0xa28fb80 -5146> 2014-05-19 10:46:54.257923 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -5145> 2014-05-19 10:46:54.257931 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0x9f6efc0 con 0x76bdce0 -5144> 2014-05-19 10:46:54.257946 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -5143> 2014-05-19 10:46:54.257951 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa6ab340 con 0x994ab00 -5142> 2014-05-19 10:46:54.257967 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -5141> 2014-05-19 10:46:54.257975 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa064e00 con 0x9ac8b00 -5140> 2014-05-19 10:46:54.257989 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -5139> 2014-05-19 10:46:54.257994 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0x951ddc0 con 0x938de40 -5138> 2014-05-19 10:46:54.258008 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -5137> 2014-05-19 10:46:54.258018 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0x9d0aa80 con 0x9970b00 -5136> 2014-05-19 10:46:54.258035 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -5135> 2014-05-19 10:46:54.258042 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa8721c0 con 0x99706e0 -5134> 2014-05-19 10:46:54.258056 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -5133> 2014-05-19 10:46:54.258063 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa2dfc00 con 0x9bb6f20 -5132> 2014-05-19 10:46:54.258078 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -5131> 2014-05-19 10:46:54.258085 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0x9e9fa40 con 0x994b340 -5130> 2014-05-19 10:46:54.258099 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -5129> 2014-05-19 10:46:54.258106 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa618700 con 0x98fa2c0 -5128> 2014-05-19 10:46:54.258121 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -5127> 2014-05-19 10:46:54.258128 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa873c00 con 0x996f8c0 -5126> 2014-05-19 10:46:54.258142 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -5125> 2014-05-19 10:46:54.258151 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa264e00 con 0x996fa20 -5124> 2014-05-19 10:46:54.258167 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -5123> 2014-05-19 10:46:54.258175 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0x9cd0c40 con 0x9ac8160 -5122> 2014-05-19 10:46:54.258189 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -5121> 2014-05-19 10:46:54.258197 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa447880 con 0x7b90420 -5120> 2014-05-19 10:46:54.258212 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -5119> 2014-05-19 10:46:54.258216 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa0bd180 con 0x919fe40 -5118> 2014-05-19 10:46:54.258230 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -5117> 2014-05-19 10:46:54.258237 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa446700 con 0x9971760 -5116> 2014-05-19 10:46:54.258252 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -5115> 2014-05-19 10:46:54.258260 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0x9d76540 con 0x994af20 -5114> 2014-05-19 10:46:54.258277 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -5113> 2014-05-19 10:46:54.258284 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0x9388700 con 0x989be40 -5112> 2014-05-19 10:46:54.258299 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -5111> 2014-05-19 10:46:54.258306 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xac34a80 con 0x9adf4a0 -5110> 2014-05-19 10:46:54.258320 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -5109> 2014-05-19 10:46:54.258327 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0x9ba4c40 con 0x9776160 -5108> 2014-05-19 10:46:54.258342 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -5107> 2014-05-19 10:46:54.258349 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa516540 con 0x96bd8c0 -5106> 2014-05-19 10:46:54.258362 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -5105> 2014-05-19 10:46:54.258374 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa8736c0 con 0x96bcdc0 -5104> 2014-05-19 10:46:54.258392 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -5103> 2014-05-19 10:46:54.258399 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xac29c00 con 0x96954a0 -5102> 2014-05-19 10:46:54.258414 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -5101> 2014-05-19 10:46:54.258421 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0x9cb6e00 con 0x76bd8c0 -5100> 2014-05-19 10:46:54.258435 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -5099> 2014-05-19 10:46:54.258443 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0x9c6e380 con 0x7b90dc0 -5098> 2014-05-19 10:46:54.258457 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -5097> 2014-05-19 10:46:54.258464 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0x99e1c00 con 0x978d8c0 -5096> 2014-05-19 10:46:54.258478 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -5095> 2014-05-19 10:46:54.258485 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0x9b44c40 con 0x978c580 -5094> 2014-05-19 10:46:54.258499 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -5093> 2014-05-19 10:46:54.258507 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xac32380 con 0x978d340 -5092> 2014-05-19 10:46:54.258525 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -5091> 2014-05-19 10:46:54.258532 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 43 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:54.256240) v2 ==== 47+0+0 (3891046451 0 0) 0xa266700 con 0x96374a0 -5090> 2014-05-19 10:46:54.258546 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -5089> 2014-05-19 10:46:54.313682 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:58.258665) v2 ==== 47+0+0 (2037523791 0 0) 0xa1ef340 con 0x987b340 -5088> 2014-05-19 10:46:54.313718 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.258665) v2 -- ?+0 0x9fd88c0 con 0x987b340 -5087> 2014-05-19 10:46:54.313791 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -5086> 2014-05-19 10:46:54.313844 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:58.258665) v2 ==== 47+0+0 (2037523791 0 0) 0xa4de380 con 0x94e26e0 -5085> 2014-05-19 10:46:54.314263 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.258665) v2 -- ?+0 0xac2afc0 con 0x94e26e0 -5084> 2014-05-19 10:46:54.314297 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -5083> 2014-05-19 10:46:54.446389 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:57.053045) v2 ==== 47+0+0 (2068408322 0 0) 0xa2081c0 con 0x996e000 -5082> 2014-05-19 10:46:54.446537 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:57.053045) v2 -- ?+0 0xa1ef340 con 0x996e000 -5081> 2014-05-19 10:46:54.446596 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -5080> 2014-05-19 10:46:54.446921 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:57.053045) v2 ==== 47+0+0 (2068408322 0 0) 0x9ee3500 con 0x9a0c9a0 -5079> 2014-05-19 10:46:54.446966 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:57.053045) v2 -- ?+0 0xa4de380 con 0x9a0c9a0 -5078> 2014-05-19 10:46:54.447041 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -5077> 2014-05-19 10:46:54.527460 7f5565600700 20 KeyValueStore::op_tp worker waiting -5076> 2014-05-19 10:46:54.577123 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:58.521932) v2 ==== 47+0+0 (3427756082 0 0) 0xa0dc700 con 0x99d31e0 -5075> 2014-05-19 10:46:54.577174 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.521932) v2 -- ?+0 0xa2081c0 con 0x99d31e0 -5074> 2014-05-19 10:46:54.577422 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:58.521932) v2 ==== 47+0+0 (3427756082 0 0) 0xac08a80 con 0x95142c0 -5073> 2014-05-19 10:46:54.577533 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -5072> 2014-05-19 10:46:54.577611 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.521932) v2 -- ?+0 0x9ee3500 con 0x95142c0 -5071> 2014-05-19 10:46:54.577692 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -5070> 2014-05-19 10:46:54.695039 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:58.640024) v2 ==== 47+0+0 (3844490482 0 0) 0xac2a1c0 con 0x9bb7b80 -5069> 2014-05-19 10:46:54.695092 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.640024) v2 -- ?+0 0xa0dc700 con 0x9bb7b80 -5068> 2014-05-19 10:46:54.695412 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -5067> 2014-05-19 10:46:54.695109 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:58.640024) v2 ==== 47+0+0 (3844490482 0 0) 0xac281c0 con 0x95151e0 -5066> 2014-05-19 10:46:54.695646 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.640024) v2 -- ?+0 0xac08a80 con 0x95151e0 -5065> 2014-05-19 10:46:54.695685 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -5064> 2014-05-19 10:46:54.769069 7f55551a5700 20 OSD::op_tp worker waiting -5063> 2014-05-19 10:46:54.769095 7f55579aa700 20 OSD::op_tp worker waiting -5062> 2014-05-19 10:46:54.769138 7f555a1af700 20 OSD::op_tp worker waiting -5061> 2014-05-19 10:46:54.770673 7f55589ac700 20 OSD::op_tp worker waiting -5060> 2014-05-19 10:46:54.770717 7f55541a3700 20 OSD::op_tp worker waiting -5059> 2014-05-19 10:46:54.770760 7f555a9b0700 20 OSD::op_tp worker waiting -5058> 2014-05-19 10:46:54.770792 7f55549a4700 20 OSD::op_tp worker waiting -5057> 2014-05-19 10:46:54.770828 7f555b1b1700 20 OSD::op_tp worker waiting -5056> 2014-05-19 10:46:54.770849 7f55569a8700 20 OSD::op_tp worker waiting -5055> 2014-05-19 10:46:54.771643 7f55581ab700 20 OSD::op_tp worker waiting -5054> 2014-05-19 10:46:54.771672 7f55571a9700 20 OSD::op_tp worker waiting -5053> 2014-05-19 10:46:54.771730 7f55531a1700 20 OSD::op_tp worker waiting -5052> 2014-05-19 10:46:54.771751 7f55529a0700 20 OSD::op_tp worker waiting -5051> 2014-05-19 10:46:54.771777 7f555219f700 20 OSD::op_tp worker waiting -5050> 2014-05-19 10:46:54.771798 7f55539a2700 20 OSD::op_tp worker waiting -5049> 2014-05-19 10:46:54.771849 7f55561a7700 20 OSD::op_tp worker waiting -5048> 2014-05-19 10:46:54.771885 7f55599ae700 20 OSD::op_tp worker waiting -5047> 2014-05-19 10:46:54.771903 7f55591ad700 20 OSD::op_tp worker waiting -5046> 2014-05-19 10:46:54.771923 7f555199e700 20 OSD::op_tp worker waiting -5045> 2014-05-19 10:46:54.771944 7f55559a6700 20 OSD::op_tp worker waiting -5044> 2014-05-19 10:46:54.897449 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:58.842397) v2 ==== 47+0+0 (2442293535 0 0) 0x96befc0 con 0x94e3e40 -5043> 2014-05-19 10:46:54.897501 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.842397) v2 -- ?+0 0xac281c0 con 0x94e3e40 -5042> 2014-05-19 10:46:54.897719 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -5041> 2014-05-19 10:46:54.897885 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:58.842397) v2 ==== 47+0+0 (2442293535 0 0) 0xa664e00 con 0x9bb69a0 -5040> 2014-05-19 10:46:54.897945 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.842397) v2 -- ?+0 0xac2a1c0 con 0x9bb69a0 -5039> 2014-05-19 10:46:54.898022 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -5038> 2014-05-19 10:46:54.920273 7f5566602700 5 osd.0 245 tick -5037> 2014-05-19 10:46:54.920325 7f555119d700 20 OSD::recovery_tp worker waiting -5036> 2014-05-19 10:46:54.920326 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 2.13 >= max 0.5 = no, load too high -5035> 2014-05-19 10:46:54.920340 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -5034> 2014-05-19 10:46:54.920343 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2235.46 < min (86400 seconds) -5033> 2014-05-19 10:46:54.920361 7f5566602700 20 osd.0 245 sched_scrub done -5032> 2014-05-19 10:46:54.920364 7f5566602700 10 osd.0 245 do_waiters -- start -5031> 2014-05-19 10:46:54.920366 7f5566602700 10 osd.0 245 do_waiters -- finish -5030> 2014-05-19 10:46:54.922028 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:58.866931) v2 ==== 47+0+0 (1209233591 0 0) 0xa4d0380 con 0x987b760 -5029> 2014-05-19 10:46:54.922243 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.866931) v2 -- ?+0 0xa664e00 con 0x987b760 -5028> 2014-05-19 10:46:54.922320 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -5027> 2014-05-19 10:46:54.922084 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 41 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:58.866931) v2 ==== 47+0+0 (1209233591 0 0) 0xa2e0fc0 con 0x94802c0 -5026> 2014-05-19 10:46:54.922356 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.866931) v2 -- ?+0 0x96befc0 con 0x94802c0 -5025> 2014-05-19 10:46:54.922473 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -5024> 2014-05-19 10:46:55.110894 7f5564dff700 20 KeyValueStore::op_tp worker waiting -5023> 2014-05-19 10:46:55.249090 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:57.855753) v2 ==== 47+0+0 (3317854146 0 0) 0xa856c40 con 0x9983600 -5022> 2014-05-19 10:46:55.249154 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:57.855753) v2 -- ?+0 0xa2e0fc0 con 0x9983600 -5021> 2014-05-19 10:46:55.249184 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -5020> 2014-05-19 10:46:55.249689 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:57.855753) v2 ==== 47+0+0 (3317854146 0 0) 0xa36da40 con 0x95846e0 -5019> 2014-05-19 10:46:55.249724 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:57.855753) v2 -- ?+0 0xa4d0380 con 0x95846e0 -5018> 2014-05-19 10:46:55.249796 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -5017> 2014-05-19 10:46:55.340769 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:57.947428) v2 ==== 47+0+0 (2901992077 0 0) 0x9b45180 con 0x9aa3600 -5016> 2014-05-19 10:46:55.340823 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:57.947428) v2 -- ?+0 0xa856c40 con 0x9aa3600 -5015> 2014-05-19 10:46:55.340835 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:57.947428) v2 ==== 47+0+0 (2901992077 0 0) 0x9cb48c0 con 0x9b8c160 -5014> 2014-05-19 10:46:55.341340 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -5013> 2014-05-19 10:46:55.341382 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:57.947428) v2 -- ?+0 0xa36da40 con 0x9b8c160 -5012> 2014-05-19 10:46:55.341461 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -5011> 2014-05-19 10:46:55.449815 7f555019b700 20 OSD::command_tp worker waiting -5010> 2014-05-19 10:46:55.453049 7f555099c700 20 OSD::disk_tp worker waiting -5009> 2014-05-19 10:46:55.494109 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:55.493917) v2 ==== 47+0+0 (436201005 0 0) 0xa36c8c0 con 0x9656580 -5008> 2014-05-19 10:46:55.494131 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:55.493917) v2 ==== 47+0+0 (436201005 0 0) 0xac34fc0 con 0x9657340 -5007> 2014-05-19 10:46:55.494159 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:55.493917) v2 -- ?+0 0x9cb48c0 con 0x9656580 -5006> 2014-05-19 10:46:55.494203 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -5005> 2014-05-19 10:46:55.494249 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:55.493917) v2 -- ?+0 0x9b45180 con 0x9657340 -5004> 2014-05-19 10:46:55.494283 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -5003> 2014-05-19 10:46:55.514992 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:58.121483) v2 ==== 47+0+0 (13467750 0 0) 0xac28a80 con 0x9b8db80 -5002> 2014-05-19 10:46:55.515186 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.121483) v2 -- ?+0 0xa36c8c0 con 0x9b8db80 -5001> 2014-05-19 10:46:55.514829 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:58.121483) v2 ==== 47+0+0 (13467750 0 0) 0xa0bddc0 con 0x7b90160 -5000> 2014-05-19 10:46:55.515267 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -4999> 2014-05-19 10:46:55.515307 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.121483) v2 -- ?+0 0xac34fc0 con 0x7b90160 -4998> 2014-05-19 10:46:55.515469 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -4997> 2014-05-19 10:46:55.686185 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:59.631160) v2 ==== 47+0+0 (3473955805 0 0) 0xac34380 con 0x987af20 -4996> 2014-05-19 10:46:55.686329 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:59.631160) v2 -- ?+0 0xac28a80 con 0x987af20 -4995> 2014-05-19 10:46:55.686403 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -4994> 2014-05-19 10:46:55.686205 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:59.631160) v2 ==== 47+0+0 (3473955805 0 0) 0xa092a80 con 0x99f1080 -4993> 2014-05-19 10:46:55.686521 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:59.631160) v2 -- ?+0 0xa0bddc0 con 0x99f1080 -4992> 2014-05-19 10:46:55.686646 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -4991> 2014-05-19 10:46:55.862935 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:58.469592) v2 ==== 47+0+0 (1079191893 0 0) 0xa23ee00 con 0x9656160 -4990> 2014-05-19 10:46:55.862939 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:58.469592) v2 ==== 47+0+0 (1079191893 0 0) 0xa4ee380 con 0x9656f20 -4989> 2014-05-19 10:46:55.863001 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.469592) v2 -- ?+0 0xac34380 con 0x9656160 -4988> 2014-05-19 10:46:55.863491 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -4987> 2014-05-19 10:46:55.863522 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.469592) v2 -- ?+0 0xa092a80 con 0x9656f20 -4986> 2014-05-19 10:46:55.863567 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -4985> 2014-05-19 10:46:55.920456 7f5566602700 5 osd.0 245 tick -4984> 2014-05-19 10:46:55.920485 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -4983> 2014-05-19 10:46:55.920492 7f5566602700 10 osd.0 245 do_waiters -- start -4982> 2014-05-19 10:46:55.920496 7f5566602700 10 osd.0 245 do_waiters -- finish -4981> 2014-05-19 10:46:55.920523 7f555119d700 20 OSD::recovery_tp worker waiting -4980> 2014-05-19 10:46:56.147838 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:58.754527) v2 ==== 47+0+0 (1832664022 0 0) 0xa031500 con 0x9a0c9a0 -4979> 2014-05-19 10:46:56.147930 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.754527) v2 -- ?+0 0xa4ee380 con 0x9a0c9a0 -4978> 2014-05-19 10:46:56.148009 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -4977> 2014-05-19 10:46:56.148154 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:58.754527) v2 ==== 47+0+0 (1832664022 0 0) 0x9ad3a40 con 0x996e000 -4976> 2014-05-19 10:46:56.148480 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.754527) v2 -- ?+0 0xa23ee00 con 0x996e000 -4975> 2014-05-19 10:46:56.148523 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -4974> 2014-05-19 10:46:56.308742 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:00.253747) v2 ==== 47+0+0 (1803252103 0 0) 0xa65b880 con 0x9743600 -4973> 2014-05-19 10:46:56.308793 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:00.253747) v2 -- ?+0 0xa031500 con 0x9743600 -4972> 2014-05-19 10:46:56.308879 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -4971> 2014-05-19 10:46:56.308812 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:00.253747) v2 ==== 47+0+0 (1803252103 0 0) 0xa4dea80 con 0x966e000 -4970> 2014-05-19 10:46:56.309259 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:00.253747) v2 -- ?+0 0x9ad3a40 con 0x966e000 -4969> 2014-05-19 10:46:56.309296 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -4968> 2014-05-19 10:46:56.352540 7f555c1b3700 10 monclient: tick -4967> 2014-05-19 10:46:56.352554 7f555c1b3700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2014-05-19 10:46:26.352552) -4966> 2014-05-19 10:46:56.352571 7f555c1b3700 10 monclient: renew subs? (now: 2014-05-19 10:46:56.352571; renew after: 2014-05-19 10:47:03.081841) -- no -4965> 2014-05-19 10:46:56.364273 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:00.309343) v2 ==== 47+0+0 (2135185178 0 0) 0xa1e4fc0 con 0x99718c0 -4964> 2014-05-19 10:46:56.364372 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:00.309343) v2 -- ?+0 0xa4dea80 con 0x99718c0 -4963> 2014-05-19 10:46:56.364457 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -4962> 2014-05-19 10:46:56.364475 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:58.971002) v2 ==== 47+0+0 (3656913091 0 0) 0xa23e380 con 0x9656160 -4961> 2014-05-19 10:46:56.364507 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.971002) v2 -- ?+0 0xa1e4fc0 con 0x9656160 -4960> 2014-05-19 10:46:56.365188 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -4959> 2014-05-19 10:46:56.365013 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:58.971002) v2 ==== 47+0+0 (3656913091 0 0) 0xa4ef6c0 con 0x9656f20 -4958> 2014-05-19 10:46:56.365393 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.971002) v2 -- ?+0 0xa65b880 con 0x9656f20 -4957> 2014-05-19 10:46:56.365430 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -4956> 2014-05-19 10:46:56.365447 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:00.309343) v2 ==== 47+0+0 (2135185178 0 0) 0x9e9f500 con 0x97431e0 -4955> 2014-05-19 10:46:56.365483 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:00.309343) v2 -- ?+0 0xa4ef6c0 con 0x97431e0 -4954> 2014-05-19 10:46:56.365515 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -4953> 2014-05-19 10:46:56.527543 7f5565600700 20 KeyValueStore::op_tp worker waiting -4952> 2014-05-19 10:46:56.615183 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:00.560166) v2 ==== 47+0+0 (1854371965 0 0) 0xa0ea700 con 0x94e26e0 -4951> 2014-05-19 10:46:56.615227 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:00.560166) v2 -- ?+0 0x9e9f500 con 0x94e26e0 -4950> 2014-05-19 10:46:56.615301 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -4949> 2014-05-19 10:46:56.615470 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:00.560166) v2 ==== 47+0+0 (1854371965 0 0) 0xac15dc0 con 0x987b340 -4948> 2014-05-19 10:46:56.615509 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:00.560166) v2 -- ?+0 0xa23e380 con 0x987b340 -4947> 2014-05-19 10:46:56.615586 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -4946> 2014-05-19 10:46:56.768576 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:00.713564) v2 ==== 47+0+0 (949507038 0 0) 0xa264540 con 0x9970840 -4945> 2014-05-19 10:46:56.768588 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:00.713564) v2 ==== 47+0+0 (949507038 0 0) 0xac1a8c0 con 0x97434a0 -4944> 2014-05-19 10:46:56.768637 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:00.713564) v2 -- ?+0 0xac15dc0 con 0x9970840 -4943> 2014-05-19 10:46:56.768670 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -4942> 2014-05-19 10:46:56.768743 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:00.713564) v2 -- ?+0 0xa0ea700 con 0x97434a0 -4941> 2014-05-19 10:46:56.768780 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -4940> 2014-05-19 10:46:56.769138 7f55579aa700 20 OSD::op_tp worker waiting -4939> 2014-05-19 10:46:56.769171 7f55551a5700 20 OSD::op_tp worker waiting -4938> 2014-05-19 10:46:56.769213 7f555a1af700 20 OSD::op_tp worker waiting -4937> 2014-05-19 10:46:56.770757 7f55589ac700 20 OSD::op_tp worker waiting -4936> 2014-05-19 10:46:56.770791 7f55541a3700 20 OSD::op_tp worker waiting -4935> 2014-05-19 10:46:56.770844 7f555a9b0700 20 OSD::op_tp worker waiting -4934> 2014-05-19 10:46:56.770874 7f55549a4700 20 OSD::op_tp worker waiting -4933> 2014-05-19 10:46:56.770912 7f555b1b1700 20 OSD::op_tp worker waiting -4932> 2014-05-19 10:46:56.770949 7f55569a8700 20 OSD::op_tp worker waiting -4931> 2014-05-19 10:46:56.771728 7f55581ab700 20 OSD::op_tp worker waiting -4930> 2014-05-19 10:46:56.771750 7f55571a9700 20 OSD::op_tp worker waiting -4929> 2014-05-19 10:46:56.771813 7f55531a1700 20 OSD::op_tp worker waiting -4928> 2014-05-19 10:46:56.771834 7f555219f700 20 OSD::op_tp worker waiting -4927> 2014-05-19 10:46:56.771847 7f55529a0700 20 OSD::op_tp worker waiting -4926> 2014-05-19 10:46:56.771863 7f55539a2700 20 OSD::op_tp worker waiting -4925> 2014-05-19 10:46:56.771921 7f55561a7700 20 OSD::op_tp worker waiting -4924> 2014-05-19 10:46:56.771954 7f55599ae700 20 OSD::op_tp worker waiting -4923> 2014-05-19 10:46:56.771969 7f55591ad700 20 OSD::op_tp worker waiting -4922> 2014-05-19 10:46:56.772019 7f55559a6700 20 OSD::op_tp worker waiting -4921> 2014-05-19 10:46:56.772041 7f555199e700 20 OSD::op_tp worker waiting -4920> 2014-05-19 10:46:56.920586 7f5566602700 5 osd.0 245 tick -4919> 2014-05-19 10:46:56.920646 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.96 >= max 0.5 = no, load too high -4918> 2014-05-19 10:46:56.920661 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -4917> 2014-05-19 10:46:56.920657 7f555119d700 20 OSD::recovery_tp worker waiting -4916> 2014-05-19 10:46:56.920664 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2237.46 < min (86400 seconds) -4915> 2014-05-19 10:46:56.920684 7f5566602700 20 osd.0 245 sched_scrub done -4914> 2014-05-19 10:46:56.920687 7f5566602700 10 osd.0 245 do_waiters -- start -4913> 2014-05-19 10:46:56.920689 7f5566602700 10 osd.0 245 do_waiters -- finish -4912> 2014-05-19 10:46:57.010189 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:59.616875) v2 ==== 47+0+0 (2514454198 0 0) 0xa2bce00 con 0x9657080 -4911> 2014-05-19 10:46:57.010226 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:59.616875) v2 ==== 47+0+0 (2514454198 0 0) 0x9c08700 con 0x96562c0 -4910> 2014-05-19 10:46:57.010247 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:59.616875) v2 -- ?+0 0xac1a8c0 con 0x9657080 -4909> 2014-05-19 10:46:57.010283 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -4908> 2014-05-19 10:46:57.010674 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:59.616875) v2 -- ?+0 0xa264540 con 0x96562c0 -4907> 2014-05-19 10:46:57.010767 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -4906> 2014-05-19 10:46:57.110967 7f5564dff700 20 KeyValueStore::op_tp worker waiting -4905> 2014-05-19 10:46:57.195514 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:57.195329) v2 ==== 47+0+0 (845255969 0 0) 0x9f19dc0 con 0x9657340 -4904> 2014-05-19 10:46:57.195522 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:57.195329) v2 ==== 47+0+0 (845255969 0 0) 0x9e6d6c0 con 0x9656580 -4903> 2014-05-19 10:46:57.195570 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:57.195329) v2 -- ?+0 0xa2bce00 con 0x9657340 -4902> 2014-05-19 10:46:57.195606 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -4901> 2014-05-19 10:46:57.195630 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:57.195329) v2 -- ?+0 0x9c08700 con 0x9656580 -4900> 2014-05-19 10:46:57.195676 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -4899> 2014-05-19 10:46:57.216332 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:59.823022) v2 ==== 47+0+0 (3892182699 0 0) 0xac1ba40 con 0x7b90160 -4898> 2014-05-19 10:46:57.216363 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:46:59.823022) v2 ==== 47+0+0 (3892182699 0 0) 0xac29dc0 con 0x9b8db80 -4897> 2014-05-19 10:46:57.216403 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:59.823022) v2 -- ?+0 0x9f19dc0 con 0x7b90160 -4896> 2014-05-19 10:46:57.216441 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -4895> 2014-05-19 10:46:57.216542 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:46:59.823022) v2 -- ?+0 0x9e6d6c0 con 0x9b8db80 -4894> 2014-05-19 10:46:57.216777 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -4893> 2014-05-19 10:46:57.410139 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:01.355163) v2 ==== 47+0+0 (3915389974 0 0) 0xa05e540 con 0x9743600 -4892> 2014-05-19 10:46:57.410157 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:01.355163) v2 ==== 47+0+0 (3915389974 0 0) 0xa4df880 con 0x966e000 -4891> 2014-05-19 10:46:57.410189 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:01.355163) v2 -- ?+0 0xac1ba40 con 0x9743600 -4890> 2014-05-19 10:46:57.410271 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -4889> 2014-05-19 10:46:57.410309 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:01.355163) v2 -- ?+0 0xac29dc0 con 0x966e000 -4888> 2014-05-19 10:46:57.410384 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -4887> 2014-05-19 10:46:57.449911 7f555019b700 20 OSD::command_tp worker waiting -4886> 2014-05-19 10:46:57.453177 7f555099c700 20 OSD::disk_tp worker waiting -4885> 2014-05-19 10:46:57.644634 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:00.251270) v2 ==== 47+0+0 (138970516 0 0) 0xa865880 con 0x96571e0 -4884> 2014-05-19 10:46:57.644966 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:00.251270) v2 -- ?+0 0xa05e540 con 0x96571e0 -4883> 2014-05-19 10:46:57.645005 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -4882> 2014-05-19 10:46:57.644641 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:00.251270) v2 ==== 47+0+0 (138970516 0 0) 0xac36540 con 0x9656420 -4881> 2014-05-19 10:46:57.645263 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:00.251270) v2 -- ?+0 0xa4df880 con 0x9656420 -4880> 2014-05-19 10:46:57.645292 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -4879> 2014-05-19 10:46:57.678279 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:01.623315) v2 ==== 47+0+0 (4233270532 0 0) 0xa0ca700 con 0x94a5a20 -4878> 2014-05-19 10:46:57.678335 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:01.623315) v2 -- ?+0 0xa865880 con 0x94a5a20 -4877> 2014-05-19 10:46:57.678356 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:01.623315) v2 ==== 47+0+0 (4233270532 0 0) 0xa2bc380 con 0x99d3340 -4876> 2014-05-19 10:46:57.678488 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -4875> 2014-05-19 10:46:57.678646 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:01.623315) v2 -- ?+0 0xac36540 con 0x99d3340 -4874> 2014-05-19 10:46:57.678738 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -4873> 2014-05-19 10:46:57.920779 7f5566602700 5 osd.0 245 tick -4872> 2014-05-19 10:46:57.920802 7f5566602700 7 osd.0 245 do_mon_report -4871> 2014-05-19 10:46:57.920808 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 -4870> 2014-05-19 10:46:57.920814 7f5566602700 20 osd.0 245 send_pg_stats -4869> 2014-05-19 10:46:57.920865 7f555119d700 20 OSD::recovery_tp worker waiting -4868> 2014-05-19 10:46:57.920860 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.96 >= max 0.5 = no, load too high -4867> 2014-05-19 10:46:57.920877 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -4866> 2014-05-19 10:46:57.920883 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2238.46 < min (86400 seconds) -4865> 2014-05-19 10:46:57.920907 7f5566602700 20 osd.0 245 sched_scrub done -4864> 2014-05-19 10:46:57.920911 7f5566602700 10 osd.0 245 do_waiters -- start -4863> 2014-05-19 10:46:57.920915 7f5566602700 10 osd.0 245 do_waiters -- finish -4862> 2014-05-19 10:46:58.066293 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:00.673057) v2 ==== 47+0+0 (3571239513 0 0) 0xa4ef500 con 0x9656f20 -4861> 2014-05-19 10:46:58.066331 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:00.673057) v2 ==== 47+0+0 (3571239513 0 0) 0x9c08000 con 0x9656160 -4860> 2014-05-19 10:46:58.066368 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:00.673057) v2 -- ?+0 0xa2bc380 con 0x9656160 -4859> 2014-05-19 10:46:58.066758 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -4858> 2014-05-19 10:46:58.066787 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:00.673057) v2 -- ?+0 0xa0ca700 con 0x9656f20 -4857> 2014-05-19 10:46:58.066836 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -4856> 2014-05-19 10:46:58.109347 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:00.716037) v2 ==== 47+0+0 (281082690 0 0) 0xac308c0 con 0x996fb80 -4855> 2014-05-19 10:46:58.109419 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:00.716037) v2 -- ?+0 0x9c08000 con 0x996fb80 -4854> 2014-05-19 10:46:58.109449 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -4853> 2014-05-19 10:46:58.109468 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:00.716037) v2 ==== 47+0+0 (281082690 0 0) 0x9ffd180 con 0x9a0cdc0 -4852> 2014-05-19 10:46:58.109499 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:00.716037) v2 -- ?+0 0xa4ef500 con 0x9a0cdc0 -4851> 2014-05-19 10:46:58.109529 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -4850> 2014-05-19 10:46:58.150628 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:00.757312) v2 ==== 47+0+0 (2620705082 0 0) 0xa36cc40 con 0x95846e0 -4849> 2014-05-19 10:46:58.150715 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:00.757312) v2 -- ?+0 0xac308c0 con 0x95846e0 -4848> 2014-05-19 10:46:58.150815 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -4847> 2014-05-19 10:46:58.150943 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:00.757312) v2 ==== 47+0+0 (2620705082 0 0) 0xa857c00 con 0x9983600 -4846> 2014-05-19 10:46:58.150998 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:00.757312) v2 -- ?+0 0x9ffd180 con 0x9983600 -4845> 2014-05-19 10:46:58.151030 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -4844> 2014-05-19 10:46:58.242094 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:00.848865) v2 ==== 47+0+0 (3203385920 0 0) 0x9d0bc00 con 0x9aa3600 -4843> 2014-05-19 10:46:58.242113 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:00.848865) v2 ==== 47+0+0 (3203385920 0 0) 0xac16a80 con 0x9b8c160 -4842> 2014-05-19 10:46:58.242177 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:00.848865) v2 -- ?+0 0xa857c00 con 0x9aa3600 -4841> 2014-05-19 10:46:58.242209 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -4840> 2014-05-19 10:46:58.242312 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:00.848865) v2 -- ?+0 0xa36cc40 con 0x9b8c160 -4839> 2014-05-19 10:46:58.242422 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -4838> 2014-05-19 10:46:58.423131 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:02.368220) v2 ==== 47+0+0 (1919857234 0 0) 0xa05ea80 con 0x987b760 -4837> 2014-05-19 10:46:58.423153 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 42 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:02.368220) v2 ==== 47+0+0 (1919857234 0 0) 0x9d52380 con 0x94802c0 -4836> 2014-05-19 10:46:58.423188 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:02.368220) v2 -- ?+0 0xac16a80 con 0x987b760 -4835> 2014-05-19 10:46:58.423239 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -4834> 2014-05-19 10:46:58.423447 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:02.368220) v2 -- ?+0 0x9d0bc00 con 0x94802c0 -4833> 2014-05-19 10:46:58.423541 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -4832> 2014-05-19 10:46:58.527626 7f5565600700 20 KeyValueStore::op_tp worker waiting -4831> 2014-05-19 10:46:58.754694 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:01.361396) v2 ==== 47+0+0 (2378658157 0 0) 0xa0bd880 con 0x94e2160 -4830> 2014-05-19 10:46:58.754746 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:01.361396) v2 -- ?+0 0x9d52380 con 0x94e2160 -4829> 2014-05-19 10:46:58.754787 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -4828> 2014-05-19 10:46:58.754788 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:01.361396) v2 ==== 47+0+0 (2378658157 0 0) 0xa243c00 con 0x9b8de40 -4827> 2014-05-19 10:46:58.754846 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:01.361396) v2 -- ?+0 0xa05ea80 con 0x9b8de40 -4826> 2014-05-19 10:46:58.754991 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -4825> 2014-05-19 10:46:58.769236 7f55579aa700 20 OSD::op_tp worker waiting -4824> 2014-05-19 10:46:58.769265 7f55551a5700 20 OSD::op_tp worker waiting -4823> 2014-05-19 10:46:58.769291 7f555a1af700 20 OSD::op_tp worker waiting -4822> 2014-05-19 10:46:58.770855 7f55589ac700 20 OSD::op_tp worker waiting -4821> 2014-05-19 10:46:58.770885 7f55541a3700 20 OSD::op_tp worker waiting -4820> 2014-05-19 10:46:58.770930 7f555a9b0700 20 OSD::op_tp worker waiting -4819> 2014-05-19 10:46:58.770952 7f55549a4700 20 OSD::op_tp worker waiting -4818> 2014-05-19 10:46:58.770996 7f555b1b1700 20 OSD::op_tp worker waiting -4817> 2014-05-19 10:46:58.771014 7f55569a8700 20 OSD::op_tp worker waiting -4816> 2014-05-19 10:46:58.771806 7f55581ab700 20 OSD::op_tp worker waiting -4815> 2014-05-19 10:46:58.771831 7f55571a9700 20 OSD::op_tp worker waiting -4814> 2014-05-19 10:46:58.771895 7f55531a1700 20 OSD::op_tp worker waiting -4813> 2014-05-19 10:46:58.771914 7f555219f700 20 OSD::op_tp worker waiting -4812> 2014-05-19 10:46:58.771930 7f55539a2700 20 OSD::op_tp worker waiting -4811> 2014-05-19 10:46:58.771976 7f55529a0700 20 OSD::op_tp worker waiting -4810> 2014-05-19 10:46:58.771998 7f55561a7700 20 OSD::op_tp worker waiting -4809> 2014-05-19 10:46:58.772022 7f55599ae700 20 OSD::op_tp worker waiting -4808> 2014-05-19 10:46:58.772040 7f55591ad700 20 OSD::op_tp worker waiting -4807> 2014-05-19 10:46:58.772100 7f55559a6700 20 OSD::op_tp worker waiting -4806> 2014-05-19 10:46:58.772122 7f555199e700 20 OSD::op_tp worker waiting -4805> 2014-05-19 10:46:58.921004 7f5566602700 5 osd.0 245 tick -4804> 2014-05-19 10:46:58.921029 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -4803> 2014-05-19 10:46:58.921034 7f5566602700 10 osd.0 245 do_waiters -- start -4802> 2014-05-19 10:46:58.921036 7f5566602700 10 osd.0 245 do_waiters -- finish -4801> 2014-05-19 10:46:58.921073 7f555119d700 20 OSD::recovery_tp worker waiting -4800> 2014-05-19 10:46:58.957496 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -4799> 2014-05-19 10:46:58.957516 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -4798> 2014-05-19 10:46:58.957525 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa856380 con 0x9bdc840 -4797> 2014-05-19 10:46:58.957551 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xac32700 con 0x9ad4420 -4796> 2014-05-19 10:46:58.957588 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0x9b44700 con 0x9bf31e0 -4795> 2014-05-19 10:46:58.957605 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0x99fce00 con 0x998b340 -4794> 2014-05-19 10:46:58.957657 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0x9c6f880 con 0x9b92840 -4793> 2014-05-19 10:46:58.957692 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0x9cb7180 con 0x9ad49a0 -4792> 2014-05-19 10:46:58.957773 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa23e8c0 con 0x7b911e0 -4791> 2014-05-19 10:46:58.957802 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0x9e81dc0 con 0x7b918c0 -4790> 2014-05-19 10:46:58.957818 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa208700 con 0x9aa8c60 -4789> 2014-05-19 10:46:58.957834 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa192e00 con 0x9bfa000 -4788> 2014-05-19 10:46:58.957848 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0x9ad3180 con 0x7c23e40 -4787> 2014-05-19 10:46:58.957889 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xac156c0 con 0x998b760 -4786> 2014-05-19 10:46:58.957892 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0x951c1c0 con 0x9bdc840 -4785> 2014-05-19 10:46:58.957922 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa6aae00 con 0x7b91080 -4784> 2014-05-19 10:46:58.957947 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa65a000 con 0xa28fb80 -4783> 2014-05-19 10:46:58.957965 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0x9e11dc0 con 0x76bdce0 -4782> 2014-05-19 10:46:58.957981 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa65bc00 con 0x994ab00 -4781> 2014-05-19 10:46:58.958010 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0x9f6fc00 con 0x9ac8b00 -4780> 2014-05-19 10:46:58.958038 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa0b7500 con 0x938de40 -4779> 2014-05-19 10:46:58.958055 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0x9c6e1c0 con 0x9970b00 -4778> 2014-05-19 10:46:58.958071 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa6abc00 con 0x99706e0 -4777> 2014-05-19 10:46:58.958097 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa516540 con 0x9bb6f20 -4776> 2014-05-19 10:46:58.958116 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0x9ba4c40 con 0x994b340 -4775> 2014-05-19 10:46:58.958141 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xac34a80 con 0x98fa2c0 -4774> 2014-05-19 10:46:58.958160 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0x9388700 con 0x996f8c0 -4773> 2014-05-19 10:46:58.958176 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0x9d76540 con 0x996fa20 -4772> 2014-05-19 10:46:58.958203 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa446700 con 0x9ac8160 -4771> 2014-05-19 10:46:58.958229 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa0bd180 con 0x7b90420 -4770> 2014-05-19 10:46:58.958245 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa447880 con 0x919fe40 -4769> 2014-05-19 10:46:58.958260 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0x9cd0c40 con 0x9971760 -4768> 2014-05-19 10:46:58.958283 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa264e00 con 0x994af20 -4767> 2014-05-19 10:46:58.958308 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa873c00 con 0x989be40 -4766> 2014-05-19 10:46:58.958356 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa618700 con 0x9adf4a0 -4765> 2014-05-19 10:46:58.958384 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0x9e9fa40 con 0x9776160 -4764> 2014-05-19 10:46:58.958406 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa2dfc00 con 0x96bd8c0 -4763> 2014-05-19 10:46:58.958421 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa8721c0 con 0x96bcdc0 -4762> 2014-05-19 10:46:58.958445 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0x9d0aa80 con 0x96954a0 -4761> 2014-05-19 10:46:58.958477 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0x951ddc0 con 0x76bd8c0 -4760> 2014-05-19 10:46:58.958504 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa064e00 con 0x7b90dc0 -4759> 2014-05-19 10:46:58.958520 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa6ab340 con 0x978d8c0 -4758> 2014-05-19 10:46:58.958550 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0x9f6efc0 con 0x978c580 -4757> 2014-05-19 10:46:58.958568 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa28d180 con 0x978d340 -4756> 2014-05-19 10:46:58.958596 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:46:58.957523) v2 -- ?+0 0xa74aa80 con 0x96374a0 -4755> 2014-05-19 10:46:58.958665 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -4754> 2014-05-19 10:46:58.958689 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa103500 con 0x9ad4420 -4753> 2014-05-19 10:46:58.958724 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -4752> 2014-05-19 10:46:58.958750 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xac37340 con 0x9bf31e0 -4751> 2014-05-19 10:46:58.958781 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -4750> 2014-05-19 10:46:58.958788 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa0eb340 con 0x998b340 -4749> 2014-05-19 10:46:58.958804 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -4748> 2014-05-19 10:46:58.958810 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa0bce00 con 0x9b92840 -4747> 2014-05-19 10:46:58.958824 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -4746> 2014-05-19 10:46:58.958829 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa3dac40 con 0x9ad49a0 -4745> 2014-05-19 10:46:58.958842 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -4744> 2014-05-19 10:46:58.958847 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa2df180 con 0x7b911e0 -4743> 2014-05-19 10:46:58.958861 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -4742> 2014-05-19 10:46:58.958866 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa617340 con 0x7b918c0 -4741> 2014-05-19 10:46:58.958880 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -4740> 2014-05-19 10:46:58.959006 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0x9f74fc0 con 0x9aa8c60 -4739> 2014-05-19 10:46:58.959046 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -4738> 2014-05-19 10:46:58.959062 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0x9ad28c0 con 0x9bfa000 -4737> 2014-05-19 10:46:58.959092 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -4736> 2014-05-19 10:46:58.959111 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa173a40 con 0x7c23e40 -4735> 2014-05-19 10:46:58.959142 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -4734> 2014-05-19 10:46:58.959152 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0x9b51dc0 con 0x998b760 -4733> 2014-05-19 10:46:58.959169 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -4732> 2014-05-19 10:46:58.959177 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa74ac40 con 0x7b91080 -4731> 2014-05-19 10:46:58.959192 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -4730> 2014-05-19 10:46:58.959199 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa0b7880 con 0xa28fb80 -4729> 2014-05-19 10:46:58.959213 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -4728> 2014-05-19 10:46:58.959222 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xac37dc0 con 0x76bdce0 -4727> 2014-05-19 10:46:58.959239 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -4726> 2014-05-19 10:46:58.959247 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xac2bdc0 con 0x994ab00 -4725> 2014-05-19 10:46:58.959261 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -4724> 2014-05-19 10:46:58.959271 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xac2ae00 con 0x9ac8b00 -4723> 2014-05-19 10:46:58.959288 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -4722> 2014-05-19 10:46:58.959295 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0x95c0380 con 0x938de40 -4721> 2014-05-19 10:46:58.959309 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -4720> 2014-05-19 10:46:58.959317 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa1e4540 con 0x9970b00 -4719> 2014-05-19 10:46:58.959331 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -4718> 2014-05-19 10:46:58.959340 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa872000 con 0x99706e0 -4717> 2014-05-19 10:46:58.959357 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -4716> 2014-05-19 10:46:58.959364 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa517a40 con 0x9bb6f20 -4715> 2014-05-19 10:46:58.959378 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -4714> 2014-05-19 10:46:58.959386 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0x948fc00 con 0x994b340 -4713> 2014-05-19 10:46:58.959400 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -4712> 2014-05-19 10:46:58.959406 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa873880 con 0x98fa2c0 -4711> 2014-05-19 10:46:58.959421 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -4710> 2014-05-19 10:46:58.959429 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0x9c0f880 con 0x996f8c0 -4709> 2014-05-19 10:46:58.959442 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -4708> 2014-05-19 10:46:58.959457 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa36ddc0 con 0x996fa20 -4707> 2014-05-19 10:46:58.959474 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -4706> 2014-05-19 10:46:58.959481 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa2df340 con 0x9ac8160 -4705> 2014-05-19 10:46:58.959496 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -4704> 2014-05-19 10:46:58.959503 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa030fc0 con 0x7b90420 -4703> 2014-05-19 10:46:58.959517 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -4702> 2014-05-19 10:46:58.959525 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa1e4380 con 0x919fe40 -4701> 2014-05-19 10:46:58.959539 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -4700> 2014-05-19 10:46:58.959546 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0x9547dc0 con 0x9971760 -4699> 2014-05-19 10:46:58.959560 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -4698> 2014-05-19 10:46:58.959567 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa864a80 con 0x994af20 -4697> 2014-05-19 10:46:58.959581 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -4696> 2014-05-19 10:46:58.959590 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0x9d52000 con 0x989be40 -4695> 2014-05-19 10:46:58.959607 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -4694> 2014-05-19 10:46:58.959615 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xac34c40 con 0x9adf4a0 -4693> 2014-05-19 10:46:58.959628 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -4692> 2014-05-19 10:46:58.959637 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xac09880 con 0x9776160 -4691> 2014-05-19 10:46:58.959654 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -4690> 2014-05-19 10:46:58.959661 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa516e00 con 0x96bd8c0 -4689> 2014-05-19 10:46:58.959675 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -4688> 2014-05-19 10:46:58.959682 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xac16540 con 0x96bcdc0 -4687> 2014-05-19 10:46:58.959697 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -4686> 2014-05-19 10:46:58.959704 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa74a8c0 con 0x96954a0 -4685> 2014-05-19 10:46:58.959718 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -4684> 2014-05-19 10:46:58.959725 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa28d180 con 0x76bd8c0 -4683> 2014-05-19 10:46:58.959740 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -4682> 2014-05-19 10:46:58.959747 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0x9fb5a40 con 0x7b90dc0 -4681> 2014-05-19 10:46:58.959761 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -4680> 2014-05-19 10:46:58.959768 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0x99e01c0 con 0x978d8c0 -4679> 2014-05-19 10:46:58.959782 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -4678> 2014-05-19 10:46:58.959789 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0x9b45880 con 0x978c580 -4677> 2014-05-19 10:46:58.959803 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -4676> 2014-05-19 10:46:58.959811 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xac321c0 con 0x978d340 -4675> 2014-05-19 10:46:58.959826 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -4674> 2014-05-19 10:46:58.959834 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 44 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:46:58.957523) v2 ==== 47+0+0 (4283405607 0 0) 0xa266fc0 con 0x96374a0 -4673> 2014-05-19 10:46:58.959848 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -4672> 2014-05-19 10:46:59.111061 7f5564dff700 20 KeyValueStore::op_tp worker waiting -4671> 2014-05-19 10:46:59.265751 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:01.872456) v2 ==== 47+0+0 (4149677112 0 0) 0xac33340 con 0x9937760 -4670> 2014-05-19 10:46:59.265801 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:01.872456) v2 -- ?+0 0xa0bd880 con 0x9937760 -4669> 2014-05-19 10:46:59.265838 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -4668> 2014-05-19 10:46:59.265745 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:01.872456) v2 ==== 47+0+0 (4149677112 0 0) 0x9fa4540 con 0x9656000 -4667> 2014-05-19 10:46:59.265874 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:01.872456) v2 -- ?+0 0xa243c00 con 0x9656000 -4666> 2014-05-19 10:46:59.265960 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -4665> 2014-05-19 10:46:59.450035 7f555019b700 20 OSD::command_tp worker waiting -4664> 2014-05-19 10:46:59.453253 7f555099c700 20 OSD::disk_tp worker waiting -4663> 2014-05-19 10:46:59.524433 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:03.469585) v2 ==== 47+0+0 (1753771503 0 0) 0x9cb7340 con 0x94802c0 -4662> 2014-05-19 10:46:59.524412 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 43 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:03.469585) v2 ==== 47+0+0 (1753771503 0 0) 0x9d0bdc0 con 0x987b760 -4661> 2014-05-19 10:46:59.524478 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:03.469585) v2 -- ?+0 0xac33340 con 0x94802c0 -4660> 2014-05-19 10:46:59.524608 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -4659> 2014-05-19 10:46:59.524639 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:03.469585) v2 -- ?+0 0x9fa4540 con 0x987b760 -4658> 2014-05-19 10:46:59.524718 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -4657> 2014-05-19 10:46:59.767293 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:02.374042) v2 ==== 47+0+0 (970513585 0 0) 0xac1bdc0 con 0x9656000 -4656> 2014-05-19 10:46:59.767302 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:02.374042) v2 ==== 47+0+0 (970513585 0 0) 0xac33180 con 0x9937760 -4655> 2014-05-19 10:46:59.767362 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:02.374042) v2 -- ?+0 0x9d0bdc0 con 0x9656000 -4654> 2014-05-19 10:46:59.767398 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -4653> 2014-05-19 10:46:59.767417 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:02.374042) v2 -- ?+0 0x9cb7340 con 0x9937760 -4652> 2014-05-19 10:46:59.767892 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -4651> 2014-05-19 10:46:59.810750 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:02.417442) v2 ==== 47+0+0 (2009208610 0 0) 0x9ee2e00 con 0x9a0cdc0 -4650> 2014-05-19 10:46:59.810806 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:02.417442) v2 -- ?+0 0xac33180 con 0x9a0cdc0 -4649> 2014-05-19 10:46:59.810763 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:02.417442) v2 ==== 47+0+0 (2009208610 0 0) 0xac30700 con 0x996fb80 -4648> 2014-05-19 10:46:59.811114 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -4647> 2014-05-19 10:46:59.811138 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:02.417442) v2 -- ?+0 0xac1bdc0 con 0x996fb80 -4646> 2014-05-19 10:46:59.811216 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -4645> 2014-05-19 10:46:59.878256 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:03.823443) v2 ==== 47+0+0 (104301290 0 0) 0xa4a8380 con 0x99d31e0 -4644> 2014-05-19 10:46:59.878369 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:03.823443) v2 ==== 47+0+0 (104301290 0 0) 0xac23880 con 0x95142c0 -4643> 2014-05-19 10:46:59.878335 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:03.823443) v2 -- ?+0 0xac30700 con 0x99d31e0 -4642> 2014-05-19 10:46:59.878591 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -4641> 2014-05-19 10:46:59.878716 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:03.823443) v2 -- ?+0 0x9ee2e00 con 0x95142c0 -4640> 2014-05-19 10:46:59.878889 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -4639> 2014-05-19 10:46:59.921124 7f5566602700 5 osd.0 245 tick -4638> 2014-05-19 10:46:59.921176 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.96 >= max 0.5 = no, load too high -4637> 2014-05-19 10:46:59.921190 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -4636> 2014-05-19 10:46:59.921193 7f555119d700 20 OSD::recovery_tp worker waiting -4635> 2014-05-19 10:46:59.921193 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2240.46 < min (86400 seconds) -4634> 2014-05-19 10:46:59.921212 7f5566602700 20 osd.0 245 sched_scrub done -4633> 2014-05-19 10:46:59.921215 7f5566602700 10 osd.0 245 do_waiters -- start -4632> 2014-05-19 10:46:59.921217 7f5566602700 10 osd.0 245 do_waiters -- finish -4631> 2014-05-19 10:46:59.996354 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:03.941521) v2 ==== 47+0+0 (468010279 0 0) 0xac2a000 con 0x9bb7b80 -4630> 2014-05-19 10:46:59.996408 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:03.941521) v2 -- ?+0 0xa4a8380 con 0x9bb7b80 -4629> 2014-05-19 10:46:59.996465 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -4628> 2014-05-19 10:46:59.996493 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:03.941521) v2 ==== 47+0+0 (468010279 0 0) 0xac28000 con 0x95151e0 -4627> 2014-05-19 10:46:59.996585 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:03.941521) v2 -- ?+0 0xac23880 con 0x95151e0 -4626> 2014-05-19 10:46:59.996680 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -4625> 2014-05-19 10:47:00.117916 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:02.724616) v2 ==== 47+0+0 (861406485 0 0) 0xac29a40 con 0x9b8db80 -4624> 2014-05-19 10:47:00.117968 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:02.724616) v2 -- ?+0 0xac2a000 con 0x9b8db80 -4623> 2014-05-19 10:47:00.118049 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -4622> 2014-05-19 10:47:00.118250 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:02.724616) v2 ==== 47+0+0 (861406485 0 0) 0x92b1180 con 0x7b90160 -4621> 2014-05-19 10:47:00.118294 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:02.724616) v2 -- ?+0 0xac28000 con 0x7b90160 -4620> 2014-05-19 10:47:00.118367 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -4619> 2014-05-19 10:47:00.198850 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:04.143999) v2 ==== 47+0+0 (4244954778 0 0) 0x96bee00 con 0x94e3e40 -4618> 2014-05-19 10:47:00.198869 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:04.143999) v2 ==== 47+0+0 (4244954778 0 0) 0xa665340 con 0x9bb69a0 -4617> 2014-05-19 10:47:00.198898 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.143999) v2 -- ?+0 0x92b1180 con 0x94e3e40 -4616> 2014-05-19 10:47:00.198977 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -4615> 2014-05-19 10:47:00.198999 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.143999) v2 -- ?+0 0xac29a40 con 0x9bb69a0 -4614> 2014-05-19 10:47:00.199124 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -4613> 2014-05-19 10:47:00.387537 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:04.332720) v2 ==== 47+0+0 (3413450599 0 0) 0xac31180 con 0x99f1080 -4612> 2014-05-19 10:47:00.387565 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:04.332720) v2 ==== 47+0+0 (3413450599 0 0) 0xac341c0 con 0x987af20 -4611> 2014-05-19 10:47:00.387587 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.332720) v2 -- ?+0 0x96bee00 con 0x99f1080 -4610> 2014-05-19 10:47:00.387620 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -4609> 2014-05-19 10:47:00.387640 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.332720) v2 -- ?+0 0xa665340 con 0x987af20 -4608> 2014-05-19 10:47:00.387727 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -4607> 2014-05-19 10:47:00.527713 7f5565600700 20 KeyValueStore::op_tp worker waiting -4606> 2014-05-19 10:47:00.716359 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:04.661539) v2 ==== 47+0+0 (3541551694 0 0) 0xa0ea000 con 0x94e26e0 -4605> 2014-05-19 10:47:00.716363 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:04.661539) v2 ==== 47+0+0 (3541551694 0 0) 0xac14700 con 0x987b340 -4604> 2014-05-19 10:47:00.716409 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.661539) v2 -- ?+0 0xac31180 con 0x94e26e0 -4603> 2014-05-19 10:47:00.716487 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -4602> 2014-05-19 10:47:00.716538 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.661539) v2 -- ?+0 0xac341c0 con 0x987b340 -4601> 2014-05-19 10:47:00.716620 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -4600> 2014-05-19 10:47:00.769339 7f55579aa700 20 OSD::op_tp worker waiting -4599> 2014-05-19 10:47:00.769365 7f55551a5700 20 OSD::op_tp worker waiting -4598> 2014-05-19 10:47:00.769388 7f555a1af700 20 OSD::op_tp worker waiting -4597> 2014-05-19 10:47:00.770956 7f55589ac700 20 OSD::op_tp worker waiting -4596> 2014-05-19 10:47:00.770979 7f55541a3700 20 OSD::op_tp worker waiting -4595> 2014-05-19 10:47:00.771008 7f555a9b0700 20 OSD::op_tp worker waiting -4594> 2014-05-19 10:47:00.771028 7f55549a4700 20 OSD::op_tp worker waiting -4593> 2014-05-19 10:47:00.771081 7f555b1b1700 20 OSD::op_tp worker waiting -4592> 2014-05-19 10:47:00.771106 7f55569a8700 20 OSD::op_tp worker waiting -4591> 2014-05-19 10:47:00.771892 7f55581ab700 20 OSD::op_tp worker waiting -4590> 2014-05-19 10:47:00.771916 7f55571a9700 20 OSD::op_tp worker waiting -4589> 2014-05-19 10:47:00.771977 7f55531a1700 20 OSD::op_tp worker waiting -4588> 2014-05-19 10:47:00.772005 7f555219f700 20 OSD::op_tp worker waiting -4587> 2014-05-19 10:47:00.772023 7f55539a2700 20 OSD::op_tp worker waiting -4586> 2014-05-19 10:47:00.772057 7f55599ae700 20 OSD::op_tp worker waiting -4585> 2014-05-19 10:47:00.772072 7f55529a0700 20 OSD::op_tp worker waiting -4584> 2014-05-19 10:47:00.772087 7f55561a7700 20 OSD::op_tp worker waiting -4583> 2014-05-19 10:47:00.772103 7f55591ad700 20 OSD::op_tp worker waiting -4582> 2014-05-19 10:47:00.772181 7f55559a6700 20 OSD::op_tp worker waiting -4581> 2014-05-19 10:47:00.772211 7f555199e700 20 OSD::op_tp worker waiting -4580> 2014-05-19 10:47:00.849211 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:03.455950) v2 ==== 47+0+0 (2891165914 0 0) 0x9ad3340 con 0x996e000 -4579> 2014-05-19 10:47:00.849263 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:03.455950) v2 -- ?+0 0xac14700 con 0x996e000 -4578> 2014-05-19 10:47:00.849234 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:03.455950) v2 ==== 47+0+0 (2891165914 0 0) 0xa1ef500 con 0x9a0c9a0 -4577> 2014-05-19 10:47:00.849297 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -4576> 2014-05-19 10:47:00.849376 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:03.455950) v2 -- ?+0 0xa0ea000 con 0x9a0c9a0 -4575> 2014-05-19 10:47:00.849459 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -4574> 2014-05-19 10:47:00.868783 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:03.475528) v2 ==== 47+0+0 (3440050544 0 0) 0xac1b6c0 con 0x9656000 -4573> 2014-05-19 10:47:00.868805 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:03.475528) v2 ==== 47+0+0 (3440050544 0 0) 0xac32fc0 con 0x9937760 -4572> 2014-05-19 10:47:00.868833 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:03.475528) v2 -- ?+0 0x9ad3340 con 0x9656000 -4571> 2014-05-19 10:47:00.868865 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -4570> 2014-05-19 10:47:00.868923 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:03.475528) v2 -- ?+0 0xa1ef500 con 0x9937760 -4569> 2014-05-19 10:47:00.868959 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -4568> 2014-05-19 10:47:00.921308 7f5566602700 5 osd.0 245 tick -4567> 2014-05-19 10:47:00.921337 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -4566> 2014-05-19 10:47:00.921344 7f5566602700 10 osd.0 245 do_waiters -- start -4565> 2014-05-19 10:47:00.921349 7f5566602700 10 osd.0 245 do_waiters -- finish -4564> 2014-05-19 10:47:00.921374 7f555119d700 20 OSD::recovery_tp worker waiting -4563> 2014-05-19 10:47:01.111158 7f5564dff700 20 KeyValueStore::op_tp worker waiting -4562> 2014-05-19 10:47:01.111592 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:03.718335) v2 ==== 47+0+0 (3929213002 0 0) 0xa0eafc0 con 0x9657080 -4561> 2014-05-19 10:47:01.111613 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:03.718335) v2 ==== 47+0+0 (3929213002 0 0) 0x9c08380 con 0x96562c0 -4560> 2014-05-19 10:47:01.111646 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:03.718335) v2 -- ?+0 0xac32fc0 con 0x9657080 -4559> 2014-05-19 10:47:01.111689 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -4558> 2014-05-19 10:47:01.111835 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:03.718335) v2 -- ?+0 0xac1b6c0 con 0x96562c0 -4557> 2014-05-19 10:47:01.112194 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -4556> 2014-05-19 10:47:01.143728 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:03.750482) v2 ==== 47+0+0 (2860146591 0 0) 0xac17340 con 0x9b8c160 -4555> 2014-05-19 10:47:01.143805 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:03.750482) v2 -- ?+0 0x9c08380 con 0x9b8c160 -4554> 2014-05-19 10:47:01.143748 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:03.750482) v2 ==== 47+0+0 (2860146591 0 0) 0xac08a80 con 0x9aa3600 -4553> 2014-05-19 10:47:01.143834 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -4552> 2014-05-19 10:47:01.144121 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:03.750482) v2 -- ?+0 0xa0eafc0 con 0x9aa3600 -4551> 2014-05-19 10:47:01.144172 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -4550> 2014-05-19 10:47:01.145805 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:03.752583) v2 ==== 47+0+0 (3945310216 0 0) 0x9e11500 con 0x96571e0 -4549> 2014-05-19 10:47:01.145854 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:03.752583) v2 -- ?+0 0xac08a80 con 0x96571e0 -4548> 2014-05-19 10:47:01.146065 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -4547> 2014-05-19 10:47:01.145848 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:03.752583) v2 ==== 47+0+0 (3945310216 0 0) 0xac36380 con 0x9656420 -4546> 2014-05-19 10:47:01.146105 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:03.752583) v2 -- ?+0 0xac17340 con 0x9656420 -4545> 2014-05-19 10:47:01.146137 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -4544> 2014-05-19 10:47:01.370418 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:03.977183) v2 ==== 47+0+0 (2973895208 0 0) 0xac1b880 con 0x9656000 -4543> 2014-05-19 10:47:01.370479 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:03.977183) v2 -- ?+0 0xac36380 con 0x9656000 -4542> 2014-05-19 10:47:01.370509 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -4541> 2014-05-19 10:47:01.370418 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:03.977183) v2 ==== 47+0+0 (2973895208 0 0) 0xa264c40 con 0x9937760 -4540> 2014-05-19 10:47:01.370590 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:03.977183) v2 -- ?+0 0x9e11500 con 0x9937760 -4539> 2014-05-19 10:47:01.370668 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -4538> 2014-05-19 10:47:01.450133 7f555019b700 20 OSD::command_tp worker waiting -4537> 2014-05-19 10:47:01.453352 7f555099c700 20 OSD::disk_tp worker waiting -4536> 2014-05-19 10:47:01.567783 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:04.174512) v2 ==== 47+0+0 (2931252686 0 0) 0xa23fdc0 con 0x9656f20 -4535> 2014-05-19 10:47:01.567842 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.174512) v2 -- ?+0 0xa264c40 con 0x9656f20 -4534> 2014-05-19 10:47:01.567947 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -4533> 2014-05-19 10:47:01.567759 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:04.174512) v2 ==== 47+0+0 (2931252686 0 0) 0x9c08e00 con 0x9656160 -4532> 2014-05-19 10:47:01.568095 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.174512) v2 -- ?+0 0xac1b880 con 0x9656160 -4531> 2014-05-19 10:47:01.568130 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -4530> 2014-05-19 10:47:01.665464 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:05.610689) v2 ==== 47+0+0 (1392472092 0 0) 0x9fd8c40 con 0x99718c0 -4529> 2014-05-19 10:47:01.665639 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.610689) v2 -- ?+0 0x9c08e00 con 0x99718c0 -4528> 2014-05-19 10:47:01.665485 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:05.610689) v2 ==== 47+0+0 (1392472092 0 0) 0x9faa8c0 con 0x97431e0 -4527> 2014-05-19 10:47:01.666012 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -4526> 2014-05-19 10:47:01.666086 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.610689) v2 -- ?+0 0xa23fdc0 con 0x97431e0 -4525> 2014-05-19 10:47:01.666130 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -4524> 2014-05-19 10:47:01.897079 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:01.896890) v2 ==== 47+0+0 (2287368138 0 0) 0xac08700 con 0x9656580 -4523> 2014-05-19 10:47:01.897085 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:01.896890) v2 ==== 47+0+0 (2287368138 0 0) 0xa0b6c40 con 0x9657340 -4522> 2014-05-19 10:47:01.897150 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:01.896890) v2 -- ?+0 0x9fd8c40 con 0x9656580 -4521> 2014-05-19 10:47:01.897185 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -4520> 2014-05-19 10:47:01.897249 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:01.896890) v2 -- ?+0 0x9faa8c0 con 0x9657340 -4519> 2014-05-19 10:47:01.897284 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -4518> 2014-05-19 10:47:01.921418 7f5566602700 5 osd.0 245 tick -4517> 2014-05-19 10:47:01.921439 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -4516> 2014-05-19 10:47:01.921444 7f5566602700 10 osd.0 245 do_waiters -- start -4515> 2014-05-19 10:47:01.921446 7f5566602700 10 osd.0 245 do_waiters -- finish -4514> 2014-05-19 10:47:01.921445 7f555119d700 20 OSD::recovery_tp worker waiting -4513> 2014-05-19 10:47:02.112304 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:04.719049) v2 ==== 47+0+0 (1472940348 0 0) 0xa8656c0 con 0x9a0cdc0 -4512> 2014-05-19 10:47:02.112342 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:04.719049) v2 ==== 47+0+0 (1472940348 0 0) 0xac30540 con 0x996fb80 -4511> 2014-05-19 10:47:02.112354 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.719049) v2 -- ?+0 0xa0b6c40 con 0x9a0cdc0 -4510> 2014-05-19 10:47:02.112890 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -4509> 2014-05-19 10:47:02.112918 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.719049) v2 -- ?+0 0xac08700 con 0x996fb80 -4508> 2014-05-19 10:47:02.112963 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -4507> 2014-05-19 10:47:02.500217 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:06.445414) v2 ==== 47+0+0 (1131805662 0 0) 0xa664fc0 con 0x9bb69a0 -4506> 2014-05-19 10:47:02.500263 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:06.445414) v2 -- ?+0 0xac30540 con 0x9bb69a0 -4505> 2014-05-19 10:47:02.500344 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -4504> 2014-05-19 10:47:02.500331 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:06.445414) v2 ==== 47+0+0 (1131805662 0 0) 0xa1dfdc0 con 0x94e3e40 -4503> 2014-05-19 10:47:02.500368 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:06.445414) v2 -- ?+0 0xa8656c0 con 0x94e3e40 -4502> 2014-05-19 10:47:02.500483 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -4501> 2014-05-19 10:47:02.527799 7f5565600700 20 KeyValueStore::op_tp worker waiting -4500> 2014-05-19 10:47:02.550742 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:05.157506) v2 ==== 47+0+0 (2314632189 0 0) 0x9ad2700 con 0x996e000 -4499> 2014-05-19 10:47:02.550735 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:05.157506) v2 ==== 47+0+0 (2314632189 0 0) 0xa1ef6c0 con 0x9a0c9a0 -4498> 2014-05-19 10:47:02.550796 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.157506) v2 -- ?+0 0xa664fc0 con 0x996e000 -4497> 2014-05-19 10:47:02.550912 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -4496> 2014-05-19 10:47:02.551229 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.157506) v2 -- ?+0 0xa1dfdc0 con 0x9a0c9a0 -4495> 2014-05-19 10:47:02.551314 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -4494> 2014-05-19 10:47:02.613802 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:05.220556) v2 ==== 47+0+0 (2638059663 0 0) 0xac16e00 con 0x9a0cdc0 -4493> 2014-05-19 10:47:02.613851 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.220556) v2 -- ?+0 0xa1ef6c0 con 0x9a0cdc0 -4492> 2014-05-19 10:47:02.613883 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -4491> 2014-05-19 10:47:02.613899 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:05.220556) v2 ==== 47+0+0 (2638059663 0 0) 0xac30380 con 0x996fb80 -4490> 2014-05-19 10:47:02.614444 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.220556) v2 -- ?+0 0x9ad2700 con 0x996fb80 -4489> 2014-05-19 10:47:02.614481 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -4488> 2014-05-19 10:47:02.669580 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:06.614855) v2 ==== 47+0+0 (1458195229 0 0) 0xa5fdc00 con 0x97434a0 -4487> 2014-05-19 10:47:02.669631 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:06.614855) v2 -- ?+0 0xac16e00 con 0x97434a0 -4486> 2014-05-19 10:47:02.669973 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -4485> 2014-05-19 10:47:02.670152 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:06.614855) v2 ==== 47+0+0 (1458195229 0 0) 0xa0ea000 con 0x9970840 -4484> 2014-05-19 10:47:02.670196 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:06.614855) v2 -- ?+0 0xac30380 con 0x9970840 -4483> 2014-05-19 10:47:02.670228 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -4482> 2014-05-19 10:47:02.769443 7f55579aa700 20 OSD::op_tp worker waiting -4481> 2014-05-19 10:47:02.769466 7f555a1af700 20 OSD::op_tp worker waiting -4480> 2014-05-19 10:47:02.769504 7f55551a5700 20 OSD::op_tp worker waiting -4479> 2014-05-19 10:47:02.771038 7f55589ac700 20 OSD::op_tp worker waiting -4478> 2014-05-19 10:47:02.771060 7f55541a3700 20 OSD::op_tp worker waiting -4477> 2014-05-19 10:47:02.771084 7f555a9b0700 20 OSD::op_tp worker waiting -4476> 2014-05-19 10:47:02.771107 7f55549a4700 20 OSD::op_tp worker waiting -4475> 2014-05-19 10:47:02.771158 7f555b1b1700 20 OSD::op_tp worker waiting -4474> 2014-05-19 10:47:02.771181 7f55569a8700 20 OSD::op_tp worker waiting -4473> 2014-05-19 10:47:02.771975 7f55581ab700 20 OSD::op_tp worker waiting -4472> 2014-05-19 10:47:02.772006 7f55571a9700 20 OSD::op_tp worker waiting -4471> 2014-05-19 10:47:02.772074 7f555219f700 20 OSD::op_tp worker waiting -4470> 2014-05-19 10:47:02.772102 7f55531a1700 20 OSD::op_tp worker waiting -4469> 2014-05-19 10:47:02.772120 7f55539a2700 20 OSD::op_tp worker waiting -4468> 2014-05-19 10:47:02.772145 7f55599ae700 20 OSD::op_tp worker waiting -4467> 2014-05-19 10:47:02.772152 7f55529a0700 20 OSD::op_tp worker waiting -4466> 2014-05-19 10:47:02.772168 7f55561a7700 20 OSD::op_tp worker waiting -4465> 2014-05-19 10:47:02.772202 7f55591ad700 20 OSD::op_tp worker waiting -4464> 2014-05-19 10:47:02.772256 7f55559a6700 20 OSD::op_tp worker waiting -4463> 2014-05-19 10:47:02.772275 7f555199e700 20 OSD::op_tp worker waiting -4462> 2014-05-19 10:47:02.813097 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:05.419874) v2 ==== 47+0+0 (3159843415 0 0) 0x9c08a80 con 0x96562c0 -4461> 2014-05-19 10:47:02.813164 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.419874) v2 -- ?+0 0xa0ea000 con 0x96562c0 -4460> 2014-05-19 10:47:02.813202 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -4459> 2014-05-19 10:47:02.813556 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:05.419874) v2 ==== 47+0+0 (3159843415 0 0) 0xa0eae00 con 0x9657080 -4458> 2014-05-19 10:47:02.813593 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.419874) v2 -- ?+0 0xa5fdc00 con 0x9657080 -4457> 2014-05-19 10:47:02.813623 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -4456> 2014-05-19 10:47:02.921535 7f5566602700 5 osd.0 245 tick -4455> 2014-05-19 10:47:02.921555 7f5566602700 7 osd.0 245 do_mon_report -4454> 2014-05-19 10:47:02.921559 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 -4453> 2014-05-19 10:47:02.921562 7f5566602700 20 osd.0 245 send_pg_stats -4452> 2014-05-19 10:47:02.921573 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -4451> 2014-05-19 10:47:02.921577 7f5566602700 10 osd.0 245 do_waiters -- start -4450> 2014-05-19 10:47:02.921579 7f5566602700 10 osd.0 245 do_waiters -- finish -4449> 2014-05-19 10:47:02.921612 7f555119d700 20 OSD::recovery_tp worker waiting -4448> 2014-05-19 10:47:02.979618 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:06.924901) v2 ==== 47+0+0 (1317599881 0 0) 0xa2bd180 con 0x99d3340 -4447> 2014-05-19 10:47:02.979675 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:06.924901) v2 -- ?+0 0x9c08a80 con 0x99d3340 -4446> 2014-05-19 10:47:02.979783 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -4445> 2014-05-19 10:47:02.980112 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:06.924901) v2 ==== 47+0+0 (1317599881 0 0) 0xa0cb6c0 con 0x94a5a20 -4444> 2014-05-19 10:47:02.980157 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:06.924901) v2 -- ?+0 0xa0eae00 con 0x94a5a20 -4443> 2014-05-19 10:47:02.980239 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -4442> 2014-05-19 10:47:03.019261 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:05.626025) v2 ==== 47+0+0 (3795560521 0 0) 0xac28c40 con 0x9b8db80 -4441> 2014-05-19 10:47:03.019271 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:05.626025) v2 ==== 47+0+0 (3795560521 0 0) 0xa664540 con 0x7b90160 -4440> 2014-05-19 10:47:03.019312 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.626025) v2 -- ?+0 0xa2bd180 con 0x9b8db80 -4439> 2014-05-19 10:47:03.019367 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -4438> 2014-05-19 10:47:03.019495 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.626025) v2 -- ?+0 0xa0cb6c0 con 0x7b90160 -4437> 2014-05-19 10:47:03.019534 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -4436> 2014-05-19 10:47:03.025749 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:06.970990) v2 ==== 47+0+0 (3206845611 0 0) 0x9ad2c40 con 0x94802c0 -4435> 2014-05-19 10:47:03.025800 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:06.970990) v2 -- ?+0 0xa664540 con 0x94802c0 -4434> 2014-05-19 10:47:03.025881 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 44 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:06.970990) v2 ==== 47+0+0 (3206845611 0 0) 0x9c0e380 con 0x987b760 -4433> 2014-05-19 10:47:03.025914 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -4432> 2014-05-19 10:47:03.025983 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:06.970990) v2 -- ?+0 0xac28c40 con 0x987b760 -4431> 2014-05-19 10:47:03.026158 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -4430> 2014-05-19 10:47:03.111241 7f5564dff700 20 KeyValueStore::op_tp worker waiting -4429> 2014-05-19 10:47:03.311251 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:07.256516) v2 ==== 47+0+0 (1327583753 0 0) 0xa05ee00 con 0x9743600 -4428> 2014-05-19 10:47:03.311318 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:07.256516) v2 ==== 47+0+0 (1327583753 0 0) 0xa4a8c40 con 0x966e000 -4427> 2014-05-19 10:47:03.311630 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:07.256516) v2 -- ?+0 0x9ad2c40 con 0x9743600 -4426> 2014-05-19 10:47:03.311707 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -4425> 2014-05-19 10:47:03.311732 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:07.256516) v2 -- ?+0 0x9c0e380 con 0x966e000 -4424> 2014-05-19 10:47:03.311768 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -4423> 2014-05-19 10:47:03.450221 7f555019b700 20 OSD::command_tp worker waiting -4422> 2014-05-19 10:47:03.452154 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:06.058901) v2 ==== 47+0+0 (2658214744 0 0) 0xa8576c0 con 0x9983600 -4421> 2014-05-19 10:47:03.452157 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:06.058901) v2 ==== 47+0+0 (2658214744 0 0) 0xa36c1c0 con 0x95846e0 -4420> 2014-05-19 10:47:03.452210 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:06.058901) v2 -- ?+0 0xa05ee00 con 0x9983600 -4419> 2014-05-19 10:47:03.452794 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -4418> 2014-05-19 10:47:03.452844 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:06.058901) v2 -- ?+0 0xa4a8c40 con 0x95846e0 -4417> 2014-05-19 10:47:03.452888 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -4416> 2014-05-19 10:47:03.453432 7f555099c700 20 OSD::disk_tp worker waiting -4415> 2014-05-19 10:47:03.715338 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:06.322101) v2 ==== 47+0+0 (1187936614 0 0) 0xac301c0 con 0x996fb80 -4414> 2014-05-19 10:47:03.715357 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:06.322101) v2 ==== 47+0+0 (1187936614 0 0) 0xac09340 con 0x9a0cdc0 -4413> 2014-05-19 10:47:03.715393 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:06.322101) v2 -- ?+0 0xa36c1c0 con 0x996fb80 -4412> 2014-05-19 10:47:03.715456 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -4411> 2014-05-19 10:47:03.715484 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:06.322101) v2 -- ?+0 0xa8576c0 con 0x9a0cdc0 -4410> 2014-05-19 10:47:03.715516 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -4409> 2014-05-19 10:47:03.771139 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:07.716443) v2 ==== 47+0+0 (868687803 0 0) 0xa5fca80 con 0x97434a0 -4408> 2014-05-19 10:47:03.771169 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:07.716443) v2 ==== 47+0+0 (868687803 0 0) 0xa665340 con 0x9970840 -4407> 2014-05-19 10:47:03.771189 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:07.716443) v2 -- ?+0 0xac09340 con 0x97434a0 -4406> 2014-05-19 10:47:03.771271 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -4405> 2014-05-19 10:47:03.771338 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:07.716443) v2 -- ?+0 0xac301c0 con 0x9970840 -4404> 2014-05-19 10:47:03.771423 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -4403> 2014-05-19 10:47:03.921668 7f5566602700 5 osd.0 245 tick -4402> 2014-05-19 10:47:03.921723 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.8 >= max 0.5 = no, load too high -4401> 2014-05-19 10:47:03.921736 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -4400> 2014-05-19 10:47:03.921738 7f555119d700 20 OSD::recovery_tp worker waiting -4399> 2014-05-19 10:47:03.921740 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2244.46 < min (86400 seconds) -4398> 2014-05-19 10:47:03.921759 7f5566602700 20 osd.0 245 sched_scrub done -4397> 2014-05-19 10:47:03.921762 7f5566602700 10 osd.0 245 do_waiters -- start -4396> 2014-05-19 10:47:03.921763 7f5566602700 10 osd.0 245 do_waiters -- finish -4395> 2014-05-19 10:47:04.527885 7f5565600700 20 KeyValueStore::op_tp worker waiting -4394> 2014-05-19 10:47:04.566715 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:08.512057) v2 ==== 47+0+0 (545281056 0 0) 0x9c6ec40 con 0x99718c0 -4393> 2014-05-19 10:47:04.566769 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.512057) v2 -- ?+0 0xa665340 con 0x99718c0 -4392> 2014-05-19 10:47:04.566800 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -4391> 2014-05-19 10:47:04.566714 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:08.512057) v2 ==== 47+0+0 (545281056 0 0) 0xa05f340 con 0x97431e0 -4390> 2014-05-19 10:47:04.566815 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.512057) v2 -- ?+0 0xa5fca80 con 0x97431e0 -4389> 2014-05-19 10:47:04.566840 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -4388> 2014-05-19 10:47:04.655994 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:07.262827) v2 ==== 47+0+0 (1218814615 0 0) 0x9c0d180 con 0x9b8de40 -4387> 2014-05-19 10:47:04.656049 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:07.262827) v2 -- ?+0 0x9c6ec40 con 0x9b8de40 -4386> 2014-05-19 10:47:04.656133 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -4385> 2014-05-19 10:47:04.655992 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:07.262827) v2 ==== 47+0+0 (1218814615 0 0) 0x9ebbc00 con 0x94e2160 -4384> 2014-05-19 10:47:04.656148 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:07.262827) v2 -- ?+0 0xa05f340 con 0x94e2160 -4383> 2014-05-19 10:47:04.656211 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -4382> 2014-05-19 10:47:04.769526 7f55579aa700 20 OSD::op_tp worker waiting -4381> 2014-05-19 10:47:04.769552 7f555a1af700 20 OSD::op_tp worker waiting -4380> 2014-05-19 10:47:04.769575 7f55551a5700 20 OSD::op_tp worker waiting -4379> 2014-05-19 10:47:04.771139 7f55541a3700 20 OSD::op_tp worker waiting -4378> 2014-05-19 10:47:04.771162 7f555a9b0700 20 OSD::op_tp worker waiting -4377> 2014-05-19 10:47:04.771183 7f55549a4700 20 OSD::op_tp worker waiting -4376> 2014-05-19 10:47:04.771207 7f55589ac700 20 OSD::op_tp worker waiting -4375> 2014-05-19 10:47:04.771233 7f555b1b1700 20 OSD::op_tp worker waiting -4374> 2014-05-19 10:47:04.771247 7f55569a8700 20 OSD::op_tp worker waiting -4373> 2014-05-19 10:47:04.772051 7f55581ab700 20 OSD::op_tp worker waiting -4372> 2014-05-19 10:47:04.772087 7f55571a9700 20 OSD::op_tp worker waiting -4371> 2014-05-19 10:47:04.772151 7f555219f700 20 OSD::op_tp worker waiting -4370> 2014-05-19 10:47:04.772176 7f55529a0700 20 OSD::op_tp worker waiting -4369> 2014-05-19 10:47:04.772184 7f55531a1700 20 OSD::op_tp worker waiting -4368> 2014-05-19 10:47:04.772205 7f55599ae700 20 OSD::op_tp worker waiting -4367> 2014-05-19 10:47:04.772228 7f55539a2700 20 OSD::op_tp worker waiting -4366> 2014-05-19 10:47:04.772255 7f55561a7700 20 OSD::op_tp worker waiting -4365> 2014-05-19 10:47:04.772269 7f55591ad700 20 OSD::op_tp worker waiting -4364> 2014-05-19 10:47:04.772330 7f55559a6700 20 OSD::op_tp worker waiting -4363> 2014-05-19 10:47:04.772345 7f555199e700 20 OSD::op_tp worker waiting -4362> 2014-05-19 10:47:04.852153 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:07.458961) v2 ==== 47+0+0 (371539721 0 0) 0x9ad36c0 con 0x996e000 -4361> 2014-05-19 10:47:04.852179 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:07.458961) v2 ==== 47+0+0 (371539721 0 0) 0x9d0bc00 con 0x9a0c9a0 -4360> 2014-05-19 10:47:04.852206 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:07.458961) v2 -- ?+0 0x9c0d180 con 0x996e000 -4359> 2014-05-19 10:47:04.852255 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -4358> 2014-05-19 10:47:04.852371 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:07.458961) v2 -- ?+0 0x9ebbc00 con 0x9a0c9a0 -4357> 2014-05-19 10:47:04.852454 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -4356> 2014-05-19 10:47:04.858751 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -4355> 2014-05-19 10:47:04.858772 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -4354> 2014-05-19 10:47:04.858780 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xa115a40 con 0x9bdc840 -4353> 2014-05-19 10:47:04.858806 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xa237500 con 0x9ad4420 -4352> 2014-05-19 10:47:04.858845 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0x9ad2e00 con 0x9bf31e0 -4351> 2014-05-19 10:47:04.858861 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xa816a80 con 0x998b340 -4350> 2014-05-19 10:47:04.858897 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0x951c380 con 0x9b92840 -4349> 2014-05-19 10:47:04.858927 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xa872380 con 0x9ad49a0 -4348> 2014-05-19 10:47:04.858954 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xa103880 con 0x7b911e0 -4347> 2014-05-19 10:47:04.858980 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0x94256c0 con 0x7b918c0 -4346> 2014-05-19 10:47:04.859009 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xa173880 con 0x9aa8c60 -4345> 2014-05-19 10:47:04.859060 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xac31340 con 0x9bfa000 -4344> 2014-05-19 10:47:04.859084 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0x9c0f880 con 0x7c23e40 -4343> 2014-05-19 10:47:04.859116 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xa873880 con 0x998b760 -4342> 2014-05-19 10:47:04.859148 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0x948fc00 con 0x7b91080 -4341> 2014-05-19 10:47:04.859145 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xa6d4380 con 0x9bdc840 -4340> 2014-05-19 10:47:04.859182 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xa517a40 con 0xa28fb80 -4339> 2014-05-19 10:47:04.859208 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xa872000 con 0x76bdce0 -4338> 2014-05-19 10:47:04.859225 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xa1e4540 con 0x994ab00 -4337> 2014-05-19 10:47:04.859254 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0x95c0380 con 0x9ac8b00 -4336> 2014-05-19 10:47:04.859284 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xac2ae00 con 0x938de40 -4335> 2014-05-19 10:47:04.859335 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xac2bdc0 con 0x9970b00 -4334> 2014-05-19 10:47:04.859358 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xac37dc0 con 0x99706e0 -4333> 2014-05-19 10:47:04.859385 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xa0b7880 con 0x9bb6f20 -4332> 2014-05-19 10:47:04.859411 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xa74ac40 con 0x994b340 -4331> 2014-05-19 10:47:04.859440 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0x9b51dc0 con 0x98fa2c0 -4330> 2014-05-19 10:47:04.859465 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xa173a40 con 0x996f8c0 -4329> 2014-05-19 10:47:04.859492 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0x9ad28c0 con 0x996fa20 -4328> 2014-05-19 10:47:04.859520 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0x9f74fc0 con 0x9ac8160 -4327> 2014-05-19 10:47:04.859546 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xa617340 con 0x7b90420 -4326> 2014-05-19 10:47:04.859560 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xa2df180 con 0x919fe40 -4325> 2014-05-19 10:47:04.859574 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xa3dac40 con 0x9971760 -4324> 2014-05-19 10:47:04.859600 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xa0bce00 con 0x994af20 -4323> 2014-05-19 10:47:04.859624 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xa0eb340 con 0x989be40 -4322> 2014-05-19 10:47:04.859641 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xac37340 con 0x9adf4a0 -4321> 2014-05-19 10:47:04.859663 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xa103500 con 0x9776160 -4320> 2014-05-19 10:47:04.859681 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0x951c1c0 con 0x96bd8c0 -4319> 2014-05-19 10:47:04.859713 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xa266700 con 0x96bcdc0 -4318> 2014-05-19 10:47:04.859745 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xac32380 con 0x96954a0 -4317> 2014-05-19 10:47:04.859799 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0x9b44c40 con 0x76bd8c0 -4316> 2014-05-19 10:47:04.859843 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0x99e1c00 con 0x7b90dc0 -4315> 2014-05-19 10:47:04.859872 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0x9c6e380 con 0x978d8c0 -4314> 2014-05-19 10:47:04.859904 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0x9cb6e00 con 0x978c580 -4313> 2014-05-19 10:47:04.859935 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xac29c00 con 0x978d340 -4312> 2014-05-19 10:47:04.859959 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:04.858779) v2 -- ?+0 0xa8736c0 con 0x96374a0 -4311> 2014-05-19 10:47:04.860044 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -4310> 2014-05-19 10:47:04.860069 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0x9d448c0 con 0x9ad4420 -4309> 2014-05-19 10:47:04.860097 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -4308> 2014-05-19 10:47:04.860104 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xac36c40 con 0x9bf31e0 -4307> 2014-05-19 10:47:04.860121 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -4306> 2014-05-19 10:47:04.860126 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xa0ea8c0 con 0x998b340 -4305> 2014-05-19 10:47:04.860140 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -4304> 2014-05-19 10:47:04.860149 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xa0bd500 con 0x9b92840 -4303> 2014-05-19 10:47:04.860178 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -4302> 2014-05-19 10:47:04.860189 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xa092fc0 con 0x9ad49a0 -4301> 2014-05-19 10:47:04.860216 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -4300> 2014-05-19 10:47:04.860256 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0x9ed1dc0 con 0x7b911e0 -4299> 2014-05-19 10:47:04.860287 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -4298> 2014-05-19 10:47:04.860299 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xa45e1c0 con 0x7b918c0 -4297> 2014-05-19 10:47:04.860327 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -4296> 2014-05-19 10:47:04.860338 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0x9ba4a80 con 0x9aa8c60 -4295> 2014-05-19 10:47:04.860385 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -4294> 2014-05-19 10:47:04.860397 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xac09dc0 con 0x9bfa000 -4293> 2014-05-19 10:47:04.860415 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -4292> 2014-05-19 10:47:04.860431 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xa872e00 con 0x7c23e40 -4291> 2014-05-19 10:47:04.860465 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -4290> 2014-05-19 10:47:04.860477 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0x9123c00 con 0x998b760 -4289> 2014-05-19 10:47:04.860495 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -4288> 2014-05-19 10:47:04.860503 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xa74bdc0 con 0x7b91080 -4287> 2014-05-19 10:47:04.860519 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -4286> 2014-05-19 10:47:04.860527 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0x9f20fc0 con 0xa28fb80 -4285> 2014-05-19 10:47:04.860544 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -4284> 2014-05-19 10:47:04.860563 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xac37c00 con 0x76bdce0 -4283> 2014-05-19 10:47:04.860581 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -4282> 2014-05-19 10:47:04.860588 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0x9ba4c40 con 0x994ab00 -4281> 2014-05-19 10:47:04.860603 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -4280> 2014-05-19 10:47:04.860611 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xa23ee00 con 0x9ac8b00 -4279> 2014-05-19 10:47:04.860626 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -4278> 2014-05-19 10:47:04.860633 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0x9c6efc0 con 0x938de40 -4277> 2014-05-19 10:47:04.860647 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -4276> 2014-05-19 10:47:04.860654 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xac16000 con 0x9970b00 -4275> 2014-05-19 10:47:04.860669 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -4274> 2014-05-19 10:47:04.860676 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xa115a40 con 0x99706e0 -4273> 2014-05-19 10:47:04.860690 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -4272> 2014-05-19 10:47:04.860700 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xa7d5a40 con 0x9bb6f20 -4271> 2014-05-19 10:47:04.860717 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -4270> 2014-05-19 10:47:04.860724 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0x9c0fdc0 con 0x994b340 -4269> 2014-05-19 10:47:04.860738 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -4268> 2014-05-19 10:47:04.860748 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xac1bc00 con 0x98fa2c0 -4267> 2014-05-19 10:47:04.860765 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -4266> 2014-05-19 10:47:04.860772 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0x9236e00 con 0x996f8c0 -4265> 2014-05-19 10:47:04.860786 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -4264> 2014-05-19 10:47:04.860793 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xa0dd880 con 0x996fa20 -4263> 2014-05-19 10:47:04.860807 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -4262> 2014-05-19 10:47:04.860824 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xa4ffdc0 con 0x9ac8160 -4261> 2014-05-19 10:47:04.860842 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -4260> 2014-05-19 10:47:04.860849 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xa4d0fc0 con 0x7b90420 -4259> 2014-05-19 10:47:04.860864 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -4258> 2014-05-19 10:47:04.860872 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xa4a88c0 con 0x919fe40 -4257> 2014-05-19 10:47:04.860886 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -4256> 2014-05-19 10:47:04.860893 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0x9d3c380 con 0x9971760 -4255> 2014-05-19 10:47:04.860908 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -4254> 2014-05-19 10:47:04.860915 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xa8648c0 con 0x994af20 -4253> 2014-05-19 10:47:04.860930 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -4252> 2014-05-19 10:47:04.860939 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0x9bcea80 con 0x989be40 -4251> 2014-05-19 10:47:04.860956 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -4250> 2014-05-19 10:47:04.860963 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0x9e9f6c0 con 0x9adf4a0 -4249> 2014-05-19 10:47:04.860977 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -4248> 2014-05-19 10:47:04.860984 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0x9fa8380 con 0x9776160 -4247> 2014-05-19 10:47:04.860998 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -4246> 2014-05-19 10:47:04.861005 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xa5161c0 con 0x96bd8c0 -4245> 2014-05-19 10:47:04.861019 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -4244> 2014-05-19 10:47:04.861026 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xac16380 con 0x96bcdc0 -4243> 2014-05-19 10:47:04.861041 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -4242> 2014-05-19 10:47:04.861048 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xa74ba40 con 0x96954a0 -4241> 2014-05-19 10:47:04.861062 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -4240> 2014-05-19 10:47:04.861071 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xa103c00 con 0x76bd8c0 -4239> 2014-05-19 10:47:04.861088 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -4238> 2014-05-19 10:47:04.861095 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xa74aa80 con 0x7b90dc0 -4237> 2014-05-19 10:47:04.861122 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -4236> 2014-05-19 10:47:04.861133 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xa857a40 con 0x978d8c0 -4235> 2014-05-19 10:47:04.861150 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -4234> 2014-05-19 10:47:04.861157 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xac2a540 con 0x978c580 -4233> 2014-05-19 10:47:04.861171 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -4232> 2014-05-19 10:47:04.861178 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xac32000 con 0x978d340 -4231> 2014-05-19 10:47:04.861192 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -4230> 2014-05-19 10:47:04.861203 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 45 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:04.858779) v2 ==== 47+0+0 (894376094 0 0) 0xac33500 con 0x96374a0 -4229> 2014-05-19 10:47:04.861220 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -4228> 2014-05-19 10:47:04.921854 7f5566602700 5 osd.0 245 tick -4227> 2014-05-19 10:47:04.921907 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.8 >= max 0.5 = no, load too high -4226> 2014-05-19 10:47:04.921923 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -4225> 2014-05-19 10:47:04.921923 7f555119d700 20 OSD::recovery_tp worker waiting -4224> 2014-05-19 10:47:04.921926 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2245.46 < min (86400 seconds) -4223> 2014-05-19 10:47:04.921945 7f5566602700 20 osd.0 245 sched_scrub done -4222> 2014-05-19 10:47:04.921948 7f5566602700 10 osd.0 245 do_waiters -- start -4221> 2014-05-19 10:47:04.921950 7f5566602700 10 osd.0 245 do_waiters -- finish -4220> 2014-05-19 10:47:05.069241 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:07.675950) v2 ==== 47+0+0 (2361122194 0 0) 0xa23e1c0 con 0x9656f20 -4219> 2014-05-19 10:47:05.069292 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:07.675950) v2 -- ?+0 0x9d0bc00 con 0x9656f20 -4218> 2014-05-19 10:47:05.069373 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -4217> 2014-05-19 10:47:05.069706 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:07.675950) v2 ==== 47+0+0 (2361122194 0 0) 0x9c08540 con 0x9656160 -4216> 2014-05-19 10:47:05.069745 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:07.675950) v2 -- ?+0 0x9ad36c0 con 0x9656160 -4215> 2014-05-19 10:47:05.069778 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -4214> 2014-05-19 10:47:05.111325 7f5564dff700 20 KeyValueStore::op_tp worker waiting -4213> 2014-05-19 10:47:05.153726 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:07.760510) v2 ==== 47+0+0 (1162633311 0 0) 0xa36ce00 con 0x95846e0 -4212> 2014-05-19 10:47:05.153791 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:07.760510) v2 ==== 47+0+0 (1162633311 0 0) 0xa856e00 con 0x9983600 -4211> 2014-05-19 10:47:05.153799 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:07.760510) v2 -- ?+0 0x9c08540 con 0x95846e0 -4210> 2014-05-19 10:47:05.153942 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -4209> 2014-05-19 10:47:05.154117 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:07.760510) v2 -- ?+0 0xa23e1c0 con 0x9983600 -4208> 2014-05-19 10:47:05.154196 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -4207> 2014-05-19 10:47:05.179432 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:09.124855) v2 ==== 47+0+0 (1856707791 0 0) 0xa4a9180 con 0x99d31e0 -4206> 2014-05-19 10:47:05.179478 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:09.124855) v2 -- ?+0 0xa36ce00 con 0x99d31e0 -4205> 2014-05-19 10:47:05.179548 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -4204> 2014-05-19 10:47:05.179477 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:09.124855) v2 ==== 47+0+0 (1856707791 0 0) 0xac22a80 con 0x95142c0 -4203> 2014-05-19 10:47:05.179585 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:09.124855) v2 -- ?+0 0xa856e00 con 0x95142c0 -4202> 2014-05-19 10:47:05.179660 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -4201> 2014-05-19 10:47:05.297512 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:09.242849) v2 ==== 47+0+0 (2117904071 0 0) 0xac40fc0 con 0x95151e0 -4200> 2014-05-19 10:47:05.297560 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:09.242849) v2 -- ?+0 0xac22a80 con 0x95151e0 -4199> 2014-05-19 10:47:05.297636 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -4198> 2014-05-19 10:47:05.297691 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:09.242849) v2 ==== 47+0+0 (2117904071 0 0) 0xac33180 con 0x9bb7b80 -4197> 2014-05-19 10:47:05.297728 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:09.242849) v2 -- ?+0 0xa4a9180 con 0x9bb7b80 -4196> 2014-05-19 10:47:05.297915 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -4195> 2014-05-19 10:47:05.353566 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:07.960339) v2 ==== 47+0+0 (2967358790 0 0) 0x96befc0 con 0x9a0c9a0 -4194> 2014-05-19 10:47:05.353616 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:07.960339) v2 -- ?+0 0xac40fc0 con 0x9a0c9a0 -4193> 2014-05-19 10:47:05.353647 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -4192> 2014-05-19 10:47:05.353623 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:07.960339) v2 ==== 47+0+0 (2967358790 0 0) 0xac41dc0 con 0x996e000 -4191> 2014-05-19 10:47:05.353666 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:07.960339) v2 -- ?+0 0xac33180 con 0x996e000 -4190> 2014-05-19 10:47:05.353724 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -4189> 2014-05-19 10:47:05.450318 7f555019b700 20 OSD::command_tp worker waiting -4188> 2014-05-19 10:47:05.453530 7f555099c700 20 OSD::disk_tp worker waiting -4187> 2014-05-19 10:47:05.922039 7f5566602700 5 osd.0 245 tick -4186> 2014-05-19 10:47:05.922064 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -4185> 2014-05-19 10:47:05.922069 7f5566602700 10 osd.0 245 do_waiters -- start -4184> 2014-05-19 10:47:05.922071 7f5566602700 10 osd.0 245 do_waiters -- finish -4183> 2014-05-19 10:47:05.922109 7f555119d700 20 OSD::recovery_tp worker waiting -4182> 2014-05-19 10:47:05.960104 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -4181> 2014-05-19 10:47:05.960125 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -4180> 2014-05-19 10:47:05.960134 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0x9f20fc0 con 0x9bdc840 -4179> 2014-05-19 10:47:05.960160 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xa74bdc0 con 0x9ad4420 -4178> 2014-05-19 10:47:05.960198 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0x9123c00 con 0x9bf31e0 -4177> 2014-05-19 10:47:05.960214 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xa872e00 con 0x998b340 -4176> 2014-05-19 10:47:05.960229 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xac09dc0 con 0x9b92840 -4175> 2014-05-19 10:47:05.960253 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0x9ba4a80 con 0x9ad49a0 -4174> 2014-05-19 10:47:05.960278 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xa45e1c0 con 0x7b911e0 -4173> 2014-05-19 10:47:05.960345 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0x9ed1dc0 con 0x7b918c0 -4172> 2014-05-19 10:47:05.960383 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xa092fc0 con 0x9aa8c60 -4171> 2014-05-19 10:47:05.960414 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xa0bd500 con 0x9bfa000 -4170> 2014-05-19 10:47:05.960440 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xa0ea8c0 con 0x7c23e40 -4169> 2014-05-19 10:47:05.960478 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xac36c40 con 0x998b760 -4168> 2014-05-19 10:47:05.960483 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xa6aafc0 con 0x9bdc840 -4167> 2014-05-19 10:47:05.960510 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0x9d448c0 con 0x7b91080 -4166> 2014-05-19 10:47:05.960538 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xa6d4380 con 0xa28fb80 -4165> 2014-05-19 10:47:05.960555 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xa266fc0 con 0x76bdce0 -4164> 2014-05-19 10:47:05.960571 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xac321c0 con 0x994ab00 -4163> 2014-05-19 10:47:05.960601 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0x9b45880 con 0x9ac8b00 -4162> 2014-05-19 10:47:05.960625 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0x99e01c0 con 0x938de40 -4161> 2014-05-19 10:47:05.960641 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0x9fb5a40 con 0x9970b00 -4160> 2014-05-19 10:47:05.960654 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xa28d180 con 0x99706e0 -4159> 2014-05-19 10:47:05.960686 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xa74a8c0 con 0x9bb6f20 -4158> 2014-05-19 10:47:05.960714 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xac16540 con 0x994b340 -4157> 2014-05-19 10:47:05.960766 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xa516e00 con 0x98fa2c0 -4156> 2014-05-19 10:47:05.960856 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xac09880 con 0x996f8c0 -4155> 2014-05-19 10:47:05.960880 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xac34c40 con 0x996fa20 -4154> 2014-05-19 10:47:05.960905 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0x9d52000 con 0x9ac8160 -4153> 2014-05-19 10:47:05.960933 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xa864a80 con 0x7b90420 -4152> 2014-05-19 10:47:05.960956 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0x9547dc0 con 0x919fe40 -4151> 2014-05-19 10:47:05.961019 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xa1e4380 con 0x9971760 -4150> 2014-05-19 10:47:05.961042 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xa030fc0 con 0x994af20 -4149> 2014-05-19 10:47:05.961071 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xa2df340 con 0x989be40 -4148> 2014-05-19 10:47:05.961099 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xa36ddc0 con 0x9adf4a0 -4147> 2014-05-19 10:47:05.961138 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0x9d22540 con 0x9776160 -4146> 2014-05-19 10:47:05.961154 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xa103dc0 con 0x96bd8c0 -4145> 2014-05-19 10:47:05.961168 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0x9142a80 con 0x96bcdc0 -4144> 2014-05-19 10:47:05.961182 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xac32540 con 0x96954a0 -4143> 2014-05-19 10:47:05.961210 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0x9b44e00 con 0x76bd8c0 -4142> 2014-05-19 10:47:05.961242 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0x99e1500 con 0x7b90dc0 -4141> 2014-05-19 10:47:05.961283 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0x9c6ee00 con 0x978d8c0 -4140> 2014-05-19 10:47:05.961314 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0x9cb7880 con 0x978c580 -4139> 2014-05-19 10:47:05.961350 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0x9fb5c00 con 0x978d340 -4138> 2014-05-19 10:47:05.961386 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:05.960132) v2 -- ?+0 0xa506380 con 0x96374a0 -4137> 2014-05-19 10:47:05.961427 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -4136> 2014-05-19 10:47:05.961449 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xa5076c0 con 0x9ad4420 -4135> 2014-05-19 10:47:05.961514 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -4134> 2014-05-19 10:47:05.961538 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xac368c0 con 0x9bf31e0 -4133> 2014-05-19 10:47:05.961608 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -4132> 2014-05-19 10:47:05.961627 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xa0eaa80 con 0x998b340 -4131> 2014-05-19 10:47:05.961664 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -4130> 2014-05-19 10:47:05.961701 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0x9cb6c40 con 0x9b92840 -4129> 2014-05-19 10:47:05.961733 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -4128> 2014-05-19 10:47:05.961744 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0x9b44000 con 0x9ad49a0 -4127> 2014-05-19 10:47:05.961829 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -4126> 2014-05-19 10:47:05.961838 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xa092000 con 0x7b911e0 -4125> 2014-05-19 10:47:05.961870 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -4124> 2014-05-19 10:47:05.961876 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0x9c0efc0 con 0x7b918c0 -4123> 2014-05-19 10:47:05.961891 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -4122> 2014-05-19 10:47:05.961897 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0x9209500 con 0x9aa8c60 -4121> 2014-05-19 10:47:05.961911 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -4120> 2014-05-19 10:47:05.961916 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xac08000 con 0x9bfa000 -4119> 2014-05-19 10:47:05.961938 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -4118> 2014-05-19 10:47:05.961945 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xa872fc0 con 0x7c23e40 -4117> 2014-05-19 10:47:05.961963 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -4116> 2014-05-19 10:47:05.961971 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xa4fe380 con 0x998b760 -4115> 2014-05-19 10:47:05.961986 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -4114> 2014-05-19 10:47:05.961996 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xa74a540 con 0x7b91080 -4113> 2014-05-19 10:47:05.962011 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -4112> 2014-05-19 10:47:05.962019 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xa616c40 con 0xa28fb80 -4111> 2014-05-19 10:47:05.962034 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -4110> 2014-05-19 10:47:05.962039 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xac37a40 con 0x76bdce0 -4109> 2014-05-19 10:47:05.962056 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -4108> 2014-05-19 10:47:05.962061 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xa1e5500 con 0x994ab00 -4107> 2014-05-19 10:47:05.962076 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -4106> 2014-05-19 10:47:05.962083 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0x92b0c40 con 0x9ac8b00 -4105> 2014-05-19 10:47:05.962098 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -4104> 2014-05-19 10:47:05.962102 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xa208000 con 0x938de40 -4103> 2014-05-19 10:47:05.962119 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -4102> 2014-05-19 10:47:05.962124 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xac31dc0 con 0x9970b00 -4101> 2014-05-19 10:47:05.962139 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -4100> 2014-05-19 10:47:05.962147 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0x9d23500 con 0x99706e0 -4099> 2014-05-19 10:47:05.962164 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -4098> 2014-05-19 10:47:05.962173 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0x97c21c0 con 0x9bb6f20 -4097> 2014-05-19 10:47:05.962190 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -4096> 2014-05-19 10:47:05.962198 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0x9fa5180 con 0x994b340 -4095> 2014-05-19 10:47:05.962212 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -4094> 2014-05-19 10:47:05.962219 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xac1b6c0 con 0x98fa2c0 -4093> 2014-05-19 10:47:05.962233 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -4092> 2014-05-19 10:47:05.962241 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0x9c58fc0 con 0x996f8c0 -4091> 2014-05-19 10:47:05.962255 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -4090> 2014-05-19 10:47:05.962262 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xac17dc0 con 0x996fa20 -4089> 2014-05-19 10:47:05.962276 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -4088> 2014-05-19 10:47:05.962283 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xa267c00 con 0x9ac8160 -4087> 2014-05-19 10:47:05.962297 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -4086> 2014-05-19 10:47:05.962304 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xa6d5dc0 con 0x7b90420 -4085> 2014-05-19 10:47:05.962319 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -4084> 2014-05-19 10:47:05.962326 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xa092c40 con 0x919fe40 -4083> 2014-05-19 10:47:05.962340 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -4082> 2014-05-19 10:47:05.962349 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0x9ccf180 con 0x9971760 -4081> 2014-05-19 10:47:05.962366 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -4080> 2014-05-19 10:47:05.962373 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xa619500 con 0x994af20 -4079> 2014-05-19 10:47:05.962387 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -4078> 2014-05-19 10:47:05.962394 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xac1a1c0 con 0x989be40 -4077> 2014-05-19 10:47:05.962408 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -4076> 2014-05-19 10:47:05.962416 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0x9e9f340 con 0x9adf4a0 -4075> 2014-05-19 10:47:05.962434 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -4074> 2014-05-19 10:47:05.962441 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xac176c0 con 0x9776160 -4073> 2014-05-19 10:47:05.962455 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -4072> 2014-05-19 10:47:05.962463 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xa516700 con 0x96bd8c0 -4071> 2014-05-19 10:47:05.962477 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -4070> 2014-05-19 10:47:05.962484 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0x97c2540 con 0x96bcdc0 -4069> 2014-05-19 10:47:05.962498 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -4068> 2014-05-19 10:47:05.962505 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xa74a380 con 0x96954a0 -4067> 2014-05-19 10:47:05.962519 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -4066> 2014-05-19 10:47:05.962530 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0x9455500 con 0x76bd8c0 -4065> 2014-05-19 10:47:05.962548 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -4064> 2014-05-19 10:47:05.962555 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0x9464000 con 0x7b90dc0 -4063> 2014-05-19 10:47:05.962570 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -4062> 2014-05-19 10:47:05.962578 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xa103340 con 0x978d8c0 -4061> 2014-05-19 10:47:05.962593 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -4060> 2014-05-19 10:47:05.962600 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xac2b340 con 0x978c580 -4059> 2014-05-19 10:47:05.962614 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -4058> 2014-05-19 10:47:05.962621 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0x9ba56c0 con 0x978d340 -4057> 2014-05-19 10:47:05.962636 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -4056> 2014-05-19 10:47:05.962643 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 46 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:05.960132) v2 ==== 47+0+0 (2168439731 0 0) 0xac33a40 con 0x96374a0 -4055> 2014-05-19 10:47:05.962657 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -4054> 2014-05-19 10:47:06.017554 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:09.962972) v2 ==== 47+0+0 (1721993043 0 0) 0xac15880 con 0x987b340 -4053> 2014-05-19 10:47:06.017606 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:09.962972) v2 -- ?+0 0xac41dc0 con 0x987b340 -4052> 2014-05-19 10:47:06.017633 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -4051> 2014-05-19 10:47:06.018062 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:09.962972) v2 ==== 47+0+0 (1721993043 0 0) 0xac14380 con 0x94e26e0 -4050> 2014-05-19 10:47:06.018099 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:09.962972) v2 -- ?+0 0x96befc0 con 0x94e26e0 -4049> 2014-05-19 10:47:06.018211 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -4048> 2014-05-19 10:47:06.288787 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:10.234197) v2 ==== 47+0+0 (780709006 0 0) 0xa44ddc0 con 0x99f1080 -4047> 2014-05-19 10:47:06.288870 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.234197) v2 -- ?+0 0xac14380 con 0x99f1080 -4046> 2014-05-19 10:47:06.288949 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -4045> 2014-05-19 10:47:06.288782 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:10.234197) v2 ==== 47+0+0 (780709006 0 0) 0xac34000 con 0x987af20 -4044> 2014-05-19 10:47:06.289395 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.234197) v2 -- ?+0 0xac15880 con 0x987af20 -4043> 2014-05-19 10:47:06.289426 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -4042> 2014-05-19 10:47:06.352675 7f555c1b3700 10 monclient: tick -4041> 2014-05-19 10:47:06.352690 7f555c1b3700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2014-05-19 10:46:36.352689) -4040> 2014-05-19 10:47:06.352708 7f555c1b3700 10 monclient: renew subs? (now: 2014-05-19 10:47:06.352708; renew after: 2014-05-19 10:47:03.081841) -- yes -4039> 2014-05-19 10:47:06.352720 7f555c1b3700 10 monclient: renew_subs -4038> 2014-05-19 10:47:06.352724 7f555c1b3700 10 monclient: _send_mon_message to mon.a at 172.16.96.201:6789/0 -4037> 2014-05-19 10:47:06.352742 7f555c1b3700 1 -- 172.16.96.201:6800/37595 --> 172.16.96.201:6789/0 -- mon_subscribe({monmap=2+,osd_pg_creates=0}) v2 -- ?+0 0x9c6e700 con 0x96958c0 -4036> 2014-05-19 10:47:06.353196 7f55619be700 1 -- 172.16.96.201:6800/37595 <== mon.0 172.16.96.201:6789/0 14 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (417074707 0 0) 0x9cabc00 con 0x96958c0 -4035> 2014-05-19 10:47:06.353226 7f55619be700 10 monclient: handle_subscribe_ack sent 2014-05-19 10:47:06.352721 renew after 2014-05-19 10:49:36.352721 -4034> 2014-05-19 10:47:06.445244 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:09.052025) v2 ==== 47+0+0 (1646543393 0 0) 0xa7d4700 con 0x9b8c160 -4033> 2014-05-19 10:47:06.445286 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:09.052025) v2 -- ?+0 0xac34000 con 0x9b8c160 -4032> 2014-05-19 10:47:06.445364 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -4031> 2014-05-19 10:47:06.445375 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:09.052025) v2 ==== 47+0+0 (1646543393 0 0) 0xac08e00 con 0x9aa3600 -4030> 2014-05-19 10:47:06.445423 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:09.052025) v2 -- ?+0 0xa44ddc0 con 0x9aa3600 -4029> 2014-05-19 10:47:06.445501 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -4028> 2014-05-19 10:47:06.447131 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:09.053955) v2 ==== 47+0+0 (3073692401 0 0) 0xa2e01c0 con 0x96571e0 -4027> 2014-05-19 10:47:06.447147 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:09.053955) v2 ==== 47+0+0 (3073692401 0 0) 0xac361c0 con 0x9656420 -4026> 2014-05-19 10:47:06.447180 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:09.053955) v2 -- ?+0 0xac08e00 con 0x96571e0 -4025> 2014-05-19 10:47:06.447243 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -4024> 2014-05-19 10:47:06.447308 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:09.053955) v2 -- ?+0 0xa7d4700 con 0x9656420 -4023> 2014-05-19 10:47:06.447337 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -4022> 2014-05-19 10:47:06.527970 7f5565600700 20 KeyValueStore::op_tp worker waiting -4021> 2014-05-19 10:47:06.671954 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:09.278753) v2 ==== 47+0+0 (1565883744 0 0) 0xac1ac40 con 0x9656000 -4020> 2014-05-19 10:47:06.671981 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:09.278753) v2 ==== 47+0+0 (1565883744 0 0) 0xa264a80 con 0x9937760 -4019> 2014-05-19 10:47:06.672003 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:09.278753) v2 -- ?+0 0xac361c0 con 0x9656000 -4018> 2014-05-19 10:47:06.672030 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -4017> 2014-05-19 10:47:06.672083 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:09.278753) v2 -- ?+0 0xa2e01c0 con 0x9937760 -4016> 2014-05-19 10:47:06.672117 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -4015> 2014-05-19 10:47:06.769631 7f55579aa700 20 OSD::op_tp worker waiting -4014> 2014-05-19 10:47:06.769658 7f55551a5700 20 OSD::op_tp worker waiting -4013> 2014-05-19 10:47:06.769690 7f555a1af700 20 OSD::op_tp worker waiting -4012> 2014-05-19 10:47:06.771238 7f55541a3700 20 OSD::op_tp worker waiting -4011> 2014-05-19 10:47:06.771267 7f555a9b0700 20 OSD::op_tp worker waiting -4010> 2014-05-19 10:47:06.771283 7f555b1b1700 20 OSD::op_tp worker waiting -4009> 2014-05-19 10:47:06.771299 7f55549a4700 20 OSD::op_tp worker waiting -4008> 2014-05-19 10:47:06.771309 7f55569a8700 20 OSD::op_tp worker waiting -4007> 2014-05-19 10:47:06.771327 7f55589ac700 20 OSD::op_tp worker waiting -4006> 2014-05-19 10:47:06.772132 7f55581ab700 20 OSD::op_tp worker waiting -4005> 2014-05-19 10:47:06.772156 7f55571a9700 20 OSD::op_tp worker waiting -4004> 2014-05-19 10:47:06.772221 7f55599ae700 20 OSD::op_tp worker waiting -4003> 2014-05-19 10:47:06.772236 7f555219f700 20 OSD::op_tp worker waiting -4002> 2014-05-19 10:47:06.772254 7f55529a0700 20 OSD::op_tp worker waiting -4001> 2014-05-19 10:47:06.772271 7f55531a1700 20 OSD::op_tp worker waiting -4000> 2014-05-19 10:47:06.772303 7f55539a2700 20 OSD::op_tp worker waiting -3999> 2014-05-19 10:47:06.772327 7f55561a7700 20 OSD::op_tp worker waiting -3998> 2014-05-19 10:47:06.772358 7f55591ad700 20 OSD::op_tp worker waiting -3997> 2014-05-19 10:47:06.772409 7f55559a6700 20 OSD::op_tp worker waiting -3996> 2014-05-19 10:47:06.772462 7f555199e700 20 OSD::op_tp worker waiting -3995> 2014-05-19 10:47:06.922147 7f5566602700 5 osd.0 245 tick -3994> 2014-05-19 10:47:06.922172 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -3993> 2014-05-19 10:47:06.922177 7f5566602700 10 osd.0 245 do_waiters -- start -3992> 2014-05-19 10:47:06.922180 7f5566602700 10 osd.0 245 do_waiters -- finish -3991> 2014-05-19 10:47:06.922217 7f555119d700 20 OSD::recovery_tp worker waiting -3990> 2014-05-19 10:47:07.055115 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:09.661914) v2 ==== 47+0+0 (1169583324 0 0) 0xac41c00 con 0x996e000 -3989> 2014-05-19 10:47:07.055129 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:09.661914) v2 ==== 47+0+0 (1169583324 0 0) 0xac35500 con 0x9a0c9a0 -3988> 2014-05-19 10:47:07.055170 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:09.661914) v2 -- ?+0 0xac1ac40 con 0x996e000 -3987> 2014-05-19 10:47:07.055280 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -3986> 2014-05-19 10:47:07.055392 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:09.661914) v2 -- ?+0 0xa264a80 con 0x9a0c9a0 -3985> 2014-05-19 10:47:07.055466 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -3984> 2014-05-19 10:47:07.111405 7f5564dff700 20 KeyValueStore::op_tp worker waiting -3983> 2014-05-19 10:47:07.216858 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:09.823502) v2 ==== 47+0+0 (1722703762 0 0) 0xac09500 con 0x9a0cdc0 -3982> 2014-05-19 10:47:07.216926 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:09.823502) v2 -- ?+0 0xac35500 con 0x9a0cdc0 -3981> 2014-05-19 10:47:07.216961 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -3980> 2014-05-19 10:47:07.216707 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:09.823502) v2 ==== 47+0+0 (1722703762 0 0) 0xac30000 con 0x996fb80 -3979> 2014-05-19 10:47:07.217168 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:09.823502) v2 -- ?+0 0xac41c00 con 0x996fb80 -3978> 2014-05-19 10:47:07.217265 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -3977> 2014-05-19 10:47:07.390235 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:11.335711) v2 ==== 47+0+0 (2048268336 0 0) 0x92a1500 con 0x987af20 -3976> 2014-05-19 10:47:07.390285 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:11.335711) v2 -- ?+0 0xac30000 con 0x987af20 -3975> 2014-05-19 10:47:07.390236 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:11.335711) v2 ==== 47+0+0 (2048268336 0 0) 0xac22e00 con 0x99f1080 -3974> 2014-05-19 10:47:07.390388 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -3973> 2014-05-19 10:47:07.390656 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:11.335711) v2 -- ?+0 0xac09500 con 0x99f1080 -3972> 2014-05-19 10:47:07.390753 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -3971> 2014-05-19 10:47:07.412393 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:11.357872) v2 ==== 47+0+0 (2318928950 0 0) 0xa05e700 con 0x9743600 -3970> 2014-05-19 10:47:07.412467 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:11.357872) v2 -- ?+0 0xac22e00 con 0x9743600 -3969> 2014-05-19 10:47:07.412577 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -3968> 2014-05-19 10:47:07.412701 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:11.357872) v2 ==== 47+0+0 (2318928950 0 0) 0xa4a9a40 con 0x966e000 -3967> 2014-05-19 10:47:07.412745 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:11.357872) v2 -- ?+0 0x92a1500 con 0x966e000 -3966> 2014-05-19 10:47:07.412831 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -3965> 2014-05-19 10:47:07.450415 7f555019b700 20 OSD::command_tp worker waiting -3964> 2014-05-19 10:47:07.453630 7f555099c700 20 OSD::disk_tp worker waiting -3963> 2014-05-19 10:47:07.480731 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:11.426231) v2 ==== 47+0+0 (1783153891 0 0) 0x9fa4380 con 0x99d31e0 -3962> 2014-05-19 10:47:07.480780 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:11.426231) v2 ==== 47+0+0 (1783153891 0 0) 0xac236c0 con 0x95142c0 -3961> 2014-05-19 10:47:07.480827 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:11.426231) v2 -- ?+0 0xa4a9a40 con 0x99d31e0 -3960> 2014-05-19 10:47:07.480980 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -3959> 2014-05-19 10:47:07.481317 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:11.426231) v2 -- ?+0 0xa05e700 con 0x95142c0 -3958> 2014-05-19 10:47:07.481399 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -3957> 2014-05-19 10:47:07.514725 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 67 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:10.121521) v2 ==== 47+0+0 (1107350117 0 0) 0x9123c00 con 0x96562c0 -3956> 2014-05-19 10:47:07.514731 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 67 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:10.121521) v2 ==== 47+0+0 (1107350117 0 0) 0x9b44700 con 0x9657080 -3955> 2014-05-19 10:47:07.514774 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.121521) v2 -- ?+0 0x9fa4380 con 0x96562c0 -3954> 2014-05-19 10:47:07.514856 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -3953> 2014-05-19 10:47:07.514934 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.121521) v2 -- ?+0 0xac236c0 con 0x9657080 -3952> 2014-05-19 10:47:07.514975 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -3951> 2014-05-19 10:47:07.598959 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:11.544399) v2 ==== 47+0+0 (3972927505 0 0) 0xac43180 con 0x9bb7b80 -3950> 2014-05-19 10:47:07.599031 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:11.544399) v2 -- ?+0 0x9123c00 con 0x9bb7b80 -3949> 2014-05-19 10:47:07.598962 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:11.544399) v2 ==== 47+0+0 (3972927505 0 0) 0xac40e00 con 0x95151e0 -3948> 2014-05-19 10:47:07.599118 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -3947> 2014-05-19 10:47:07.599345 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:11.544399) v2 -- ?+0 0x9b44700 con 0x95151e0 -3946> 2014-05-19 10:47:07.599432 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -3945> 2014-05-19 10:47:07.798674 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:07.798506) v2 ==== 47+0+0 (339965611 0 0) 0xa173340 con 0x9656580 -3944> 2014-05-19 10:47:07.798723 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:07.798506) v2 -- ?+0 0xac43180 con 0x9656580 -3943> 2014-05-19 10:47:07.798702 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:07.798506) v2 ==== 47+0+0 (339965611 0 0) 0x9b45a40 con 0x9657340 -3942> 2014-05-19 10:47:07.798760 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -3941> 2014-05-19 10:47:07.798813 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:07.798506) v2 -- ?+0 0xac40e00 con 0x9657340 -3940> 2014-05-19 10:47:07.798854 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -3939> 2014-05-19 10:47:07.922265 7f5566602700 5 osd.0 245 tick -3938> 2014-05-19 10:47:07.922285 7f5566602700 7 osd.0 245 do_mon_report -3937> 2014-05-19 10:47:07.922289 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 -3936> 2014-05-19 10:47:07.922293 7f5566602700 20 osd.0 245 send_pg_stats -3935> 2014-05-19 10:47:07.922302 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -3934> 2014-05-19 10:47:07.922306 7f5566602700 10 osd.0 245 do_waiters -- start -3933> 2014-05-19 10:47:07.922308 7f5566602700 10 osd.0 245 do_waiters -- finish -3932> 2014-05-19 10:47:07.922342 7f555119d700 20 OSD::recovery_tp worker waiting -3931> 2014-05-19 10:47:08.146611 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:10.753453) v2 ==== 47+0+0 (966157603 0 0) 0xac32a80 con 0x9b8c160 -3930> 2014-05-19 10:47:08.146662 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.753453) v2 -- ?+0 0xa173340 con 0x9b8c160 -3929> 2014-05-19 10:47:08.146624 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:10.753453) v2 ==== 47+0+0 (966157603 0 0) 0xa4fe000 con 0x9aa3600 -3928> 2014-05-19 10:47:08.146758 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -3927> 2014-05-19 10:47:08.147160 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.753453) v2 -- ?+0 0x9b45a40 con 0x9aa3600 -3926> 2014-05-19 10:47:08.147216 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -3925> 2014-05-19 10:47:08.148641 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:10.755351) v2 ==== 47+0+0 (3091716222 0 0) 0xac36000 con 0x9656420 -3924> 2014-05-19 10:47:08.148687 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.755351) v2 -- ?+0 0xac32a80 con 0x9656420 -3923> 2014-05-19 10:47:08.148715 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -3922> 2014-05-19 10:47:08.148994 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:10.755351) v2 ==== 47+0+0 (3091716222 0 0) 0xa2e1880 con 0x96571e0 -3921> 2014-05-19 10:47:08.149039 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.755351) v2 -- ?+0 0xa4fe000 con 0x96571e0 -3920> 2014-05-19 10:47:08.149130 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -3919> 2014-05-19 10:47:08.261539 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -3918> 2014-05-19 10:47:08.261561 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -3917> 2014-05-19 10:47:08.261570 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0x9b44380 con 0x9bdc840 -3916> 2014-05-19 10:47:08.261596 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xa267500 con 0x9ad4420 -3915> 2014-05-19 10:47:08.261635 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xac34540 con 0x9bf31e0 -3914> 2014-05-19 10:47:08.261650 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xa447c00 con 0x998b340 -3913> 2014-05-19 10:47:08.261664 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0x9faa1c0 con 0x9b92840 -3912> 2014-05-19 10:47:08.261689 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xa4dee00 con 0x9ad49a0 -3911> 2014-05-19 10:47:08.261719 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xa079880 con 0x7b911e0 -3910> 2014-05-19 10:47:08.261750 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0x9ef41c0 con 0x7b918c0 -3909> 2014-05-19 10:47:08.261778 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xa05e380 con 0x9aa8c60 -3908> 2014-05-19 10:47:08.261800 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xa0b68c0 con 0x9bfa000 -3907> 2014-05-19 10:47:08.261843 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0x9feca80 con 0x7c23e40 -3906> 2014-05-19 10:47:08.261872 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0x9e101c0 con 0x998b760 -3905> 2014-05-19 10:47:08.261901 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xac14fc0 con 0x7b91080 -3904> 2014-05-19 10:47:08.261927 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0x9c6f180 con 0xa28fb80 -3903> 2014-05-19 10:47:08.261961 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xa873dc0 con 0x76bdce0 -3902> 2014-05-19 10:47:08.261951 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xa6136c0 con 0x9bdc840 -3901> 2014-05-19 10:47:08.262007 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xa114e00 con 0x994ab00 -3900> 2014-05-19 10:47:08.262039 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xa8068c0 con 0x9ac8b00 -3899> 2014-05-19 10:47:08.262086 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xa74a1c0 con 0x938de40 -3898> 2014-05-19 10:47:08.262118 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xa6abdc0 con 0x9970b00 -3897> 2014-05-19 10:47:08.262139 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0x96be700 con 0x99706e0 -3896> 2014-05-19 10:47:08.262156 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xa267340 con 0x9bb6f20 -3895> 2014-05-19 10:47:08.262169 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xa7d4c40 con 0x994b340 -3894> 2014-05-19 10:47:08.262185 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xa74a380 con 0x98fa2c0 -3893> 2014-05-19 10:47:08.262214 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0x97c2540 con 0x996f8c0 -3892> 2014-05-19 10:47:08.262246 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xa516700 con 0x996fa20 -3891> 2014-05-19 10:47:08.262276 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xac176c0 con 0x9ac8160 -3890> 2014-05-19 10:47:08.262295 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0x9e9f340 con 0x7b90420 -3889> 2014-05-19 10:47:08.262323 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xac1a1c0 con 0x919fe40 -3888> 2014-05-19 10:47:08.262353 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xa619500 con 0x9971760 -3887> 2014-05-19 10:47:08.262378 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0x9ccf180 con 0x994af20 -3886> 2014-05-19 10:47:08.262407 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xa092c40 con 0x989be40 -3885> 2014-05-19 10:47:08.262431 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xa6d5dc0 con 0x9adf4a0 -3884> 2014-05-19 10:47:08.262448 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xa267c00 con 0x9776160 -3883> 2014-05-19 10:47:08.262464 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xac17dc0 con 0x96bd8c0 -3882> 2014-05-19 10:47:08.262479 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0x9c58fc0 con 0x96bcdc0 -3881> 2014-05-19 10:47:08.262495 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xac1b6c0 con 0x96954a0 -3880> 2014-05-19 10:47:08.262511 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0x9fa5180 con 0x76bd8c0 -3879> 2014-05-19 10:47:08.262529 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0x97c21c0 con 0x7b90dc0 -3878> 2014-05-19 10:47:08.262569 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0x9d23500 con 0x978d8c0 -3877> 2014-05-19 10:47:08.262613 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xac31dc0 con 0x978c580 -3876> 2014-05-19 10:47:08.262645 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0xa208000 con 0x978d340 -3875> 2014-05-19 10:47:08.262738 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:08.261568) v2 -- ?+0 0x92b0c40 con 0x96374a0 -3874> 2014-05-19 10:47:08.262785 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -3873> 2014-05-19 10:47:08.262805 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xac43500 con 0x9ad4420 -3872> 2014-05-19 10:47:08.262842 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -3871> 2014-05-19 10:47:08.262860 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xa209500 con 0x9bf31e0 -3870> 2014-05-19 10:47:08.262892 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -3869> 2014-05-19 10:47:08.262903 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xa516540 con 0x998b340 -3868> 2014-05-19 10:47:08.262945 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -3867> 2014-05-19 10:47:08.262958 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xac43880 con 0x9b92840 -3866> 2014-05-19 10:47:08.262977 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -3865> 2014-05-19 10:47:08.262987 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0x9e11880 con 0x9ad49a0 -3864> 2014-05-19 10:47:08.263004 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -3863> 2014-05-19 10:47:08.263012 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xa4461c0 con 0x7b911e0 -3862> 2014-05-19 10:47:08.263033 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -3861> 2014-05-19 10:47:08.263047 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xa6d4a80 con 0x7b918c0 -3860> 2014-05-19 10:47:08.263068 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -3859> 2014-05-19 10:47:08.263074 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0x9fa5c00 con 0x9aa8c60 -3858> 2014-05-19 10:47:08.263093 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -3857> 2014-05-19 10:47:08.263098 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xac17a40 con 0x9bfa000 -3856> 2014-05-19 10:47:08.263112 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -3855> 2014-05-19 10:47:08.263120 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xa1eefc0 con 0x7c23e40 -3854> 2014-05-19 10:47:08.263135 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -3853> 2014-05-19 10:47:08.263140 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xa4a8000 con 0x998b760 -3852> 2014-05-19 10:47:08.263153 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -3851> 2014-05-19 10:47:08.263158 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xa0cafc0 con 0x7b91080 -3850> 2014-05-19 10:47:08.263173 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -3849> 2014-05-19 10:47:08.263178 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xac161c0 con 0xa28fb80 -3848> 2014-05-19 10:47:08.263191 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -3847> 2014-05-19 10:47:08.263196 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xac37880 con 0x76bdce0 -3846> 2014-05-19 10:47:08.263210 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -3845> 2014-05-19 10:47:08.263215 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xa2de700 con 0x994ab00 -3844> 2014-05-19 10:47:08.263235 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -3843> 2014-05-19 10:47:08.263259 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xa3dafc0 con 0x9ac8b00 -3842> 2014-05-19 10:47:08.263280 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -3841> 2014-05-19 10:47:08.263288 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0x9d3cfc0 con 0x938de40 -3840> 2014-05-19 10:47:08.263304 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -3839> 2014-05-19 10:47:08.263312 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xac31c00 con 0x9970b00 -3838> 2014-05-19 10:47:08.263327 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -3837> 2014-05-19 10:47:08.263334 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xa2e1c00 con 0x99706e0 -3836> 2014-05-19 10:47:08.263351 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -3835> 2014-05-19 10:47:08.263358 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xa0ba540 con 0x9bb6f20 -3834> 2014-05-19 10:47:08.263373 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -3833> 2014-05-19 10:47:08.263382 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xa2bd500 con 0x994b340 -3832> 2014-05-19 10:47:08.263399 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -3831> 2014-05-19 10:47:08.263406 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0x9c08000 con 0x98fa2c0 -3830> 2014-05-19 10:47:08.263421 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -3829> 2014-05-19 10:47:08.263428 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xac43a40 con 0x996f8c0 -3828> 2014-05-19 10:47:08.263442 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -3827> 2014-05-19 10:47:08.263450 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0x92a16c0 con 0x996fa20 -3826> 2014-05-19 10:47:08.263464 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -3825> 2014-05-19 10:47:08.263472 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xa237dc0 con 0x9ac8160 -3824> 2014-05-19 10:47:08.263486 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -3823> 2014-05-19 10:47:08.263499 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xa6d5c00 con 0x7b90420 -3822> 2014-05-19 10:47:08.263517 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -3821> 2014-05-19 10:47:08.263525 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xa7d48c0 con 0x919fe40 -3820> 2014-05-19 10:47:08.263540 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -3819> 2014-05-19 10:47:08.263548 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0x95e6540 con 0x9971760 -3818> 2014-05-19 10:47:08.263562 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -3817> 2014-05-19 10:47:08.263570 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0x9ba41c0 con 0x994af20 -3816> 2014-05-19 10:47:08.263584 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -3815> 2014-05-19 10:47:08.263591 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xa856fc0 con 0x989be40 -3814> 2014-05-19 10:47:08.263606 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -3813> 2014-05-19 10:47:08.263613 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0x9fd9500 con 0x9adf4a0 -3812> 2014-05-19 10:47:08.263627 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -3811> 2014-05-19 10:47:08.263637 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xa665180 con 0x9776160 -3810> 2014-05-19 10:47:08.263651 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -3809> 2014-05-19 10:47:08.263656 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xa516380 con 0x96bd8c0 -3808> 2014-05-19 10:47:08.263670 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -3807> 2014-05-19 10:47:08.263679 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xa0ba1c0 con 0x96bcdc0 -3806> 2014-05-19 10:47:08.263693 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -3805> 2014-05-19 10:47:08.263701 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xac31500 con 0x96954a0 -3804> 2014-05-19 10:47:08.263715 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -3803> 2014-05-19 10:47:08.263722 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0x94488c0 con 0x76bd8c0 -3802> 2014-05-19 10:47:08.263736 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -3801> 2014-05-19 10:47:08.263744 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0x9fece00 con 0x7b90dc0 -3800> 2014-05-19 10:47:08.263758 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -3799> 2014-05-19 10:47:08.263765 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xa102c40 con 0x978d8c0 -3798> 2014-05-19 10:47:08.263780 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -3797> 2014-05-19 10:47:08.263787 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0x9ad3880 con 0x978c580 -3796> 2014-05-19 10:47:08.263801 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -3795> 2014-05-19 10:47:08.263808 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0x9ba5dc0 con 0x978d340 -3794> 2014-05-19 10:47:08.263822 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -3793> 2014-05-19 10:47:08.263829 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 47 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.261568) v2 ==== 47+0+0 (3260537409 0 0) 0xac33dc0 con 0x96374a0 -3792> 2014-05-19 10:47:08.263844 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -3791> 2014-05-19 10:47:08.280810 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:12.226366) v2 ==== 47+0+0 (98413317 0 0) 0x9d0b6c0 con 0x99d3340 -3790> 2014-05-19 10:47:08.280936 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:12.226366) v2 -- ?+0 0xac36000 con 0x99d3340 -3789> 2014-05-19 10:47:08.281015 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -3788> 2014-05-19 10:47:08.281394 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:12.226366) v2 ==== 47+0+0 (98413317 0 0) 0xa0ca540 con 0x94a5a20 -3787> 2014-05-19 10:47:08.281439 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:12.226366) v2 -- ?+0 0xa2e1880 con 0x94a5a20 -3786> 2014-05-19 10:47:08.281478 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -3785> 2014-05-19 10:47:08.320623 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:10.927442) v2 ==== 47+0+0 (1392491051 0 0) 0xa44d6c0 con 0x7b90160 -3784> 2014-05-19 10:47:08.320678 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.927442) v2 -- ?+0 0xa0ca540 con 0x7b90160 -3783> 2014-05-19 10:47:08.320756 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -3782> 2014-05-19 10:47:08.320725 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:10.927442) v2 ==== 47+0+0 (1392491051 0 0) 0xac288c0 con 0x9b8db80 -3781> 2014-05-19 10:47:08.321161 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.927442) v2 -- ?+0 0x9d0b6c0 con 0x9b8db80 -3780> 2014-05-19 10:47:08.321242 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -3779> 2014-05-19 10:47:08.326913 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:12.272417) v2 ==== 47+0+0 (3880798797 0 0) 0xa107880 con 0x987b760 -3778> 2014-05-19 10:47:08.326938 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 45 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:12.272417) v2 ==== 47+0+0 (3880798797 0 0) 0xa102000 con 0x94802c0 -3777> 2014-05-19 10:47:08.327258 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:12.272417) v2 -- ?+0 0xac288c0 con 0x987b760 -3776> 2014-05-19 10:47:08.327340 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -3775> 2014-05-19 10:47:08.327376 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:12.272417) v2 -- ?+0 0xa44d6c0 con 0x94802c0 -3774> 2014-05-19 10:47:08.327447 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -3773> 2014-05-19 10:47:08.401283 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:12.346762) v2 ==== 47+0+0 (3504061919 0 0) 0xa1e5340 con 0x9bb69a0 -3772> 2014-05-19 10:47:08.401333 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:12.346762) v2 -- ?+0 0xa107880 con 0x9bb69a0 -3771> 2014-05-19 10:47:08.401414 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -3770> 2014-05-19 10:47:08.401280 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:12.346762) v2 ==== 47+0+0 (3504061919 0 0) 0xa872540 con 0x94e3e40 -3769> 2014-05-19 10:47:08.401798 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:12.346762) v2 -- ?+0 0xa102000 con 0x94e3e40 -3768> 2014-05-19 10:47:08.401852 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -3767> 2014-05-19 10:47:08.528060 7f5565600700 20 KeyValueStore::op_tp worker waiting -3766> 2014-05-19 10:47:08.655270 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:11.262053) v2 ==== 47+0+0 (1540340889 0 0) 0xac35880 con 0x9983600 -3765> 2014-05-19 10:47:08.655360 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:11.262053) v2 -- ?+0 0xa872540 con 0x9983600 -3764> 2014-05-19 10:47:08.655440 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -3763> 2014-05-19 10:47:08.655243 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:11.262053) v2 ==== 47+0+0 (1540340889 0 0) 0xa36d880 con 0x95846e0 -3762> 2014-05-19 10:47:08.655760 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:11.262053) v2 -- ?+0 0xa1e5340 con 0x95846e0 -3761> 2014-05-19 10:47:08.655794 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -3760> 2014-05-19 10:47:08.769734 7f55579aa700 20 OSD::op_tp worker waiting -3759> 2014-05-19 10:47:08.769762 7f55551a5700 20 OSD::op_tp worker waiting -3758> 2014-05-19 10:47:08.769787 7f555a1af700 20 OSD::op_tp worker waiting -3757> 2014-05-19 10:47:08.771344 7f555a9b0700 20 OSD::op_tp worker waiting -3756> 2014-05-19 10:47:08.771367 7f55549a4700 20 OSD::op_tp worker waiting -3755> 2014-05-19 10:47:08.771391 7f555b1b1700 20 OSD::op_tp worker waiting -3754> 2014-05-19 10:47:08.771422 7f55569a8700 20 OSD::op_tp worker waiting -3753> 2014-05-19 10:47:08.771467 7f55589ac700 20 OSD::op_tp worker waiting -3752> 2014-05-19 10:47:08.771524 7f55541a3700 20 OSD::op_tp worker waiting -3751> 2014-05-19 10:47:08.772215 7f55581ab700 20 OSD::op_tp worker waiting -3750> 2014-05-19 10:47:08.772237 7f55571a9700 20 OSD::op_tp worker waiting -3749> 2014-05-19 10:47:08.772292 7f55531a1700 20 OSD::op_tp worker waiting -3748> 2014-05-19 10:47:08.772309 7f555219f700 20 OSD::op_tp worker waiting -3747> 2014-05-19 10:47:08.772336 7f55599ae700 20 OSD::op_tp worker waiting -3746> 2014-05-19 10:47:08.772365 7f55529a0700 20 OSD::op_tp worker waiting -3745> 2014-05-19 10:47:08.772388 7f55539a2700 20 OSD::op_tp worker waiting -3744> 2014-05-19 10:47:08.772401 7f55561a7700 20 OSD::op_tp worker waiting -3743> 2014-05-19 10:47:08.772426 7f55591ad700 20 OSD::op_tp worker waiting -3742> 2014-05-19 10:47:08.772484 7f55559a6700 20 OSD::op_tp worker waiting -3741> 2014-05-19 10:47:08.772534 7f555199e700 20 OSD::op_tp worker waiting -3740> 2014-05-19 10:47:08.900119 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:08.899939) v2 ==== 47+0+0 (2452183685 0 0) 0x95636c0 con 0x9656580 -3739> 2014-05-19 10:47:08.900172 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.899939) v2 -- ?+0 0xa36d880 con 0x9656580 -3738> 2014-05-19 10:47:08.900209 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -3737> 2014-05-19 10:47:08.900201 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:08.899939) v2 ==== 47+0+0 (2452183685 0 0) 0x9b44fc0 con 0x9657340 -3736> 2014-05-19 10:47:08.900260 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:08.899939) v2 -- ?+0 0xac35880 con 0x9657340 -3735> 2014-05-19 10:47:08.900295 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -3734> 2014-05-19 10:47:08.922387 7f5566602700 5 osd.0 245 tick -3733> 2014-05-19 10:47:08.922412 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -3732> 2014-05-19 10:47:08.922417 7f5566602700 10 osd.0 245 do_waiters -- start -3731> 2014-05-19 10:47:08.922419 7f5566602700 10 osd.0 245 do_waiters -- finish -3730> 2014-05-19 10:47:08.922456 7f555119d700 20 OSD::recovery_tp worker waiting -3729> 2014-05-19 10:47:09.111490 7f5564dff700 20 KeyValueStore::op_tp worker waiting -3728> 2014-05-19 10:47:09.170583 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:11.777402) v2 ==== 47+0+0 (312769605 0 0) 0xa23e000 con 0x9656f20 -3727> 2014-05-19 10:47:09.170629 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:11.777402) v2 -- ?+0 0x9b44fc0 con 0x9656f20 -3726> 2014-05-19 10:47:09.170680 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -3725> 2014-05-19 10:47:09.170591 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:11.777402) v2 ==== 47+0+0 (312769605 0 0) 0x9c09180 con 0x9656160 -3724> 2014-05-19 10:47:09.171093 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:11.777402) v2 -- ?+0 0x95636c0 con 0x9656160 -3723> 2014-05-19 10:47:09.171165 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -3722> 2014-05-19 10:47:09.357377 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:11.964182) v2 ==== 47+0+0 (3170060702 0 0) 0xa0dc8c0 con 0x94e2160 -3721> 2014-05-19 10:47:09.357435 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:11.964182) v2 -- ?+0 0xa23e000 con 0x94e2160 -3720> 2014-05-19 10:47:09.357392 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:11.964182) v2 ==== 47+0+0 (3170060702 0 0) 0xa857180 con 0x9b8de40 -3719> 2014-05-19 10:47:09.357494 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -3718> 2014-05-19 10:47:09.357519 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:11.964182) v2 -- ?+0 0x9c09180 con 0x9b8de40 -3717> 2014-05-19 10:47:09.357604 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -3716> 2014-05-19 10:47:09.450496 7f555019b700 20 OSD::command_tp worker waiting -3715> 2014-05-19 10:47:09.453714 7f555099c700 20 OSD::disk_tp worker waiting -3714> 2014-05-19 10:47:09.672261 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:13.617813) v2 ==== 47+0+0 (1227788447 0 0) 0x96bee00 con 0x97434a0 -3713> 2014-05-19 10:47:09.672256 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:13.617813) v2 ==== 47+0+0 (1227788447 0 0) 0xa664fc0 con 0x9970840 -3712> 2014-05-19 10:47:09.672306 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:13.617813) v2 -- ?+0 0xa0dc8c0 con 0x97434a0 -3711> 2014-05-19 10:47:09.672431 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -3710> 2014-05-19 10:47:09.672698 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:13.617813) v2 -- ?+0 0xa857180 con 0x9970840 -3709> 2014-05-19 10:47:09.672796 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -3708> 2014-05-19 10:47:09.867839 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:13.813393) v2 ==== 47+0+0 (2914408327 0 0) 0x9ad6700 con 0x97431e0 -3707> 2014-05-19 10:47:09.867848 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:13.813393) v2 ==== 47+0+0 (2914408327 0 0) 0xac30fc0 con 0x99718c0 -3706> 2014-05-19 10:47:09.867887 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:13.813393) v2 -- ?+0 0x96bee00 con 0x97431e0 -3705> 2014-05-19 10:47:09.867997 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -3704> 2014-05-19 10:47:09.868056 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:13.813393) v2 -- ?+0 0xa664fc0 con 0x99718c0 -3703> 2014-05-19 10:47:09.868145 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -3702> 2014-05-19 10:47:09.922507 7f5566602700 5 osd.0 245 tick -3701> 2014-05-19 10:47:09.922536 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -3700> 2014-05-19 10:47:09.922544 7f5566602700 10 osd.0 245 do_waiters -- start -3699> 2014-05-19 10:47:09.922548 7f5566602700 10 osd.0 245 do_waiters -- finish -3698> 2014-05-19 10:47:09.922574 7f555119d700 20 OSD::recovery_tp worker waiting -3697> 2014-05-19 10:47:10.022027 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:12.628901) v2 ==== 47+0+0 (1949256145 0 0) 0xa0dc700 con 0x9b8db80 -3696> 2014-05-19 10:47:10.022030 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:12.628901) v2 ==== 47+0+0 (1949256145 0 0) 0xac30e00 con 0x7b90160 -3695> 2014-05-19 10:47:10.022070 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:12.628901) v2 -- ?+0 0xac30fc0 con 0x9b8db80 -3694> 2014-05-19 10:47:10.022111 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -3693> 2014-05-19 10:47:10.022239 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:12.628901) v2 -- ?+0 0x9ad6700 con 0x7b90160 -3692> 2014-05-19 10:47:10.022553 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -3691> 2014-05-19 10:47:10.173587 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:12.780401) v2 ==== 47+0+0 (2036972870 0 0) 0xa264540 con 0x9937760 -3690> 2014-05-19 10:47:10.173648 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:12.780401) v2 -- ?+0 0xac30e00 con 0x9937760 -3689> 2014-05-19 10:47:10.173587 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:12.780401) v2 ==== 47+0+0 (2036972870 0 0) 0xa665c00 con 0x9656000 -3688> 2014-05-19 10:47:10.173748 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -3687> 2014-05-19 10:47:10.173831 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:12.780401) v2 -- ?+0 0xa0dc700 con 0x9656000 -3686> 2014-05-19 10:47:10.173869 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -3685> 2014-05-19 10:47:10.528151 7f5565600700 20 KeyValueStore::op_tp worker waiting -3684> 2014-05-19 10:47:10.556644 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:13.163497) v2 ==== 47+0+0 (2111755036 0 0) 0xac41a40 con 0x996e000 -3683> 2014-05-19 10:47:10.556667 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:13.163497) v2 ==== 47+0+0 (2111755036 0 0) 0x9562000 con 0x9a0c9a0 -3682> 2014-05-19 10:47:10.556696 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:13.163497) v2 -- ?+0 0xa665c00 con 0x996e000 -3681> 2014-05-19 10:47:10.556733 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -3680> 2014-05-19 10:47:10.557301 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:13.163497) v2 -- ?+0 0xa264540 con 0x9a0c9a0 -3679> 2014-05-19 10:47:10.557378 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -3678> 2014-05-19 10:47:10.562898 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -3677> 2014-05-19 10:47:10.562919 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -3676> 2014-05-19 10:47:10.562928 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xa1e5500 con 0x9bdc840 -3675> 2014-05-19 10:47:10.562954 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xac37a40 con 0x9ad4420 -3674> 2014-05-19 10:47:10.562994 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xa616c40 con 0x9bf31e0 -3673> 2014-05-19 10:47:10.563010 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xa74a540 con 0x998b340 -3672> 2014-05-19 10:47:10.563025 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xa4fe380 con 0x9b92840 -3671> 2014-05-19 10:47:10.563054 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xa872fc0 con 0x9ad49a0 -3670> 2014-05-19 10:47:10.563082 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xac08000 con 0x7b911e0 -3669> 2014-05-19 10:47:10.563180 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0x9209500 con 0x7b918c0 -3668> 2014-05-19 10:47:10.563205 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0x9c0efc0 con 0x9aa8c60 -3667> 2014-05-19 10:47:10.563235 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xa092000 con 0x9bfa000 -3666> 2014-05-19 10:47:10.563266 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0x9b44000 con 0x7c23e40 -3665> 2014-05-19 10:47:10.563287 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0x9cb6c40 con 0x998b760 -3664> 2014-05-19 10:47:10.563309 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xa237dc0 con 0x7b91080 -3663> 2014-05-19 10:47:10.563354 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0x92a16c0 con 0xa28fb80 -3662> 2014-05-19 10:47:10.563385 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xac43a40 con 0x76bdce0 -3661> 2014-05-19 10:47:10.563414 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0x9c08000 con 0x994ab00 -3660> 2014-05-19 10:47:10.563292 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0x9faa1c0 con 0x9bdc840 -3659> 2014-05-19 10:47:10.563439 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xa2bd500 con 0x9ac8b00 -3658> 2014-05-19 10:47:10.563466 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xa0ba540 con 0x938de40 -3657> 2014-05-19 10:47:10.563486 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xa2e1c00 con 0x9970b00 -3656> 2014-05-19 10:47:10.563503 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xac31c00 con 0x99706e0 -3655> 2014-05-19 10:47:10.563535 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0x9d3cfc0 con 0x9bb6f20 -3654> 2014-05-19 10:47:10.563556 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xa3dafc0 con 0x994b340 -3653> 2014-05-19 10:47:10.563572 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xa2de700 con 0x98fa2c0 -3652> 2014-05-19 10:47:10.563600 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xac37880 con 0x996f8c0 -3651> 2014-05-19 10:47:10.563631 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xac161c0 con 0x996fa20 -3650> 2014-05-19 10:47:10.563662 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xa0cafc0 con 0x9ac8160 -3649> 2014-05-19 10:47:10.563685 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xa4a8000 con 0x7b90420 -3648> 2014-05-19 10:47:10.563712 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xa1eefc0 con 0x919fe40 -3647> 2014-05-19 10:47:10.563739 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xac17a40 con 0x9971760 -3646> 2014-05-19 10:47:10.563756 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0x9fa5c00 con 0x994af20 -3645> 2014-05-19 10:47:10.563784 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xa6d4a80 con 0x989be40 -3644> 2014-05-19 10:47:10.563816 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xa4461c0 con 0x9adf4a0 -3643> 2014-05-19 10:47:10.563840 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0x9e11880 con 0x9776160 -3642> 2014-05-19 10:47:10.563855 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xac43880 con 0x96bd8c0 -3641> 2014-05-19 10:47:10.563878 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xa516540 con 0x96bcdc0 -3640> 2014-05-19 10:47:10.563902 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xa209500 con 0x96954a0 -3639> 2014-05-19 10:47:10.563917 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xac43500 con 0x76bd8c0 -3638> 2014-05-19 10:47:10.563935 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xa6136c0 con 0x7b90dc0 -3637> 2014-05-19 10:47:10.563963 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xac33a40 con 0x978d8c0 -3636> 2014-05-19 10:47:10.563994 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0x9ba56c0 con 0x978c580 -3635> 2014-05-19 10:47:10.564021 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xac2b340 con 0x978d340 -3634> 2014-05-19 10:47:10.564049 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:10.562926) v2 -- ?+0 0xa103340 con 0x96374a0 -3633> 2014-05-19 10:47:10.564118 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -3632> 2014-05-19 10:47:10.564140 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xa208fc0 con 0x9bf31e0 -3631> 2014-05-19 10:47:10.564178 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -3630> 2014-05-19 10:47:10.564197 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0x9f43a40 con 0x998b340 -3629> 2014-05-19 10:47:10.564228 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -3628> 2014-05-19 10:47:10.564243 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xac436c0 con 0x9b92840 -3627> 2014-05-19 10:47:10.564275 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -3626> 2014-05-19 10:47:10.564288 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xa0bc540 con 0x9ad49a0 -3625> 2014-05-19 10:47:10.564317 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -3624> 2014-05-19 10:47:10.564329 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xa665a40 con 0x7b911e0 -3623> 2014-05-19 10:47:10.564357 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -3622> 2014-05-19 10:47:10.564374 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0x95e7180 con 0x7b918c0 -3621> 2014-05-19 10:47:10.564405 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -3620> 2014-05-19 10:47:10.564419 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0x9ccec40 con 0x9aa8c60 -3619> 2014-05-19 10:47:10.564452 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -3618> 2014-05-19 10:47:10.564475 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xac16fc0 con 0x9bfa000 -3617> 2014-05-19 10:47:10.564506 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -3616> 2014-05-19 10:47:10.564517 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xa1ef180 con 0x7c23e40 -3615> 2014-05-19 10:47:10.564546 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -3614> 2014-05-19 10:47:10.564557 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xa0bc1c0 con 0x998b760 -3613> 2014-05-19 10:47:10.564583 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -3612> 2014-05-19 10:47:10.564597 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xa0cb340 con 0x7b91080 -3611> 2014-05-19 10:47:10.564622 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -3610> 2014-05-19 10:47:10.564631 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xac17180 con 0xa28fb80 -3609> 2014-05-19 10:47:10.564659 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -3608> 2014-05-19 10:47:10.564673 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xac376c0 con 0x76bdce0 -3607> 2014-05-19 10:47:10.564705 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -3606> 2014-05-19 10:47:10.564717 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xa093880 con 0x994ab00 -3605> 2014-05-19 10:47:10.564744 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -3604> 2014-05-19 10:47:10.564755 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xa3dba40 con 0x9ac8b00 -3603> 2014-05-19 10:47:10.564783 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -3602> 2014-05-19 10:47:10.564809 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0x9b51dc0 con 0x938de40 -3601> 2014-05-19 10:47:10.564840 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -3600> 2014-05-19 10:47:10.564854 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0x9faa380 con 0x9970b00 -3599> 2014-05-19 10:47:10.564885 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -3598> 2014-05-19 10:47:10.564898 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0x9e6d880 con 0x99706e0 -3597> 2014-05-19 10:47:10.564930 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -3596> 2014-05-19 10:47:10.564943 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0x9fdc380 con 0x9bb6f20 -3595> 2014-05-19 10:47:10.564973 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -3594> 2014-05-19 10:47:10.564987 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xa1dec40 con 0x994b340 -3593> 2014-05-19 10:47:10.565018 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -3592> 2014-05-19 10:47:10.565033 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xac29500 con 0x98fa2c0 -3591> 2014-05-19 10:47:10.565063 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -3590> 2014-05-19 10:47:10.565079 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xac1a1c0 con 0x996f8c0 -3589> 2014-05-19 10:47:10.565131 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -3588> 2014-05-19 10:47:10.565147 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0x9ba5880 con 0x996fa20 -3587> 2014-05-19 10:47:10.565177 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -3586> 2014-05-19 10:47:10.565194 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xa23e000 con 0x9ac8160 -3585> 2014-05-19 10:47:10.565226 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -3584> 2014-05-19 10:47:10.565239 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0x9b2e380 con 0x7b90420 -3583> 2014-05-19 10:47:10.565270 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -3582> 2014-05-19 10:47:10.565284 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0x94641c0 con 0x919fe40 -3581> 2014-05-19 10:47:10.565316 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -3580> 2014-05-19 10:47:10.565329 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xa384fc0 con 0x9971760 -3579> 2014-05-19 10:47:10.565360 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -3578> 2014-05-19 10:47:10.565373 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xac31a40 con 0x994af20 -3577> 2014-05-19 10:47:10.565403 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -3576> 2014-05-19 10:47:10.565416 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0x9fecfc0 con 0x989be40 -3575> 2014-05-19 10:47:10.565446 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -3574> 2014-05-19 10:47:10.565460 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0x9fd96c0 con 0x9adf4a0 -3573> 2014-05-19 10:47:10.565490 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -3572> 2014-05-19 10:47:10.565503 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xa236a80 con 0x9776160 -3571> 2014-05-19 10:47:10.565534 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -3570> 2014-05-19 10:47:10.565549 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xa517880 con 0x96bd8c0 -3569> 2014-05-19 10:47:10.565580 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -3568> 2014-05-19 10:47:10.565593 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xac08c40 con 0x96bcdc0 -3567> 2014-05-19 10:47:10.565623 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -3566> 2014-05-19 10:47:10.565636 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xa2e1340 con 0x96954a0 -3565> 2014-05-19 10:47:10.565667 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -3564> 2014-05-19 10:47:10.565680 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xac16c40 con 0x76bd8c0 -3563> 2014-05-19 10:47:10.565711 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -3562> 2014-05-19 10:47:10.565724 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xa618a80 con 0x7b90dc0 -3561> 2014-05-19 10:47:10.565751 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -3560> 2014-05-19 10:47:10.565764 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xa102380 con 0x978d8c0 -3559> 2014-05-19 10:47:10.565796 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -3558> 2014-05-19 10:47:10.565811 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0x9ad2fc0 con 0x978c580 -3557> 2014-05-19 10:47:10.565841 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -3556> 2014-05-19 10:47:10.565855 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xac1b340 con 0x978d340 -3555> 2014-05-19 10:47:10.565887 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -3554> 2014-05-19 10:47:10.565902 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 48 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xac32fc0 con 0x96374a0 -3553> 2014-05-19 10:47:10.565933 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -3552> 2014-05-19 10:47:10.565947 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:10.562926) v2 ==== 47+0+0 (722245526 0 0) 0xac43340 con 0x9ad4420 -3551> 2014-05-19 10:47:10.565977 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -3550> 2014-05-19 10:47:10.582114 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:14.527773) v2 ==== 47+0+0 (1909966967 0 0) 0x9d0ae00 con 0x99d3340 -3549> 2014-05-19 10:47:10.582140 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:14.527773) v2 ==== 47+0+0 (1909966967 0 0) 0xa0cb500 con 0x94a5a20 -3548> 2014-05-19 10:47:10.582213 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:14.527773) v2 -- ?+0 0xac41a40 con 0x99d3340 -3547> 2014-05-19 10:47:10.582748 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -3546> 2014-05-19 10:47:10.582773 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:14.527773) v2 -- ?+0 0x9562000 con 0x94a5a20 -3545> 2014-05-19 10:47:10.582817 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -3544> 2014-05-19 10:47:10.769838 7f55579aa700 20 OSD::op_tp worker waiting -3543> 2014-05-19 10:47:10.769865 7f55551a5700 20 OSD::op_tp worker waiting -3542> 2014-05-19 10:47:10.769893 7f555a1af700 20 OSD::op_tp worker waiting -3541> 2014-05-19 10:47:10.771447 7f55549a4700 20 OSD::op_tp worker waiting -3540> 2014-05-19 10:47:10.771476 7f555a9b0700 20 OSD::op_tp worker waiting -3539> 2014-05-19 10:47:10.771496 7f55569a8700 20 OSD::op_tp worker waiting -3538> 2014-05-19 10:47:10.771519 7f555b1b1700 20 OSD::op_tp worker waiting -3537> 2014-05-19 10:47:10.771539 7f55589ac700 20 OSD::op_tp worker waiting -3536> 2014-05-19 10:47:10.771592 7f55541a3700 20 OSD::op_tp worker waiting -3535> 2014-05-19 10:47:10.772300 7f55581ab700 20 OSD::op_tp worker waiting -3534> 2014-05-19 10:47:10.772320 7f55571a9700 20 OSD::op_tp worker waiting -3533> 2014-05-19 10:47:10.772366 7f55531a1700 20 OSD::op_tp worker waiting -3532> 2014-05-19 10:47:10.772379 7f555219f700 20 OSD::op_tp worker waiting -3531> 2014-05-19 10:47:10.772408 7f55539a2700 20 OSD::op_tp worker waiting -3530> 2014-05-19 10:47:10.772419 7f55599ae700 20 OSD::op_tp worker waiting -3529> 2014-05-19 10:47:10.772441 7f55529a0700 20 OSD::op_tp worker waiting -3528> 2014-05-19 10:47:10.772470 7f55561a7700 20 OSD::op_tp worker waiting -3527> 2014-05-19 10:47:10.772491 7f55591ad700 20 OSD::op_tp worker waiting -3526> 2014-05-19 10:47:10.772561 7f55559a6700 20 OSD::op_tp worker waiting -3525> 2014-05-19 10:47:10.772598 7f555199e700 20 OSD::op_tp worker waiting -3524> 2014-05-19 10:47:10.872022 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:13.478857) v2 ==== 47+0+0 (3164320579 0 0) 0x9c08fc0 con 0x9656160 -3523> 2014-05-19 10:47:10.872100 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:13.478857) v2 -- ?+0 0x9d0ae00 con 0x9656160 -3522> 2014-05-19 10:47:10.872186 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -3521> 2014-05-19 10:47:10.872029 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:13.478857) v2 ==== 47+0+0 (3164320579 0 0) 0xa23f180 con 0x9656f20 -3520> 2014-05-19 10:47:10.872532 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:13.478857) v2 -- ?+0 0xa0cb500 con 0x9656f20 -3519> 2014-05-19 10:47:10.872625 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -3518> 2014-05-19 10:47:10.922636 7f5566602700 5 osd.0 245 tick -3517> 2014-05-19 10:47:10.922659 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -3516> 2014-05-19 10:47:10.922664 7f5566602700 10 osd.0 245 do_waiters -- start -3515> 2014-05-19 10:47:10.922666 7f5566602700 10 osd.0 245 do_waiters -- finish -3514> 2014-05-19 10:47:10.922706 7f555119d700 20 OSD::recovery_tp worker waiting -3513> 2014-05-19 10:47:11.058841 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:13.665666) v2 ==== 47+0+0 (2072160850 0 0) 0x9c6f500 con 0x94e2160 -3512> 2014-05-19 10:47:11.058884 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:13.665666) v2 -- ?+0 0xa23f180 con 0x94e2160 -3511> 2014-05-19 10:47:11.058929 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:13.665666) v2 ==== 47+0+0 (2072160850 0 0) 0xac09180 con 0x9b8de40 -3510> 2014-05-19 10:47:11.059194 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -3509> 2014-05-19 10:47:11.059220 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:13.665666) v2 -- ?+0 0x9c08fc0 con 0x9b8de40 -3508> 2014-05-19 10:47:11.059393 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -3507> 2014-05-19 10:47:11.111570 7f5564dff700 20 KeyValueStore::op_tp worker waiting -3506> 2014-05-19 10:47:11.201562 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:11.201380) v2 ==== 47+0+0 (952744948 0 0) 0x9cd1a40 con 0x9656580 -3505> 2014-05-19 10:47:11.201615 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:11.201380) v2 -- ?+0 0xac09180 con 0x9656580 -3504> 2014-05-19 10:47:11.201652 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -3503> 2014-05-19 10:47:11.201623 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:11.201380) v2 ==== 47+0+0 (952744948 0 0) 0x9c081c0 con 0x9657340 -3502> 2014-05-19 10:47:11.201682 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:11.201380) v2 -- ?+0 0x9c6f500 con 0x9657340 -3501> 2014-05-19 10:47:11.201717 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -3500> 2014-05-19 10:47:11.318684 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:15.264287) v2 ==== 47+0+0 (2662813487 0 0) 0xac15340 con 0x987b340 -3499> 2014-05-19 10:47:11.318730 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:15.264287) v2 -- ?+0 0x9cd1a40 con 0x987b340 -3498> 2014-05-19 10:47:11.319102 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -3497> 2014-05-19 10:47:11.319144 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:15.264287) v2 ==== 47+0+0 (2662813487 0 0) 0xac14540 con 0x94e26e0 -3496> 2014-05-19 10:47:11.319187 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:15.264287) v2 -- ?+0 0x9c081c0 con 0x94e26e0 -3495> 2014-05-19 10:47:11.319221 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -3494> 2014-05-19 10:47:11.450591 7f555019b700 20 OSD::command_tp worker waiting -3493> 2014-05-19 10:47:11.453791 7f555099c700 20 OSD::disk_tp worker waiting -3492> 2014-05-19 10:47:11.648076 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:14.254920) v2 ==== 47+0+0 (3003644269 0 0) 0x9ebbdc0 con 0x9b8c160 -3491> 2014-05-19 10:47:11.648127 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:14.254920) v2 -- ?+0 0xac15340 con 0x9b8c160 -3490> 2014-05-19 10:47:11.648206 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -3489> 2014-05-19 10:47:11.648431 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:14.254920) v2 ==== 47+0+0 (3003644269 0 0) 0x9fb4540 con 0x9aa3600 -3488> 2014-05-19 10:47:11.648471 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:14.254920) v2 -- ?+0 0xac14540 con 0x9aa3600 -3487> 2014-05-19 10:47:11.648572 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -3486> 2014-05-19 10:47:11.922758 7f5566602700 5 osd.0 245 tick -3485> 2014-05-19 10:47:11.922822 7f555119d700 20 OSD::recovery_tp worker waiting -3484> 2014-05-19 10:47:11.922819 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.53 >= max 0.5 = no, load too high -3483> 2014-05-19 10:47:11.922852 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -3482> 2014-05-19 10:47:11.922858 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2252.46 < min (86400 seconds) -3481> 2014-05-19 10:47:11.922883 7f5566602700 20 osd.0 245 sched_scrub done -3480> 2014-05-19 10:47:11.922888 7f5566602700 10 osd.0 245 do_waiters -- start -3479> 2014-05-19 10:47:11.922891 7f5566602700 10 osd.0 245 do_waiters -- finish -3478> 2014-05-19 10:47:12.156701 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:14.763545) v2 ==== 47+0+0 (629974546 0 0) 0xac08540 con 0x95846e0 -3477> 2014-05-19 10:47:12.156744 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:14.763545) v2 -- ?+0 0x9ebbdc0 con 0x95846e0 -3476> 2014-05-19 10:47:12.157049 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:14.763545) v2 ==== 47+0+0 (629974546 0 0) 0xac348c0 con 0x9983600 -3475> 2014-05-19 10:47:12.157185 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -3474> 2014-05-19 10:47:12.157308 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:14.763545) v2 -- ?+0 0x9fb4540 con 0x9983600 -3473> 2014-05-19 10:47:12.157354 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -3472> 2014-05-19 10:47:12.518077 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:15.124931) v2 ==== 47+0+0 (3906362625 0 0) 0xac37180 con 0x9a0cdc0 -3471> 2014-05-19 10:47:12.518080 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:15.124931) v2 ==== 47+0+0 (3906362625 0 0) 0x9c6ec40 con 0x996fb80 -3470> 2014-05-19 10:47:12.518468 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:15.124931) v2 -- ?+0 0xac348c0 con 0x9a0cdc0 -3469> 2014-05-19 10:47:12.518504 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -3468> 2014-05-19 10:47:12.518528 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:15.124931) v2 -- ?+0 0xac08540 con 0x996fb80 -3467> 2014-05-19 10:47:12.518574 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -3466> 2014-05-19 10:47:12.528247 7f5565600700 20 KeyValueStore::op_tp worker waiting -3465> 2014-05-19 10:47:12.713558 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:16.659234) v2 ==== 47+0+0 (3040488999 0 0) 0xa4a9340 con 0x966e000 -3464> 2014-05-19 10:47:12.713592 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:16.659234) v2 ==== 47+0+0 (3040488999 0 0) 0x9cd1880 con 0x9743600 -3463> 2014-05-19 10:47:12.713610 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.659234) v2 -- ?+0 0x9c6ec40 con 0x966e000 -3462> 2014-05-19 10:47:12.713690 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -3461> 2014-05-19 10:47:12.713762 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.659234) v2 -- ?+0 0xac37180 con 0x9743600 -3460> 2014-05-19 10:47:12.713975 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -3459> 2014-05-19 10:47:12.769941 7f55579aa700 20 OSD::op_tp worker waiting -3458> 2014-05-19 10:47:12.769965 7f55551a5700 20 OSD::op_tp worker waiting -3457> 2014-05-19 10:47:12.770001 7f555a1af700 20 OSD::op_tp worker waiting -3456> 2014-05-19 10:47:12.771555 7f55549a4700 20 OSD::op_tp worker waiting -3455> 2014-05-19 10:47:12.771582 7f555a9b0700 20 OSD::op_tp worker waiting -3454> 2014-05-19 10:47:12.771594 7f55569a8700 20 OSD::op_tp worker waiting -3453> 2014-05-19 10:47:12.771616 7f55589ac700 20 OSD::op_tp worker waiting -3452> 2014-05-19 10:47:12.771636 7f555b1b1700 20 OSD::op_tp worker waiting -3451> 2014-05-19 10:47:12.771659 7f55541a3700 20 OSD::op_tp worker waiting -3450> 2014-05-19 10:47:12.772377 7f55581ab700 20 OSD::op_tp worker waiting -3449> 2014-05-19 10:47:12.772399 7f55571a9700 20 OSD::op_tp worker waiting -3448> 2014-05-19 10:47:12.772442 7f55531a1700 20 OSD::op_tp worker waiting -3447> 2014-05-19 10:47:12.772458 7f55539a2700 20 OSD::op_tp worker waiting -3446> 2014-05-19 10:47:12.772476 7f555219f700 20 OSD::op_tp worker waiting -3445> 2014-05-19 10:47:12.772503 7f55599ae700 20 OSD::op_tp worker waiting -3444> 2014-05-19 10:47:12.772536 7f55529a0700 20 OSD::op_tp worker waiting -3443> 2014-05-19 10:47:12.772557 7f55561a7700 20 OSD::op_tp worker waiting -3442> 2014-05-19 10:47:12.772589 7f55591ad700 20 OSD::op_tp worker waiting -3441> 2014-05-19 10:47:12.772639 7f55559a6700 20 OSD::op_tp worker waiting -3440> 2014-05-19 10:47:12.772666 7f555199e700 20 OSD::op_tp worker waiting -3439> 2014-05-19 10:47:12.922981 7f5566602700 5 osd.0 245 tick -3438> 2014-05-19 10:47:12.923001 7f5566602700 7 osd.0 245 do_mon_report -3437> 2014-05-19 10:47:12.923005 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 -3436> 2014-05-19 10:47:12.923009 7f5566602700 20 osd.0 245 send_pg_stats -3435> 2014-05-19 10:47:12.923033 7f555119d700 20 OSD::recovery_tp worker waiting -3434> 2014-05-19 10:47:12.923047 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.53 >= max 0.5 = no, load too high -3433> 2014-05-19 10:47:12.923059 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -3432> 2014-05-19 10:47:12.923062 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2253.46 < min (86400 seconds) -3431> 2014-05-19 10:47:12.923081 7f5566602700 20 osd.0 245 sched_scrub done -3430> 2014-05-19 10:47:12.923085 7f5566602700 10 osd.0 245 do_waiters -- start -3429> 2014-05-19 10:47:12.923086 7f5566602700 10 osd.0 245 do_waiters -- finish -3428> 2014-05-19 10:47:13.111646 7f5564dff700 20 KeyValueStore::op_tp worker waiting -3427> 2014-05-19 10:47:13.215167 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.160832) v2 ==== 47+0+0 (1245529188 0 0) 0x95e61c0 con 0x9743600 -3426> 2014-05-19 10:47:13.215167 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.160832) v2 ==== 47+0+0 (1245529188 0 0) 0x9c6fa40 con 0x966e000 -3425> 2014-05-19 10:47:13.215224 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.160832) v2 -- ?+0 0x9cd1880 con 0x9743600 -3424> 2014-05-19 10:47:13.215326 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -3423> 2014-05-19 10:47:13.215703 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.160832) v2 -- ?+0 0xa4a9340 con 0x966e000 -3422> 2014-05-19 10:47:13.215742 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -3421> 2014-05-19 10:47:13.291480 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.237195) v2 ==== 47+0+0 (1615345823 0 0) 0xac23c00 con 0x99f1080 -3420> 2014-05-19 10:47:13.291486 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.237195) v2 ==== 47+0+0 (1615345823 0 0) 0x9c088c0 con 0x987af20 -3419> 2014-05-19 10:47:13.291521 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.237195) v2 -- ?+0 0x95e61c0 con 0x99f1080 -3418> 2014-05-19 10:47:13.291605 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -3417> 2014-05-19 10:47:13.291875 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.237195) v2 -- ?+0 0x9c6fa40 con 0x987af20 -3416> 2014-05-19 10:47:13.291964 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -3415> 2014-05-19 10:47:13.360052 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:15.966997) v2 ==== 47+0+0 (708693758 0 0) 0xac35c00 con 0x9b8de40 -3414> 2014-05-19 10:47:13.360105 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:15.966997) v2 -- ?+0 0x9c088c0 con 0x9b8de40 -3413> 2014-05-19 10:47:13.360117 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:15.966997) v2 ==== 47+0+0 (708693758 0 0) 0x9c09180 con 0x94e2160 -3412> 2014-05-19 10:47:13.360211 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -3411> 2014-05-19 10:47:13.360251 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:15.966997) v2 -- ?+0 0xac23c00 con 0x94e2160 -3410> 2014-05-19 10:47:13.360286 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -3409> 2014-05-19 10:47:13.381999 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.327675) v2 ==== 47+0+0 (1917901921 0 0) 0xac228c0 con 0x95142c0 -3408> 2014-05-19 10:47:13.382051 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.327675) v2 -- ?+0 0x9c09180 con 0x95142c0 -3407> 2014-05-19 10:47:13.382091 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.327675) v2 ==== 47+0+0 (1917901921 0 0) 0x9fa4c40 con 0x99d31e0 -3406> 2014-05-19 10:47:13.382159 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -3405> 2014-05-19 10:47:13.382277 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.327675) v2 -- ?+0 0xac35c00 con 0x99d31e0 -3404> 2014-05-19 10:47:13.382372 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -3403> 2014-05-19 10:47:13.416337 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 68 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:16.023296) v2 ==== 47+0+0 (4179926937 0 0) 0xac08e00 con 0x9657080 -3402> 2014-05-19 10:47:13.416343 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 68 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:16.023296) v2 ==== 47+0+0 (4179926937 0 0) 0x9ad2e00 con 0x96562c0 -3401> 2014-05-19 10:47:13.416395 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.023296) v2 -- ?+0 0xac228c0 con 0x9657080 -3400> 2014-05-19 10:47:13.416940 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -3399> 2014-05-19 10:47:13.416987 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.023296) v2 -- ?+0 0x9fa4c40 con 0x96562c0 -3398> 2014-05-19 10:47:13.417072 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -3397> 2014-05-19 10:47:13.450689 7f555019b700 20 OSD::command_tp worker waiting -3396> 2014-05-19 10:47:13.453889 7f555099c700 20 OSD::disk_tp worker waiting -3395> 2014-05-19 10:47:13.500203 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.445858) v2 ==== 47+0+0 (3296739114 0 0) 0xac42fc0 con 0x9bb7b80 -3394> 2014-05-19 10:47:13.500257 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.445858) v2 -- ?+0 0x9ad2e00 con 0x9bb7b80 -3393> 2014-05-19 10:47:13.500255 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.445858) v2 ==== 47+0+0 (3296739114 0 0) 0xac40c40 con 0x95151e0 -3392> 2014-05-19 10:47:13.500332 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -3391> 2014-05-19 10:47:13.500358 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.445858) v2 -- ?+0 0xac08e00 con 0x95151e0 -3390> 2014-05-19 10:47:13.500391 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -3389> 2014-05-19 10:47:13.502949 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 67 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:13.502760) v2 ==== 47+0+0 (1202208995 0 0) 0xac43dc0 con 0x9656580 -3388> 2014-05-19 10:47:13.503001 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:13.502760) v2 -- ?+0 0xac42fc0 con 0x9656580 -3387> 2014-05-19 10:47:13.503040 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -3386> 2014-05-19 10:47:13.503026 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 67 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:13.502760) v2 ==== 47+0+0 (1202208995 0 0) 0xac45340 con 0x9657340 -3385> 2014-05-19 10:47:13.503075 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:13.502760) v2 -- ?+0 0xac40c40 con 0x9657340 -3384> 2014-05-19 10:47:13.503129 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -3383> 2014-05-19 10:47:13.523525 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:16.130406) v2 ==== 47+0+0 (610700908 0 0) 0xa74ae00 con 0x9b8db80 -3382> 2014-05-19 10:47:13.523534 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:16.130406) v2 ==== 47+0+0 (610700908 0 0) 0x93ad500 con 0x7b90160 -3381> 2014-05-19 10:47:13.523578 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.130406) v2 -- ?+0 0xac43dc0 con 0x9b8db80 -3380> 2014-05-19 10:47:13.523615 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -3379> 2014-05-19 10:47:13.523641 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.130406) v2 -- ?+0 0xac45340 con 0x7b90160 -3378> 2014-05-19 10:47:13.523688 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -3377> 2014-05-19 10:47:13.619852 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.565565) v2 ==== 47+0+0 (471500970 0 0) 0xac15500 con 0x987b340 -3376> 2014-05-19 10:47:13.619908 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.565565) v2 -- ?+0 0xa74ae00 con 0x987b340 -3375> 2014-05-19 10:47:13.619962 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -3374> 2014-05-19 10:47:13.619839 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.565565) v2 ==== 47+0+0 (471500970 0 0) 0xac14c40 con 0x94e26e0 -3373> 2014-05-19 10:47:13.620004 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.565565) v2 -- ?+0 0x93ad500 con 0x94e26e0 -3372> 2014-05-19 10:47:13.620030 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -3371> 2014-05-19 10:47:13.628203 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.573888) v2 ==== 47+0+0 (3133744593 0 0) 0xac45dc0 con 0x94802c0 -3370> 2014-05-19 10:47:13.628253 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.573888) v2 -- ?+0 0xac14c40 con 0x94802c0 -3369> 2014-05-19 10:47:13.628283 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -3368> 2014-05-19 10:47:13.628468 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 46 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.573888) v2 ==== 47+0+0 (3133744593 0 0) 0xac46fc0 con 0x987b760 -3367> 2014-05-19 10:47:13.628558 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.573888) v2 -- ?+0 0xac15500 con 0x987b760 -3366> 2014-05-19 10:47:13.628589 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -3365> 2014-05-19 10:47:13.773425 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.719128) v2 ==== 47+0+0 (3929089429 0 0) 0x9e6c1c0 con 0x9970840 -3364> 2014-05-19 10:47:13.773763 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.719128) v2 -- ?+0 0xac46fc0 con 0x9970840 -3363> 2014-05-19 10:47:13.773845 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -3362> 2014-05-19 10:47:13.773395 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.719128) v2 ==== 47+0+0 (3929089429 0 0) 0xa0bddc0 con 0x97434a0 -3361> 2014-05-19 10:47:13.773882 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.719128) v2 -- ?+0 0xac45dc0 con 0x97434a0 -3360> 2014-05-19 10:47:13.773963 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -3359> 2014-05-19 10:47:13.861485 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:16.468354) v2 ==== 47+0+0 (3897850287 0 0) 0xac40e00 con 0x9b8de40 -3358> 2014-05-19 10:47:13.861544 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.468354) v2 -- ?+0 0x9e6c1c0 con 0x9b8de40 -3357> 2014-05-19 10:47:13.861580 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -3356> 2014-05-19 10:47:13.861497 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:16.468354) v2 ==== 47+0+0 (3897850287 0 0) 0x9cb48c0 con 0x94e2160 -3355> 2014-05-19 10:47:13.862089 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.468354) v2 -- ?+0 0xa0bddc0 con 0x94e2160 -3354> 2014-05-19 10:47:13.862140 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -3353> 2014-05-19 10:47:13.923161 7f5566602700 5 osd.0 245 tick -3352> 2014-05-19 10:47:13.923187 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -3351> 2014-05-19 10:47:13.923192 7f5566602700 10 osd.0 245 do_waiters -- start -3350> 2014-05-19 10:47:13.923195 7f5566602700 10 osd.0 245 do_waiters -- finish -3349> 2014-05-19 10:47:13.923231 7f555119d700 20 OSD::recovery_tp worker waiting -3348> 2014-05-19 10:47:14.049746 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 67 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:16.656640) v2 ==== 47+0+0 (3716891055 0 0) 0xa0dd6c0 con 0x96571e0 -3347> 2014-05-19 10:47:14.049802 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 67 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:16.656640) v2 ==== 47+0+0 (3716891055 0 0) 0xac47dc0 con 0x9656420 -3346> 2014-05-19 10:47:14.049822 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.656640) v2 -- ?+0 0x9cb48c0 con 0x96571e0 -3345> 2014-05-19 10:47:14.049879 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -3344> 2014-05-19 10:47:14.050034 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.656640) v2 -- ?+0 0xac40e00 con 0x9656420 -3343> 2014-05-19 10:47:14.050072 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -3342> 2014-05-19 10:47:14.058303 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:16.665202) v2 ==== 47+0+0 (1750996500 0 0) 0xac41880 con 0x996e000 -3341> 2014-05-19 10:47:14.058348 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.665202) v2 -- ?+0 0xac47dc0 con 0x996e000 -3340> 2014-05-19 10:47:14.058470 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -3339> 2014-05-19 10:47:14.058297 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:16.665202) v2 ==== 47+0+0 (1750996500 0 0) 0xa0bd340 con 0x9a0c9a0 -3338> 2014-05-19 10:47:14.058518 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.665202) v2 -- ?+0 0xa0dd6c0 con 0x9a0c9a0 -3337> 2014-05-19 10:47:14.058624 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -3336> 2014-05-19 10:47:14.302459 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:18.248184) v2 ==== 47+0+0 (3545128518 0 0) 0xa1e56c0 con 0x9bb69a0 -3335> 2014-05-19 10:47:14.302509 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:18.248184) v2 -- ?+0 0xac41880 con 0x9bb69a0 -3334> 2014-05-19 10:47:14.302588 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -3333> 2014-05-19 10:47:14.302852 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:18.248184) v2 ==== 47+0+0 (3545128518 0 0) 0xa8728c0 con 0x94e3e40 -3332> 2014-05-19 10:47:14.302906 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:18.248184) v2 -- ?+0 0xa0bd340 con 0x94e3e40 -3331> 2014-05-19 10:47:14.303000 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -3330> 2014-05-19 10:47:14.517967 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 69 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.124855) v2 ==== 47+0+0 (2833650081 0 0) 0x9ad28c0 con 0x96562c0 -3329> 2014-05-19 10:47:14.518005 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 69 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.124855) v2 ==== 47+0+0 (2833650081 0 0) 0xac08a80 con 0x9657080 -3328> 2014-05-19 10:47:14.518030 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.124855) v2 -- ?+0 0xa1e56c0 con 0x96562c0 -3327> 2014-05-19 10:47:14.518063 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -3326> 2014-05-19 10:47:14.518136 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.124855) v2 -- ?+0 0xa8728c0 con 0x9657080 -3325> 2014-05-19 10:47:14.518174 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -3324> 2014-05-19 10:47:14.528345 7f5565600700 20 KeyValueStore::op_tp worker waiting -3323> 2014-05-19 10:47:14.551134 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 68 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.158074) v2 ==== 47+0+0 (2523943958 0 0) 0xac47c00 con 0x9656420 -3322> 2014-05-19 10:47:14.551186 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.158074) v2 -- ?+0 0x9ad28c0 con 0x9656420 -3321> 2014-05-19 10:47:14.551212 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 68 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.158074) v2 ==== 47+0+0 (2523943958 0 0) 0x9cb9c00 con 0x96571e0 -3320> 2014-05-19 10:47:14.551249 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -3319> 2014-05-19 10:47:14.551369 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.158074) v2 -- ?+0 0xac08a80 con 0x96571e0 -3318> 2014-05-19 10:47:14.551456 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -3317> 2014-05-19 10:47:14.770019 7f55579aa700 20 OSD::op_tp worker waiting -3316> 2014-05-19 10:47:14.770046 7f55551a5700 20 OSD::op_tp worker waiting -3315> 2014-05-19 10:47:14.770073 7f555a1af700 20 OSD::op_tp worker waiting -3314> 2014-05-19 10:47:14.771660 7f55549a4700 20 OSD::op_tp worker waiting -3313> 2014-05-19 10:47:14.771686 7f555a9b0700 20 OSD::op_tp worker waiting -3312> 2014-05-19 10:47:14.771703 7f55569a8700 20 OSD::op_tp worker waiting -3311> 2014-05-19 10:47:14.771724 7f55589ac700 20 OSD::op_tp worker waiting -3310> 2014-05-19 10:47:14.771746 7f555b1b1700 20 OSD::op_tp worker waiting -3309> 2014-05-19 10:47:14.771779 7f55541a3700 20 OSD::op_tp worker waiting -3308> 2014-05-19 10:47:14.772446 7f55581ab700 20 OSD::op_tp worker waiting -3307> 2014-05-19 10:47:14.772466 7f55571a9700 20 OSD::op_tp worker waiting -3306> 2014-05-19 10:47:14.772506 7f55531a1700 20 OSD::op_tp worker waiting -3305> 2014-05-19 10:47:14.772540 7f55539a2700 20 OSD::op_tp worker waiting -3304> 2014-05-19 10:47:14.772552 7f555219f700 20 OSD::op_tp worker waiting -3303> 2014-05-19 10:47:14.772571 7f55599ae700 20 OSD::op_tp worker waiting -3302> 2014-05-19 10:47:14.772610 7f55529a0700 20 OSD::op_tp worker waiting -3301> 2014-05-19 10:47:14.772625 7f55561a7700 20 OSD::op_tp worker waiting -3300> 2014-05-19 10:47:14.772662 7f55591ad700 20 OSD::op_tp worker waiting -3299> 2014-05-19 10:47:14.772707 7f55559a6700 20 OSD::op_tp worker waiting -3298> 2014-05-19 10:47:14.772736 7f555199e700 20 OSD::op_tp worker waiting -3297> 2014-05-19 10:47:14.923266 7f5566602700 5 osd.0 245 tick -3296> 2014-05-19 10:47:14.923321 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.53 >= max 0.5 = no, load too high -3295> 2014-05-19 10:47:14.923334 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -3294> 2014-05-19 10:47:14.923336 7f555119d700 20 OSD::recovery_tp worker waiting -3293> 2014-05-19 10:47:14.923337 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2255.46 < min (86400 seconds) -3292> 2014-05-19 10:47:14.923356 7f5566602700 20 osd.0 245 sched_scrub done -3291> 2014-05-19 10:47:14.923359 7f5566602700 10 osd.0 245 do_waiters -- start -3290> 2014-05-19 10:47:14.923361 7f5566602700 10 osd.0 245 do_waiters -- finish -3289> 2014-05-19 10:47:14.962824 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.569701) v2 ==== 47+0+0 (1983061775 0 0) 0x9faa8c0 con 0x9b8de40 -3288> 2014-05-19 10:47:14.962877 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.569701) v2 -- ?+0 0xac47c00 con 0x9b8de40 -3287> 2014-05-19 10:47:14.962912 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -3286> 2014-05-19 10:47:14.962826 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.569701) v2 ==== 47+0+0 (1983061775 0 0) 0x9cb5340 con 0x94e2160 -3285> 2014-05-19 10:47:14.963419 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.569701) v2 -- ?+0 0x9cb9c00 con 0x94e2160 -3284> 2014-05-19 10:47:14.963460 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -3283> 2014-05-19 10:47:15.111719 7f5564dff700 20 KeyValueStore::op_tp worker waiting -3282> 2014-05-19 10:47:15.149377 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.756322) v2 ==== 47+0+0 (77930116 0 0) 0x9f74e00 con 0x9b8c160 -3281> 2014-05-19 10:47:15.149445 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.756322) v2 -- ?+0 0x9faa8c0 con 0x9b8c160 -3280> 2014-05-19 10:47:15.149481 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -3279> 2014-05-19 10:47:15.149447 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:17.756322) v2 ==== 47+0+0 (77930116 0 0) 0x97c2e00 con 0x9aa3600 -3278> 2014-05-19 10:47:15.149514 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:17.756322) v2 -- ?+0 0x9cb5340 con 0x9aa3600 -3277> 2014-05-19 10:47:15.149594 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -3276> 2014-05-19 10:47:15.168950 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:19.114740) v2 ==== 47+0+0 (935676143 0 0) 0xa644c40 con 0x99718c0 -3275> 2014-05-19 10:47:15.168963 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:19.114740) v2 ==== 47+0+0 (935676143 0 0) 0xa0928c0 con 0x97431e0 -3274> 2014-05-19 10:47:15.169001 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.114740) v2 -- ?+0 0x9f74e00 con 0x99718c0 -3273> 2014-05-19 10:47:15.169036 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -3272> 2014-05-19 10:47:15.169168 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.114740) v2 -- ?+0 0x97c2e00 con 0x97431e0 -3271> 2014-05-19 10:47:15.169429 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -3270> 2014-05-19 10:47:15.450786 7f555019b700 20 OSD::command_tp worker waiting -3269> 2014-05-19 10:47:15.453987 7f555099c700 20 OSD::disk_tp worker waiting -3268> 2014-05-19 10:47:15.475093 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:18.081974) v2 ==== 47+0+0 (1826013364 0 0) 0xac33880 con 0x9656000 -3267> 2014-05-19 10:47:15.475159 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:18.081974) v2 -- ?+0 0xa644c40 con 0x9656000 -3266> 2014-05-19 10:47:15.475093 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:18.081974) v2 ==== 47+0+0 (1826013364 0 0) 0x9ffd340 con 0x9937760 -3265> 2014-05-19 10:47:15.475283 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -3264> 2014-05-19 10:47:15.475318 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:18.081974) v2 -- ?+0 0xa0928c0 con 0x9937760 -3263> 2014-05-19 10:47:15.475393 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -3262> 2014-05-19 10:47:15.516574 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:19.462320) v2 ==== 47+0+0 (755988431 0 0) 0x9c6e540 con 0x966e000 -3261> 2014-05-19 10:47:15.516618 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:19.462320) v2 ==== 47+0+0 (755988431 0 0) 0x9e77880 con 0x9743600 -3260> 2014-05-19 10:47:15.516644 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.462320) v2 -- ?+0 0xac33880 con 0x966e000 -3259> 2014-05-19 10:47:15.516677 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -3258> 2014-05-19 10:47:15.516740 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.462320) v2 -- ?+0 0x9ffd340 con 0x9743600 -3257> 2014-05-19 10:47:15.516777 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -3256> 2014-05-19 10:47:15.573570 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:18.180476) v2 ==== 47+0+0 (1194860738 0 0) 0x9c09dc0 con 0x9656160 -3255> 2014-05-19 10:47:15.573621 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:18.180476) v2 -- ?+0 0x9c6e540 con 0x9656160 -3254> 2014-05-19 10:47:15.573669 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -3253> 2014-05-19 10:47:15.573593 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:18.180476) v2 ==== 47+0+0 (1194860738 0 0) 0xa23e700 con 0x9656f20 -3252> 2014-05-19 10:47:15.573719 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:18.180476) v2 -- ?+0 0x9e77880 con 0x9656f20 -3251> 2014-05-19 10:47:15.574071 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -3250> 2014-05-19 10:47:15.923426 7f5566602700 5 osd.0 245 tick -3249> 2014-05-19 10:47:15.923450 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -3248> 2014-05-19 10:47:15.923461 7f5566602700 10 osd.0 245 do_waiters -- start -3247> 2014-05-19 10:47:15.923463 7f5566602700 10 osd.0 245 do_waiters -- finish -3246> 2014-05-19 10:47:15.923488 7f555119d700 20 OSD::recovery_tp worker waiting -3245> 2014-05-19 10:47:16.019614 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:18.626515) v2 ==== 47+0+0 (3188187476 0 0) 0xa05ea80 con 0x996fb80 -3244> 2014-05-19 10:47:16.019638 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:18.626515) v2 ==== 47+0+0 (3188187476 0 0) 0x9748e00 con 0x9a0cdc0 -3243> 2014-05-19 10:47:16.019677 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:18.626515) v2 -- ?+0 0x9c09dc0 con 0x996fb80 -3242> 2014-05-19 10:47:16.019747 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -3241> 2014-05-19 10:47:16.019816 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:18.626515) v2 -- ?+0 0xa23e700 con 0x9a0cdc0 -3240> 2014-05-19 10:47:16.019851 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -3239> 2014-05-19 10:47:16.258139 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:18.865004) v2 ==== 47+0+0 (1895867289 0 0) 0xac08fc0 con 0x95846e0 -3238> 2014-05-19 10:47:16.258157 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:18.865004) v2 ==== 47+0+0 (1895867289 0 0) 0xac35340 con 0x9983600 -3237> 2014-05-19 10:47:16.258194 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:18.865004) v2 -- ?+0 0xa05ea80 con 0x95846e0 -3236> 2014-05-19 10:47:16.258233 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -3235> 2014-05-19 10:47:16.258277 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:18.865004) v2 -- ?+0 0x9748e00 con 0x9983600 -3234> 2014-05-19 10:47:16.258312 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -3233> 2014-05-19 10:47:16.352847 7f555c1b3700 10 monclient: tick -3232> 2014-05-19 10:47:16.352861 7f555c1b3700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2014-05-19 10:46:46.352859) -3231> 2014-05-19 10:47:16.352888 7f555c1b3700 10 monclient: renew subs? (now: 2014-05-19 10:47:16.352888; renew after: 2014-05-19 10:49:36.352721) -- no -3230> 2014-05-19 10:47:16.401726 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:20.347490) v2 ==== 47+0+0 (2985334563 0 0) 0xac40a80 con 0x95151e0 -3229> 2014-05-19 10:47:16.401802 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.347490) v2 -- ?+0 0xac35340 con 0x95151e0 -3228> 2014-05-19 10:47:16.401839 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -3227> 2014-05-19 10:47:16.401850 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:20.347490) v2 ==== 47+0+0 (2985334563 0 0) 0xac42e00 con 0x9bb7b80 -3226> 2014-05-19 10:47:16.401922 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.347490) v2 -- ?+0 0xac08fc0 con 0x9bb7b80 -3225> 2014-05-19 10:47:16.402012 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -3224> 2014-05-19 10:47:16.464229 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -3223> 2014-05-19 10:47:16.464250 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -3222> 2014-05-19 10:47:16.464259 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0x9464000 con 0x9bdc840 -3221> 2014-05-19 10:47:16.464284 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0x9455500 con 0x9ad4420 -3220> 2014-05-19 10:47:16.464325 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xa3dba40 con 0x9bf31e0 -3219> 2014-05-19 10:47:16.464340 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xa093880 con 0x998b340 -3218> 2014-05-19 10:47:16.464356 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xac376c0 con 0x9b92840 -3217> 2014-05-19 10:47:16.464377 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xac17180 con 0x9ad49a0 -3216> 2014-05-19 10:47:16.464407 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xa0cb340 con 0x7b911e0 -3215> 2014-05-19 10:47:16.464431 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xa0bc1c0 con 0x7b918c0 -3214> 2014-05-19 10:47:16.464473 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xa1ef180 con 0x9aa8c60 -3213> 2014-05-19 10:47:16.464505 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xac16fc0 con 0x9bfa000 -3212> 2014-05-19 10:47:16.464535 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0x9ccec40 con 0x7c23e40 -3211> 2014-05-19 10:47:16.464562 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0x95e7180 con 0x998b760 -3210> 2014-05-19 10:47:16.464596 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xa665a40 con 0x7b91080 -3209> 2014-05-19 10:47:16.464625 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xa0bc540 con 0xa28fb80 -3208> 2014-05-19 10:47:16.464618 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0x9faa540 con 0x9bdc840 -3207> 2014-05-19 10:47:16.464648 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xac436c0 con 0x76bdce0 -3206> 2014-05-19 10:47:16.464663 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0x9f43a40 con 0x994ab00 -3205> 2014-05-19 10:47:16.464700 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xa208fc0 con 0x9ac8b00 -3204> 2014-05-19 10:47:16.464728 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0x9faa1c0 con 0x938de40 -3203> 2014-05-19 10:47:16.464744 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xac33dc0 con 0x9970b00 -3202> 2014-05-19 10:47:16.464758 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0x9ba5dc0 con 0x99706e0 -3201> 2014-05-19 10:47:16.464780 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0x9ad3880 con 0x9bb6f20 -3200> 2014-05-19 10:47:16.464794 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xa102c40 con 0x994b340 -3199> 2014-05-19 10:47:16.464808 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0x9fece00 con 0x98fa2c0 -3198> 2014-05-19 10:47:16.464821 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0x94488c0 con 0x996f8c0 -3197> 2014-05-19 10:47:16.464836 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xac31500 con 0x996fa20 -3196> 2014-05-19 10:47:16.464850 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xa0ba1c0 con 0x9ac8160 -3195> 2014-05-19 10:47:16.464875 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xa516380 con 0x7b90420 -3194> 2014-05-19 10:47:16.464905 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xa665180 con 0x919fe40 -3193> 2014-05-19 10:47:16.464928 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0x9fd9500 con 0x9971760 -3192> 2014-05-19 10:47:16.464945 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xa856fc0 con 0x994af20 -3191> 2014-05-19 10:47:16.464972 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0x9ba41c0 con 0x989be40 -3190> 2014-05-19 10:47:16.465004 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0x95e6540 con 0x9adf4a0 -3189> 2014-05-19 10:47:16.465027 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xa7d48c0 con 0x9776160 -3188> 2014-05-19 10:47:16.465052 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xa6d5c00 con 0x96bd8c0 -3187> 2014-05-19 10:47:16.465081 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xa0eaa80 con 0x96bcdc0 -3186> 2014-05-19 10:47:16.465127 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xac368c0 con 0x96954a0 -3185> 2014-05-19 10:47:16.465144 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xa5076c0 con 0x76bd8c0 -3184> 2014-05-19 10:47:16.465159 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xa6aafc0 con 0x7b90dc0 -3183> 2014-05-19 10:47:16.465192 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xac33500 con 0x978d8c0 -3182> 2014-05-19 10:47:16.465290 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xac32000 con 0x978c580 -3181> 2014-05-19 10:47:16.465341 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xac2a540 con 0x978d340 -3180> 2014-05-19 10:47:16.465374 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:16.464257) v2 -- ?+0 0xa857a40 con 0x96374a0 -3179> 2014-05-19 10:47:16.465421 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -3178> 2014-05-19 10:47:16.465448 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xa4dee00 con 0x9ad4420 -3177> 2014-05-19 10:47:16.465476 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -3176> 2014-05-19 10:47:16.465492 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xa209340 con 0x9bf31e0 -3175> 2014-05-19 10:47:16.465509 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -3174> 2014-05-19 10:47:16.465516 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0x9cb41c0 con 0x998b340 -3173> 2014-05-19 10:47:16.465538 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -3172> 2014-05-19 10:47:16.465577 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0x9e9f340 con 0x9b92840 -3171> 2014-05-19 10:47:16.465613 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -3170> 2014-05-19 10:47:16.465628 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xac49340 con 0x9ad49a0 -3169> 2014-05-19 10:47:16.465646 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -3168> 2014-05-19 10:47:16.465665 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xa665500 con 0x7b911e0 -3167> 2014-05-19 10:47:16.465684 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -3166> 2014-05-19 10:47:16.465690 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xa44ca80 con 0x7b918c0 -3165> 2014-05-19 10:47:16.465705 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -3164> 2014-05-19 10:47:16.465720 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xa07a540 con 0x9aa8c60 -3163> 2014-05-19 10:47:16.465754 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -3162> 2014-05-19 10:47:16.465766 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xac16700 con 0x9bfa000 -3161> 2014-05-19 10:47:16.465799 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -3160> 2014-05-19 10:47:16.465827 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xa1efa40 con 0x7c23e40 -3159> 2014-05-19 10:47:16.465854 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -3158> 2014-05-19 10:47:16.465863 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0x9ad3c00 con 0x998b760 -3157> 2014-05-19 10:47:16.465878 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -3156> 2014-05-19 10:47:16.465887 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xa0ca000 con 0x7b91080 -3155> 2014-05-19 10:47:16.465905 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -3154> 2014-05-19 10:47:16.465912 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0x9ffcfc0 con 0xa28fb80 -3153> 2014-05-19 10:47:16.465926 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -3152> 2014-05-19 10:47:16.465934 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xac37500 con 0x76bdce0 -3151> 2014-05-19 10:47:16.465948 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -3150> 2014-05-19 10:47:16.465955 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xa817a40 con 0x994ab00 -3149> 2014-05-19 10:47:16.465969 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -3148> 2014-05-19 10:47:16.465977 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xa3dbdc0 con 0x9ac8b00 -3147> 2014-05-19 10:47:16.465992 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -3146> 2014-05-19 10:47:16.465999 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xac34a80 con 0x938de40 -3145> 2014-05-19 10:47:16.466015 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -3144> 2014-05-19 10:47:16.466023 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xa6d4c40 con 0x9970b00 -3143> 2014-05-19 10:47:16.466038 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -3142> 2014-05-19 10:47:16.466046 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xa4ff500 con 0x99706e0 -3141> 2014-05-19 10:47:16.466060 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -3140> 2014-05-19 10:47:16.466068 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0x9f19500 con 0x9bb6f20 -3139> 2014-05-19 10:47:16.466082 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -3138> 2014-05-19 10:47:16.466090 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xac34c40 con 0x994b340 -3137> 2014-05-19 10:47:16.466104 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -3136> 2014-05-19 10:47:16.466113 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xac28a80 con 0x98fa2c0 -3135> 2014-05-19 10:47:16.466130 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -3134> 2014-05-19 10:47:16.466137 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0x9547dc0 con 0x996f8c0 -3133> 2014-05-19 10:47:16.466154 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -3132> 2014-05-19 10:47:16.466161 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0x9e9e8c0 con 0x996fa20 -3131> 2014-05-19 10:47:16.466175 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -3130> 2014-05-19 10:47:16.466183 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0x9d52380 con 0x9ac8160 -3129> 2014-05-19 10:47:16.466197 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -3128> 2014-05-19 10:47:16.466204 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xac49dc0 con 0x7b90420 -3127> 2014-05-19 10:47:16.466219 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -3126> 2014-05-19 10:47:16.466226 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xac4b180 con 0x919fe40 -3125> 2014-05-19 10:47:16.466240 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -3124> 2014-05-19 10:47:16.466250 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0x9c6ea80 con 0x9971760 -3123> 2014-05-19 10:47:16.466267 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -3122> 2014-05-19 10:47:16.466274 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xa4fe1c0 con 0x994af20 -3121> 2014-05-19 10:47:16.466288 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -3120> 2014-05-19 10:47:16.466297 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xa1736c0 con 0x989be40 -3119> 2014-05-19 10:47:16.466315 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -3118> 2014-05-19 10:47:16.466322 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0x97c2fc0 con 0x9adf4a0 -3117> 2014-05-19 10:47:16.466336 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -3116> 2014-05-19 10:47:16.466343 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xa1028c0 con 0x9776160 -3115> 2014-05-19 10:47:16.466358 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -3114> 2014-05-19 10:47:16.466367 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xa242c40 con 0x96bd8c0 -3113> 2014-05-19 10:47:16.466384 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -3112> 2014-05-19 10:47:16.466392 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xa102700 con 0x96bcdc0 -3111> 2014-05-19 10:47:16.466409 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -3110> 2014-05-19 10:47:16.466416 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xa6d4000 con 0x96954a0 -3109> 2014-05-19 10:47:16.466430 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -3108> 2014-05-19 10:47:16.466437 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0x9e76e00 con 0x76bd8c0 -3107> 2014-05-19 10:47:16.466452 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -3106> 2014-05-19 10:47:16.466459 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xa6641c0 con 0x7b90dc0 -3105> 2014-05-19 10:47:16.466473 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -3104> 2014-05-19 10:47:16.466485 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xa102540 con 0x978d8c0 -3103> 2014-05-19 10:47:16.466502 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -3102> 2014-05-19 10:47:16.466510 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0x9ad2540 con 0x978c580 -3101> 2014-05-19 10:47:16.466527 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -3100> 2014-05-19 10:47:16.466534 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xac1b180 con 0x978d340 -3099> 2014-05-19 10:47:16.466548 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -3098> 2014-05-19 10:47:16.466556 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 49 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:16.464257) v2 ==== 47+0+0 (1228639532 0 0) 0xac33340 con 0x96374a0 -3097> 2014-05-19 10:47:16.466572 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -3096> 2014-05-19 10:47:16.483372 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:20.429198) v2 ==== 47+0+0 (1490927873 0 0) 0x9b441c0 con 0x99d3340 -3095> 2014-05-19 10:47:16.483408 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:20.429198) v2 ==== 47+0+0 (1490927873 0 0) 0xa0cba40 con 0x94a5a20 -3094> 2014-05-19 10:47:16.483421 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.429198) v2 -- ?+0 0xac42e00 con 0x99d3340 -3093> 2014-05-19 10:47:16.483880 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -3092> 2014-05-19 10:47:16.483901 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.429198) v2 -- ?+0 0xac40a80 con 0x94a5a20 -3091> 2014-05-19 10:47:16.483991 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -3090> 2014-05-19 10:47:16.528443 7f5565600700 20 KeyValueStore::op_tp worker waiting -3089> 2014-05-19 10:47:16.529483 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:20.475279) v2 ==== 47+0+0 (614554100 0 0) 0xac45c00 con 0x94802c0 -3088> 2014-05-19 10:47:16.529536 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.475279) v2 -- ?+0 0xa0cba40 con 0x94802c0 -3087> 2014-05-19 10:47:16.529594 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 47 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:20.475279) v2 ==== 47+0+0 (614554100 0 0) 0xac46e00 con 0x987b760 -3086> 2014-05-19 10:47:16.529996 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -3085> 2014-05-19 10:47:16.530062 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.475279) v2 -- ?+0 0x9b441c0 con 0x987b760 -3084> 2014-05-19 10:47:16.530143 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -3083> 2014-05-19 10:47:16.770120 7f55579aa700 20 OSD::op_tp worker waiting -3082> 2014-05-19 10:47:16.770145 7f55551a5700 20 OSD::op_tp worker waiting -3081> 2014-05-19 10:47:16.770171 7f555a1af700 20 OSD::op_tp worker waiting -3080> 2014-05-19 10:47:16.771765 7f555a9b0700 20 OSD::op_tp worker waiting -3079> 2014-05-19 10:47:16.771786 7f55569a8700 20 OSD::op_tp worker waiting -3078> 2014-05-19 10:47:16.771807 7f55549a4700 20 OSD::op_tp worker waiting -3077> 2014-05-19 10:47:16.771822 7f55589ac700 20 OSD::op_tp worker waiting -3076> 2014-05-19 10:47:16.771840 7f555b1b1700 20 OSD::op_tp worker waiting -3075> 2014-05-19 10:47:16.771856 7f55541a3700 20 OSD::op_tp worker waiting -3074> 2014-05-19 10:47:16.772515 7f55581ab700 20 OSD::op_tp worker waiting -3073> 2014-05-19 10:47:16.772532 7f55571a9700 20 OSD::op_tp worker waiting -3072> 2014-05-19 10:47:16.772576 7f55531a1700 20 OSD::op_tp worker waiting -3071> 2014-05-19 10:47:16.772601 7f55539a2700 20 OSD::op_tp worker waiting -3070> 2014-05-19 10:47:16.772623 7f55599ae700 20 OSD::op_tp worker waiting -3069> 2014-05-19 10:47:16.772633 7f555219f700 20 OSD::op_tp worker waiting -3068> 2014-05-19 10:47:16.772688 7f55529a0700 20 OSD::op_tp worker waiting -3067> 2014-05-19 10:47:16.772706 7f55561a7700 20 OSD::op_tp worker waiting -3066> 2014-05-19 10:47:16.772727 7f55591ad700 20 OSD::op_tp worker waiting -3065> 2014-05-19 10:47:16.772773 7f55559a6700 20 OSD::op_tp worker waiting -3064> 2014-05-19 10:47:16.772800 7f555199e700 20 OSD::op_tp worker waiting -3063> 2014-05-19 10:47:16.819366 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 70 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:19.426309) v2 ==== 47+0+0 (1025063242 0 0) 0x9ad3500 con 0x96562c0 -3062> 2014-05-19 10:47:16.819406 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 70 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:19.426309) v2 ==== 47+0+0 (1025063242 0 0) 0xac096c0 con 0x9657080 -3061> 2014-05-19 10:47:16.819419 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.426309) v2 -- ?+0 0xac46e00 con 0x96562c0 -3060> 2014-05-19 10:47:16.819450 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -3059> 2014-05-19 10:47:16.819474 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.426309) v2 -- ?+0 0xac45c00 con 0x9657080 -3058> 2014-05-19 10:47:16.819549 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -3057> 2014-05-19 10:47:16.923542 7f5566602700 5 osd.0 245 tick -3056> 2014-05-19 10:47:16.923568 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -3055> 2014-05-19 10:47:16.923572 7f5566602700 10 osd.0 245 do_waiters -- start -3054> 2014-05-19 10:47:16.923574 7f5566602700 10 osd.0 245 do_waiters -- finish -3053> 2014-05-19 10:47:16.923595 7f555119d700 20 OSD::recovery_tp worker waiting -3052> 2014-05-19 10:47:17.025019 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:19.631945) v2 ==== 47+0+0 (1856486488 0 0) 0x9f19c00 con 0x7b90160 -3051> 2014-05-19 10:47:17.025073 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.631945) v2 -- ?+0 0xac096c0 con 0x7b90160 -3050> 2014-05-19 10:47:17.025093 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:19.631945) v2 ==== 47+0+0 (1856486488 0 0) 0xa464380 con 0x9b8db80 -3049> 2014-05-19 10:47:17.025183 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -3048> 2014-05-19 10:47:17.025212 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.631945) v2 -- ?+0 0x9ad3500 con 0x9b8db80 -3047> 2014-05-19 10:47:17.025322 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -3046> 2014-05-19 10:47:17.111802 7f5564dff700 20 KeyValueStore::op_tp worker waiting -3045> 2014-05-19 10:47:17.392636 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:21.338479) v2 ==== 47+0+0 (4112501526 0 0) 0x9c0e700 con 0x99f1080 -3044> 2014-05-19 10:47:17.392661 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:21.338479) v2 ==== 47+0+0 (4112501526 0 0) 0xa7d4700 con 0x987af20 -3043> 2014-05-19 10:47:17.393165 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:21.338479) v2 -- ?+0 0x9f19c00 con 0x99f1080 -3042> 2014-05-19 10:47:17.393231 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -3041> 2014-05-19 10:47:17.393268 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:21.338479) v2 -- ?+0 0xa464380 con 0x987af20 -3040> 2014-05-19 10:47:17.393333 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -3039> 2014-05-19 10:47:17.450879 7f555019b700 20 OSD::command_tp worker waiting -3038> 2014-05-19 10:47:17.452567 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 69 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:20.059525) v2 ==== 47+0+0 (2663172656 0 0) 0xac47a40 con 0x9656420 -3037> 2014-05-19 10:47:17.452653 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.059525) v2 -- ?+0 0xa7d4700 con 0x9656420 -3036> 2014-05-19 10:47:17.452707 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -3035> 2014-05-19 10:47:17.452603 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 69 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:20.059525) v2 ==== 47+0+0 (2663172656 0 0) 0xa1eec40 con 0x96571e0 -3034> 2014-05-19 10:47:17.453213 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.059525) v2 -- ?+0 0x9c0e700 con 0x96571e0 -3033> 2014-05-19 10:47:17.453247 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -3032> 2014-05-19 10:47:17.454070 7f555099c700 20 OSD::disk_tp worker waiting -3031> 2014-05-19 10:47:17.470202 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:21.416080) v2 ==== 47+0+0 (1234671263 0 0) 0xa664700 con 0x99718c0 -3030> 2014-05-19 10:47:17.470256 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:21.416080) v2 -- ?+0 0xac47a40 con 0x99718c0 -3029> 2014-05-19 10:47:17.470267 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:21.416080) v2 ==== 47+0+0 (1234671263 0 0) 0xa1df6c0 con 0x97431e0 -3028> 2014-05-19 10:47:17.470293 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -3027> 2014-05-19 10:47:17.470385 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:21.416080) v2 -- ?+0 0xa1eec40 con 0x97431e0 -3026> 2014-05-19 10:47:17.470425 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -3025> 2014-05-19 10:47:17.923663 7f5566602700 5 osd.0 245 tick -3024> 2014-05-19 10:47:17.923683 7f5566602700 7 osd.0 245 do_mon_report -3023> 2014-05-19 10:47:17.923688 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 -3022> 2014-05-19 10:47:17.923692 7f5566602700 20 osd.0 245 send_pg_stats -3021> 2014-05-19 10:47:17.923701 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -3020> 2014-05-19 10:47:17.923705 7f5566602700 10 osd.0 245 do_waiters -- start -3019> 2014-05-19 10:47:17.923707 7f5566602700 10 osd.0 245 do_waiters -- finish -3018> 2014-05-19 10:47:17.923742 7f555119d700 20 OSD::recovery_tp worker waiting -3017> 2014-05-19 10:47:17.959906 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:20.566452) v2 ==== 47+0+0 (2087060989 0 0) 0xac081c0 con 0x95846e0 -3016> 2014-05-19 10:47:17.959962 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.566452) v2 -- ?+0 0xa664700 con 0x95846e0 -3015> 2014-05-19 10:47:17.959994 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -3014> 2014-05-19 10:47:17.959903 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:20.566452) v2 ==== 47+0+0 (2087060989 0 0) 0xa1728c0 con 0x9983600 -3013> 2014-05-19 10:47:17.960032 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.566452) v2 -- ?+0 0xa1df6c0 con 0x9983600 -3012> 2014-05-19 10:47:17.960107 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -3011> 2014-05-19 10:47:17.971559 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:21.917448) v2 ==== 47+0+0 (4294082015 0 0) 0x9706c40 con 0x97431e0 -3010> 2014-05-19 10:47:17.971567 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:21.917448) v2 ==== 47+0+0 (4294082015 0 0) 0x9fdc540 con 0x99718c0 -3009> 2014-05-19 10:47:17.971654 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:21.917448) v2 -- ?+0 0xac081c0 con 0x99718c0 -3008> 2014-05-19 10:47:17.971695 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -3007> 2014-05-19 10:47:17.971983 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:21.917448) v2 -- ?+0 0xa1728c0 con 0x97431e0 -3006> 2014-05-19 10:47:17.972025 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -3005> 2014-05-19 10:47:18.103048 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:22.048861) v2 ==== 47+0+0 (2920165463 0 0) 0xac42c40 con 0x9bb7b80 -3004> 2014-05-19 10:47:18.103100 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:22.048861) v2 -- ?+0 0x9fdc540 con 0x9bb7b80 -3003> 2014-05-19 10:47:18.103193 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -3002> 2014-05-19 10:47:18.103367 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:22.048861) v2 ==== 47+0+0 (2920165463 0 0) 0xac408c0 con 0x95151e0 -3001> 2014-05-19 10:47:18.103406 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:22.048861) v2 -- ?+0 0x9706c40 con 0x95151e0 -3000> 2014-05-19 10:47:18.103534 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -2999> 2014-05-19 10:47:18.159710 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:20.766646) v2 ==== 47+0+0 (3620310362 0 0) 0xac416c0 con 0x996e000 -2998> 2014-05-19 10:47:18.159728 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:20.766646) v2 ==== 47+0+0 (3620310362 0 0) 0x9fa4540 con 0x9a0c9a0 -2997> 2014-05-19 10:47:18.159761 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.766646) v2 -- ?+0 0xac42c40 con 0x996e000 -2996> 2014-05-19 10:47:18.159848 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -2995> 2014-05-19 10:47:18.159897 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.766646) v2 -- ?+0 0xac408c0 con 0x9a0c9a0 -2994> 2014-05-19 10:47:18.159933 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -2993> 2014-05-19 10:47:18.464258 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:21.071205) v2 ==== 47+0+0 (2804979867 0 0) 0xa2bce00 con 0x9b8de40 -2992> 2014-05-19 10:47:18.464310 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:21.071205) v2 -- ?+0 0xac416c0 con 0x9b8de40 -2991> 2014-05-19 10:47:18.464395 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -2990> 2014-05-19 10:47:18.464362 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:21.071205) v2 ==== 47+0+0 (2804979867 0 0) 0x9fa8c40 con 0x94e2160 -2989> 2014-05-19 10:47:18.464430 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:21.071205) v2 -- ?+0 0x9fa4540 con 0x94e2160 -2988> 2014-05-19 10:47:18.464920 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -2987> 2014-05-19 10:47:18.528539 7f5565600700 20 KeyValueStore::op_tp worker waiting -2986> 2014-05-19 10:47:18.554111 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 70 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:21.160960) v2 ==== 47+0+0 (867994057 0 0) 0xac47880 con 0x9656420 -2985> 2014-05-19 10:47:18.554163 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:21.160960) v2 -- ?+0 0xa2bce00 con 0x9656420 -2984> 2014-05-19 10:47:18.554198 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -2983> 2014-05-19 10:47:18.554089 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 70 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:21.160960) v2 ==== 47+0+0 (867994057 0 0) 0xa464540 con 0x96571e0 -2982> 2014-05-19 10:47:18.554559 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:21.160960) v2 -- ?+0 0x9fa8c40 con 0x96571e0 -2981> 2014-05-19 10:47:18.554739 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -2980> 2014-05-19 10:47:18.770224 7f55579aa700 20 OSD::op_tp worker waiting -2979> 2014-05-19 10:47:18.770248 7f55551a5700 20 OSD::op_tp worker waiting -2978> 2014-05-19 10:47:18.770270 7f555a1af700 20 OSD::op_tp worker waiting -2977> 2014-05-19 10:47:18.771866 7f55569a8700 20 OSD::op_tp worker waiting -2976> 2014-05-19 10:47:18.771888 7f55549a4700 20 OSD::op_tp worker waiting -2975> 2014-05-19 10:47:18.771912 7f55541a3700 20 OSD::op_tp worker waiting -2974> 2014-05-19 10:47:18.771936 7f55589ac700 20 OSD::op_tp worker waiting -2973> 2014-05-19 10:47:18.771981 7f555a9b0700 20 OSD::op_tp worker waiting -2972> 2014-05-19 10:47:18.772023 7f555b1b1700 20 OSD::op_tp worker waiting -2971> 2014-05-19 10:47:18.772584 7f55581ab700 20 OSD::op_tp worker waiting -2970> 2014-05-19 10:47:18.772601 7f55571a9700 20 OSD::op_tp worker waiting -2969> 2014-05-19 10:47:18.772644 7f55531a1700 20 OSD::op_tp worker waiting -2968> 2014-05-19 10:47:18.772672 7f55599ae700 20 OSD::op_tp worker waiting -2967> 2014-05-19 10:47:18.772703 7f555219f700 20 OSD::op_tp worker waiting -2966> 2014-05-19 10:47:18.772721 7f55539a2700 20 OSD::op_tp worker waiting -2965> 2014-05-19 10:47:18.772758 7f55529a0700 20 OSD::op_tp worker waiting -2964> 2014-05-19 10:47:18.772772 7f55561a7700 20 OSD::op_tp worker waiting -2963> 2014-05-19 10:47:18.772790 7f55591ad700 20 OSD::op_tp worker waiting -2962> 2014-05-19 10:47:18.772840 7f55559a6700 20 OSD::op_tp worker waiting -2961> 2014-05-19 10:47:18.772861 7f555199e700 20 OSD::op_tp worker waiting -2960> 2014-05-19 10:47:18.923797 7f5566602700 5 osd.0 245 tick -2959> 2014-05-19 10:47:18.923827 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -2958> 2014-05-19 10:47:18.923834 7f5566602700 10 osd.0 245 do_waiters -- start -2957> 2014-05-19 10:47:18.923838 7f5566602700 10 osd.0 245 do_waiters -- finish -2956> 2014-05-19 10:47:18.923864 7f555119d700 20 OSD::recovery_tp worker waiting -2955> 2014-05-19 10:47:19.003628 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:22.949546) v2 ==== 47+0+0 (561851308 0 0) 0xa106540 con 0x9bb69a0 -2954> 2014-05-19 10:47:19.003681 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:22.949546) v2 -- ?+0 0xac47880 con 0x9bb69a0 -2953> 2014-05-19 10:47:19.003775 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -2952> 2014-05-19 10:47:19.003756 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:22.949546) v2 ==== 47+0+0 (561851308 0 0) 0xa2de8c0 con 0x94e3e40 -2951> 2014-05-19 10:47:19.004017 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:22.949546) v2 -- ?+0 0xa464540 con 0x94e3e40 -2950> 2014-05-19 10:47:19.004150 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -2949> 2014-05-19 10:47:19.017929 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:22.963893) v2 ==== 47+0+0 (1560524418 0 0) 0xa507180 con 0x966e000 -2948> 2014-05-19 10:47:19.017982 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:22.963893) v2 -- ?+0 0xa106540 con 0x966e000 -2947> 2014-05-19 10:47:19.018042 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -2946> 2014-05-19 10:47:19.018104 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:22.963893) v2 ==== 47+0+0 (1560524418 0 0) 0xa0bac40 con 0x9743600 -2945> 2014-05-19 10:47:19.018183 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:22.963893) v2 -- ?+0 0xa2de8c0 con 0x9743600 -2944> 2014-05-19 10:47:19.018417 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -2943> 2014-05-19 10:47:19.074535 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:23.020436) v2 ==== 47+0+0 (3570911773 0 0) 0x9e6ddc0 con 0x9970840 -2942> 2014-05-19 10:47:19.074494 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:23.020436) v2 ==== 47+0+0 (3570911773 0 0) 0xac356c0 con 0x97434a0 -2941> 2014-05-19 10:47:19.074613 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.020436) v2 -- ?+0 0xa507180 con 0x9970840 -2940> 2014-05-19 10:47:19.074672 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -2939> 2014-05-19 10:47:19.074952 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.020436) v2 -- ?+0 0xa0bac40 con 0x97434a0 -2938> 2014-05-19 10:47:19.075050 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -2937> 2014-05-19 10:47:19.111882 7f5564dff700 20 KeyValueStore::op_tp worker waiting -2936> 2014-05-19 10:47:19.120863 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 71 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:21.727801) v2 ==== 47+0+0 (3011449693 0 0) 0x9c6ec40 con 0x96562c0 -2935> 2014-05-19 10:47:19.121255 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:21.727801) v2 -- ?+0 0x9e6ddc0 con 0x96562c0 -2934> 2014-05-19 10:47:19.121349 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -2933> 2014-05-19 10:47:19.120879 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 71 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:21.727801) v2 ==== 47+0+0 (3011449693 0 0) 0xa05e540 con 0x9657080 -2932> 2014-05-19 10:47:19.121389 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:21.727801) v2 -- ?+0 0xac356c0 con 0x9657080 -2931> 2014-05-19 10:47:19.121424 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -2930> 2014-05-19 10:47:19.251010 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:21.857891) v2 ==== 47+0+0 (1006980892 0 0) 0xa0bc380 con 0x9b8c160 -2929> 2014-05-19 10:47:19.251064 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:21.857891) v2 -- ?+0 0x9c6ec40 con 0x9b8c160 -2928> 2014-05-19 10:47:19.251097 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -2927> 2014-05-19 10:47:19.251069 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:21.857891) v2 ==== 47+0+0 (1006980892 0 0) 0x9cd0fc0 con 0x9aa3600 -2926> 2014-05-19 10:47:19.251409 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:21.857891) v2 -- ?+0 0xa05e540 con 0x9aa3600 -2925> 2014-05-19 10:47:19.251452 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -2924> 2014-05-19 10:47:19.283040 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:23.228974) v2 ==== 47+0+0 (1543760610 0 0) 0x9fa4fc0 con 0x99d31e0 -2923> 2014-05-19 10:47:19.283070 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:23.228974) v2 ==== 47+0+0 (1543760610 0 0) 0xa1ee700 con 0x95142c0 -2922> 2014-05-19 10:47:19.283092 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.228974) v2 -- ?+0 0xa0bc380 con 0x99d31e0 -2921> 2014-05-19 10:47:19.283125 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -2920> 2014-05-19 10:47:19.283446 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.228974) v2 -- ?+0 0x9cd0fc0 con 0x95142c0 -2919> 2014-05-19 10:47:19.283528 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -2918> 2014-05-19 10:47:19.384641 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:23.330583) v2 ==== 47+0+0 (1823551240 0 0) 0x9b45340 con 0x99d3340 -2917> 2014-05-19 10:47:19.384716 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.330583) v2 -- ?+0 0x9fa4fc0 con 0x99d3340 -2916> 2014-05-19 10:47:19.384798 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -2915> 2014-05-19 10:47:19.384735 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:23.330583) v2 ==== 47+0+0 (1823551240 0 0) 0xa2bd340 con 0x94a5a20 -2914> 2014-05-19 10:47:19.384817 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.330583) v2 -- ?+0 0xa1ee700 con 0x94a5a20 -2913> 2014-05-19 10:47:19.384897 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -2912> 2014-05-19 10:47:19.404451 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 68 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:19.404262) v2 ==== 47+0+0 (2327549114 0 0) 0xac43c00 con 0x9656580 -2911> 2014-05-19 10:47:19.404466 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 68 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:19.404262) v2 ==== 47+0+0 (2327549114 0 0) 0xac45180 con 0x9657340 -2910> 2014-05-19 10:47:19.404503 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.404262) v2 -- ?+0 0x9b45340 con 0x9656580 -2909> 2014-05-19 10:47:19.404543 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -2908> 2014-05-19 10:47:19.404591 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.404262) v2 -- ?+0 0xa2bd340 con 0x9657340 -2907> 2014-05-19 10:47:19.404629 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -2906> 2014-05-19 10:47:19.450951 7f555019b700 20 OSD::command_tp worker waiting -2905> 2014-05-19 10:47:19.454143 7f555099c700 20 OSD::disk_tp worker waiting -2904> 2014-05-19 10:47:19.520836 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:23.466828) v2 ==== 47+0+0 (660523501 0 0) 0xac14000 con 0x94e26e0 -2903> 2014-05-19 10:47:19.520885 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.466828) v2 -- ?+0 0xac45180 con 0x94e26e0 -2902> 2014-05-19 10:47:19.520907 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -2901> 2014-05-19 10:47:19.520830 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:23.466828) v2 ==== 47+0+0 (660523501 0 0) 0xac148c0 con 0x987b340 -2900> 2014-05-19 10:47:19.520933 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.466828) v2 -- ?+0 0xac43c00 con 0x987b340 -2899> 2014-05-19 10:47:19.520969 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -2898> 2014-05-19 10:47:19.576582 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:22.183573) v2 ==== 47+0+0 (3988404715 0 0) 0xac23180 con 0x9937760 -2897> 2014-05-19 10:47:19.576627 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:22.183573) v2 -- ?+0 0xac14000 con 0x9937760 -2896> 2014-05-19 10:47:19.576645 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -2895> 2014-05-19 10:47:19.576583 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:22.183573) v2 ==== 47+0+0 (3988404715 0 0) 0xac33c00 con 0x9656000 -2894> 2014-05-19 10:47:19.576703 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:22.183573) v2 -- ?+0 0xac148c0 con 0x9656000 -2893> 2014-05-19 10:47:19.576718 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -2892> 2014-05-19 10:47:19.672796 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:23.618751) v2 ==== 47+0+0 (1099037468 0 0) 0x9ad21c0 con 0x97431e0 -2891> 2014-05-19 10:47:19.672825 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.618751) v2 -- ?+0 0xac23180 con 0x97431e0 -2890> 2014-05-19 10:47:19.672754 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:23.618751) v2 ==== 47+0+0 (1099037468 0 0) 0x9ed0a80 con 0x99718c0 -2889> 2014-05-19 10:47:19.672891 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -2888> 2014-05-19 10:47:19.672929 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.618751) v2 -- ?+0 0xac33c00 con 0x99718c0 -2887> 2014-05-19 10:47:19.672963 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -2886> 2014-05-19 10:47:19.861243 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:22.468092) v2 ==== 47+0+0 (3531976658 0 0) 0xac41500 con 0x996e000 -2885> 2014-05-19 10:47:19.861549 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:22.468092) v2 -- ?+0 0x9ed0a80 con 0x996e000 -2884> 2014-05-19 10:47:19.861502 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:22.468092) v2 ==== 47+0+0 (3531976658 0 0) 0xac16a80 con 0x9a0c9a0 -2883> 2014-05-19 10:47:19.861639 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -2882> 2014-05-19 10:47:19.861723 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:22.468092) v2 -- ?+0 0x9ad21c0 con 0x9a0c9a0 -2881> 2014-05-19 10:47:19.861763 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -2880> 2014-05-19 10:47:19.923929 7f5566602700 5 osd.0 245 tick -2879> 2014-05-19 10:47:19.923984 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.4 >= max 0.5 = no, load too high -2878> 2014-05-19 10:47:19.923998 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -2877> 2014-05-19 10:47:19.923998 7f555119d700 20 OSD::recovery_tp worker waiting -2876> 2014-05-19 10:47:19.924001 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2260.46 < min (86400 seconds) -2875> 2014-05-19 10:47:19.924020 7f5566602700 20 osd.0 245 sched_scrub done -2874> 2014-05-19 10:47:19.924024 7f5566602700 10 osd.0 245 do_waiters -- start -2873> 2014-05-19 10:47:19.924025 7f5566602700 10 osd.0 245 do_waiters -- finish -2872> 2014-05-19 10:47:19.965533 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -2871> 2014-05-19 10:47:19.965555 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -2870> 2014-05-19 10:47:19.965564 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xa74aa80 con 0x9bdc840 -2869> 2014-05-19 10:47:19.965590 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xa103c00 con 0x9ad4420 -2868> 2014-05-19 10:47:19.965628 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xa74ba40 con 0x9bf31e0 -2867> 2014-05-19 10:47:19.965644 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xac16380 con 0x998b340 -2866> 2014-05-19 10:47:19.965659 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xa5161c0 con 0x9b92840 -2865> 2014-05-19 10:47:19.965676 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0x9fa8380 con 0x9ad49a0 -2864> 2014-05-19 10:47:19.965694 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0x9e9f6c0 con 0x7b911e0 -2863> 2014-05-19 10:47:19.965721 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0x9bcea80 con 0x7b918c0 -2862> 2014-05-19 10:47:19.965751 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xa8648c0 con 0x9aa8c60 -2861> 2014-05-19 10:47:19.965777 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0x9d3c380 con 0x9bfa000 -2860> 2014-05-19 10:47:19.965793 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xa4a88c0 con 0x7c23e40 -2859> 2014-05-19 10:47:19.965839 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xa4d0fc0 con 0x998b760 -2858> 2014-05-19 10:47:19.965862 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xa4ffdc0 con 0x7b91080 -2857> 2014-05-19 10:47:19.965878 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xa0dd880 con 0xa28fb80 -2856> 2014-05-19 10:47:19.965901 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0x9236e00 con 0x76bdce0 -2855> 2014-05-19 10:47:19.965926 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xac1bc00 con 0x994ab00 -2854> 2014-05-19 10:47:19.965951 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0x9c0fdc0 con 0x9ac8b00 -2853> 2014-05-19 10:47:19.965977 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xa7d5a40 con 0x938de40 -2852> 2014-05-19 10:47:19.965995 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xa115a40 con 0x9970b00 -2851> 2014-05-19 10:47:19.966008 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xac16000 con 0x99706e0 -2850> 2014-05-19 10:47:19.966024 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0x9c6efc0 con 0x9bb6f20 -2849> 2014-05-19 10:47:19.966038 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xa23ee00 con 0x994b340 -2848> 2014-05-19 10:47:19.966020 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 70 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xac09dc0 con 0x9bdc840 -2847> 2014-05-19 10:47:19.966091 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0x9ba4c40 con 0x98fa2c0 -2846> 2014-05-19 10:47:19.966124 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xac37c00 con 0x996f8c0 -2845> 2014-05-19 10:47:19.966146 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xa6641c0 con 0x996fa20 -2844> 2014-05-19 10:47:19.966174 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0x9e76e00 con 0x9ac8160 -2843> 2014-05-19 10:47:19.966189 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xa6d4000 con 0x7b90420 -2842> 2014-05-19 10:47:19.966202 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xa102700 con 0x919fe40 -2841> 2014-05-19 10:47:19.966216 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xa242c40 con 0x9971760 -2840> 2014-05-19 10:47:19.966230 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xa1028c0 con 0x994af20 -2839> 2014-05-19 10:47:19.966255 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0x97c2fc0 con 0x989be40 -2838> 2014-05-19 10:47:19.966282 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xa1736c0 con 0x9adf4a0 -2837> 2014-05-19 10:47:19.966308 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xa4fe1c0 con 0x9776160 -2836> 2014-05-19 10:47:19.966360 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0x9c6ea80 con 0x96bd8c0 -2835> 2014-05-19 10:47:19.966392 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xac4b180 con 0x96bcdc0 -2834> 2014-05-19 10:47:19.966428 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xac49dc0 con 0x96954a0 -2833> 2014-05-19 10:47:19.966445 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0x9d52380 con 0x76bd8c0 -2832> 2014-05-19 10:47:19.966470 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0x9e9e8c0 con 0x7b90dc0 -2831> 2014-05-19 10:47:19.966517 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0x9547dc0 con 0x978d8c0 -2830> 2014-05-19 10:47:19.966587 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xac28a80 con 0x978c580 -2829> 2014-05-19 10:47:19.966627 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0xac34c40 con 0x978d340 -2828> 2014-05-19 10:47:19.966658 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:19.965562) v2 -- ?+0 0x9f19500 con 0x96374a0 -2827> 2014-05-19 10:47:19.966739 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -2826> 2014-05-19 10:47:19.966762 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0x9ad2000 con 0x998b340 -2825> 2014-05-19 10:47:19.966824 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -2824> 2014-05-19 10:47:19.966843 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xa864a80 con 0x9b92840 -2823> 2014-05-19 10:47:19.966862 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -2822> 2014-05-19 10:47:19.966879 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xac49180 con 0x9ad49a0 -2821> 2014-05-19 10:47:19.966895 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -2820> 2014-05-19 10:47:19.966926 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0x9b51880 con 0x7b911e0 -2819> 2014-05-19 10:47:19.966942 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -2818> 2014-05-19 10:47:19.966969 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0x9cce8c0 con 0x7b918c0 -2817> 2014-05-19 10:47:19.966990 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -2816> 2014-05-19 10:47:19.966999 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0x9ec1880 con 0x9aa8c60 -2815> 2014-05-19 10:47:19.967015 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -2814> 2014-05-19 10:47:19.967024 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xa0ba700 con 0x9bfa000 -2813> 2014-05-19 10:47:19.967039 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -2812> 2014-05-19 10:47:19.967075 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0x9f75500 con 0x7c23e40 -2811> 2014-05-19 10:47:19.967100 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -2810> 2014-05-19 10:47:19.967106 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0x95e7500 con 0x998b760 -2809> 2014-05-19 10:47:19.967120 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -2808> 2014-05-19 10:47:19.967125 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xa2e0540 con 0x7b91080 -2807> 2014-05-19 10:47:19.967139 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -2806> 2014-05-19 10:47:19.967154 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0x9ed2540 con 0xa28fb80 -2805> 2014-05-19 10:47:19.967173 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -2804> 2014-05-19 10:47:19.967180 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0x9b50000 con 0x76bdce0 -2803> 2014-05-19 10:47:19.967195 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -2802> 2014-05-19 10:47:19.967203 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0x9ed2a80 con 0x994ab00 -2801> 2014-05-19 10:47:19.967217 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -2800> 2014-05-19 10:47:19.967222 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xa0eb500 con 0x9ac8b00 -2799> 2014-05-19 10:47:19.967240 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -2798> 2014-05-19 10:47:19.967247 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xa05e000 con 0x938de40 -2797> 2014-05-19 10:47:19.967261 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -2796> 2014-05-19 10:47:19.967266 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xa6d56c0 con 0x9970b00 -2795> 2014-05-19 10:47:19.967281 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -2794> 2014-05-19 10:47:19.967289 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xac14a80 con 0x99706e0 -2793> 2014-05-19 10:47:19.967303 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -2792> 2014-05-19 10:47:19.967311 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0x9e77dc0 con 0x9bb6f20 -2791> 2014-05-19 10:47:19.967325 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -2790> 2014-05-19 10:47:19.967330 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0x9d76540 con 0x994b340 -2789> 2014-05-19 10:47:19.967344 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -2788> 2014-05-19 10:47:19.967350 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xac28540 con 0x98fa2c0 -2787> 2014-05-19 10:47:19.967378 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -2786> 2014-05-19 10:47:19.967384 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xa2df180 con 0x996f8c0 -2785> 2014-05-19 10:47:19.967398 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -2784> 2014-05-19 10:47:19.967407 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0x99e1180 con 0x996fa20 -2783> 2014-05-19 10:47:19.967424 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -2782> 2014-05-19 10:47:19.967432 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xa2e0c40 con 0x9ac8160 -2781> 2014-05-19 10:47:19.967450 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -2780> 2014-05-19 10:47:19.967455 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xac49c00 con 0x7b90420 -2779> 2014-05-19 10:47:19.967473 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -2778> 2014-05-19 10:47:19.967478 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xac4afc0 con 0x919fe40 -2777> 2014-05-19 10:47:19.967492 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -2776> 2014-05-19 10:47:19.967497 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xa6d5dc0 con 0x9971760 -2775> 2014-05-19 10:47:19.967511 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -2774> 2014-05-19 10:47:19.967515 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0x9bcea80 con 0x994af20 -2773> 2014-05-19 10:47:19.967538 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -2772> 2014-05-19 10:47:19.967553 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xa1721c0 con 0x989be40 -2771> 2014-05-19 10:47:19.967571 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -2770> 2014-05-19 10:47:19.967576 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0x97c3880 con 0x9adf4a0 -2769> 2014-05-19 10:47:19.967598 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -2768> 2014-05-19 10:47:19.967603 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xa1efdc0 con 0x9776160 -2767> 2014-05-19 10:47:19.967618 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -2766> 2014-05-19 10:47:19.967626 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xa2421c0 con 0x96bd8c0 -2765> 2014-05-19 10:47:19.967640 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -2764> 2014-05-19 10:47:19.967646 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0x9e10c40 con 0x96bcdc0 -2763> 2014-05-19 10:47:19.967660 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -2762> 2014-05-19 10:47:19.967667 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0x9e9fc00 con 0x96954a0 -2761> 2014-05-19 10:47:19.967681 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -2760> 2014-05-19 10:47:19.967691 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xa2088c0 con 0x76bd8c0 -2759> 2014-05-19 10:47:19.967708 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -2758> 2014-05-19 10:47:19.967714 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0x9ebb880 con 0x7b90dc0 -2757> 2014-05-19 10:47:19.967730 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -2756> 2014-05-19 10:47:19.967737 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xa74afc0 con 0x978d8c0 -2755> 2014-05-19 10:47:19.967752 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -2754> 2014-05-19 10:47:19.967757 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0x9ad2380 con 0x978c580 -2753> 2014-05-19 10:47:19.967770 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -2752> 2014-05-19 10:47:19.967775 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xac1a540 con 0x978d340 -2751> 2014-05-19 10:47:19.967789 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -2750> 2014-05-19 10:47:19.967795 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 50 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xac32700 con 0x96374a0 -2749> 2014-05-19 10:47:19.967811 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -2748> 2014-05-19 10:47:19.967819 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 70 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0x9ba4a80 con 0x9ad4420 -2747> 2014-05-19 10:47:19.967834 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -2746> 2014-05-19 10:47:19.967841 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:19.965562) v2 ==== 47+0+0 (2577316936 0 0) 0xa208380 con 0x9bf31e0 -2745> 2014-05-19 10:47:19.967856 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -2744> 2014-05-19 10:47:20.174193 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:24.120150) v2 ==== 47+0+0 (2992298799 0 0) 0xa092c40 con 0x97431e0 -2743> 2014-05-19 10:47:20.174321 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:24.120150) v2 -- ?+0 0xac16a80 con 0x97431e0 -2742> 2014-05-19 10:47:20.174734 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -2741> 2014-05-19 10:47:20.174197 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:24.120150) v2 ==== 47+0+0 (2992298799 0 0) 0xa243c00 con 0x99718c0 -2740> 2014-05-19 10:47:20.174817 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:24.120150) v2 -- ?+0 0xac41500 con 0x99718c0 -2739> 2014-05-19 10:47:20.174855 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -2738> 2014-05-19 10:47:20.466840 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -2737> 2014-05-19 10:47:20.466861 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -2736> 2014-05-19 10:47:20.466870 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xa4ff500 con 0x9bdc840 -2735> 2014-05-19 10:47:20.466895 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xa6d4c40 con 0x9ad4420 -2734> 2014-05-19 10:47:20.466934 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xac34a80 con 0x9bf31e0 -2733> 2014-05-19 10:47:20.466948 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xa3dbdc0 con 0x998b340 -2732> 2014-05-19 10:47:20.466964 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xa817a40 con 0x9b92840 -2731> 2014-05-19 10:47:20.466986 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xac37500 con 0x9ad49a0 -2730> 2014-05-19 10:47:20.467010 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0x9ffcfc0 con 0x7b911e0 -2729> 2014-05-19 10:47:20.467037 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xa0ca000 con 0x7b918c0 -2728> 2014-05-19 10:47:20.467065 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0x9ad3c00 con 0x9aa8c60 -2727> 2014-05-19 10:47:20.467089 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xa1efa40 con 0x9bfa000 -2726> 2014-05-19 10:47:20.467106 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xac16700 con 0x7c23e40 -2725> 2014-05-19 10:47:20.467121 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xa07a540 con 0x998b760 -2724> 2014-05-19 10:47:20.467147 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xa44ca80 con 0x7b91080 -2723> 2014-05-19 10:47:20.467192 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xa665500 con 0xa28fb80 -2722> 2014-05-19 10:47:20.467223 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0x9bcea80 con 0x76bdce0 -2721> 2014-05-19 10:47:20.467249 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xa6d5dc0 con 0x994ab00 -2720> 2014-05-19 10:47:20.467242 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 71 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0x951c380 con 0x9bdc840 -2719> 2014-05-19 10:47:20.467273 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xac4afc0 con 0x9ac8b00 -2718> 2014-05-19 10:47:20.467299 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xac49c00 con 0x938de40 -2717> 2014-05-19 10:47:20.467317 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xa2e0c40 con 0x9970b00 -2716> 2014-05-19 10:47:20.467330 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0x99e1180 con 0x99706e0 -2715> 2014-05-19 10:47:20.467347 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xa2df180 con 0x9bb6f20 -2714> 2014-05-19 10:47:20.467361 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xac28540 con 0x994b340 -2713> 2014-05-19 10:47:20.467374 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0x9d76540 con 0x98fa2c0 -2712> 2014-05-19 10:47:20.467388 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0x9e77dc0 con 0x996f8c0 -2711> 2014-05-19 10:47:20.467402 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xac14a80 con 0x996fa20 -2710> 2014-05-19 10:47:20.467427 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xa6d56c0 con 0x9ac8160 -2709> 2014-05-19 10:47:20.467469 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xa05e000 con 0x7b90420 -2708> 2014-05-19 10:47:20.467489 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xa0eb500 con 0x919fe40 -2707> 2014-05-19 10:47:20.467503 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0x9ed2a80 con 0x9971760 -2706> 2014-05-19 10:47:20.467517 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0x9b50000 con 0x994af20 -2705> 2014-05-19 10:47:20.467533 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0x9ed2540 con 0x989be40 -2704> 2014-05-19 10:47:20.467546 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xa2e0540 con 0x9adf4a0 -2703> 2014-05-19 10:47:20.467559 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0x95e7500 con 0x9776160 -2702> 2014-05-19 10:47:20.467583 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0x9f75500 con 0x96bd8c0 -2701> 2014-05-19 10:47:20.467611 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xa0ba700 con 0x96bcdc0 -2700> 2014-05-19 10:47:20.467637 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0x9ec1880 con 0x96954a0 -2699> 2014-05-19 10:47:20.467673 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0x9cce8c0 con 0x76bd8c0 -2698> 2014-05-19 10:47:20.467700 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0x9b51880 con 0x7b90dc0 -2697> 2014-05-19 10:47:20.467726 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xac49180 con 0x978d8c0 -2696> 2014-05-19 10:47:20.467766 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xa864a80 con 0x978c580 -2695> 2014-05-19 10:47:20.467819 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0x9ad2000 con 0x978d340 -2694> 2014-05-19 10:47:20.467845 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:20.466868) v2 -- ?+0 0xac09dc0 con 0x96374a0 -2693> 2014-05-19 10:47:20.468014 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -2692> 2014-05-19 10:47:20.468034 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 71 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xa872380 con 0x9ad4420 -2691> 2014-05-19 10:47:20.468062 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -2690> 2014-05-19 10:47:20.468072 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 70 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xa209180 con 0x9bf31e0 -2689> 2014-05-19 10:47:20.468089 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -2688> 2014-05-19 10:47:20.468099 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 70 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xa645c00 con 0x998b340 -2687> 2014-05-19 10:47:20.468154 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -2686> 2014-05-19 10:47:20.468170 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xa617340 con 0x9b92840 -2685> 2014-05-19 10:47:20.468213 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -2684> 2014-05-19 10:47:20.468229 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xac48fc0 con 0x9ad49a0 -2683> 2014-05-19 10:47:20.468345 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -2682> 2014-05-19 10:47:20.468356 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xa103180 con 0x7b911e0 -2681> 2014-05-19 10:47:20.468371 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -2680> 2014-05-19 10:47:20.468380 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xa236540 con 0x7b918c0 -2679> 2014-05-19 10:47:20.468394 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -2678> 2014-05-19 10:47:20.468406 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0x9d20380 con 0x9aa8c60 -2677> 2014-05-19 10:47:20.468423 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -2676> 2014-05-19 10:47:20.468431 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0x9e6dc00 con 0x9bfa000 -2675> 2014-05-19 10:47:20.468445 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -2674> 2014-05-19 10:47:20.468453 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xa1e5c00 con 0x7c23e40 -2673> 2014-05-19 10:47:20.468470 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -2672> 2014-05-19 10:47:20.468478 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0x9f7afc0 con 0x998b760 -2671> 2014-05-19 10:47:20.468493 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -2670> 2014-05-19 10:47:20.468501 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0x9e816c0 con 0x7b91080 -2669> 2014-05-19 10:47:20.468518 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -2668> 2014-05-19 10:47:20.468529 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0x9cd0000 con 0xa28fb80 -2667> 2014-05-19 10:47:20.468546 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -2666> 2014-05-19 10:47:20.468553 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xa4fe1c0 con 0x76bdce0 -2665> 2014-05-19 10:47:20.468571 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -2664> 2014-05-19 10:47:20.468578 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xa23f500 con 0x994ab00 -2663> 2014-05-19 10:47:20.468595 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -2662> 2014-05-19 10:47:20.468602 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xa0ea540 con 0x9ac8b00 -2661> 2014-05-19 10:47:20.468618 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -2660> 2014-05-19 10:47:20.468626 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0x9cb6700 con 0x938de40 -2659> 2014-05-19 10:47:20.468643 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -2658> 2014-05-19 10:47:20.468657 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xa163a40 con 0x9970b00 -2657> 2014-05-19 10:47:20.468675 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -2656> 2014-05-19 10:47:20.468682 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xa2bcfc0 con 0x99706e0 -2655> 2014-05-19 10:47:20.468699 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -2654> 2014-05-19 10:47:20.468706 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0x9fd8700 con 0x9bb6f20 -2653> 2014-05-19 10:47:20.468724 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -2652> 2014-05-19 10:47:20.468731 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0x99e0000 con 0x994b340 -2651> 2014-05-19 10:47:20.468748 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -2650> 2014-05-19 10:47:20.468755 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xac28c40 con 0x98fa2c0 -2649> 2014-05-19 10:47:20.468774 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -2648> 2014-05-19 10:47:20.468782 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xa447880 con 0x996f8c0 -2647> 2014-05-19 10:47:20.468798 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -2646> 2014-05-19 10:47:20.468807 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0x9fa5c00 con 0x996fa20 -2645> 2014-05-19 10:47:20.468824 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -2644> 2014-05-19 10:47:20.468831 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xac08380 con 0x9ac8160 -2643> 2014-05-19 10:47:20.468845 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -2642> 2014-05-19 10:47:20.468853 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xac49a40 con 0x7b90420 -2641> 2014-05-19 10:47:20.468870 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -2640> 2014-05-19 10:47:20.468877 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xac4ae00 con 0x919fe40 -2639> 2014-05-19 10:47:20.468892 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -2638> 2014-05-19 10:47:20.468900 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xa6d5c00 con 0x9971760 -2637> 2014-05-19 10:47:20.468914 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -2636> 2014-05-19 10:47:20.468921 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0x9209500 con 0x994af20 -2635> 2014-05-19 10:47:20.468938 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -2634> 2014-05-19 10:47:20.468946 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xa0bc700 con 0x989be40 -2633> 2014-05-19 10:47:20.468964 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -2632> 2014-05-19 10:47:20.468971 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xa265a40 con 0x9adf4a0 -2631> 2014-05-19 10:47:20.468986 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -2630> 2014-05-19 10:47:20.468993 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xa864700 con 0x9776160 -2629> 2014-05-19 10:47:20.469007 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -2628> 2014-05-19 10:47:20.469015 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xac35180 con 0x96bd8c0 -2627> 2014-05-19 10:47:20.469032 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -2626> 2014-05-19 10:47:20.469041 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0x9e708c0 con 0x96bcdc0 -2625> 2014-05-19 10:47:20.469058 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -2624> 2014-05-19 10:47:20.469065 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0x9f75a40 con 0x96954a0 -2623> 2014-05-19 10:47:20.469079 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -2622> 2014-05-19 10:47:20.469086 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0x9cb4e00 con 0x76bd8c0 -2621> 2014-05-19 10:47:20.469101 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -2620> 2014-05-19 10:47:20.469137 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0x97c28c0 con 0x7b90dc0 -2619> 2014-05-19 10:47:20.469161 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -2618> 2014-05-19 10:47:20.469168 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xa74b180 con 0x978d8c0 -2617> 2014-05-19 10:47:20.469183 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -2616> 2014-05-19 10:47:20.469190 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xa856540 con 0x978c580 -2615> 2014-05-19 10:47:20.469204 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -2614> 2014-05-19 10:47:20.469214 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xac1a380 con 0x978d340 -2613> 2014-05-19 10:47:20.469231 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -2612> 2014-05-19 10:47:20.469238 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 51 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:20.466868) v2 ==== 47+0+0 (3725012043 0 0) 0xa4ef500 con 0x96374a0 -2611> 2014-05-19 10:47:20.469253 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -2610> 2014-05-19 10:47:20.528634 7f5565600700 20 KeyValueStore::op_tp worker waiting -2609> 2014-05-19 10:47:20.678079 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:23.285071) v2 ==== 47+0+0 (1571626168 0 0) 0xac22380 con 0x9937760 -2608> 2014-05-19 10:47:20.678129 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.285071) v2 -- ?+0 0xa092c40 con 0x9937760 -2607> 2014-05-19 10:47:20.678075 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:23.285071) v2 ==== 47+0+0 (1571626168 0 0) 0xac09c00 con 0x9656000 -2606> 2014-05-19 10:47:20.678719 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -2605> 2014-05-19 10:47:20.678746 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.285071) v2 -- ?+0 0xa243c00 con 0x9656000 -2604> 2014-05-19 10:47:20.678781 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -2603> 2014-05-19 10:47:20.705039 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:24.651075) v2 ==== 47+0+0 (119564059 0 0) 0xa2dee00 con 0x94e3e40 -2602> 2014-05-19 10:47:20.705045 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:24.651075) v2 ==== 47+0+0 (119564059 0 0) 0x9c06a80 con 0x9bb69a0 -2601> 2014-05-19 10:47:20.705088 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:24.651075) v2 -- ?+0 0xac22380 con 0x94e3e40 -2600> 2014-05-19 10:47:20.705710 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -2599> 2014-05-19 10:47:20.705731 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:24.651075) v2 -- ?+0 0xac09c00 con 0x9bb69a0 -2598> 2014-05-19 10:47:20.705774 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -2597> 2014-05-19 10:47:20.770326 7f55579aa700 20 OSD::op_tp worker waiting -2596> 2014-05-19 10:47:20.770349 7f555a1af700 20 OSD::op_tp worker waiting -2595> 2014-05-19 10:47:20.770409 7f55551a5700 20 OSD::op_tp worker waiting -2594> 2014-05-19 10:47:20.771967 7f55569a8700 20 OSD::op_tp worker waiting -2593> 2014-05-19 10:47:20.771991 7f55541a3700 20 OSD::op_tp worker waiting -2592> 2014-05-19 10:47:20.772010 7f55589ac700 20 OSD::op_tp worker waiting -2591> 2014-05-19 10:47:20.772026 7f55549a4700 20 OSD::op_tp worker waiting -2590> 2014-05-19 10:47:20.772062 7f555a9b0700 20 OSD::op_tp worker waiting -2589> 2014-05-19 10:47:20.772104 7f555b1b1700 20 OSD::op_tp worker waiting -2588> 2014-05-19 10:47:20.772650 7f55581ab700 20 OSD::op_tp worker waiting -2587> 2014-05-19 10:47:20.772682 7f55571a9700 20 OSD::op_tp worker waiting -2586> 2014-05-19 10:47:20.772715 7f55531a1700 20 OSD::op_tp worker waiting -2585> 2014-05-19 10:47:20.772742 7f55599ae700 20 OSD::op_tp worker waiting -2584> 2014-05-19 10:47:20.772766 7f555219f700 20 OSD::op_tp worker waiting -2583> 2014-05-19 10:47:20.772796 7f55539a2700 20 OSD::op_tp worker waiting -2582> 2014-05-19 10:47:20.772824 7f55529a0700 20 OSD::op_tp worker waiting -2581> 2014-05-19 10:47:20.772831 7f55591ad700 20 OSD::op_tp worker waiting -2580> 2014-05-19 10:47:20.772843 7f55561a7700 20 OSD::op_tp worker waiting -2579> 2014-05-19 10:47:20.772918 7f55559a6700 20 OSD::op_tp worker waiting -2578> 2014-05-19 10:47:20.772945 7f555199e700 20 OSD::op_tp worker waiting -2577> 2014-05-19 10:47:20.924115 7f5566602700 5 osd.0 245 tick -2576> 2014-05-19 10:47:20.924168 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.4 >= max 0.5 = no, load too high -2575> 2014-05-19 10:47:20.924182 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -2574> 2014-05-19 10:47:20.924185 7f555119d700 20 OSD::recovery_tp worker waiting -2573> 2014-05-19 10:47:20.924184 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2261.46 < min (86400 seconds) -2572> 2014-05-19 10:47:20.924205 7f5566602700 20 osd.0 245 sched_scrub done -2571> 2014-05-19 10:47:20.924207 7f5566602700 10 osd.0 245 do_waiters -- start -2570> 2014-05-19 10:47:20.924209 7f5566602700 10 osd.0 245 do_waiters -- finish -2569> 2014-05-19 10:47:20.952577 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:23.559324) v2 ==== 47+0+0 (1194753056 0 0) 0x9d021c0 con 0x9b8c160 -2568> 2014-05-19 10:47:20.952637 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.559324) v2 -- ?+0 0x9c06a80 con 0x9b8c160 -2567> 2014-05-19 10:47:20.952714 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -2566> 2014-05-19 10:47:20.952342 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:23.559324) v2 ==== 47+0+0 (1194753056 0 0) 0x9ad3dc0 con 0x9aa3600 -2565> 2014-05-19 10:47:20.952905 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.559324) v2 -- ?+0 0xa2dee00 con 0x9aa3600 -2564> 2014-05-19 10:47:20.952993 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -2563> 2014-05-19 10:47:21.086259 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:25.031944) v2 ==== 47+0+0 (2817616200 0 0) 0xa2bc1c0 con 0x94a5a20 -2562> 2014-05-19 10:47:21.086303 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:25.031944) v2 -- ?+0 0x9ad3dc0 con 0x94a5a20 -2561> 2014-05-19 10:47:21.086318 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:25.031944) v2 ==== 47+0+0 (2817616200 0 0) 0x9b45c00 con 0x99d3340 -2560> 2014-05-19 10:47:21.086391 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -2559> 2014-05-19 10:47:21.086437 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:25.031944) v2 -- ?+0 0x9d021c0 con 0x99d3340 -2558> 2014-05-19 10:47:21.086469 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -2557> 2014-05-19 10:47:21.111966 7f5564dff700 20 KeyValueStore::op_tp worker waiting -2556> 2014-05-19 10:47:21.126389 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:23.733356) v2 ==== 47+0+0 (282235265 0 0) 0xa4bb880 con 0x7b90160 -2555> 2014-05-19 10:47:21.126393 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:23.733356) v2 ==== 47+0+0 (282235265 0 0) 0x9f6c380 con 0x9b8db80 -2554> 2014-05-19 10:47:21.126432 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.733356) v2 -- ?+0 0xa2bc1c0 con 0x7b90160 -2553> 2014-05-19 10:47:21.126509 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -2552> 2014-05-19 10:47:21.126653 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.733356) v2 -- ?+0 0x9b45c00 con 0x9b8db80 -2551> 2014-05-19 10:47:21.126728 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -2550> 2014-05-19 10:47:21.321136 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:23.928080) v2 ==== 47+0+0 (710711299 0 0) 0xa05f340 con 0x996fb80 -2549> 2014-05-19 10:47:21.321218 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.928080) v2 -- ?+0 0x9f6c380 con 0x996fb80 -2548> 2014-05-19 10:47:21.321304 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:23.928080) v2 ==== 47+0+0 (710711299 0 0) 0xa1dfdc0 con 0x9a0cdc0 -2547> 2014-05-19 10:47:21.321389 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -2546> 2014-05-19 10:47:21.321638 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.928080) v2 -- ?+0 0xa4bb880 con 0x9a0cdc0 -2545> 2014-05-19 10:47:21.321677 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -2544> 2014-05-19 10:47:21.375817 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:25.321870) v2 ==== 47+0+0 (2724897281 0 0) 0xa2096c0 con 0x9970840 -2543> 2014-05-19 10:47:21.375924 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:25.321870) v2 -- ?+0 0xa05f340 con 0x9970840 -2542> 2014-05-19 10:47:21.376024 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -2541> 2014-05-19 10:47:21.376317 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:25.321870) v2 ==== 47+0+0 (2724897281 0 0) 0xac34e00 con 0x97434a0 -2540> 2014-05-19 10:47:21.376361 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:25.321870) v2 -- ?+0 0xa1dfdc0 con 0x97434a0 -2539> 2014-05-19 10:47:21.376416 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -2538> 2014-05-19 10:47:21.451035 7f555019b700 20 OSD::command_tp worker waiting -2537> 2014-05-19 10:47:21.454233 7f555099c700 20 OSD::disk_tp worker waiting -2536> 2014-05-19 10:47:21.475333 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:24.082317) v2 ==== 47+0+0 (1420696553 0 0) 0xa23f340 con 0x9656f20 -2535> 2014-05-19 10:47:21.475372 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:24.082317) v2 ==== 47+0+0 (1420696553 0 0) 0x9c09a40 con 0x9656160 -2534> 2014-05-19 10:47:21.475390 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:24.082317) v2 -- ?+0 0xac34e00 con 0x9656f20 -2533> 2014-05-19 10:47:21.475584 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -2532> 2014-05-19 10:47:21.475611 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:24.082317) v2 -- ?+0 0xa2096c0 con 0x9656160 -2531> 2014-05-19 10:47:21.475641 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -2530> 2014-05-19 10:47:21.779523 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 67 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:24.386486) v2 ==== 47+0+0 (809315955 0 0) 0xac49dc0 con 0x9656000 -2529> 2014-05-19 10:47:21.779550 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 67 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:24.386486) v2 ==== 47+0+0 (809315955 0 0) 0x9e9fdc0 con 0x9937760 -2528> 2014-05-19 10:47:21.779578 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:24.386486) v2 -- ?+0 0x9c09a40 con 0x9656000 -2527> 2014-05-19 10:47:21.779689 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -2526> 2014-05-19 10:47:21.779733 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:24.386486) v2 -- ?+0 0xa23f340 con 0x9937760 -2525> 2014-05-19 10:47:21.779792 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -2524> 2014-05-19 10:47:21.830590 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:25.776649) v2 ==== 47+0+0 (3050503898 0 0) 0xac45a40 con 0x94802c0 -2523> 2014-05-19 10:47:21.830639 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:25.776649) v2 -- ?+0 0x9e9fdc0 con 0x94802c0 -2522> 2014-05-19 10:47:21.830861 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 48 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:25.776649) v2 ==== 47+0+0 (3050503898 0 0) 0xac46c40 con 0x987b760 -2521> 2014-05-19 10:47:21.831174 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -2520> 2014-05-19 10:47:21.831234 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:25.776649) v2 -- ?+0 0xac49dc0 con 0x987b760 -2519> 2014-05-19 10:47:21.831279 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -2518> 2014-05-19 10:47:21.877220 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:25.823224) v2 ==== 47+0+0 (983066684 0 0) 0xac35dc0 con 0x97434a0 -2517> 2014-05-19 10:47:21.877282 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:25.823224) v2 -- ?+0 0xac45a40 con 0x97434a0 -2516> 2014-05-19 10:47:21.877316 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -2515> 2014-05-19 10:47:21.877765 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:25.823224) v2 ==== 47+0+0 (983066684 0 0) 0xa6ab500 con 0x9970840 -2514> 2014-05-19 10:47:21.877804 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:25.823224) v2 -- ?+0 0xac46c40 con 0x9970840 -2513> 2014-05-19 10:47:21.877837 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -2512> 2014-05-19 10:47:21.924286 7f5566602700 5 osd.0 245 tick -2511> 2014-05-19 10:47:21.924340 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.29 >= max 0.5 = no, load too high -2510> 2014-05-19 10:47:21.924354 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -2509> 2014-05-19 10:47:21.924357 7f555119d700 20 OSD::recovery_tp worker waiting -2508> 2014-05-19 10:47:21.924357 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2262.46 < min (86400 seconds) -2507> 2014-05-19 10:47:21.924376 7f5566602700 20 osd.0 245 sched_scrub done -2506> 2014-05-19 10:47:21.924379 7f5566602700 10 osd.0 245 do_waiters -- start -2505> 2014-05-19 10:47:21.924381 7f5566602700 10 osd.0 245 do_waiters -- finish -2504> 2014-05-19 10:47:22.281014 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 68 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:24.887986) v2 ==== 47+0+0 (309335653 0 0) 0xac1b6c0 con 0x9656000 -2503> 2014-05-19 10:47:22.281063 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:24.887986) v2 -- ?+0 0xa6ab500 con 0x9656000 -2502> 2014-05-19 10:47:22.281370 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 68 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:24.887986) v2 ==== 47+0+0 (309335653 0 0) 0xa36d340 con 0x9937760 -2501> 2014-05-19 10:47:22.281463 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -2500> 2014-05-19 10:47:22.281574 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:24.887986) v2 -- ?+0 0xac35dc0 con 0x9937760 -2499> 2014-05-19 10:47:22.281621 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -2498> 2014-05-19 10:47:22.422104 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:26.368169) v2 ==== 47+0+0 (1857277716 0 0) 0xac15a40 con 0x987b340 -2497> 2014-05-19 10:47:22.422120 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:26.368169) v2 ==== 47+0+0 (1857277716 0 0) 0xac141c0 con 0x94e26e0 -2496> 2014-05-19 10:47:22.422151 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:26.368169) v2 -- ?+0 0xac1b6c0 con 0x987b340 -2495> 2014-05-19 10:47:22.422224 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -2494> 2014-05-19 10:47:22.422629 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:26.368169) v2 -- ?+0 0xa36d340 con 0x94e26e0 -2493> 2014-05-19 10:47:22.422716 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -2492> 2014-05-19 10:47:22.528733 7f5565600700 20 KeyValueStore::op_tp worker waiting -2491> 2014-05-19 10:47:22.577039 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:25.183895) v2 ==== 47+0+0 (2422080382 0 0) 0x9c08c40 con 0x9656160 -2490> 2014-05-19 10:47:22.577087 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:25.183895) v2 -- ?+0 0xac15a40 con 0x9656160 -2489> 2014-05-19 10:47:22.577381 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:25.183895) v2 ==== 47+0+0 (2422080382 0 0) 0xa23ec40 con 0x9656f20 -2488> 2014-05-19 10:47:22.577626 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -2487> 2014-05-19 10:47:22.577647 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:25.183895) v2 -- ?+0 0xac141c0 con 0x9656f20 -2486> 2014-05-19 10:47:22.577677 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -2485> 2014-05-19 10:47:22.655461 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 71 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:25.262442) v2 ==== 47+0+0 (2331822296 0 0) 0x9d0bc00 con 0x96571e0 -2484> 2014-05-19 10:47:22.655510 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:25.262442) v2 -- ?+0 0xa23ec40 con 0x96571e0 -2483> 2014-05-19 10:47:22.655545 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -2482> 2014-05-19 10:47:22.655929 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 71 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:25.262442) v2 ==== 47+0+0 (2331822296 0 0) 0xac476c0 con 0x9656420 -2481> 2014-05-19 10:47:22.655972 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:25.262442) v2 -- ?+0 0x9c08c40 con 0x9656420 -2480> 2014-05-19 10:47:22.656003 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -2479> 2014-05-19 10:47:22.660921 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:25.267898) v2 ==== 47+0+0 (3943439906 0 0) 0x9caa380 con 0x95846e0 -2478> 2014-05-19 10:47:22.660992 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:25.267898) v2 -- ?+0 0xac476c0 con 0x95846e0 -2477> 2014-05-19 10:47:22.661020 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -2476> 2014-05-19 10:47:22.661373 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:25.267898) v2 ==== 47+0+0 (3943439906 0 0) 0xa172e00 con 0x9983600 -2475> 2014-05-19 10:47:22.661413 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:25.267898) v2 -- ?+0 0x9d0bc00 con 0x9983600 -2474> 2014-05-19 10:47:22.661455 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -2473> 2014-05-19 10:47:22.693950 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:26.640037) v2 ==== 47+0+0 (620732498 0 0) 0xac1aa80 con 0x99f1080 -2472> 2014-05-19 10:47:22.693977 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:26.640037) v2 ==== 47+0+0 (620732498 0 0) 0xac17340 con 0x987af20 -2471> 2014-05-19 10:47:22.694001 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:26.640037) v2 -- ?+0 0xa172e00 con 0x99f1080 -2470> 2014-05-19 10:47:22.694338 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -2469> 2014-05-19 10:47:22.694402 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:26.640037) v2 -- ?+0 0x9caa380 con 0x987af20 -2468> 2014-05-19 10:47:22.694487 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -2467> 2014-05-19 10:47:22.770428 7f55579aa700 20 OSD::op_tp worker waiting -2466> 2014-05-19 10:47:22.770486 7f555a1af700 20 OSD::op_tp worker waiting -2465> 2014-05-19 10:47:22.770546 7f55551a5700 20 OSD::op_tp worker waiting -2464> 2014-05-19 10:47:22.772067 7f55569a8700 20 OSD::op_tp worker waiting -2463> 2014-05-19 10:47:22.772105 7f55541a3700 20 OSD::op_tp worker waiting -2462> 2014-05-19 10:47:22.772119 7f55549a4700 20 OSD::op_tp worker waiting -2461> 2014-05-19 10:47:22.772140 7f55589ac700 20 OSD::op_tp worker waiting -2460> 2014-05-19 10:47:22.772159 7f555a9b0700 20 OSD::op_tp worker waiting -2459> 2014-05-19 10:47:22.772179 7f555b1b1700 20 OSD::op_tp worker waiting -2458> 2014-05-19 10:47:22.772720 7f55581ab700 20 OSD::op_tp worker waiting -2457> 2014-05-19 10:47:22.772753 7f55571a9700 20 OSD::op_tp worker waiting -2456> 2014-05-19 10:47:22.772804 7f55599ae700 20 OSD::op_tp worker waiting -2455> 2014-05-19 10:47:22.772816 7f55531a1700 20 OSD::op_tp worker waiting -2454> 2014-05-19 10:47:22.772831 7f555219f700 20 OSD::op_tp worker waiting -2453> 2014-05-19 10:47:22.772871 7f55591ad700 20 OSD::op_tp worker waiting -2452> 2014-05-19 10:47:22.772891 7f55539a2700 20 OSD::op_tp worker waiting -2451> 2014-05-19 10:47:22.772910 7f55561a7700 20 OSD::op_tp worker waiting -2450> 2014-05-19 10:47:22.772921 7f55529a0700 20 OSD::op_tp worker waiting -2449> 2014-05-19 10:47:22.772994 7f55559a6700 20 OSD::op_tp worker waiting -2448> 2014-05-19 10:47:22.773006 7f555199e700 20 OSD::op_tp worker waiting -2447> 2014-05-19 10:47:22.804077 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:26.750211) v2 ==== 47+0+0 (3168461368 0 0) 0xac42a80 con 0x9bb7b80 -2446> 2014-05-19 10:47:22.804128 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:26.750211) v2 -- ?+0 0xac17340 con 0x9bb7b80 -2445> 2014-05-19 10:47:22.804207 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -2444> 2014-05-19 10:47:22.804341 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:26.750211) v2 ==== 47+0+0 (3168461368 0 0) 0xac40700 con 0x95151e0 -2443> 2014-05-19 10:47:22.804384 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:26.750211) v2 -- ?+0 0xac1aa80 con 0x95151e0 -2442> 2014-05-19 10:47:22.804553 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -2441> 2014-05-19 10:47:22.828229 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:25.434909) v2 ==== 47+0+0 (3939183867 0 0) 0xa192e00 con 0x7b90160 -2440> 2014-05-19 10:47:22.828274 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:25.434909) v2 -- ?+0 0xac40700 con 0x7b90160 -2439> 2014-05-19 10:47:22.828308 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -2438> 2014-05-19 10:47:22.828310 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:25.434909) v2 ==== 47+0+0 (3939183867 0 0) 0x9b2efc0 con 0x9b8db80 -2437> 2014-05-19 10:47:22.828363 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:25.434909) v2 -- ?+0 0xac42a80 con 0x9b8db80 -2436> 2014-05-19 10:47:22.828396 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -2435> 2014-05-19 10:47:22.905986 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 69 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:22.905811) v2 ==== 47+0+0 (206763069 0 0) 0xac43180 con 0x9656580 -2434> 2014-05-19 10:47:22.906014 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 69 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:22.905811) v2 ==== 47+0+0 (206763069 0 0) 0xac44fc0 con 0x9657340 -2433> 2014-05-19 10:47:22.906071 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:22.905811) v2 -- ?+0 0x9b2efc0 con 0x9656580 -2432> 2014-05-19 10:47:22.906111 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -2431> 2014-05-19 10:47:22.906137 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:22.905811) v2 -- ?+0 0xa192e00 con 0x9657340 -2430> 2014-05-19 10:47:22.906211 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -2429> 2014-05-19 10:47:22.924472 7f5566602700 5 osd.0 245 tick -2428> 2014-05-19 10:47:22.924493 7f5566602700 7 osd.0 245 do_mon_report -2427> 2014-05-19 10:47:22.924497 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 -2426> 2014-05-19 10:47:22.924501 7f5566602700 20 osd.0 245 send_pg_stats -2425> 2014-05-19 10:47:22.924540 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.29 >= max 0.5 = no, load too high -2424> 2014-05-19 10:47:22.924554 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -2423> 2014-05-19 10:47:22.924551 7f555119d700 20 OSD::recovery_tp worker waiting -2422> 2014-05-19 10:47:22.924557 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2263.46 < min (86400 seconds) -2421> 2014-05-19 10:47:22.924578 7f5566602700 20 osd.0 245 sched_scrub done -2420> 2014-05-19 10:47:22.924581 7f5566602700 10 osd.0 245 do_waiters -- start -2419> 2014-05-19 10:47:22.924583 7f5566602700 10 osd.0 245 do_waiters -- finish -2418> 2014-05-19 10:47:23.006297 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:26.952401) v2 ==== 47+0+0 (2332733278 0 0) 0x97c2c40 con 0x9bb69a0 -2417> 2014-05-19 10:47:23.006319 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:26.952401) v2 ==== 47+0+0 (2332733278 0 0) 0x9f43c00 con 0x94e3e40 -2416> 2014-05-19 10:47:23.006347 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:26.952401) v2 -- ?+0 0xac43180 con 0x9bb69a0 -2415> 2014-05-19 10:47:23.006418 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -2414> 2014-05-19 10:47:23.006461 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:26.952401) v2 -- ?+0 0xac44fc0 con 0x94e3e40 -2413> 2014-05-19 10:47:23.006609 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -2412> 2014-05-19 10:47:23.112061 7f5564dff700 20 KeyValueStore::op_tp worker waiting -2411> 2014-05-19 10:47:23.156176 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 72 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:25.763172) v2 ==== 47+0+0 (1374222535 0 0) 0x95636c0 con 0x96571e0 -2410> 2014-05-19 10:47:23.156208 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 72 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:25.763172) v2 ==== 47+0+0 (1374222535 0 0) 0xac47500 con 0x9656420 -2409> 2014-05-19 10:47:23.156227 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:25.763172) v2 -- ?+0 0x9f43c00 con 0x96571e0 -2408> 2014-05-19 10:47:23.156684 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -2407> 2014-05-19 10:47:23.156712 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:25.763172) v2 -- ?+0 0x97c2c40 con 0x9656420 -2406> 2014-05-19 10:47:23.156747 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -2405> 2014-05-19 10:47:23.195417 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:27.141543) v2 ==== 47+0+0 (2362495409 0 0) 0xa1ef880 con 0x99f1080 -2404> 2014-05-19 10:47:23.195446 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:27.141543) v2 ==== 47+0+0 (2362495409 0 0) 0xa4df880 con 0x987af20 -2403> 2014-05-19 10:47:23.195701 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:27.141543) v2 -- ?+0 0xac47500 con 0x987af20 -2402> 2014-05-19 10:47:23.195789 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -2401> 2014-05-19 10:47:23.195849 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:27.141543) v2 -- ?+0 0x95636c0 con 0x99f1080 -2400> 2014-05-19 10:47:23.195930 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -2399> 2014-05-19 10:47:23.367994 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -2398> 2014-05-19 10:47:23.368017 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -2397> 2014-05-19 10:47:23.368026 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xac33340 con 0x9bdc840 -2396> 2014-05-19 10:47:23.368052 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xac1b180 con 0x9ad4420 -2395> 2014-05-19 10:47:23.368090 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0x9ad2540 con 0x9bf31e0 -2394> 2014-05-19 10:47:23.368106 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xa102540 con 0x998b340 -2393> 2014-05-19 10:47:23.368122 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0x9cb6700 con 0x9b92840 -2392> 2014-05-19 10:47:23.368137 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xa0ea540 con 0x9ad49a0 -2391> 2014-05-19 10:47:23.368162 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xa23f500 con 0x7b911e0 -2390> 2014-05-19 10:47:23.368232 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xa4fe1c0 con 0x7b918c0 -2389> 2014-05-19 10:47:23.368263 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0x9cd0000 con 0x9aa8c60 -2388> 2014-05-19 10:47:23.368288 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0x9e816c0 con 0x9bfa000 -2387> 2014-05-19 10:47:23.368303 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0x9f7afc0 con 0x7c23e40 -2386> 2014-05-19 10:47:23.368318 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xa1e5c00 con 0x998b760 -2385> 2014-05-19 10:47:23.368346 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0x9e6dc00 con 0x7b91080 -2384> 2014-05-19 10:47:23.368385 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0x9d20380 con 0xa28fb80 -2383> 2014-05-19 10:47:23.368417 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xa236540 con 0x76bdce0 -2382> 2014-05-19 10:47:23.368447 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xa103180 con 0x994ab00 -2381> 2014-05-19 10:47:23.368475 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xac48fc0 con 0x9ac8b00 -2380> 2014-05-19 10:47:23.368464 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 72 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0x9c6f880 con 0x9bdc840 -2379> 2014-05-19 10:47:23.368504 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xa617340 con 0x938de40 -2378> 2014-05-19 10:47:23.368533 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xa645c00 con 0x9970b00 -2377> 2014-05-19 10:47:23.368560 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xa209180 con 0x99706e0 -2376> 2014-05-19 10:47:23.368578 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xa872380 con 0x9bb6f20 -2375> 2014-05-19 10:47:23.368591 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0x951c380 con 0x994b340 -2374> 2014-05-19 10:47:23.368615 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xa208380 con 0x98fa2c0 -2373> 2014-05-19 10:47:23.368629 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0x9ba4a80 con 0x996f8c0 -2372> 2014-05-19 10:47:23.368654 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xac32700 con 0x996fa20 -2371> 2014-05-19 10:47:23.368704 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xac1a540 con 0x9ac8160 -2370> 2014-05-19 10:47:23.368727 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0x9ad2380 con 0x7b90420 -2369> 2014-05-19 10:47:23.368741 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xa74afc0 con 0x919fe40 -2368> 2014-05-19 10:47:23.368755 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0x9ebb880 con 0x9971760 -2367> 2014-05-19 10:47:23.368782 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xa2088c0 con 0x994af20 -2366> 2014-05-19 10:47:23.368811 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0x9e9fc00 con 0x989be40 -2365> 2014-05-19 10:47:23.368829 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0x9e10c40 con 0x9adf4a0 -2364> 2014-05-19 10:47:23.368843 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xa2421c0 con 0x9776160 -2363> 2014-05-19 10:47:23.368867 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xa1efdc0 con 0x96bd8c0 -2362> 2014-05-19 10:47:23.368932 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0x97c3880 con 0x96bcdc0 -2361> 2014-05-19 10:47:23.368966 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xa1721c0 con 0x96954a0 -2360> 2014-05-19 10:47:23.369035 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xac49340 con 0x76bd8c0 -2359> 2014-05-19 10:47:23.369090 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0x9e9f340 con 0x7b90dc0 -2358> 2014-05-19 10:47:23.369143 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0x9cb41c0 con 0x978d8c0 -2357> 2014-05-19 10:47:23.369174 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xa209340 con 0x978c580 -2356> 2014-05-19 10:47:23.369205 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0xa4dee00 con 0x978d340 -2355> 2014-05-19 10:47:23.369224 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:23.368024) v2 -- ?+0 0x9faa540 con 0x96374a0 -2354> 2014-05-19 10:47:23.369295 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -2353> 2014-05-19 10:47:23.369319 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 72 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0x9cb7180 con 0x9ad4420 -2352> 2014-05-19 10:47:23.369350 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -2351> 2014-05-19 10:47:23.369373 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 71 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xac2aa80 con 0x9bf31e0 -2350> 2014-05-19 10:47:23.369410 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -2349> 2014-05-19 10:47:23.369427 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 71 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xac23dc0 con 0x998b340 -2348> 2014-05-19 10:47:23.369470 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -2347> 2014-05-19 10:47:23.369478 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 70 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xa0bd180 con 0x9b92840 -2346> 2014-05-19 10:47:23.369493 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -2345> 2014-05-19 10:47:23.369499 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 70 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xac48e00 con 0x9ad49a0 -2344> 2014-05-19 10:47:23.369514 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -2343> 2014-05-19 10:47:23.369519 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0x9f7afc0 con 0x7b911e0 -2342> 2014-05-19 10:47:23.369533 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -2341> 2014-05-19 10:47:23.369540 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0x92a16c0 con 0x7b918c0 -2340> 2014-05-19 10:47:23.369582 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -2339> 2014-05-19 10:47:23.369619 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0x9ee2700 con 0x9aa8c60 -2338> 2014-05-19 10:47:23.369658 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -2337> 2014-05-19 10:47:23.369675 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0x9b2e1c0 con 0x9bfa000 -2336> 2014-05-19 10:47:23.369703 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -2335> 2014-05-19 10:47:23.369720 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xa5168c0 con 0x7c23e40 -2334> 2014-05-19 10:47:23.369749 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -2333> 2014-05-19 10:47:23.369758 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xa6648c0 con 0x998b760 -2332> 2014-05-19 10:47:23.369772 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -2331> 2014-05-19 10:47:23.369781 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xa107dc0 con 0x7b91080 -2330> 2014-05-19 10:47:23.369798 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -2329> 2014-05-19 10:47:23.369805 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0x9cd08c0 con 0xa28fb80 -2328> 2014-05-19 10:47:23.369819 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -2327> 2014-05-19 10:47:23.369828 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xa7d48c0 con 0x76bdce0 -2326> 2014-05-19 10:47:23.369844 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -2325> 2014-05-19 10:47:23.369851 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xac088c0 con 0x994ab00 -2324> 2014-05-19 10:47:23.369865 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -2323> 2014-05-19 10:47:23.369874 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xa664540 con 0x9ac8b00 -2322> 2014-05-19 10:47:23.369891 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -2321> 2014-05-19 10:47:23.369899 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0x9f6f6c0 con 0x938de40 -2320> 2014-05-19 10:47:23.369913 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -2319> 2014-05-19 10:47:23.369920 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xa173a40 con 0x9970b00 -2318> 2014-05-19 10:47:23.369935 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -2317> 2014-05-19 10:47:23.369942 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xa1eee00 con 0x99706e0 -2316> 2014-05-19 10:47:23.369956 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -2315> 2014-05-19 10:47:23.369964 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0x9fd81c0 con 0x9bb6f20 -2314> 2014-05-19 10:47:23.369978 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -2313> 2014-05-19 10:47:23.369985 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xa05e1c0 con 0x994b340 -2312> 2014-05-19 10:47:23.370000 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -2311> 2014-05-19 10:47:23.370004 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xac29180 con 0x98fa2c0 -2310> 2014-05-19 10:47:23.370018 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -2309> 2014-05-19 10:47:23.370027 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0x9b501c0 con 0x996f8c0 -2308> 2014-05-19 10:47:23.370045 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -2307> 2014-05-19 10:47:23.370054 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0x9ccf180 con 0x996fa20 -2306> 2014-05-19 10:47:23.370071 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -2305> 2014-05-19 10:47:23.370079 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xac2b880 con 0x9ac8160 -2304> 2014-05-19 10:47:23.370095 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -2303> 2014-05-19 10:47:23.370102 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xac49880 con 0x7b90420 -2302> 2014-05-19 10:47:23.370117 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -2301> 2014-05-19 10:47:23.370124 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xac4ac40 con 0x919fe40 -2300> 2014-05-19 10:47:23.370138 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -2299> 2014-05-19 10:47:23.370145 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xa2df340 con 0x9971760 -2298> 2014-05-19 10:47:23.370159 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -2297> 2014-05-19 10:47:23.370166 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0x9ef41c0 con 0x994af20 -2296> 2014-05-19 10:47:23.370180 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -2295> 2014-05-19 10:47:23.370189 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xa8656c0 con 0x989be40 -2294> 2014-05-19 10:47:23.370206 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -2293> 2014-05-19 10:47:23.370214 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0x9ad6700 con 0x9adf4a0 -2292> 2014-05-19 10:47:23.370230 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -2291> 2014-05-19 10:47:23.370239 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0x9fa5180 con 0x9776160 -2290> 2014-05-19 10:47:23.370256 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -2289> 2014-05-19 10:47:23.370263 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0x9d0b6c0 con 0x96bd8c0 -2288> 2014-05-19 10:47:23.370277 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -2287> 2014-05-19 10:47:23.370284 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0x9e716c0 con 0x96bcdc0 -2286> 2014-05-19 10:47:23.370298 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -2285> 2014-05-19 10:47:23.370308 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xa172380 con 0x96954a0 -2284> 2014-05-19 10:47:23.370325 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -2283> 2014-05-19 10:47:23.370332 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0x9c6f180 con 0x76bd8c0 -2282> 2014-05-19 10:47:23.370347 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -2281> 2014-05-19 10:47:23.370354 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xa1de1c0 con 0x7b90dc0 -2280> 2014-05-19 10:47:23.370368 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -2279> 2014-05-19 10:47:23.370375 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xac1bdc0 con 0x978d8c0 -2278> 2014-05-19 10:47:23.370389 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -2277> 2014-05-19 10:47:23.370396 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xa857340 con 0x978c580 -2276> 2014-05-19 10:47:23.370409 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -2275> 2014-05-19 10:47:23.370421 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xa872e00 con 0x978d340 -2274> 2014-05-19 10:47:23.370438 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -2273> 2014-05-19 10:47:23.370446 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 52 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.368024) v2 ==== 47+0+0 (978153146 0 0) 0xa4ee000 con 0x96374a0 -2272> 2014-05-19 10:47:23.370460 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -2271> 2014-05-19 10:47:23.407513 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 70 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:23.407333) v2 ==== 47+0+0 (3438139241 0 0) 0xa36d880 con 0x9656580 -2270> 2014-05-19 10:47:23.407561 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.407333) v2 -- ?+0 0xa4df880 con 0x9656580 -2269> 2014-05-19 10:47:23.407577 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 70 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:23.407333) v2 ==== 47+0+0 (3438139241 0 0) 0xac44e00 con 0x9657340 -2268> 2014-05-19 10:47:23.407649 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -2267> 2014-05-19 10:47:23.407673 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:23.407333) v2 -- ?+0 0xa1ef880 con 0x9657340 -2266> 2014-05-19 10:47:23.407704 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -2265> 2014-05-19 10:47:23.451134 7f555019b700 20 OSD::command_tp worker waiting -2264> 2014-05-19 10:47:23.454335 7f555099c700 20 OSD::disk_tp worker waiting -2263> 2014-05-19 10:47:23.507721 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:27.453837) v2 ==== 47+0+0 (238061901 0 0) 0xac14fc0 con 0x9bb69a0 -2262> 2014-05-19 10:47:23.507797 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:27.453837) v2 -- ?+0 0xa36d880 con 0x9bb69a0 -2261> 2014-05-19 10:47:23.507877 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -2260> 2014-05-19 10:47:23.507707 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:27.453837) v2 ==== 47+0+0 (238061901 0 0) 0xa107880 con 0x94e3e40 -2259> 2014-05-19 10:47:23.508167 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:27.453837) v2 -- ?+0 0xac44e00 con 0x94e3e40 -2258> 2014-05-19 10:47:23.508248 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -2257> 2014-05-19 10:47:23.578318 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:27.524433) v2 ==== 47+0+0 (337018774 0 0) 0xac14700 con 0x97434a0 -2256> 2014-05-19 10:47:23.578366 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:27.524433) v2 -- ?+0 0xa107880 con 0x97434a0 -2255> 2014-05-19 10:47:23.578395 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -2254> 2014-05-19 10:47:23.578749 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:27.524433) v2 ==== 47+0+0 (337018774 0 0) 0xa464a80 con 0x9970840 -2253> 2014-05-19 10:47:23.578788 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:27.524433) v2 -- ?+0 0xac14fc0 con 0x9970840 -2252> 2014-05-19 10:47:23.578873 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -2251> 2014-05-19 10:47:23.675479 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:27.621606) v2 ==== 47+0+0 (1490435549 0 0) 0xa208540 con 0x99718c0 -2250> 2014-05-19 10:47:23.675513 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:27.621606) v2 ==== 47+0+0 (1490435549 0 0) 0x9cb7340 con 0x97431e0 -2249> 2014-05-19 10:47:23.675546 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:27.621606) v2 -- ?+0 0xa464a80 con 0x99718c0 -2248> 2014-05-19 10:47:23.675629 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -2247> 2014-05-19 10:47:23.675652 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:27.621606) v2 -- ?+0 0xac14700 con 0x97431e0 -2246> 2014-05-19 10:47:23.675679 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -2245> 2014-05-19 10:47:23.765713 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:26.372741) v2 ==== 47+0+0 (3090598961 0 0) 0xa2bc000 con 0x9b8de40 -2244> 2014-05-19 10:47:23.765759 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:26.372741) v2 ==== 47+0+0 (3090598961 0 0) 0xac36e00 con 0x94e2160 -2243> 2014-05-19 10:47:23.765792 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:26.372741) v2 -- ?+0 0xa208540 con 0x9b8de40 -2242> 2014-05-19 10:47:23.765829 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -2241> 2014-05-19 10:47:23.766333 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:26.372741) v2 -- ?+0 0x9cb7340 con 0x94e2160 -2240> 2014-05-19 10:47:23.766429 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -2239> 2014-05-19 10:47:23.924673 7f5566602700 5 osd.0 245 tick -2238> 2014-05-19 10:47:23.924730 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.29 >= max 0.5 = no, load too high -2237> 2014-05-19 10:47:23.924744 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -2236> 2014-05-19 10:47:23.924746 7f555119d700 20 OSD::recovery_tp worker waiting -2235> 2014-05-19 10:47:23.924747 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2264.46 < min (86400 seconds) -2234> 2014-05-19 10:47:23.924765 7f5566602700 20 osd.0 245 sched_scrub done -2233> 2014-05-19 10:47:23.924768 7f5566602700 10 osd.0 245 do_waiters -- start -2232> 2014-05-19 10:47:23.924771 7f5566602700 10 osd.0 245 do_waiters -- finish -2231> 2014-05-19 10:47:23.984321 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:27.930367) v2 ==== 47+0+0 (1419187744 0 0) 0xa1ee1c0 con 0x95142c0 -2230> 2014-05-19 10:47:23.984782 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:27.930367) v2 -- ?+0 0xac36e00 con 0x95142c0 -2229> 2014-05-19 10:47:23.984882 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -2228> 2014-05-19 10:47:23.984479 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:27.930367) v2 ==== 47+0+0 (1419187744 0 0) 0x9fa41c0 con 0x99d31e0 -2227> 2014-05-19 10:47:23.984939 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:27.930367) v2 -- ?+0 0xa2bc000 con 0x99d31e0 -2226> 2014-05-19 10:47:23.984961 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -2225> 2014-05-19 10:47:24.079513 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:28.025692) v2 ==== 47+0+0 (4282522034 0 0) 0xa092700 con 0x9970840 -2224> 2014-05-19 10:47:24.079546 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:28.025692) v2 ==== 47+0+0 (4282522034 0 0) 0xa1ef340 con 0x97434a0 -2223> 2014-05-19 10:47:24.079569 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.025692) v2 -- ?+0 0x9fa41c0 con 0x9970840 -2222> 2014-05-19 10:47:24.079657 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -2221> 2014-05-19 10:47:24.079702 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.025692) v2 -- ?+0 0xa1ee1c0 con 0x97434a0 -2220> 2014-05-19 10:47:24.079744 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -2219> 2014-05-19 10:47:24.123339 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:28.069468) v2 ==== 47+0+0 (50147509 0 0) 0xac14e00 con 0x94e26e0 -2218> 2014-05-19 10:47:24.123409 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069468) v2 -- ?+0 0xa1ef340 con 0x94e26e0 -2217> 2014-05-19 10:47:24.123404 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:28.069468) v2 ==== 47+0+0 (50147509 0 0) 0xa4ee540 con 0x987b340 -2216> 2014-05-19 10:47:24.123439 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -2215> 2014-05-19 10:47:24.123452 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069468) v2 -- ?+0 0xa092700 con 0x987b340 -2214> 2014-05-19 10:47:24.123533 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -2213> 2014-05-19 10:47:24.505681 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:28.451849) v2 ==== 47+0+0 (247999323 0 0) 0xac428c0 con 0x9bb7b80 -2212> 2014-05-19 10:47:24.505678 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:28.451849) v2 ==== 47+0+0 (247999323 0 0) 0xac40540 con 0x95151e0 -2211> 2014-05-19 10:47:24.505724 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.451849) v2 -- ?+0 0xa4ee540 con 0x9bb7b80 -2210> 2014-05-19 10:47:24.505749 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -2209> 2014-05-19 10:47:24.505771 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.451849) v2 -- ?+0 0xac14e00 con 0x95151e0 -2208> 2014-05-19 10:47:24.505876 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -2207> 2014-05-19 10:47:24.528830 7f5565600700 20 KeyValueStore::op_tp worker waiting -2206> 2014-05-19 10:47:24.562701 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:27.169655) v2 ==== 47+0+0 (1157204223 0 0) 0xac41340 con 0x996e000 -2205> 2014-05-19 10:47:24.562719 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:27.169655) v2 ==== 47+0+0 (1157204223 0 0) 0xa172a80 con 0x9a0c9a0 -2204> 2014-05-19 10:47:24.562753 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:27.169655) v2 -- ?+0 0xac40540 con 0x9a0c9a0 -2203> 2014-05-19 10:47:24.562812 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -2202> 2014-05-19 10:47:24.562836 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:27.169655) v2 -- ?+0 0xac428c0 con 0x996e000 -2201> 2014-05-19 10:47:24.562915 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -2200> 2014-05-19 10:47:24.582500 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 69 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:27.189531) v2 ==== 47+0+0 (1947516075 0 0) 0xa36d6c0 con 0x9937760 -2199> 2014-05-19 10:47:24.582497 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 69 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:27.189531) v2 ==== 47+0+0 (1947516075 0 0) 0x9d0aa80 con 0x9656000 -2198> 2014-05-19 10:47:24.582543 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:27.189531) v2 -- ?+0 0xa172a80 con 0x9937760 -2197> 2014-05-19 10:47:24.582574 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -2196> 2014-05-19 10:47:24.582600 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:27.189531) v2 -- ?+0 0xac41340 con 0x9656000 -2195> 2014-05-19 10:47:24.582649 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -2194> 2014-05-19 10:47:24.609213 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:28.555370) v2 ==== 47+0+0 (3414115340 0 0) 0xac33880 con 0x94e3e40 -2193> 2014-05-19 10:47:24.609228 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:28.555370) v2 ==== 47+0+0 (3414115340 0 0) 0xa0928c0 con 0x9bb69a0 -2192> 2014-05-19 10:47:24.609282 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.555370) v2 -- ?+0 0xa36d6c0 con 0x94e3e40 -2191> 2014-05-19 10:47:24.609320 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -2190> 2014-05-19 10:47:24.609706 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.555370) v2 -- ?+0 0x9d0aa80 con 0x9bb69a0 -2189> 2014-05-19 10:47:24.609785 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -2188> 2014-05-19 10:47:24.770528 7f55579aa700 20 OSD::op_tp worker waiting -2187> 2014-05-19 10:47:24.770571 7f555a1af700 20 OSD::op_tp worker waiting -2186> 2014-05-19 10:47:24.770631 7f55551a5700 20 OSD::op_tp worker waiting -2185> 2014-05-19 10:47:24.772167 7f55569a8700 20 OSD::op_tp worker waiting -2184> 2014-05-19 10:47:24.772186 7f55541a3700 20 OSD::op_tp worker waiting -2183> 2014-05-19 10:47:24.772213 7f55549a4700 20 OSD::op_tp worker waiting -2182> 2014-05-19 10:47:24.772236 7f55589ac700 20 OSD::op_tp worker waiting -2181> 2014-05-19 10:47:24.772260 7f555a9b0700 20 OSD::op_tp worker waiting -2180> 2014-05-19 10:47:24.772300 7f555b1b1700 20 OSD::op_tp worker waiting -2179> 2014-05-19 10:47:24.772786 7f55581ab700 20 OSD::op_tp worker waiting -2178> 2014-05-19 10:47:24.772821 7f55571a9700 20 OSD::op_tp worker waiting -2177> 2014-05-19 10:47:24.772874 7f55599ae700 20 OSD::op_tp worker waiting -2176> 2014-05-19 10:47:24.772886 7f55531a1700 20 OSD::op_tp worker waiting -2175> 2014-05-19 10:47:24.772909 7f555219f700 20 OSD::op_tp worker waiting -2174> 2014-05-19 10:47:24.772951 7f55591ad700 20 OSD::op_tp worker waiting -2173> 2014-05-19 10:47:24.772970 7f55539a2700 20 OSD::op_tp worker waiting -2172> 2014-05-19 10:47:24.772992 7f55561a7700 20 OSD::op_tp worker waiting -2171> 2014-05-19 10:47:24.773016 7f55529a0700 20 OSD::op_tp worker waiting -2170> 2014-05-19 10:47:24.773059 7f55559a6700 20 OSD::op_tp worker waiting -2169> 2014-05-19 10:47:24.773077 7f555199e700 20 OSD::op_tp worker waiting -2168> 2014-05-19 10:47:24.878066 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:27.485009) v2 ==== 47+0+0 (3269094406 0 0) 0xac28fc0 con 0x9656160 -2167> 2014-05-19 10:47:24.878182 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:27.485009) v2 -- ?+0 0xa0928c0 con 0x9656160 -2166> 2014-05-19 10:47:24.878355 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -2165> 2014-05-19 10:47:24.878072 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:27.485009) v2 ==== 47+0+0 (3269094406 0 0) 0xa23f880 con 0x9656f20 -2164> 2014-05-19 10:47:24.878395 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:27.485009) v2 -- ?+0 0xac33880 con 0x9656f20 -2163> 2014-05-19 10:47:24.878427 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -2162> 2014-05-19 10:47:24.919323 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:28.865503) v2 ==== 47+0+0 (218148107 0 0) 0x9fd8e00 con 0x9743600 -2161> 2014-05-19 10:47:24.919637 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.865503) v2 -- ?+0 0xa23f880 con 0x9743600 -2160> 2014-05-19 10:47:24.919677 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -2159> 2014-05-19 10:47:24.919373 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:28.865503) v2 ==== 47+0+0 (218148107 0 0) 0xa506700 con 0x966e000 -2158> 2014-05-19 10:47:24.919820 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.865503) v2 -- ?+0 0xac28fc0 con 0x966e000 -2157> 2014-05-19 10:47:24.919897 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -2156> 2014-05-19 10:47:24.924860 7f5566602700 5 osd.0 245 tick -2155> 2014-05-19 10:47:24.924914 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.29 >= max 0.5 = no, load too high -2154> 2014-05-19 10:47:24.924928 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -2153> 2014-05-19 10:47:24.924929 7f555119d700 20 OSD::recovery_tp worker waiting -2152> 2014-05-19 10:47:24.924931 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2265.46 < min (86400 seconds) -2151> 2014-05-19 10:47:24.924950 7f5566602700 20 osd.0 245 sched_scrub done -2150> 2014-05-19 10:47:24.924953 7f5566602700 10 osd.0 245 do_waiters -- start -2149> 2014-05-19 10:47:24.924955 7f5566602700 10 osd.0 245 do_waiters -- finish -2148> 2014-05-19 10:47:25.022311 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 72 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:27.629319) v2 ==== 47+0+0 (1680428526 0 0) 0x92a1500 con 0x96562c0 -2147> 2014-05-19 10:47:25.022390 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:27.629319) v2 -- ?+0 0xa506700 con 0x96562c0 -2146> 2014-05-19 10:47:25.022474 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -2145> 2014-05-19 10:47:25.022319 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 72 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:27.629319) v2 ==== 47+0+0 (1680428526 0 0) 0xa0bcfc0 con 0x9657080 -2144> 2014-05-19 10:47:25.022778 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:27.629319) v2 -- ?+0 0x9fd8e00 con 0x9657080 -2143> 2014-05-19 10:47:25.022856 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -2142> 2014-05-19 10:47:25.112156 7f5564dff700 20 KeyValueStore::op_tp worker waiting -2141> 2014-05-19 10:47:25.377001 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:29.323284) v2 ==== 47+0+0 (1150214219 0 0) 0x9e9f6c0 con 0x99718c0 -2140> 2014-05-19 10:47:25.377042 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:29.323284) v2 ==== 47+0+0 (1150214219 0 0) 0xa0bd880 con 0x97431e0 -2139> 2014-05-19 10:47:25.377059 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.323284) v2 -- ?+0 0x92a1500 con 0x99718c0 -2138> 2014-05-19 10:47:25.377339 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -2137> 2014-05-19 10:47:25.377400 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.323284) v2 -- ?+0 0xa0bcfc0 con 0x97431e0 -2136> 2014-05-19 10:47:25.377709 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -2135> 2014-05-19 10:47:25.422660 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:28.029582) v2 ==== 47+0+0 (2759515867 0 0) 0xa4de380 con 0x9a0cdc0 -2134> 2014-05-19 10:47:25.422734 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.029582) v2 -- ?+0 0xa0bd880 con 0x9a0cdc0 -2133> 2014-05-19 10:47:25.422815 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -2132> 2014-05-19 10:47:25.422835 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:28.029582) v2 ==== 47+0+0 (2759515867 0 0) 0xa05e8c0 con 0x996fb80 -2131> 2014-05-19 10:47:25.422869 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.029582) v2 -- ?+0 0x9e9f6c0 con 0x996fb80 -2130> 2014-05-19 10:47:25.423008 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -2129> 2014-05-19 10:47:25.451216 7f555019b700 20 OSD::command_tp worker waiting -2128> 2014-05-19 10:47:25.454434 7f555099c700 20 OSD::disk_tp worker waiting -2127> 2014-05-19 10:47:25.467148 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:28.074169) v2 ==== 47+0+0 (2470868618 0 0) 0x9b45180 con 0x9b8de40 -2126> 2014-05-19 10:47:25.467200 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.074169) v2 -- ?+0 0xa05e8c0 con 0x9b8de40 -2125> 2014-05-19 10:47:25.467219 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:28.074169) v2 ==== 47+0+0 (2470868618 0 0) 0xac36fc0 con 0x94e2160 -2124> 2014-05-19 10:47:25.467305 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -2123> 2014-05-19 10:47:25.467579 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.074169) v2 -- ?+0 0xa4de380 con 0x94e2160 -2122> 2014-05-19 10:47:25.467676 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -2121> 2014-05-19 10:47:25.496732 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:29.442934) v2 ==== 47+0+0 (1511360389 0 0) 0x9e9ea80 con 0x99f1080 -2120> 2014-05-19 10:47:25.496781 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.442934) v2 -- ?+0 0xac36fc0 con 0x99f1080 -2119> 2014-05-19 10:47:25.496727 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:29.442934) v2 ==== 47+0+0 (1511360389 0 0) 0xac22000 con 0x987af20 -2118> 2014-05-19 10:47:25.496877 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -2117> 2014-05-19 10:47:25.496905 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.442934) v2 -- ?+0 0x9b45180 con 0x987af20 -2116> 2014-05-19 10:47:25.496940 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -2115> 2014-05-19 10:47:25.653738 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:28.260756) v2 ==== 47+0+0 (3634787816 0 0) 0xa2081c0 con 0x9b8c160 -2114> 2014-05-19 10:47:25.653743 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:28.260756) v2 ==== 47+0+0 (3634787816 0 0) 0xac17880 con 0x9aa3600 -2113> 2014-05-19 10:47:25.653793 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.260756) v2 -- ?+0 0xac22000 con 0x9b8c160 -2112> 2014-05-19 10:47:25.653938 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -2111> 2014-05-19 10:47:25.654264 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.260756) v2 -- ?+0 0x9e9ea80 con 0x9aa3600 -2110> 2014-05-19 10:47:25.654298 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -2109> 2014-05-19 10:47:25.685521 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:29.631687) v2 ==== 47+0+0 (1582185750 0 0) 0xac17c00 con 0x99d31e0 -2108> 2014-05-19 10:47:25.685866 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:29.631687) v2 ==== 47+0+0 (1582185750 0 0) 0xa1eea80 con 0x95142c0 -2107> 2014-05-19 10:47:25.685568 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.631687) v2 -- ?+0 0xa2081c0 con 0x99d31e0 -2106> 2014-05-19 10:47:25.686144 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -2105> 2014-05-19 10:47:25.686166 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.631687) v2 -- ?+0 0xac17880 con 0x95142c0 -2104> 2014-05-19 10:47:25.686247 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -2103> 2014-05-19 10:47:25.786983 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:29.733320) v2 ==== 47+0+0 (3475853499 0 0) 0x9b448c0 con 0x99d3340 -2102> 2014-05-19 10:47:25.787022 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.733320) v2 -- ?+0 0xac17c00 con 0x99d3340 -2101> 2014-05-19 10:47:25.787146 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:29.733320) v2 ==== 47+0+0 (3475853499 0 0) 0xa2bc700 con 0x94a5a20 -2100> 2014-05-19 10:47:25.787072 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -2099> 2014-05-19 10:47:25.787456 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.733320) v2 -- ?+0 0xa1eea80 con 0x94a5a20 -2098> 2014-05-19 10:47:25.787671 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -2097> 2014-05-19 10:47:25.925044 7f5566602700 5 osd.0 245 tick -2096> 2014-05-19 10:47:25.925070 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -2095> 2014-05-19 10:47:25.925075 7f5566602700 10 osd.0 245 do_waiters -- start -2094> 2014-05-19 10:47:25.925077 7f5566602700 10 osd.0 245 do_waiters -- finish -2093> 2014-05-19 10:47:25.925120 7f555119d700 20 OSD::recovery_tp worker waiting -2092> 2014-05-19 10:47:26.309199 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 71 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:26.309030) v2 ==== 47+0+0 (3437671919 0 0) 0x9fd8c40 con 0x9656580 -2091> 2014-05-19 10:47:26.309227 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 71 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:26.309030) v2 ==== 47+0+0 (3437671919 0 0) 0xac44c40 con 0x9657340 -2090> 2014-05-19 10:47:26.309252 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:26.309030) v2 -- ?+0 0x9b448c0 con 0x9656580 -2089> 2014-05-19 10:47:26.309287 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -2088> 2014-05-19 10:47:26.309332 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:26.309030) v2 -- ?+0 0xa2bc700 con 0x9657340 -2087> 2014-05-19 10:47:26.309374 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -2086> 2014-05-19 10:47:26.352983 7f555c1b3700 10 monclient: tick -2085> 2014-05-19 10:47:26.352995 7f555c1b3700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2014-05-19 10:46:56.352994) -2084> 2014-05-19 10:47:26.353014 7f555c1b3700 10 monclient: renew subs? (now: 2014-05-19 10:47:26.353013; renew after: 2014-05-19 10:49:36.352721) -- no -2083> 2014-05-19 10:47:26.528928 7f5565600700 20 KeyValueStore::op_tp worker waiting -2082> 2014-05-19 10:47:26.657658 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 73 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:29.264674) v2 ==== 47+0+0 (2237719005 0 0) 0xac47340 con 0x9656420 -2081> 2014-05-19 10:47:26.657702 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.264674) v2 -- ?+0 0x9fd8c40 con 0x9656420 -2080> 2014-05-19 10:47:26.657810 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -2079> 2014-05-19 10:47:26.657994 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 73 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:29.264674) v2 ==== 47+0+0 (2237719005 0 0) 0xac1b880 con 0x96571e0 -2078> 2014-05-19 10:47:26.658035 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.264674) v2 -- ?+0 0xac44c40 con 0x96571e0 -2077> 2014-05-19 10:47:26.658068 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -2076> 2014-05-19 10:47:26.770627 7f55579aa700 20 OSD::op_tp worker waiting -2075> 2014-05-19 10:47:26.770652 7f555a1af700 20 OSD::op_tp worker waiting -2074> 2014-05-19 10:47:26.770712 7f55551a5700 20 OSD::op_tp worker waiting -2073> 2014-05-19 10:47:26.772269 7f55569a8700 20 OSD::op_tp worker waiting -2072> 2014-05-19 10:47:26.772293 7f55549a4700 20 OSD::op_tp worker waiting -2071> 2014-05-19 10:47:26.772312 7f55541a3700 20 OSD::op_tp worker waiting -2070> 2014-05-19 10:47:26.772325 7f555a9b0700 20 OSD::op_tp worker waiting -2069> 2014-05-19 10:47:26.772339 7f55589ac700 20 OSD::op_tp worker waiting -2068> 2014-05-19 10:47:26.772364 7f555b1b1700 20 OSD::op_tp worker waiting -2067> 2014-05-19 10:47:26.772853 7f55581ab700 20 OSD::op_tp worker waiting -2066> 2014-05-19 10:47:26.772889 7f55571a9700 20 OSD::op_tp worker waiting -2065> 2014-05-19 10:47:26.772939 7f55599ae700 20 OSD::op_tp worker waiting -2064> 2014-05-19 10:47:26.772963 7f55531a1700 20 OSD::op_tp worker waiting -2063> 2014-05-19 10:47:26.773023 7f555219f700 20 OSD::op_tp worker waiting -2062> 2014-05-19 10:47:26.773043 7f55591ad700 20 OSD::op_tp worker waiting -2061> 2014-05-19 10:47:26.773058 7f55561a7700 20 OSD::op_tp worker waiting -2060> 2014-05-19 10:47:26.773071 7f55539a2700 20 OSD::op_tp worker waiting -2059> 2014-05-19 10:47:26.773084 7f55529a0700 20 OSD::op_tp worker waiting -2058> 2014-05-19 10:47:26.773127 7f55559a6700 20 OSD::op_tp worker waiting -2057> 2014-05-19 10:47:26.773140 7f555199e700 20 OSD::op_tp worker waiting -2056> 2014-05-19 10:47:26.807129 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:30.753372) v2 ==== 47+0+0 (3101877142 0 0) 0xac42700 con 0x9bb7b80 -2055> 2014-05-19 10:47:26.807167 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:30.753372) v2 ==== 47+0+0 (3101877142 0 0) 0xac40380 con 0x95151e0 -2054> 2014-05-19 10:47:26.807181 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:30.753372) v2 -- ?+0 0xac47340 con 0x9bb7b80 -2053> 2014-05-19 10:47:26.807504 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -2052> 2014-05-19 10:47:26.807711 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:30.753372) v2 -- ?+0 0xac1b880 con 0x95151e0 -2051> 2014-05-19 10:47:26.807757 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -2050> 2014-05-19 10:47:26.925167 7f5566602700 5 osd.0 245 tick -2049> 2014-05-19 10:47:26.925234 7f555119d700 20 OSD::recovery_tp worker waiting -2048> 2014-05-19 10:47:26.925231 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.19 >= max 0.5 = no, load too high -2047> 2014-05-19 10:47:26.925251 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -2046> 2014-05-19 10:47:26.925256 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2267.46 < min (86400 seconds) -2045> 2014-05-19 10:47:26.925280 7f5566602700 20 osd.0 245 sched_scrub done -2044> 2014-05-19 10:47:26.925285 7f5566602700 10 osd.0 245 do_waiters -- start -2043> 2014-05-19 10:47:26.925288 7f5566602700 10 osd.0 245 do_waiters -- finish -2042> 2014-05-19 10:47:27.112256 7f5564dff700 20 KeyValueStore::op_tp worker waiting -2041> 2014-05-19 10:47:27.131763 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:31.078022) v2 ==== 47+0+0 (3079368508 0 0) 0xac45880 con 0x94802c0 -2040> 2014-05-19 10:47:27.131820 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.078022) v2 -- ?+0 0xac40380 con 0x94802c0 -2039> 2014-05-19 10:47:27.131928 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -2038> 2014-05-19 10:47:27.131862 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 49 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:31.078022) v2 ==== 47+0+0 (3079368508 0 0) 0xac46a80 con 0x987b760 -2037> 2014-05-19 10:47:27.132258 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.078022) v2 -- ?+0 0xac42700 con 0x987b760 -2036> 2014-05-19 10:47:27.132369 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -2035> 2014-05-19 10:47:27.158968 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 74 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:29.766039) v2 ==== 47+0+0 (2626742268 0 0) 0xa2bc380 con 0x96571e0 -2034> 2014-05-19 10:47:27.158982 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 74 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:29.766039) v2 ==== 47+0+0 (2626742268 0 0) 0xac47180 con 0x9656420 -2033> 2014-05-19 10:47:27.159019 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.766039) v2 -- ?+0 0xac45880 con 0x96571e0 -2032> 2014-05-19 10:47:27.159063 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -2031> 2014-05-19 10:47:27.159088 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.766039) v2 -- ?+0 0xac46a80 con 0x9656420 -2030> 2014-05-19 10:47:27.159233 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -2029> 2014-05-19 10:47:27.179446 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 67 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:29.786548) v2 ==== 47+0+0 (1852920534 0 0) 0xac17c00 con 0x9656160 -2028> 2014-05-19 10:47:27.179456 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 67 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:29.786548) v2 ==== 47+0+0 (1852920534 0 0) 0x9faa8c0 con 0x9656f20 -2027> 2014-05-19 10:47:27.179513 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.786548) v2 -- ?+0 0xac47180 con 0x9656160 -2026> 2014-05-19 10:47:27.179554 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -2025> 2014-05-19 10:47:27.179615 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.786548) v2 -- ?+0 0xa2bc380 con 0x9656f20 -2024> 2014-05-19 10:47:27.179725 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -2023> 2014-05-19 10:47:27.308779 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:31.255046) v2 ==== 47+0+0 (3088323664 0 0) 0xac42540 con 0x9bb7b80 -2022> 2014-05-19 10:47:27.308819 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:31.255046) v2 ==== 47+0+0 (3088323664 0 0) 0xac401c0 con 0x95151e0 -2021> 2014-05-19 10:47:27.308830 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.255046) v2 -- ?+0 0xac17c00 con 0x9bb7b80 -2020> 2014-05-19 10:47:27.308895 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -2019> 2014-05-19 10:47:27.308918 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.255046) v2 -- ?+0 0x9faa8c0 con 0x95151e0 -2018> 2014-05-19 10:47:27.309222 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -2017> 2014-05-19 10:47:27.451297 7f555019b700 20 OSD::command_tp worker waiting -2016> 2014-05-19 10:47:27.454534 7f555099c700 20 OSD::disk_tp worker waiting -2015> 2014-05-19 10:47:27.488453 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:31.434709) v2 ==== 47+0+0 (2107857392 0 0) 0x9b44a80 con 0x99d3340 -2014> 2014-05-19 10:47:27.488521 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.434709) v2 -- ?+0 0xac42540 con 0x99d3340 -2013> 2014-05-19 10:47:27.488599 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -2012> 2014-05-19 10:47:27.488584 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:31.434709) v2 ==== 47+0+0 (2107857392 0 0) 0xa2bda40 con 0x94a5a20 -2011> 2014-05-19 10:47:27.488628 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.434709) v2 -- ?+0 0xac401c0 con 0x94a5a20 -2010> 2014-05-19 10:47:27.488703 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -2009> 2014-05-19 10:47:27.528653 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:30.135677) v2 ==== 47+0+0 (696227333 0 0) 0xa265880 con 0x9b8db80 -2008> 2014-05-19 10:47:27.528651 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:30.135677) v2 ==== 47+0+0 (696227333 0 0) 0x97d28c0 con 0x7b90160 -2007> 2014-05-19 10:47:27.528703 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:30.135677) v2 -- ?+0 0x9b44a80 con 0x9b8db80 -2006> 2014-05-19 10:47:27.528785 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -2005> 2014-05-19 10:47:27.528870 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:30.135677) v2 -- ?+0 0xa2bda40 con 0x7b90160 -2004> 2014-05-19 10:47:27.528909 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -2003> 2014-05-19 10:47:27.580799 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:31.527075) v2 ==== 47+0+0 (209365180 0 0) 0x9fa8fc0 con 0x9970840 -2002> 2014-05-19 10:47:27.580848 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.527075) v2 -- ?+0 0xa265880 con 0x9970840 -2001> 2014-05-19 10:47:27.580902 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -2000> 2014-05-19 10:47:27.580960 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:31.527075) v2 ==== 47+0+0 (209365180 0 0) 0xac221c0 con 0x97434a0 -1999> 2014-05-19 10:47:27.581012 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.527075) v2 -- ?+0 0x97d28c0 con 0x97434a0 -1998> 2014-05-19 10:47:27.581088 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -1997> 2014-05-19 10:47:27.925375 7f5566602700 5 osd.0 245 tick -1996> 2014-05-19 10:47:27.925396 7f5566602700 7 osd.0 245 do_mon_report -1995> 2014-05-19 10:47:27.925400 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 -1994> 2014-05-19 10:47:27.925404 7f5566602700 20 osd.0 245 send_pg_stats -1993> 2014-05-19 10:47:27.925413 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -1992> 2014-05-19 10:47:27.925417 7f5566602700 10 osd.0 245 do_waiters -- start -1991> 2014-05-19 10:47:27.925419 7f5566602700 10 osd.0 245 do_waiters -- finish -1990> 2014-05-19 10:47:27.925454 7f555119d700 20 OSD::recovery_tp worker waiting -1989> 2014-05-19 10:47:27.986834 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:31.933130) v2 ==== 47+0+0 (4023988072 0 0) 0x9faa8c0 con 0x99d31e0 -1988> 2014-05-19 10:47:27.986906 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.933130) v2 -- ?+0 0x9fa8fc0 con 0x99d31e0 -1987> 2014-05-19 10:47:27.986915 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:31.933130) v2 ==== 47+0+0 (4023988072 0 0) 0xa2bc000 con 0x95142c0 -1986> 2014-05-19 10:47:27.986949 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -1985> 2014-05-19 10:47:27.986962 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.933130) v2 -- ?+0 0xac221c0 con 0x95142c0 -1984> 2014-05-19 10:47:27.987101 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -1983> 2014-05-19 10:47:28.069394 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -1982> 2014-05-19 10:47:28.069415 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -1981> 2014-05-19 10:47:28.069424 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xac43340 con 0x9bdc840 -1980> 2014-05-19 10:47:28.069450 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xac32fc0 con 0x9ad4420 -1979> 2014-05-19 10:47:28.069490 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xac1b340 con 0x9bf31e0 -1978> 2014-05-19 10:47:28.069507 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0x9ad2fc0 con 0x998b340 -1977> 2014-05-19 10:47:28.069536 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xa102380 con 0x9b92840 -1976> 2014-05-19 10:47:28.069566 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xa618a80 con 0x9ad49a0 -1975> 2014-05-19 10:47:28.069596 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xac16c40 con 0x7b911e0 -1974> 2014-05-19 10:47:28.069633 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xa2e1340 con 0x7b918c0 -1973> 2014-05-19 10:47:28.069663 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xac08c40 con 0x9aa8c60 -1972> 2014-05-19 10:47:28.069680 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xa517880 con 0x9bfa000 -1971> 2014-05-19 10:47:28.069697 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xa236a80 con 0x7c23e40 -1970> 2014-05-19 10:47:28.069715 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0x9fd96c0 con 0x998b760 -1969> 2014-05-19 10:47:28.069730 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0x9fecfc0 con 0x7b91080 -1968> 2014-05-19 10:47:28.069784 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xac31a40 con 0xa28fb80 -1967> 2014-05-19 10:47:28.069794 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 73 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0x9fa9dc0 con 0x9bdc840 -1966> 2014-05-19 10:47:28.069819 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xa384fc0 con 0x76bdce0 -1965> 2014-05-19 10:47:28.069844 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0x94641c0 con 0x994ab00 -1964> 2014-05-19 10:47:28.069869 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0x9b2e380 con 0x9ac8b00 -1963> 2014-05-19 10:47:28.069898 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xa23e000 con 0x938de40 -1962> 2014-05-19 10:47:28.069924 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0x9ba5880 con 0x9970b00 -1961> 2014-05-19 10:47:28.069940 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xac1a1c0 con 0x99706e0 -1960> 2014-05-19 10:47:28.069956 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xac29500 con 0x9bb6f20 -1959> 2014-05-19 10:47:28.069972 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xa1dec40 con 0x994b340 -1958> 2014-05-19 10:47:28.069988 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0x9fdc380 con 0x98fa2c0 -1957> 2014-05-19 10:47:28.070004 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0x9e6d880 con 0x996f8c0 -1956> 2014-05-19 10:47:28.070032 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0x9faa380 con 0x996fa20 -1955> 2014-05-19 10:47:28.070071 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0x9b51dc0 con 0x9ac8160 -1954> 2014-05-19 10:47:28.070091 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xa857340 con 0x7b90420 -1953> 2014-05-19 10:47:28.070107 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xac1bdc0 con 0x919fe40 -1952> 2014-05-19 10:47:28.070123 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xa1de1c0 con 0x9971760 -1951> 2014-05-19 10:47:28.070150 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0x9c6f180 con 0x994af20 -1950> 2014-05-19 10:47:28.070179 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xa172380 con 0x989be40 -1949> 2014-05-19 10:47:28.070198 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0x9e716c0 con 0x9adf4a0 -1948> 2014-05-19 10:47:28.070212 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0x9d0b6c0 con 0x9776160 -1947> 2014-05-19 10:47:28.070240 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0x9fa5180 con 0x96bd8c0 -1946> 2014-05-19 10:47:28.070266 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0x9ad6700 con 0x96bcdc0 -1945> 2014-05-19 10:47:28.070295 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xa8656c0 con 0x96954a0 -1944> 2014-05-19 10:47:28.070339 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0x9ef41c0 con 0x76bd8c0 -1943> 2014-05-19 10:47:28.070379 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xa2df340 con 0x7b90dc0 -1942> 2014-05-19 10:47:28.070490 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xac4ac40 con 0x978d8c0 -1941> 2014-05-19 10:47:28.070528 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xac49880 con 0x978c580 -1940> 2014-05-19 10:47:28.070664 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0xac2b880 con 0x978d340 -1939> 2014-05-19 10:47:28.070700 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:28.069422) v2 -- ?+0 0x9ccf180 con 0x96374a0 -1938> 2014-05-19 10:47:28.070758 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -1937> 2014-05-19 10:47:28.070790 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 73 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0x9cb7dc0 con 0x9ad4420 -1936> 2014-05-19 10:47:28.070833 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -1935> 2014-05-19 10:47:28.070857 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 72 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xac2bc00 con 0x9bf31e0 -1934> 2014-05-19 10:47:28.070903 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -1933> 2014-05-19 10:47:28.070913 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 72 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0x95621c0 con 0x998b340 -1932> 2014-05-19 10:47:28.070929 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -1931> 2014-05-19 10:47:28.070939 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 71 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xa162a80 con 0x9b92840 -1930> 2014-05-19 10:47:28.070969 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -1929> 2014-05-19 10:47:28.070986 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 71 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xac48c40 con 0x9ad49a0 -1928> 2014-05-19 10:47:28.071017 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -1927> 2014-05-19 10:47:28.071036 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0x9ccec40 con 0x7b911e0 -1926> 2014-05-19 10:47:28.071063 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -1925> 2014-05-19 10:47:28.071073 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xa6d4380 con 0x7b918c0 -1924> 2014-05-19 10:47:28.071108 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -1923> 2014-05-19 10:47:28.071118 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xa107880 con 0x9aa8c60 -1922> 2014-05-19 10:47:28.071138 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -1921> 2014-05-19 10:47:28.071149 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0x9236e00 con 0x9bfa000 -1920> 2014-05-19 10:47:28.071171 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -1919> 2014-05-19 10:47:28.071180 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0x95c0540 con 0x7c23e40 -1918> 2014-05-19 10:47:28.071194 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -1917> 2014-05-19 10:47:28.071202 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xa2661c0 con 0x998b760 -1916> 2014-05-19 10:47:28.071216 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -1915> 2014-05-19 10:47:28.071224 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xa030380 con 0x7b91080 -1914> 2014-05-19 10:47:28.071240 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -1913> 2014-05-19 10:47:28.071247 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xa114fc0 con 0xa28fb80 -1912> 2014-05-19 10:47:28.071261 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -1911> 2014-05-19 10:47:28.071272 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xa7d4a80 con 0x76bdce0 -1910> 2014-05-19 10:47:28.071289 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -1909> 2014-05-19 10:47:28.071296 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0x9caae00 con 0x994ab00 -1908> 2014-05-19 10:47:28.071310 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -1907> 2014-05-19 10:47:28.071318 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xa664e00 con 0x9ac8b00 -1906> 2014-05-19 10:47:28.071332 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -1905> 2014-05-19 10:47:28.071340 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xa0bda40 con 0x938de40 -1904> 2014-05-19 10:47:28.071354 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -1903> 2014-05-19 10:47:28.071362 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0x9388700 con 0x9970b00 -1902> 2014-05-19 10:47:28.071376 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -1901> 2014-05-19 10:47:28.071383 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xa237500 con 0x99706e0 -1900> 2014-05-19 10:47:28.071397 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -1899> 2014-05-19 10:47:28.071406 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0x9d52000 con 0x9bb6f20 -1898> 2014-05-19 10:47:28.071424 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -1897> 2014-05-19 10:47:28.071429 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0x9ed0000 con 0x994b340 -1896> 2014-05-19 10:47:28.071445 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -1895> 2014-05-19 10:47:28.071455 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xa0bafc0 con 0x98fa2c0 -1894> 2014-05-19 10:47:28.071472 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -1893> 2014-05-19 10:47:28.071479 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xac316c0 con 0x996f8c0 -1892> 2014-05-19 10:47:28.071493 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -1891> 2014-05-19 10:47:28.071500 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xa030fc0 con 0x996fa20 -1890> 2014-05-19 10:47:28.071515 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -1889> 2014-05-19 10:47:28.071524 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xac2ba40 con 0x9ac8160 -1888> 2014-05-19 10:47:28.071541 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -1887> 2014-05-19 10:47:28.071548 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xac496c0 con 0x7b90420 -1886> 2014-05-19 10:47:28.071562 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -1885> 2014-05-19 10:47:28.071570 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xac4aa80 con 0x919fe40 -1884> 2014-05-19 10:47:28.071584 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -1883> 2014-05-19 10:47:28.071591 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xa2dfc00 con 0x9971760 -1882> 2014-05-19 10:47:28.071606 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -1881> 2014-05-19 10:47:28.071613 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0x9ef4540 con 0x994af20 -1880> 2014-05-19 10:47:28.071627 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -1879> 2014-05-19 10:47:28.071640 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xa865180 con 0x989be40 -1878> 2014-05-19 10:47:28.071658 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -1877> 2014-05-19 10:47:28.071665 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xa0ca540 con 0x9adf4a0 -1876> 2014-05-19 10:47:28.071681 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -1875> 2014-05-19 10:47:28.071688 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0x951ddc0 con 0x9776160 -1874> 2014-05-19 10:47:28.071702 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -1873> 2014-05-19 10:47:28.071710 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0x9d0afc0 con 0x96bd8c0 -1872> 2014-05-19 10:47:28.071724 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -1871> 2014-05-19 10:47:28.071731 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xa106540 con 0x96bcdc0 -1870> 2014-05-19 10:47:28.071746 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -1869> 2014-05-19 10:47:28.071753 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xa5fc1c0 con 0x96954a0 -1868> 2014-05-19 10:47:28.071767 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -1867> 2014-05-19 10:47:28.071776 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xac16fc0 con 0x76bd8c0 -1866> 2014-05-19 10:47:28.071793 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -1865> 2014-05-19 10:47:28.071800 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xa030540 con 0x7b90dc0 -1864> 2014-05-19 10:47:28.071814 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -1863> 2014-05-19 10:47:28.071823 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xac1a8c0 con 0x978d8c0 -1862> 2014-05-19 10:47:28.071840 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -1861> 2014-05-19 10:47:28.071848 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xa856700 con 0x978c580 -1860> 2014-05-19 10:47:28.071863 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -1859> 2014-05-19 10:47:28.071870 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xa872c40 con 0x978d340 -1858> 2014-05-19 10:47:28.071884 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -1857> 2014-05-19 10:47:28.071892 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 53 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:28.069422) v2 ==== 47+0+0 (3813913263 0 0) 0xa4ee380 con 0x96374a0 -1856> 2014-05-19 10:47:28.071910 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -1855> 2014-05-19 10:47:28.110307 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:32.056695) v2 ==== 47+0+0 (1814775633 0 0) 0xa0921c0 con 0x9bb69a0 -1854> 2014-05-19 10:47:28.110398 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:32.056695) v2 ==== 47+0+0 (1814775633 0 0) 0xac328c0 con 0x94e3e40 -1853> 2014-05-19 10:47:28.110429 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:32.056695) v2 -- ?+0 0x9faa8c0 con 0x9bb69a0 -1852> 2014-05-19 10:47:28.110513 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -1851> 2014-05-19 10:47:28.110936 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:32.056695) v2 -- ?+0 0xa2bc000 con 0x94e3e40 -1850> 2014-05-19 10:47:28.110977 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -1849> 2014-05-19 10:47:28.278534 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:32.224697) v2 ==== 47+0+0 (3436502722 0 0) 0x9e9fa40 con 0x99718c0 -1848> 2014-05-19 10:47:28.278578 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:32.224697) v2 -- ?+0 0xa0921c0 con 0x99718c0 -1847> 2014-05-19 10:47:28.278700 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:32.224697) v2 ==== 47+0+0 (3436502722 0 0) 0xa0bc1c0 con 0x97431e0 -1846> 2014-05-19 10:47:28.278653 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -1845> 2014-05-19 10:47:28.278937 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:32.224697) v2 -- ?+0 0xac328c0 con 0x97431e0 -1844> 2014-05-19 10:47:28.279023 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -1843> 2014-05-19 10:47:28.488470 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:32.434548) v2 ==== 47+0+0 (2254703755 0 0) 0xa2bca80 con 0x95142c0 -1842> 2014-05-19 10:47:28.488513 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:32.434548) v2 -- ?+0 0xa0bc1c0 con 0x95142c0 -1841> 2014-05-19 10:47:28.488541 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -1840> 2014-05-19 10:47:28.488683 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:32.434548) v2 ==== 47+0+0 (2254703755 0 0) 0xac1b880 con 0x99d31e0 -1839> 2014-05-19 10:47:28.488723 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:32.434548) v2 -- ?+0 0x9e9fa40 con 0x99d31e0 -1838> 2014-05-19 10:47:28.488747 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -1837> 2014-05-19 10:47:28.523692 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 73 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:31.130731) v2 ==== 47+0+0 (2109274488 0 0) 0xac336c0 con 0x9657080 -1836> 2014-05-19 10:47:28.523708 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 73 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:31.130731) v2 ==== 47+0+0 (2109274488 0 0) 0x9c0e380 con 0x96562c0 -1835> 2014-05-19 10:47:28.523745 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.130731) v2 -- ?+0 0xa2bca80 con 0x9657080 -1834> 2014-05-19 10:47:28.523828 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -1833> 2014-05-19 10:47:28.524223 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.130731) v2 -- ?+0 0xac1b880 con 0x96562c0 -1832> 2014-05-19 10:47:28.524263 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -1831> 2014-05-19 10:47:28.529027 7f5565600700 20 KeyValueStore::op_tp worker waiting -1830> 2014-05-19 10:47:28.561652 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 67 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:31.168681) v2 ==== 47+0+0 (3883281432 0 0) 0x97c2fc0 con 0x9983600 -1829> 2014-05-19 10:47:28.561664 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 67 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:31.168681) v2 ==== 47+0+0 (3883281432 0 0) 0xa1736c0 con 0x95846e0 -1828> 2014-05-19 10:47:28.561702 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.168681) v2 -- ?+0 0xac336c0 con 0x9983600 -1827> 2014-05-19 10:47:28.561735 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -1826> 2014-05-19 10:47:28.562114 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.168681) v2 -- ?+0 0x9c0e380 con 0x95846e0 -1825> 2014-05-19 10:47:28.562215 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -1824> 2014-05-19 10:47:28.770733 7f55579aa700 20 OSD::op_tp worker waiting -1823> 2014-05-19 10:47:28.770793 7f555a1af700 20 OSD::op_tp worker waiting -1822> 2014-05-19 10:47:28.770856 7f55551a5700 20 OSD::op_tp worker waiting -1821> 2014-05-19 10:47:28.772372 7f55569a8700 20 OSD::op_tp worker waiting -1820> 2014-05-19 10:47:28.772398 7f555b1b1700 20 OSD::op_tp worker waiting -1819> 2014-05-19 10:47:28.772419 7f55541a3700 20 OSD::op_tp worker waiting -1818> 2014-05-19 10:47:28.772440 7f55549a4700 20 OSD::op_tp worker waiting -1817> 2014-05-19 10:47:28.772464 7f555a9b0700 20 OSD::op_tp worker waiting -1816> 2014-05-19 10:47:28.772483 7f55589ac700 20 OSD::op_tp worker waiting -1815> 2014-05-19 10:47:28.772923 7f55581ab700 20 OSD::op_tp worker waiting -1814> 2014-05-19 10:47:28.772954 7f55571a9700 20 OSD::op_tp worker waiting -1813> 2014-05-19 10:47:28.772992 7f55599ae700 20 OSD::op_tp worker waiting -1812> 2014-05-19 10:47:28.773034 7f55531a1700 20 OSD::op_tp worker waiting -1811> 2014-05-19 10:47:28.773114 7f55591ad700 20 OSD::op_tp worker waiting -1810> 2014-05-19 10:47:28.773131 7f55529a0700 20 OSD::op_tp worker waiting -1809> 2014-05-19 10:47:28.773145 7f55539a2700 20 OSD::op_tp worker waiting -1808> 2014-05-19 10:47:28.773164 7f55561a7700 20 OSD::op_tp worker waiting -1807> 2014-05-19 10:47:28.773201 7f555199e700 20 OSD::op_tp worker waiting -1806> 2014-05-19 10:47:28.773214 7f555219f700 20 OSD::op_tp worker waiting -1805> 2014-05-19 10:47:28.773243 7f55559a6700 20 OSD::op_tp worker waiting -1804> 2014-05-19 10:47:28.824559 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:32.770883) v2 ==== 47+0+0 (1030759446 0 0) 0xac15c00 con 0x94e26e0 -1803> 2014-05-19 10:47:28.824567 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:32.770883) v2 ==== 47+0+0 (1030759446 0 0) 0xa4ef340 con 0x987b340 -1802> 2014-05-19 10:47:28.824648 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:32.770883) v2 -- ?+0 0x97c2fc0 con 0x94e26e0 -1801> 2014-05-19 10:47:28.824912 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -1800> 2014-05-19 10:47:28.824937 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:32.770883) v2 -- ?+0 0xa1736c0 con 0x987b340 -1799> 2014-05-19 10:47:28.825212 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -1798> 2014-05-19 10:47:28.925485 7f5566602700 5 osd.0 245 tick -1797> 2014-05-19 10:47:28.925511 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -1796> 2014-05-19 10:47:28.925516 7f5566602700 10 osd.0 245 do_waiters -- start -1795> 2014-05-19 10:47:28.925519 7f5566602700 10 osd.0 245 do_waiters -- finish -1794> 2014-05-19 10:47:28.925548 7f555119d700 20 OSD::recovery_tp worker waiting -1793> 2014-05-19 10:47:28.998036 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:32.944378) v2 ==== 47+0+0 (1988767548 0 0) 0xa093180 con 0x987af20 -1792> 2014-05-19 10:47:28.998097 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:32.944378) v2 -- ?+0 0xa4ef340 con 0x987af20 -1791> 2014-05-19 10:47:28.998151 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -1790> 2014-05-19 10:47:28.998038 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:32.944378) v2 ==== 47+0+0 (1988767548 0 0) 0x93ad500 con 0x99f1080 -1789> 2014-05-19 10:47:28.998166 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:32.944378) v2 -- ?+0 0xac15c00 con 0x99f1080 -1788> 2014-05-19 10:47:28.998458 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -1787> 2014-05-19 10:47:29.010032 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:32.956404) v2 ==== 47+0+0 (2424473774 0 0) 0xac40000 con 0x95151e0 -1786> 2014-05-19 10:47:29.010080 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:32.956404) v2 -- ?+0 0x93ad500 con 0x95151e0 -1785> 2014-05-19 10:47:29.010095 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:32.956404) v2 ==== 47+0+0 (2424473774 0 0) 0xac42380 con 0x9bb7b80 -1784> 2014-05-19 10:47:29.010287 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -1783> 2014-05-19 10:47:29.010496 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:32.956404) v2 -- ?+0 0xa093180 con 0x9bb7b80 -1782> 2014-05-19 10:47:29.010581 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -1781> 2014-05-19 10:47:29.025094 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 74 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:31.632217) v2 ==== 47+0+0 (2449024716 0 0) 0xa242380 con 0x9657080 -1780> 2014-05-19 10:47:29.025185 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.632217) v2 -- ?+0 0xac40000 con 0x9657080 -1779> 2014-05-19 10:47:29.025132 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 74 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:31.632217) v2 ==== 47+0+0 (2449024716 0 0) 0x9ad3a40 con 0x96562c0 -1778> 2014-05-19 10:47:29.025653 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -1777> 2014-05-19 10:47:29.025715 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.632217) v2 -- ?+0 0xac42380 con 0x96562c0 -1776> 2014-05-19 10:47:29.025801 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -1775> 2014-05-19 10:47:29.112352 7f5564dff700 20 KeyValueStore::op_tp worker waiting -1774> 2014-05-19 10:47:29.282091 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:33.228406) v2 ==== 47+0+0 (2842749434 0 0) 0x9e116c0 con 0x9970840 -1773> 2014-05-19 10:47:29.282137 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:33.228406) v2 -- ?+0 0x9ad3a40 con 0x9970840 -1772> 2014-05-19 10:47:29.282234 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -1771> 2014-05-19 10:47:29.282037 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:33.228406) v2 ==== 47+0+0 (2842749434 0 0) 0xac096c0 con 0x97434a0 -1770> 2014-05-19 10:47:29.282560 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:33.228406) v2 -- ?+0 0xa242380 con 0x97434a0 -1769> 2014-05-19 10:47:29.282659 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -1768> 2014-05-19 10:47:29.432858 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:33.379314) v2 ==== 47+0+0 (1646595335 0 0) 0xac468c0 con 0x987b760 -1767> 2014-05-19 10:47:29.432904 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:33.379314) v2 -- ?+0 0x9e116c0 con 0x987b760 -1766> 2014-05-19 10:47:29.432928 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -1765> 2014-05-19 10:47:29.432992 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 50 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:33.379314) v2 ==== 47+0+0 (1646595335 0 0) 0xac456c0 con 0x94802c0 -1764> 2014-05-19 10:47:29.433038 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:33.379314) v2 -- ?+0 0xac096c0 con 0x94802c0 -1763> 2014-05-19 10:47:29.433227 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -1762> 2014-05-19 10:47:29.451385 7f555019b700 20 OSD::command_tp worker waiting -1761> 2014-05-19 10:47:29.454633 7f555099c700 20 OSD::disk_tp worker waiting -1760> 2014-05-19 10:47:29.568641 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:32.175695) v2 ==== 47+0+0 (1969717999 0 0) 0xac168c0 con 0x9b8de40 -1759> 2014-05-19 10:47:29.568681 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:32.175695) v2 ==== 47+0+0 (1969717999 0 0) 0x9e6d180 con 0x94e2160 -1758> 2014-05-19 10:47:29.568691 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:32.175695) v2 -- ?+0 0xac468c0 con 0x9b8de40 -1757> 2014-05-19 10:47:29.569171 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -1756> 2014-05-19 10:47:29.569248 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:32.175695) v2 -- ?+0 0xac456c0 con 0x94e2160 -1755> 2014-05-19 10:47:29.569335 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -1754> 2014-05-19 10:47:29.589618 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:33.535918) v2 ==== 47+0+0 (321151575 0 0) 0xa0bc380 con 0x95142c0 -1753> 2014-05-19 10:47:29.589692 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:33.535918) v2 -- ?+0 0x9e6d180 con 0x95142c0 -1752> 2014-05-19 10:47:29.589779 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -1751> 2014-05-19 10:47:29.589898 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:33.535918) v2 ==== 47+0+0 (321151575 0 0) 0xac1aa80 con 0x99d31e0 -1750> 2014-05-19 10:47:29.589957 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:33.535918) v2 -- ?+0 0xac168c0 con 0x99d31e0 -1749> 2014-05-19 10:47:29.589981 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -1748> 2014-05-19 10:47:29.620537 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:33.566866) v2 ==== 47+0+0 (186320471 0 0) 0xac29dc0 con 0x966e000 -1747> 2014-05-19 10:47:29.620715 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:33.566866) v2 -- ?+0 0xac1aa80 con 0x966e000 -1746> 2014-05-19 10:47:29.620834 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -1745> 2014-05-19 10:47:29.621022 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:33.566866) v2 ==== 47+0+0 (186320471 0 0) 0xa23e8c0 con 0x9743600 -1744> 2014-05-19 10:47:29.621075 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:33.566866) v2 -- ?+0 0xa0bc380 con 0x9743600 -1743> 2014-05-19 10:47:29.621203 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -1742> 2014-05-19 10:47:29.662952 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 68 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:32.270050) v2 ==== 47+0+0 (3312517745 0 0) 0xa173880 con 0x95846e0 -1741> 2014-05-19 10:47:29.663012 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 68 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:32.270050) v2 ==== 47+0+0 (3312517745 0 0) 0x97c21c0 con 0x9983600 -1740> 2014-05-19 10:47:29.663012 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:32.270050) v2 -- ?+0 0xac29dc0 con 0x95846e0 -1739> 2014-05-19 10:47:29.663079 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -1738> 2014-05-19 10:47:29.663485 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:32.270050) v2 -- ?+0 0xa23e8c0 con 0x9983600 -1737> 2014-05-19 10:47:29.663563 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -1736> 2014-05-19 10:47:29.770861 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -1735> 2014-05-19 10:47:29.770883 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -1734> 2014-05-19 10:47:29.770896 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0x9b501c0 con 0x9bdc840 -1733> 2014-05-19 10:47:29.770928 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xac29180 con 0x9ad4420 -1732> 2014-05-19 10:47:29.770954 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xa05e1c0 con 0x9bf31e0 -1731> 2014-05-19 10:47:29.770984 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0x9fd81c0 con 0x998b340 -1730> 2014-05-19 10:47:29.771009 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xa1eee00 con 0x9b92840 -1729> 2014-05-19 10:47:29.771035 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xa173a40 con 0x9ad49a0 -1728> 2014-05-19 10:47:29.771063 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0x9f6f6c0 con 0x7b911e0 -1727> 2014-05-19 10:47:29.771138 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xa664540 con 0x7b918c0 -1726> 2014-05-19 10:47:29.771164 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xac088c0 con 0x9aa8c60 -1725> 2014-05-19 10:47:29.771191 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xa7d48c0 con 0x9bfa000 -1724> 2014-05-19 10:47:29.771214 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0x9cd08c0 con 0x7c23e40 -1723> 2014-05-19 10:47:29.771241 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xa107dc0 con 0x998b760 -1722> 2014-05-19 10:47:29.771270 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xa6648c0 con 0x7b91080 -1721> 2014-05-19 10:47:29.771296 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xa5168c0 con 0xa28fb80 -1720> 2014-05-19 10:47:29.771288 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 74 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0x9ad68c0 con 0x9bdc840 -1719> 2014-05-19 10:47:29.771324 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0x9b2e1c0 con 0x76bdce0 -1718> 2014-05-19 10:47:29.771354 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0x9ee2700 con 0x994ab00 -1717> 2014-05-19 10:47:29.771386 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0x9ef4540 con 0x9ac8b00 -1716> 2014-05-19 10:47:29.771420 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xa2dfc00 con 0x938de40 -1715> 2014-05-19 10:47:29.771452 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xac4aa80 con 0x9970b00 -1714> 2014-05-19 10:47:29.771475 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xac496c0 con 0x99706e0 -1713> 2014-05-19 10:47:29.771500 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xac2ba40 con 0x9bb6f20 -1712> 2014-05-19 10:47:29.771521 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xa030fc0 con 0x994b340 -1711> 2014-05-19 10:47:29.771542 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xac316c0 con 0x98fa2c0 -1710> 2014-05-19 10:47:29.771563 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xa0bafc0 con 0x996f8c0 -1709> 2014-05-19 10:47:29.771587 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0x9ed0000 con 0x996fa20 -1708> 2014-05-19 10:47:29.771625 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0x9d52000 con 0x9ac8160 -1707> 2014-05-19 10:47:29.771648 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xa237500 con 0x7b90420 -1706> 2014-05-19 10:47:29.771670 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0x9388700 con 0x919fe40 -1705> 2014-05-19 10:47:29.771692 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xa0bda40 con 0x9971760 -1704> 2014-05-19 10:47:29.771719 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xa664e00 con 0x994af20 -1703> 2014-05-19 10:47:29.771747 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0x9caae00 con 0x989be40 -1702> 2014-05-19 10:47:29.771773 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xa7d4a80 con 0x9adf4a0 -1701> 2014-05-19 10:47:29.771840 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xa114fc0 con 0x9776160 -1700> 2014-05-19 10:47:29.771869 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xa030380 con 0x96bd8c0 -1699> 2014-05-19 10:47:29.771894 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xa2661c0 con 0x96bcdc0 -1698> 2014-05-19 10:47:29.771917 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0x95c0540 con 0x96954a0 -1697> 2014-05-19 10:47:29.771938 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0x9236e00 con 0x76bd8c0 -1696> 2014-05-19 10:47:29.771995 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xa107880 con 0x7b90dc0 -1695> 2014-05-19 10:47:29.772025 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xa6d4380 con 0x978d8c0 -1694> 2014-05-19 10:47:29.772057 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0x9ccec40 con 0x978c580 -1693> 2014-05-19 10:47:29.772088 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xac48c40 con 0x978d340 -1692> 2014-05-19 10:47:29.772118 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:29.770894) v2 -- ?+0 0xa162a80 con 0x96374a0 -1691> 2014-05-19 10:47:29.772163 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -1690> 2014-05-19 10:47:29.772202 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 73 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xac2ac40 con 0x9bf31e0 -1689> 2014-05-19 10:47:29.772229 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -1688> 2014-05-19 10:47:29.772240 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 73 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0x9c6e8c0 con 0x998b340 -1687> 2014-05-19 10:47:29.772260 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -1686> 2014-05-19 10:47:29.772270 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 72 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0x9fb5880 con 0x9b92840 -1685> 2014-05-19 10:47:29.772298 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -1684> 2014-05-19 10:47:29.772318 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 72 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xac48a80 con 0x9ad49a0 -1683> 2014-05-19 10:47:29.772347 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -1682> 2014-05-19 10:47:29.772359 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0x9feca80 con 0x7b911e0 -1681> 2014-05-19 10:47:29.772418 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -1680> 2014-05-19 10:47:29.772443 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xa517a40 con 0x7b918c0 -1679> 2014-05-19 10:47:29.772469 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -1678> 2014-05-19 10:47:29.772476 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0x9cd0fc0 con 0x9aa8c60 -1677> 2014-05-19 10:47:29.772503 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -1676> 2014-05-19 10:47:29.772523 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xac436c0 con 0x9bfa000 -1675> 2014-05-19 10:47:29.772544 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -1674> 2014-05-19 10:47:29.772560 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xa645c00 con 0x7c23e40 -1673> 2014-05-19 10:47:29.772579 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -1672> 2014-05-19 10:47:29.772591 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0x9ef4540 con 0x998b760 -1671> 2014-05-19 10:47:29.772608 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -1670> 2014-05-19 10:47:29.772616 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0x9f6fc00 con 0x7b91080 -1669> 2014-05-19 10:47:29.772634 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -1668> 2014-05-19 10:47:29.772644 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xa872540 con 0xa28fb80 -1667> 2014-05-19 10:47:29.772661 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -1666> 2014-05-19 10:47:29.772668 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xa267c00 con 0x76bdce0 -1665> 2014-05-19 10:47:29.772684 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -1664> 2014-05-19 10:47:29.772692 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0x9d23dc0 con 0x994ab00 -1663> 2014-05-19 10:47:29.772706 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -1662> 2014-05-19 10:47:29.772715 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xa6656c0 con 0x9ac8b00 -1661> 2014-05-19 10:47:29.772732 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -1660> 2014-05-19 10:47:29.772738 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0x9ed1c00 con 0x938de40 -1659> 2014-05-19 10:47:29.772754 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -1658> 2014-05-19 10:47:29.772762 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0x9ba4540 con 0x9970b00 -1657> 2014-05-19 10:47:29.772776 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -1656> 2014-05-19 10:47:29.772784 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xa4df340 con 0x99706e0 -1655> 2014-05-19 10:47:29.772798 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -1654> 2014-05-19 10:47:29.772805 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0x9f74fc0 con 0x9bb6f20 -1653> 2014-05-19 10:47:29.772820 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -1652> 2014-05-19 10:47:29.772836 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0x97d2a80 con 0x994b340 -1651> 2014-05-19 10:47:29.772852 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -1650> 2014-05-19 10:47:29.772860 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xa23fa40 con 0x98fa2c0 -1649> 2014-05-19 10:47:29.772876 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -1648> 2014-05-19 10:47:29.772884 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xa385340 con 0x996f8c0 -1647> 2014-05-19 10:47:29.772898 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -1646> 2014-05-19 10:47:29.772905 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xa0bce00 con 0x996fa20 -1645> 2014-05-19 10:47:29.772921 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -1644> 2014-05-19 10:47:29.772928 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xa0b6fc0 con 0x9ac8160 -1643> 2014-05-19 10:47:29.772942 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -1642> 2014-05-19 10:47:29.772947 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xac49500 con 0x7b90420 -1641> 2014-05-19 10:47:29.772960 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -1640> 2014-05-19 10:47:29.772970 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xac4a8c0 con 0x919fe40 -1639> 2014-05-19 10:47:29.772987 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -1638> 2014-05-19 10:47:29.772994 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xa0eb340 con 0x9971760 -1637> 2014-05-19 10:47:29.773011 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -1636> 2014-05-19 10:47:29.773019 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0x94256c0 con 0x994af20 -1635> 2014-05-19 10:47:29.773036 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -1634> 2014-05-19 10:47:29.773043 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0x9c0efc0 con 0x989be40 -1633> 2014-05-19 10:47:29.773061 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -1632> 2014-05-19 10:47:29.773068 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xa0cb6c0 con 0x9adf4a0 -1631> 2014-05-19 10:47:29.773082 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -1630> 2014-05-19 10:47:29.773089 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xa102e00 con 0x9776160 -1629> 2014-05-19 10:47:29.773116 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -1628> 2014-05-19 10:47:29.773130 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0x9e6d6c0 con 0x96bd8c0 -1627> 2014-05-19 10:47:29.773150 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -1626> 2014-05-19 10:47:29.773158 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xa1076c0 con 0x96bcdc0 -1625> 2014-05-19 10:47:29.773172 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -1624> 2014-05-19 10:47:29.773179 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xa4ef6c0 con 0x96954a0 -1623> 2014-05-19 10:47:29.773193 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -1622> 2014-05-19 10:47:29.773200 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xac16700 con 0x76bd8c0 -1621> 2014-05-19 10:47:29.773215 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -1620> 2014-05-19 10:47:29.773224 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xac29c00 con 0x7b90dc0 -1619> 2014-05-19 10:47:29.773241 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -1618> 2014-05-19 10:47:29.773248 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xac1afc0 con 0x978d8c0 -1617> 2014-05-19 10:47:29.773266 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -1616> 2014-05-19 10:47:29.773273 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xa856380 con 0x978c580 -1615> 2014-05-19 10:47:29.773287 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -1614> 2014-05-19 10:47:29.773294 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xa816a80 con 0x978d340 -1613> 2014-05-19 10:47:29.773308 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -1612> 2014-05-19 10:47:29.773315 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 54 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0xac2b6c0 con 0x96374a0 -1611> 2014-05-19 10:47:29.773329 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -1610> 2014-05-19 10:47:29.773336 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 74 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:29.770894) v2 ==== 47+0+0 (1520337845 0 0) 0x94b7340 con 0x9ad4420 -1609> 2014-05-19 10:47:29.773351 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -1608> 2014-05-19 10:47:29.789634 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:33.736049) v2 ==== 47+0+0 (18963366 0 0) 0xa1df180 con 0x99d3340 -1607> 2014-05-19 10:47:29.789688 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:33.736049) v2 -- ?+0 0xa173880 con 0x99d3340 -1606> 2014-05-19 10:47:29.789697 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:33.736049) v2 ==== 47+0+0 (18963366 0 0) 0xac2b340 con 0x94a5a20 -1605> 2014-05-19 10:47:29.789773 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -1604> 2014-05-19 10:47:29.789829 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:33.736049) v2 -- ?+0 0x97c21c0 con 0x94a5a20 -1603> 2014-05-19 10:47:29.789893 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -1602> 2014-05-19 10:47:29.925611 7f5566602700 5 osd.0 245 tick -1601> 2014-05-19 10:47:29.925665 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.19 >= max 0.5 = no, load too high -1600> 2014-05-19 10:47:29.925679 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -1599> 2014-05-19 10:47:29.925683 7f555119d700 20 OSD::recovery_tp worker waiting -1598> 2014-05-19 10:47:29.925683 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2270.46 < min (86400 seconds) -1597> 2014-05-19 10:47:29.925701 7f5566602700 20 osd.0 245 sched_scrub done -1596> 2014-05-19 10:47:29.925704 7f5566602700 10 osd.0 245 do_waiters -- start -1595> 2014-05-19 10:47:29.925706 7f5566602700 10 osd.0 245 do_waiters -- finish -1594> 2014-05-19 10:47:29.934534 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:33.880845) v2 ==== 47+0+0 (1647783553 0 0) 0xac45500 con 0x94802c0 -1593> 2014-05-19 10:47:29.934569 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 51 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:33.880845) v2 ==== 47+0+0 (1647783553 0 0) 0xac46700 con 0x987b760 -1592> 2014-05-19 10:47:29.934578 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:33.880845) v2 -- ?+0 0xac2b340 con 0x94802c0 -1591> 2014-05-19 10:47:29.934640 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -1590> 2014-05-19 10:47:29.934662 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:33.880845) v2 -- ?+0 0xa1df180 con 0x987b760 -1589> 2014-05-19 10:47:29.934725 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -1588> 2014-05-19 10:47:30.060338 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 75 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:32.667291) v2 ==== 47+0+0 (3146848372 0 0) 0xac36e00 con 0x9656420 -1587> 2014-05-19 10:47:30.060755 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 75 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:32.667291) v2 ==== 47+0+0 (3146848372 0 0) 0xa2bd6c0 con 0x96571e0 -1586> 2014-05-19 10:47:30.060892 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:32.667291) v2 -- ?+0 0xac46700 con 0x9656420 -1585> 2014-05-19 10:47:30.060933 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -1584> 2014-05-19 10:47:30.060967 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:32.667291) v2 -- ?+0 0xac45500 con 0x96571e0 -1583> 2014-05-19 10:47:30.061009 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -1582> 2014-05-19 10:47:30.291155 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:34.237540) v2 ==== 47+0+0 (2942365243 0 0) 0xa1dfdc0 con 0x99d3340 -1581> 2014-05-19 10:47:30.291186 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:34.237540) v2 ==== 47+0+0 (2942365243 0 0) 0xac22700 con 0x94a5a20 -1580> 2014-05-19 10:47:30.291205 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:34.237540) v2 -- ?+0 0xac36e00 con 0x99d3340 -1579> 2014-05-19 10:47:30.291232 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -1578> 2014-05-19 10:47:30.291516 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:34.237540) v2 -- ?+0 0xa2bd6c0 con 0x94a5a20 -1577> 2014-05-19 10:47:30.291608 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -1576> 2014-05-19 10:47:30.464046 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:33.071165) v2 ==== 47+0+0 (578705573 0 0) 0x9ed01c0 con 0x9a0c9a0 -1575> 2014-05-19 10:47:30.464079 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:33.071165) v2 ==== 47+0+0 (578705573 0 0) 0xac41180 con 0x996e000 -1574> 2014-05-19 10:47:30.464097 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:33.071165) v2 -- ?+0 0xac22700 con 0x9a0c9a0 -1573> 2014-05-19 10:47:30.464129 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -1572> 2014-05-19 10:47:30.464215 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:33.071165) v2 -- ?+0 0xa1dfdc0 con 0x996e000 -1571> 2014-05-19 10:47:30.464259 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -1570> 2014-05-19 10:47:30.483818 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 70 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:33.090912) v2 ==== 47+0+0 (3175848318 0 0) 0xa102fc0 con 0x9656000 -1569> 2014-05-19 10:47:30.483883 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:33.090912) v2 -- ?+0 0xac41180 con 0x9656000 -1568> 2014-05-19 10:47:30.483910 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -1567> 2014-05-19 10:47:30.483830 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 70 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:33.090912) v2 ==== 47+0+0 (3175848318 0 0) 0xa36d500 con 0x9937760 -1566> 2014-05-19 10:47:30.484271 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:33.090912) v2 -- ?+0 0x9ed01c0 con 0x9937760 -1565> 2014-05-19 10:47:30.484361 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -1564> 2014-05-19 10:47:30.525943 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:34.472329) v2 ==== 47+0+0 (2588517601 0 0) 0xac15180 con 0x94e26e0 -1563> 2014-05-19 10:47:30.525951 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:34.472329) v2 ==== 47+0+0 (2588517601 0 0) 0xa4eea80 con 0x987b340 -1562> 2014-05-19 10:47:30.525994 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:34.472329) v2 -- ?+0 0xa36d500 con 0x94e26e0 -1561> 2014-05-19 10:47:30.526048 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -1560> 2014-05-19 10:47:30.526078 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:34.472329) v2 -- ?+0 0xa102fc0 con 0x987b340 -1559> 2014-05-19 10:47:30.526110 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -1558> 2014-05-19 10:47:30.529124 7f5565600700 20 KeyValueStore::op_tp worker waiting -1557> 2014-05-19 10:47:30.724092 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:33.331173) v2 ==== 47+0+0 (3055363474 0 0) 0x9ed0540 con 0x9a0cdc0 -1556> 2014-05-19 10:47:30.724144 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:33.331173) v2 -- ?+0 0xac15180 con 0x9a0cdc0 -1555> 2014-05-19 10:47:30.724196 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:33.331173) v2 ==== 47+0+0 (3055363474 0 0) 0xac296c0 con 0x996fb80 -1554> 2014-05-19 10:47:30.724269 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -1553> 2014-05-19 10:47:30.724363 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:33.331173) v2 -- ?+0 0xa4eea80 con 0x996fb80 -1552> 2014-05-19 10:47:30.724454 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -1551> 2014-05-19 10:47:30.770832 7f55579aa700 20 OSD::op_tp worker waiting -1550> 2014-05-19 10:47:30.770880 7f555a1af700 20 OSD::op_tp worker waiting -1549> 2014-05-19 10:47:30.770966 7f55551a5700 20 OSD::op_tp worker waiting -1548> 2014-05-19 10:47:30.772471 7f55569a8700 20 OSD::op_tp worker waiting -1547> 2014-05-19 10:47:30.772494 7f55541a3700 20 OSD::op_tp worker waiting -1546> 2014-05-19 10:47:30.772517 7f555b1b1700 20 OSD::op_tp worker waiting -1545> 2014-05-19 10:47:30.772536 7f55549a4700 20 OSD::op_tp worker waiting -1544> 2014-05-19 10:47:30.772557 7f55589ac700 20 OSD::op_tp worker waiting -1543> 2014-05-19 10:47:30.772596 7f555a9b0700 20 OSD::op_tp worker waiting -1542> 2014-05-19 10:47:30.772990 7f55581ab700 20 OSD::op_tp worker waiting -1541> 2014-05-19 10:47:30.773019 7f55571a9700 20 OSD::op_tp worker waiting -1540> 2014-05-19 10:47:30.773063 7f55599ae700 20 OSD::op_tp worker waiting -1539> 2014-05-19 10:47:30.773120 7f55531a1700 20 OSD::op_tp worker waiting -1538> 2014-05-19 10:47:30.773180 7f55591ad700 20 OSD::op_tp worker waiting -1537> 2014-05-19 10:47:30.773193 7f55529a0700 20 OSD::op_tp worker waiting -1536> 2014-05-19 10:47:30.773214 7f55539a2700 20 OSD::op_tp worker waiting -1535> 2014-05-19 10:47:30.773232 7f555199e700 20 OSD::op_tp worker waiting -1534> 2014-05-19 10:47:30.773242 7f55561a7700 20 OSD::op_tp worker waiting -1533> 2014-05-19 10:47:30.773278 7f555219f700 20 OSD::op_tp worker waiting -1532> 2014-05-19 10:47:30.773313 7f55559a6700 20 OSD::op_tp worker waiting -1531> 2014-05-19 10:47:30.925773 7f5566602700 5 osd.0 245 tick -1530> 2014-05-19 10:47:30.925831 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.19 >= max 0.5 = no, load too high -1529> 2014-05-19 10:47:30.925846 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -1528> 2014-05-19 10:47:30.925842 7f555119d700 20 OSD::recovery_tp worker waiting -1527> 2014-05-19 10:47:30.925849 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2271.46 < min (86400 seconds) -1526> 2014-05-19 10:47:30.925869 7f5566602700 20 osd.0 245 sched_scrub done -1525> 2014-05-19 10:47:30.925871 7f5566602700 10 osd.0 245 do_waiters -- start -1524> 2014-05-19 10:47:30.925873 7f5566602700 10 osd.0 245 do_waiters -- finish -1523> 2014-05-19 10:47:31.010928 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 72 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:31.010755) v2 ==== 47+0+0 (1249116136 0 0) 0x9fd8000 con 0x9656580 -1522> 2014-05-19 10:47:31.010952 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 72 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:31.010755) v2 ==== 47+0+0 (1249116136 0 0) 0xac44a80 con 0x9657340 -1521> 2014-05-19 10:47:31.010978 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.010755) v2 -- ?+0 0xac296c0 con 0x9656580 -1520> 2014-05-19 10:47:31.011014 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -1519> 2014-05-19 10:47:31.011062 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.010755) v2 -- ?+0 0x9ed0540 con 0x9657340 -1518> 2014-05-19 10:47:31.011146 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -1517> 2014-05-19 10:47:31.112450 7f5564dff700 20 KeyValueStore::op_tp worker waiting -1516> 2014-05-19 10:47:31.179778 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:35.126168) v2 ==== 47+0+0 (566787378 0 0) 0xac1a700 con 0x97431e0 -1515> 2014-05-19 10:47:31.179829 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.126168) v2 -- ?+0 0xac44a80 con 0x97431e0 -1514> 2014-05-19 10:47:31.179888 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -1513> 2014-05-19 10:47:31.179999 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:35.126168) v2 ==== 47+0+0 (566787378 0 0) 0xa0cb340 con 0x99718c0 -1512> 2014-05-19 10:47:31.180074 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.126168) v2 -- ?+0 0x9fd8000 con 0x99718c0 -1511> 2014-05-19 10:47:31.180119 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -1510> 2014-05-19 10:47:31.270181 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:33.877260) v2 ==== 47+0+0 (2833130712 0 0) 0xac17a40 con 0x9b8de40 -1509> 2014-05-19 10:47:31.270181 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:33.877260) v2 ==== 47+0+0 (2833130712 0 0) 0x9e6da40 con 0x94e2160 -1508> 2014-05-19 10:47:31.270243 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:33.877260) v2 -- ?+0 0xa0cb340 con 0x9b8de40 -1507> 2014-05-19 10:47:31.270341 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -1506> 2014-05-19 10:47:31.270428 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:33.877260) v2 -- ?+0 0xac1a700 con 0x94e2160 -1505> 2014-05-19 10:47:31.270478 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -1504> 2014-05-19 10:47:31.322085 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:35.268530) v2 ==== 47+0+0 (724085770 0 0) 0xac281c0 con 0x966e000 -1503> 2014-05-19 10:47:31.322125 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:35.268530) v2 ==== 47+0+0 (724085770 0 0) 0xa23e380 con 0x9743600 -1502> 2014-05-19 10:47:31.322163 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.268530) v2 -- ?+0 0xac17a40 con 0x966e000 -1501> 2014-05-19 10:47:31.322196 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -1500> 2014-05-19 10:47:31.322234 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.268530) v2 -- ?+0 0x9e6da40 con 0x9743600 -1499> 2014-05-19 10:47:31.322311 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -1498> 2014-05-19 10:47:31.451479 7f555019b700 20 OSD::command_tp worker waiting -1497> 2014-05-19 10:47:31.454732 7f555099c700 20 OSD::disk_tp worker waiting -1496> 2014-05-19 10:47:31.472275 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -1495> 2014-05-19 10:47:31.472296 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -1494> 2014-05-19 10:47:31.472304 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0x95621c0 con 0x9bdc840 -1493> 2014-05-19 10:47:31.472331 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xac2bc00 con 0x9ad4420 -1492> 2014-05-19 10:47:31.472368 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0x9cb7dc0 con 0x9bf31e0 -1491> 2014-05-19 10:47:31.472384 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0x9fa9dc0 con 0x998b340 -1490> 2014-05-19 10:47:31.472398 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xa4ee000 con 0x9b92840 -1489> 2014-05-19 10:47:31.472422 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xa872e00 con 0x9ad49a0 -1488> 2014-05-19 10:47:31.472453 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0x9f74fc0 con 0x7b911e0 -1487> 2014-05-19 10:47:31.472484 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xa4df340 con 0x7b918c0 -1486> 2014-05-19 10:47:31.472510 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0x9ba4540 con 0x9aa8c60 -1485> 2014-05-19 10:47:31.472536 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0x9ed1c00 con 0x9bfa000 -1484> 2014-05-19 10:47:31.472557 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xa6656c0 con 0x7c23e40 -1483> 2014-05-19 10:47:31.472576 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0x9d23dc0 con 0x998b760 -1482> 2014-05-19 10:47:31.472606 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xa267c00 con 0x7b91080 -1481> 2014-05-19 10:47:31.472632 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xa872540 con 0xa28fb80 -1480> 2014-05-19 10:47:31.472637 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 75 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0x9fd9180 con 0x9bdc840 -1479> 2014-05-19 10:47:31.472658 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0x9f6fc00 con 0x76bdce0 -1478> 2014-05-19 10:47:31.472685 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0x9ef4540 con 0x994ab00 -1477> 2014-05-19 10:47:31.472708 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xa645c00 con 0x9ac8b00 -1476> 2014-05-19 10:47:31.472725 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xac436c0 con 0x938de40 -1475> 2014-05-19 10:47:31.472739 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0x9cd0fc0 con 0x9970b00 -1474> 2014-05-19 10:47:31.472757 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xa517a40 con 0x99706e0 -1473> 2014-05-19 10:47:31.472777 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0x9feca80 con 0x9bb6f20 -1472> 2014-05-19 10:47:31.472791 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xac48a80 con 0x994b340 -1471> 2014-05-19 10:47:31.472804 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0x9fb5880 con 0x98fa2c0 -1470> 2014-05-19 10:47:31.472817 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0x9c6e8c0 con 0x996f8c0 -1469> 2014-05-19 10:47:31.472831 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xac2ac40 con 0x996fa20 -1468> 2014-05-19 10:47:31.472845 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0x9ad68c0 con 0x9ac8160 -1467> 2014-05-19 10:47:31.472870 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xa4ee380 con 0x7b90420 -1466> 2014-05-19 10:47:31.472885 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xa872c40 con 0x919fe40 -1465> 2014-05-19 10:47:31.472899 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xa856700 con 0x9971760 -1464> 2014-05-19 10:47:31.472913 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xac1a8c0 con 0x994af20 -1463> 2014-05-19 10:47:31.472938 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xa030540 con 0x989be40 -1462> 2014-05-19 10:47:31.472963 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xac16fc0 con 0x9adf4a0 -1461> 2014-05-19 10:47:31.472984 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xa5fc1c0 con 0x9776160 -1460> 2014-05-19 10:47:31.473009 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xa106540 con 0x96bd8c0 -1459> 2014-05-19 10:47:31.473035 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0x9d0afc0 con 0x96bcdc0 -1458> 2014-05-19 10:47:31.473060 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0x951ddc0 con 0x96954a0 -1457> 2014-05-19 10:47:31.473166 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xa0ca540 con 0x76bd8c0 -1456> 2014-05-19 10:47:31.473197 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xa865180 con 0x7b90dc0 -1455> 2014-05-19 10:47:31.473225 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0x92a16c0 con 0x978d8c0 -1454> 2014-05-19 10:47:31.473253 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0x9f7afc0 con 0x978c580 -1453> 2014-05-19 10:47:31.473280 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xac48e00 con 0x978d340 -1452> 2014-05-19 10:47:31.473307 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:31.472302) v2 -- ?+0 0xa0bd180 con 0x96374a0 -1451> 2014-05-19 10:47:31.473368 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -1450> 2014-05-19 10:47:31.473424 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 75 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xac31880 con 0x9ad4420 -1449> 2014-05-19 10:47:31.473466 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -1448> 2014-05-19 10:47:31.473492 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 74 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xac2a8c0 con 0x9bf31e0 -1447> 2014-05-19 10:47:31.473515 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -1446> 2014-05-19 10:47:31.473521 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 74 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xa1e4e00 con 0x998b340 -1445> 2014-05-19 10:47:31.473536 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -1444> 2014-05-19 10:47:31.473541 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 73 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xa4ff340 con 0x9b92840 -1443> 2014-05-19 10:47:31.473557 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -1442> 2014-05-19 10:47:31.473571 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 73 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xac488c0 con 0x9ad49a0 -1441> 2014-05-19 10:47:31.473626 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -1440> 2014-05-19 10:47:31.473636 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 70 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xa0ea8c0 con 0x7b911e0 -1439> 2014-05-19 10:47:31.473693 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -1438> 2014-05-19 10:47:31.473707 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 70 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xa65a000 con 0x7b918c0 -1437> 2014-05-19 10:47:31.473753 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -1436> 2014-05-19 10:47:31.473768 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xa856e00 con 0x9aa8c60 -1435> 2014-05-19 10:47:31.473785 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -1434> 2014-05-19 10:47:31.473791 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xac43a40 con 0x9bfa000 -1433> 2014-05-19 10:47:31.473805 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -1432> 2014-05-19 10:47:31.473821 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xa2e0c40 con 0x7c23e40 -1431> 2014-05-19 10:47:31.473839 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -1430> 2014-05-19 10:47:31.473844 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0x9b2e380 con 0x998b760 -1429> 2014-05-19 10:47:31.473868 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -1428> 2014-05-19 10:47:31.473873 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xa2dfc00 con 0x7b91080 -1427> 2014-05-19 10:47:31.473888 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -1426> 2014-05-19 10:47:31.473896 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xa872700 con 0xa28fb80 -1425> 2014-05-19 10:47:31.473910 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -1424> 2014-05-19 10:47:31.473915 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0x9d22540 con 0x76bdce0 -1423> 2014-05-19 10:47:31.473929 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -1422> 2014-05-19 10:47:31.473936 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xa74a8c0 con 0x994ab00 -1421> 2014-05-19 10:47:31.473950 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -1420> 2014-05-19 10:47:31.473958 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xa664000 con 0x9ac8b00 -1419> 2014-05-19 10:47:31.473976 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -1418> 2014-05-19 10:47:31.473983 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0x9fd8fc0 con 0x938de40 -1417> 2014-05-19 10:47:31.474000 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -1416> 2014-05-19 10:47:31.474009 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xa873340 con 0x9970b00 -1415> 2014-05-19 10:47:31.474026 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -1414> 2014-05-19 10:47:31.474034 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0x9448380 con 0x99706e0 -1413> 2014-05-19 10:47:31.474050 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -1412> 2014-05-19 10:47:31.474058 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xa446700 con 0x9bb6f20 -1411> 2014-05-19 10:47:31.474075 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -1410> 2014-05-19 10:47:31.474082 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xa45e700 con 0x994b340 -1409> 2014-05-19 10:47:31.474099 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -1408> 2014-05-19 10:47:31.474106 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xa23fc00 con 0x98fa2c0 -1407> 2014-05-19 10:47:31.474121 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -1406> 2014-05-19 10:47:31.474129 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xa236700 con 0x996f8c0 -1405> 2014-05-19 10:47:31.474145 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -1404> 2014-05-19 10:47:31.474152 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xa264e00 con 0x996fa20 -1403> 2014-05-19 10:47:31.474168 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -1402> 2014-05-19 10:47:31.474175 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xa3db880 con 0x9ac8160 -1401> 2014-05-19 10:47:31.474188 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -1400> 2014-05-19 10:47:31.474197 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xac368c0 con 0x7b90420 -1399> 2014-05-19 10:47:31.474214 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -1398> 2014-05-19 10:47:31.474221 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xac4a700 con 0x919fe40 -1397> 2014-05-19 10:47:31.474237 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -1396> 2014-05-19 10:47:31.474244 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0x9f428c0 con 0x9971760 -1395> 2014-05-19 10:47:31.474259 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -1394> 2014-05-19 10:47:31.474267 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0x9e81dc0 con 0x994af20 -1393> 2014-05-19 10:47:31.474284 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -1392> 2014-05-19 10:47:31.474291 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0x9c0f880 con 0x989be40 -1391> 2014-05-19 10:47:31.474305 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -1390> 2014-05-19 10:47:31.474312 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xac34fc0 con 0x9adf4a0 -1389> 2014-05-19 10:47:31.474330 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -1388> 2014-05-19 10:47:31.474339 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0x9e9f340 con 0x9776160 -1387> 2014-05-19 10:47:31.474356 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -1386> 2014-05-19 10:47:31.474363 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0x9e6dc00 con 0x96bd8c0 -1385> 2014-05-19 10:47:31.474380 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -1384> 2014-05-19 10:47:31.474388 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0x9cb41c0 con 0x96bcdc0 -1383> 2014-05-19 10:47:31.474405 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -1382> 2014-05-19 10:47:31.474412 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xa4ef180 con 0x96954a0 -1381> 2014-05-19 10:47:31.474429 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -1380> 2014-05-19 10:47:31.474436 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xa0b68c0 con 0x76bd8c0 -1379> 2014-05-19 10:47:31.474454 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -1378> 2014-05-19 10:47:31.474464 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xa162a80 con 0x7b90dc0 -1377> 2014-05-19 10:47:31.474480 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -1376> 2014-05-19 10:47:31.474488 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0x9c09500 con 0x978d8c0 -1375> 2014-05-19 10:47:31.474505 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -1374> 2014-05-19 10:47:31.474512 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xac31dc0 con 0x978c580 -1373> 2014-05-19 10:47:31.474529 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -1372> 2014-05-19 10:47:31.474536 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0x99fce00 con 0x978d340 -1371> 2014-05-19 10:47:31.474554 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -1370> 2014-05-19 10:47:31.474561 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 55 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:31.472302) v2 ==== 47+0+0 (60901446 0 0) 0xa4a9180 con 0x96374a0 -1369> 2014-05-19 10:47:31.474578 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -1368> 2014-05-19 10:47:31.555185 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:34.162272) v2 ==== 47+0+0 (1694509436 0 0) 0xa1021c0 con 0x9aa3600 -1367> 2014-05-19 10:47:31.555257 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:34.162272) v2 -- ?+0 0xa23e380 con 0x9aa3600 -1366> 2014-05-19 10:47:31.555291 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -1365> 2014-05-19 10:47:31.555250 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:34.162272) v2 ==== 47+0+0 (1694509436 0 0) 0xa208c40 con 0x9b8c160 -1364> 2014-05-19 10:47:31.555809 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:34.162272) v2 -- ?+0 0xac281c0 con 0x9b8c160 -1363> 2014-05-19 10:47:31.555844 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -1362> 2014-05-19 10:47:31.565610 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:34.172692) v2 ==== 47+0+0 (84298439 0 0) 0xa05e700 con 0x996e000 -1361> 2014-05-19 10:47:31.565661 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:34.172692) v2 -- ?+0 0xa208c40 con 0x996e000 -1360> 2014-05-19 10:47:31.565648 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:34.172692) v2 ==== 47+0+0 (84298439 0 0) 0xa1ee000 con 0x9a0c9a0 -1359> 2014-05-19 10:47:31.565767 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -1358> 2014-05-19 10:47:31.566167 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:34.172692) v2 -- ?+0 0xa1021c0 con 0x9a0c9a0 -1357> 2014-05-19 10:47:31.566208 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -1356> 2014-05-19 10:47:31.635806 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:35.582254) v2 ==== 47+0+0 (2499386385 0 0) 0xac4afc0 con 0x94802c0 -1355> 2014-05-19 10:47:31.635862 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.582254) v2 -- ?+0 0xa1ee000 con 0x94802c0 -1354> 2014-05-19 10:47:31.635942 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -1353> 2014-05-19 10:47:31.635811 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 52 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:35.582254) v2 ==== 47+0+0 (2499386385 0 0) 0xac46540 con 0x987b760 -1352> 2014-05-19 10:47:31.636003 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.582254) v2 -- ?+0 0xa05e700 con 0x987b760 -1351> 2014-05-19 10:47:31.636031 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -1350> 2014-05-19 10:47:31.925945 7f5566602700 5 osd.0 245 tick -1349> 2014-05-19 10:47:31.925969 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -1348> 2014-05-19 10:47:31.925974 7f5566602700 10 osd.0 245 do_waiters -- start -1347> 2014-05-19 10:47:31.925978 7f5566602700 10 osd.0 245 do_waiters -- finish -1346> 2014-05-19 10:47:31.926015 7f555119d700 20 OSD::recovery_tp worker waiting -1345> 2014-05-19 10:47:31.926623 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 75 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:34.533720) v2 ==== 47+0+0 (4218903933 0 0) 0xac2b180 con 0x9657080 -1344> 2014-05-19 10:47:31.926701 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:34.533720) v2 -- ?+0 0xac4afc0 con 0x9657080 -1343> 2014-05-19 10:47:31.926969 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -1342> 2014-05-19 10:47:31.926645 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 75 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:34.533720) v2 ==== 47+0+0 (4218903933 0 0) 0x9ad2c40 con 0x96562c0 -1341> 2014-05-19 10:47:31.927016 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:34.533720) v2 -- ?+0 0xac46540 con 0x96562c0 -1340> 2014-05-19 10:47:31.927085 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -1339> 2014-05-19 10:47:31.964517 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 69 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:34.571591) v2 ==== 47+0+0 (1490924820 0 0) 0xa172000 con 0x95846e0 -1338> 2014-05-19 10:47:31.964577 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:34.571591) v2 -- ?+0 0x9ad2c40 con 0x95846e0 -1337> 2014-05-19 10:47:31.964669 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -1336> 2014-05-19 10:47:31.964515 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 69 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:34.571591) v2 ==== 47+0+0 (1490924820 0 0) 0x96bee00 con 0x9983600 -1335> 2014-05-19 10:47:31.964835 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:34.571591) v2 -- ?+0 0xac2b180 con 0x9983600 -1334> 2014-05-19 10:47:31.964859 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -1333> 2014-05-19 10:47:31.992463 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:35.938911) v2 ==== 47+0+0 (510964495 0 0) 0xac23500 con 0x94a5a20 -1332> 2014-05-19 10:47:31.992533 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.938911) v2 -- ?+0 0x96bee00 con 0x94a5a20 -1331> 2014-05-19 10:47:31.992566 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -1330> 2014-05-19 10:47:31.992882 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:35.938911) v2 ==== 47+0+0 (510964495 0 0) 0x9748e00 con 0x99d3340 -1329> 2014-05-19 10:47:31.992926 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.938911) v2 -- ?+0 0xa172000 con 0x99d3340 -1328> 2014-05-19 10:47:31.993004 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -1327> 2014-05-19 10:47:32.137634 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:36.083578) v2 ==== 47+0+0 (3513464939 0 0) 0xac46380 con 0x987b760 -1326> 2014-05-19 10:47:32.137690 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.083578) v2 -- ?+0 0x9748e00 con 0x987b760 -1325> 2014-05-19 10:47:32.137714 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:36.083578) v2 ==== 47+0+0 (3513464939 0 0) 0xac4aa80 con 0x94802c0 -1324> 2014-05-19 10:47:32.137765 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -1323> 2014-05-19 10:47:32.137783 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.083578) v2 -- ?+0 0xac23500 con 0x94802c0 -1322> 2014-05-19 10:47:32.137845 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -1321> 2014-05-19 10:47:32.183116 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:36.129617) v2 ==== 47+0+0 (2689407678 0 0) 0xac09340 con 0x97434a0 -1320> 2014-05-19 10:47:32.183166 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.129617) v2 -- ?+0 0xac4aa80 con 0x97434a0 -1319> 2014-05-19 10:47:32.183132 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:36.129617) v2 ==== 47+0+0 (2689407678 0 0) 0x9e11500 con 0x9970840 -1318> 2014-05-19 10:47:32.183248 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -1317> 2014-05-19 10:47:32.183333 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.129617) v2 -- ?+0 0xac46380 con 0x9970840 -1316> 2014-05-19 10:47:32.183830 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -1315> 2014-05-19 10:47:32.511208 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:36.457718) v2 ==== 47+0+0 (2761059058 0 0) 0xac421c0 con 0x9bb7b80 -1314> 2014-05-19 10:47:32.511259 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.457718) v2 -- ?+0 0x9e11500 con 0x9bb7b80 -1313> 2014-05-19 10:47:32.511252 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:36.457718) v2 ==== 47+0+0 (2761059058 0 0) 0xac4bdc0 con 0x95151e0 -1312> 2014-05-19 10:47:32.511378 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -1311> 2014-05-19 10:47:32.511417 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.457718) v2 -- ?+0 0xac09340 con 0x95151e0 -1310> 2014-05-19 10:47:32.511496 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -1309> 2014-05-19 10:47:32.529223 7f5565600700 20 KeyValueStore::op_tp worker waiting -1308> 2014-05-19 10:47:32.656535 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 67 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:35.263603) v2 ==== 47+0+0 (4039871079 0 0) 0x9fa41c0 con 0x9b8c160 -1307> 2014-05-19 10:47:32.656552 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 67 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:35.263603) v2 ==== 47+0+0 (4039871079 0 0) 0xac4d340 con 0x9aa3600 -1306> 2014-05-19 10:47:32.656585 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.263603) v2 -- ?+0 0xac421c0 con 0x9b8c160 -1305> 2014-05-19 10:47:32.656701 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -1304> 2014-05-19 10:47:32.656757 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.263603) v2 -- ?+0 0xac4bdc0 con 0x9aa3600 -1303> 2014-05-19 10:47:32.656861 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -1302> 2014-05-19 10:47:32.712474 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 73 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:32.712288) v2 ==== 47+0+0 (3868194075 0 0) 0x9fd8540 con 0x9656580 -1301> 2014-05-19 10:47:32.712530 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:32.712288) v2 -- ?+0 0x9fa41c0 con 0x9656580 -1300> 2014-05-19 10:47:32.712563 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -1299> 2014-05-19 10:47:32.712484 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 73 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:32.712288) v2 ==== 47+0+0 (3868194075 0 0) 0xac448c0 con 0x9657340 -1298> 2014-05-19 10:47:32.712609 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:32.712288) v2 -- ?+0 0xac4d340 con 0x9657340 -1297> 2014-05-19 10:47:32.712637 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -1296> 2014-05-19 10:47:32.770931 7f55579aa700 20 OSD::op_tp worker waiting -1295> 2014-05-19 10:47:32.770960 7f555a1af700 20 OSD::op_tp worker waiting -1294> 2014-05-19 10:47:32.771040 7f55551a5700 20 OSD::op_tp worker waiting -1293> 2014-05-19 10:47:32.772570 7f55569a8700 20 OSD::op_tp worker waiting -1292> 2014-05-19 10:47:32.772591 7f555b1b1700 20 OSD::op_tp worker waiting -1291> 2014-05-19 10:47:32.772611 7f55541a3700 20 OSD::op_tp worker waiting -1290> 2014-05-19 10:47:32.772627 7f55589ac700 20 OSD::op_tp worker waiting -1289> 2014-05-19 10:47:32.772643 7f55549a4700 20 OSD::op_tp worker waiting -1288> 2014-05-19 10:47:32.772658 7f555a9b0700 20 OSD::op_tp worker waiting -1287> 2014-05-19 10:47:32.773055 7f55581ab700 20 OSD::op_tp worker waiting -1286> 2014-05-19 10:47:32.773088 7f55599ae700 20 OSD::op_tp worker waiting -1285> 2014-05-19 10:47:32.773100 7f55571a9700 20 OSD::op_tp worker waiting -1284> 2014-05-19 10:47:32.773198 7f55531a1700 20 OSD::op_tp worker waiting -1283> 2014-05-19 10:47:32.773248 7f55591ad700 20 OSD::op_tp worker waiting -1282> 2014-05-19 10:47:32.773259 7f555199e700 20 OSD::op_tp worker waiting -1281> 2014-05-19 10:47:32.773269 7f55529a0700 20 OSD::op_tp worker waiting -1280> 2014-05-19 10:47:32.773284 7f55539a2700 20 OSD::op_tp worker waiting -1279> 2014-05-19 10:47:32.773302 7f55561a7700 20 OSD::op_tp worker waiting -1278> 2014-05-19 10:47:32.773341 7f555219f700 20 OSD::op_tp worker waiting -1277> 2014-05-19 10:47:32.773375 7f55559a6700 20 OSD::op_tp worker waiting -1276> 2014-05-19 10:47:32.785191 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 71 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:35.392313) v2 ==== 47+0+0 (552548756 0 0) 0xac30a80 con 0x9937760 -1275> 2014-05-19 10:47:32.785256 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.392313) v2 -- ?+0 0xac448c0 con 0x9937760 -1274> 2014-05-19 10:47:32.785292 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -1273> 2014-05-19 10:47:32.785191 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 71 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:35.392313) v2 ==== 47+0+0 (552548756 0 0) 0xa102000 con 0x9656000 -1272> 2014-05-19 10:47:32.785388 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.392313) v2 -- ?+0 0x9fd8540 con 0x9656000 -1271> 2014-05-19 10:47:32.785547 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -1270> 2014-05-19 10:47:32.827351 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:36.773849) v2 ==== 47+0+0 (2534135632 0 0) 0xac4ddc0 con 0x94e26e0 -1269> 2014-05-19 10:47:32.827391 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:36.773849) v2 ==== 47+0+0 (2534135632 0 0) 0xac4f180 con 0x987b340 -1268> 2014-05-19 10:47:32.827403 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.773849) v2 -- ?+0 0xac30a80 con 0x94e26e0 -1267> 2014-05-19 10:47:32.827480 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -1266> 2014-05-19 10:47:32.827526 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.773849) v2 -- ?+0 0xa102000 con 0x987b340 -1265> 2014-05-19 10:47:32.827619 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -1264> 2014-05-19 10:47:32.926054 7f5566602700 5 osd.0 245 tick -1263> 2014-05-19 10:47:32.926075 7f5566602700 7 osd.0 245 do_mon_report -1262> 2014-05-19 10:47:32.926079 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 -1261> 2014-05-19 10:47:32.926083 7f5566602700 20 osd.0 245 send_pg_stats -1260> 2014-05-19 10:47:32.926121 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.09 >= max 0.5 = no, load too high -1259> 2014-05-19 10:47:32.926134 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -1258> 2014-05-19 10:47:32.926131 7f555119d700 20 OSD::recovery_tp worker waiting -1257> 2014-05-19 10:47:32.926137 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2273.46 < min (86400 seconds) -1256> 2014-05-19 10:47:32.926189 7f5566602700 20 osd.0 245 sched_scrub done -1255> 2014-05-19 10:47:32.926192 7f5566602700 10 osd.0 245 do_waiters -- start -1254> 2014-05-19 10:47:32.926194 7f5566602700 10 osd.0 245 do_waiters -- finish -1253> 2014-05-19 10:47:33.081048 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 68 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:35.688111) v2 ==== 47+0+0 (2712901346 0 0) 0xac17500 con 0x9656160 -1252> 2014-05-19 10:47:33.081093 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.688111) v2 -- ?+0 0xac4f180 con 0x9656160 -1251> 2014-05-19 10:47:33.081096 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 68 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:35.688111) v2 ==== 47+0+0 (2712901346 0 0) 0xac15340 con 0x9656f20 -1250> 2014-05-19 10:47:33.081227 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -1249> 2014-05-19 10:47:33.081339 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.688111) v2 -- ?+0 0xac4ddc0 con 0x9656f20 -1248> 2014-05-19 10:47:33.081375 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -1247> 2014-05-19 10:47:33.090799 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:37.037254) v2 ==== 47+0+0 (2107730081 0 0) 0xac14e00 con 0x99d31e0 -1246> 2014-05-19 10:47:33.090846 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:37.037254) v2 -- ?+0 0xac17500 con 0x99d31e0 -1245> 2014-05-19 10:47:33.090909 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:37.037254) v2 ==== 47+0+0 (2107730081 0 0) 0xac35c00 con 0x95142c0 -1244> 2014-05-19 10:47:33.091009 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -1243> 2014-05-19 10:47:33.091079 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:37.037254) v2 -- ?+0 0xac15340 con 0x95142c0 -1242> 2014-05-19 10:47:33.091157 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -1241> 2014-05-19 10:47:33.112546 7f5564dff700 20 KeyValueStore::op_tp worker waiting -1240> 2014-05-19 10:47:33.328722 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:37.275257) v2 ==== 47+0+0 (3079594262 0 0) 0xac4dc00 con 0x94e26e0 -1239> 2014-05-19 10:47:33.328749 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:37.275257) v2 ==== 47+0+0 (3079594262 0 0) 0xac4efc0 con 0x987b340 -1238> 2014-05-19 10:47:33.328793 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:37.275257) v2 -- ?+0 0xac14e00 con 0x987b340 -1237> 2014-05-19 10:47:33.328833 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -1236> 2014-05-19 10:47:33.328903 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:37.275257) v2 -- ?+0 0xac35c00 con 0x94e26e0 -1235> 2014-05-19 10:47:33.328933 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -1234> 2014-05-19 10:47:33.411536 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:37.358067) v2 ==== 47+0+0 (2273537034 0 0) 0xa092fc0 con 0x9bb69a0 -1233> 2014-05-19 10:47:33.411586 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:37.358067) v2 -- ?+0 0xac4efc0 con 0x9bb69a0 -1232> 2014-05-19 10:47:33.411632 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:37.358067) v2 ==== 47+0+0 (2273537034 0 0) 0xac32c40 con 0x94e3e40 -1231> 2014-05-19 10:47:33.411757 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -1230> 2014-05-19 10:47:33.411925 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:37.358067) v2 -- ?+0 0xac4dc00 con 0x94e3e40 -1229> 2014-05-19 10:47:33.411965 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -1228> 2014-05-19 10:47:33.430111 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 67 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:36.037220) v2 ==== 47+0+0 (1003305718 0 0) 0xa0ba700 con 0x7b90160 -1227> 2014-05-19 10:47:33.430111 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 67 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:36.037220) v2 ==== 47+0+0 (1003305718 0 0) 0xac4fdc0 con 0x9b8db80 -1226> 2014-05-19 10:47:33.430160 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.037220) v2 -- ?+0 0xac32c40 con 0x7b90160 -1225> 2014-05-19 10:47:33.430192 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -1224> 2014-05-19 10:47:33.430239 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.037220) v2 -- ?+0 0xa092fc0 con 0x9b8db80 -1223> 2014-05-19 10:47:33.430328 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -1222> 2014-05-19 10:47:33.451576 7f555019b700 20 OSD::command_tp worker waiting -1221> 2014-05-19 10:47:33.454831 7f555099c700 20 OSD::disk_tp worker waiting -1220> 2014-05-19 10:47:33.625639 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:36.232720) v2 ==== 47+0+0 (3253156949 0 0) 0x9c0f500 con 0x9a0cdc0 -1219> 2014-05-19 10:47:33.625636 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:36.232720) v2 ==== 47+0+0 (3253156949 0 0) 0xac29880 con 0x996fb80 -1218> 2014-05-19 10:47:33.625690 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.232720) v2 -- ?+0 0xa0ba700 con 0x9a0cdc0 -1217> 2014-05-19 10:47:33.625791 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -1216> 2014-05-19 10:47:33.625862 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.232720) v2 -- ?+0 0xac4fdc0 con 0x996fb80 -1215> 2014-05-19 10:47:33.625900 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -1214> 2014-05-19 10:47:33.867170 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:36.474259) v2 ==== 47+0+0 (391521027 0 0) 0xa05f340 con 0x996e000 -1213> 2014-05-19 10:47:33.867236 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.474259) v2 -- ?+0 0xac29880 con 0x996e000 -1212> 2014-05-19 10:47:33.867173 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:36.474259) v2 ==== 47+0+0 (391521027 0 0) 0xa447500 con 0x9a0c9a0 -1211> 2014-05-19 10:47:33.867365 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -1210> 2014-05-19 10:47:33.867412 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.474259) v2 -- ?+0 0x9c0f500 con 0x9a0c9a0 -1209> 2014-05-19 10:47:33.867682 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -1208> 2014-05-19 10:47:33.926268 7f5566602700 5 osd.0 245 tick -1207> 2014-05-19 10:47:33.926293 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -1206> 2014-05-19 10:47:33.926298 7f5566602700 10 osd.0 245 do_waiters -- start -1205> 2014-05-19 10:47:33.926300 7f5566602700 10 osd.0 245 do_waiters -- finish -1204> 2014-05-19 10:47:33.926337 7f555119d700 20 OSD::recovery_tp worker waiting -1203> 2014-05-19 10:47:34.265948 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 70 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:36.873063) v2 ==== 47+0+0 (244768497 0 0) 0xa173340 con 0x95846e0 -1202> 2014-05-19 10:47:34.265963 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 70 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:36.873063) v2 ==== 47+0+0 (244768497 0 0) 0xa5fca80 con 0x9983600 -1201> 2014-05-19 10:47:34.266003 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.873063) v2 -- ?+0 0xa05f340 con 0x95846e0 -1200> 2014-05-19 10:47:34.266080 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -1199> 2014-05-19 10:47:34.266110 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.873063) v2 -- ?+0 0xa447500 con 0x9983600 -1198> 2014-05-19 10:47:34.266144 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -1197> 2014-05-19 10:47:34.413934 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 74 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:34.413747) v2 ==== 47+0+0 (989924258 0 0) 0x9c08700 con 0x9656580 -1196> 2014-05-19 10:47:34.413983 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:34.413747) v2 -- ?+0 0xa173340 con 0x9656580 -1195> 2014-05-19 10:47:34.413974 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 74 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:34.413747) v2 ==== 47+0+0 (989924258 0 0) 0xac44700 con 0x9657340 -1194> 2014-05-19 10:47:34.414015 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -1193> 2014-05-19 10:47:34.414064 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:34.413747) v2 -- ?+0 0xa5fca80 con 0x9657340 -1192> 2014-05-19 10:47:34.414094 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -1191> 2014-05-19 10:47:34.529322 7f5565600700 20 KeyValueStore::op_tp worker waiting -1190> 2014-05-19 10:47:34.531246 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 68 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:37.138382) v2 ==== 47+0+0 (3583820475 0 0) 0xac4fc00 con 0x9b8db80 -1189> 2014-05-19 10:47:34.531273 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 68 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:37.138382) v2 ==== 47+0+0 (3583820475 0 0) 0xa0eaa80 con 0x7b90160 -1188> 2014-05-19 10:47:34.531321 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:37.138382) v2 -- ?+0 0x9c08700 con 0x9b8db80 -1187> 2014-05-19 10:47:34.531355 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -1186> 2014-05-19 10:47:34.531715 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:37.138382) v2 -- ?+0 0xac44700 con 0x7b90160 -1185> 2014-05-19 10:47:34.531872 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -1184> 2014-05-19 10:47:34.727127 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:37.334207) v2 ==== 47+0+0 (1708954522 0 0) 0x9cd1500 con 0x996fb80 -1183> 2014-05-19 10:47:34.727198 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:37.334207) v2 -- ?+0 0xac4fc00 con 0x996fb80 -1182> 2014-05-19 10:47:34.727166 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:37.334207) v2 ==== 47+0+0 (1708954522 0 0) 0xa0b76c0 con 0x9a0cdc0 -1181> 2014-05-19 10:47:34.727284 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -1180> 2014-05-19 10:47:34.727393 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:37.334207) v2 -- ?+0 0xa0eaa80 con 0x9a0cdc0 -1179> 2014-05-19 10:47:34.727435 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -1178> 2014-05-19 10:47:34.761447 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 76 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:37.368560) v2 ==== 47+0+0 (432053132 0 0) 0xac34380 con 0x96571e0 -1177> 2014-05-19 10:47:34.761436 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 76 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:37.368560) v2 ==== 47+0+0 (432053132 0 0) 0xac36000 con 0x9656420 -1176> 2014-05-19 10:47:34.761492 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:37.368560) v2 -- ?+0 0xa0b76c0 con 0x96571e0 -1175> 2014-05-19 10:47:34.761590 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -1174> 2014-05-19 10:47:34.761634 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:37.368560) v2 -- ?+0 0x9cd1500 con 0x9656420 -1173> 2014-05-19 10:47:34.761711 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -1172> 2014-05-19 10:47:34.771032 7f55579aa700 20 OSD::op_tp worker waiting -1171> 2014-05-19 10:47:34.771057 7f555a1af700 20 OSD::op_tp worker waiting -1170> 2014-05-19 10:47:34.771106 7f55551a5700 20 OSD::op_tp worker waiting -1169> 2014-05-19 10:47:34.772671 7f555b1b1700 20 OSD::op_tp worker waiting -1168> 2014-05-19 10:47:34.772697 7f55569a8700 20 OSD::op_tp worker waiting -1167> 2014-05-19 10:47:34.772721 7f55549a4700 20 OSD::op_tp worker waiting -1166> 2014-05-19 10:47:34.772735 7f55541a3700 20 OSD::op_tp worker waiting -1165> 2014-05-19 10:47:34.772756 7f555a9b0700 20 OSD::op_tp worker waiting -1164> 2014-05-19 10:47:34.772791 7f55589ac700 20 OSD::op_tp worker waiting -1163> 2014-05-19 10:47:34.773124 7f55581ab700 20 OSD::op_tp worker waiting -1162> 2014-05-19 10:47:34.773154 7f55599ae700 20 OSD::op_tp worker waiting -1161> 2014-05-19 10:47:34.773177 7f55571a9700 20 OSD::op_tp worker waiting -1160> 2014-05-19 10:47:34.773272 7f55531a1700 20 OSD::op_tp worker waiting -1159> 2014-05-19 10:47:34.773308 7f55591ad700 20 OSD::op_tp worker waiting -1158> 2014-05-19 10:47:34.773327 7f555199e700 20 OSD::op_tp worker waiting -1157> 2014-05-19 10:47:34.773347 7f55529a0700 20 OSD::op_tp worker waiting -1156> 2014-05-19 10:47:34.773359 7f55561a7700 20 OSD::op_tp worker waiting -1155> 2014-05-19 10:47:34.773373 7f55539a2700 20 OSD::op_tp worker waiting -1154> 2014-05-19 10:47:34.773411 7f555219f700 20 OSD::op_tp worker waiting -1153> 2014-05-19 10:47:34.773439 7f55559a6700 20 OSD::op_tp worker waiting -1152> 2014-05-19 10:47:34.899306 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:38.845898) v2 ==== 47+0+0 (561864078 0 0) 0xa172fc0 con 0x987af20 -1151> 2014-05-19 10:47:34.899310 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 53 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:38.845898) v2 ==== 47+0+0 (561864078 0 0) 0x96befc0 con 0x99f1080 -1150> 2014-05-19 10:47:34.899367 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.845898) v2 -- ?+0 0xac36000 con 0x987af20 -1149> 2014-05-19 10:47:34.899491 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -1148> 2014-05-19 10:47:34.899634 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.845898) v2 -- ?+0 0xac34380 con 0x99f1080 -1147> 2014-05-19 10:47:34.899722 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -1146> 2014-05-19 10:47:34.926376 7f5566602700 5 osd.0 245 tick -1145> 2014-05-19 10:47:34.926430 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.09 >= max 0.5 = no, load too high -1144> 2014-05-19 10:47:34.926444 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -1143> 2014-05-19 10:47:34.926446 7f555119d700 20 OSD::recovery_tp worker waiting -1142> 2014-05-19 10:47:34.926447 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2275.46 < min (86400 seconds) -1141> 2014-05-19 10:47:34.926466 7f5566602700 20 osd.0 245 sched_scrub done -1140> 2014-05-19 10:47:34.926469 7f5566602700 10 osd.0 245 do_waiters -- start -1139> 2014-05-19 10:47:34.926471 7f5566602700 10 osd.0 245 do_waiters -- finish -1138> 2014-05-19 10:47:34.957960 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 68 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:37.565080) v2 ==== 47+0+0 (1498006557 0 0) 0xac4d180 con 0x9aa3600 -1137> 2014-05-19 10:47:34.957999 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:37.565080) v2 -- ?+0 0x96befc0 con 0x9aa3600 -1136> 2014-05-19 10:47:34.957996 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 68 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:37.565080) v2 ==== 47+0+0 (1498006557 0 0) 0xac14fc0 con 0x9b8c160 -1135> 2014-05-19 10:47:34.958132 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -1134> 2014-05-19 10:47:34.958202 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:37.565080) v2 -- ?+0 0xa172fc0 con 0x9b8c160 -1133> 2014-05-19 10:47:34.958241 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -1132> 2014-05-19 10:47:35.030157 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:38.976787) v2 ==== 47+0+0 (3617912925 0 0) 0xac4da40 con 0x94e26e0 -1131> 2014-05-19 10:47:35.030168 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:38.976787) v2 ==== 47+0+0 (3617912925 0 0) 0xac4ee00 con 0x987b340 -1130> 2014-05-19 10:47:35.030209 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.976787) v2 -- ?+0 0xac4d180 con 0x94e26e0 -1129> 2014-05-19 10:47:35.030319 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -1128> 2014-05-19 10:47:35.030521 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.976787) v2 -- ?+0 0xac14fc0 con 0x987b340 -1127> 2014-05-19 10:47:35.030565 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -1126> 2014-05-19 10:47:35.084401 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.031052) v2 ==== 47+0+0 (2952598197 0 0) 0x9e11880 con 0x9970840 -1125> 2014-05-19 10:47:35.084453 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.031052) v2 -- ?+0 0xac4ee00 con 0x9970840 -1124> 2014-05-19 10:47:35.084495 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -1123> 2014-05-19 10:47:35.084443 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.031052) v2 ==== 47+0+0 (2952598197 0 0) 0xac08e00 con 0x97434a0 -1122> 2014-05-19 10:47:35.084514 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.031052) v2 -- ?+0 0xac4da40 con 0x97434a0 -1121> 2014-05-19 10:47:35.084548 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -1120> 2014-05-19 10:47:35.112643 7f5564dff700 20 KeyValueStore::op_tp worker waiting -1119> 2014-05-19 10:47:35.371625 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:37.978729) v2 ==== 47+0+0 (306199808 0 0) 0xa0ca380 con 0x9b8de40 -1118> 2014-05-19 10:47:35.371642 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 64 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:37.978729) v2 ==== 47+0+0 (306199808 0 0) 0xa092380 con 0x94e2160 -1117> 2014-05-19 10:47:35.371674 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:37.978729) v2 -- ?+0 0x9e11880 con 0x9b8de40 -1116> 2014-05-19 10:47:35.371759 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -1115> 2014-05-19 10:47:35.372052 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:37.978729) v2 -- ?+0 0xac08e00 con 0x94e2160 -1114> 2014-05-19 10:47:35.372155 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -1113> 2014-05-19 10:47:35.451673 7f555019b700 20 OSD::command_tp worker waiting -1112> 2014-05-19 10:47:35.454913 7f555099c700 20 OSD::disk_tp worker waiting -1111> 2014-05-19 10:47:35.493775 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.440500) v2 ==== 47+0+0 (2700932610 0 0) 0x9fb4540 con 0x99d3340 -1110> 2014-05-19 10:47:35.493816 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.440500) v2 -- ?+0 0xa0ca380 con 0x99d3340 -1109> 2014-05-19 10:47:35.493851 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -1108> 2014-05-19 10:47:35.493916 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.440500) v2 ==== 47+0+0 (2700932610 0 0) 0xac22e00 con 0x94a5a20 -1107> 2014-05-19 10:47:35.493990 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.440500) v2 -- ?+0 0xa092380 con 0x94a5a20 -1106> 2014-05-19 10:47:35.494026 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -1105> 2014-05-19 10:47:35.573454 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -1104> 2014-05-19 10:47:35.573475 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -1103> 2014-05-19 10:47:35.573483 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xac23dc0 con 0x9bdc840 -1102> 2014-05-19 10:47:35.573509 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xac2aa80 con 0x9ad4420 -1101> 2014-05-19 10:47:35.573545 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0x9cb7180 con 0x9bf31e0 -1100> 2014-05-19 10:47:35.573560 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0x9c6f880 con 0x998b340 -1099> 2014-05-19 10:47:35.573589 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xa4ef500 con 0x9b92840 -1098> 2014-05-19 10:47:35.573622 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xac1a380 con 0x9ad49a0 -1097> 2014-05-19 10:47:35.573648 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xa856540 con 0x7b911e0 -1096> 2014-05-19 10:47:35.573673 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xa74b180 con 0x7b918c0 -1095> 2014-05-19 10:47:35.573701 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0x97c28c0 con 0x9aa8c60 -1094> 2014-05-19 10:47:35.573718 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0x9cb4e00 con 0x9bfa000 -1093> 2014-05-19 10:47:35.573733 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0x9f75a40 con 0x7c23e40 -1092> 2014-05-19 10:47:35.573763 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0x9e708c0 con 0x998b760 -1091> 2014-05-19 10:47:35.573792 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xac35180 con 0x7b91080 -1090> 2014-05-19 10:47:35.573838 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 76 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0x9209c00 con 0x9bdc840 -1089> 2014-05-19 10:47:35.573869 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xa864700 con 0xa28fb80 -1088> 2014-05-19 10:47:35.573894 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xa265a40 con 0x76bdce0 -1087> 2014-05-19 10:47:35.573920 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xa0bc700 con 0x994ab00 -1086> 2014-05-19 10:47:35.573982 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0x9209500 con 0x9ac8b00 -1085> 2014-05-19 10:47:35.574014 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xa6d5c00 con 0x938de40 -1084> 2014-05-19 10:47:35.574033 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xac4ae00 con 0x9970b00 -1083> 2014-05-19 10:47:35.574049 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xac49a40 con 0x99706e0 -1082> 2014-05-19 10:47:35.574066 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xac08380 con 0x9bb6f20 -1081> 2014-05-19 10:47:35.574082 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0x9fa5c00 con 0x994b340 -1080> 2014-05-19 10:47:35.574137 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xa447880 con 0x98fa2c0 -1079> 2014-05-19 10:47:35.574168 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xac28c40 con 0x996f8c0 -1078> 2014-05-19 10:47:35.574188 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0x99e0000 con 0x996fa20 -1077> 2014-05-19 10:47:35.574204 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0x9fd8700 con 0x9ac8160 -1076> 2014-05-19 10:47:35.574219 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xa2bcfc0 con 0x7b90420 -1075> 2014-05-19 10:47:35.574243 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xa163a40 con 0x919fe40 -1074> 2014-05-19 10:47:35.574270 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xa4a9180 con 0x9971760 -1073> 2014-05-19 10:47:35.574316 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0x99fce00 con 0x994af20 -1072> 2014-05-19 10:47:35.574348 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xac31dc0 con 0x989be40 -1071> 2014-05-19 10:47:35.574387 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0x9c09500 con 0x9adf4a0 -1070> 2014-05-19 10:47:35.574420 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xa162a80 con 0x9776160 -1069> 2014-05-19 10:47:35.574450 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xa0b68c0 con 0x96bd8c0 -1068> 2014-05-19 10:47:35.574488 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xa4ef180 con 0x96bcdc0 -1067> 2014-05-19 10:47:35.574518 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0x9cb41c0 con 0x96954a0 -1066> 2014-05-19 10:47:35.574556 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0x9e6dc00 con 0x76bd8c0 -1065> 2014-05-19 10:47:35.574585 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0x9e9f340 con 0x7b90dc0 -1064> 2014-05-19 10:47:35.574606 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0xac34fc0 con 0x978d8c0 -1063> 2014-05-19 10:47:35.574631 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0x9c0f880 con 0x978c580 -1062> 2014-05-19 10:47:35.574659 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0x9e81dc0 con 0x978d340 -1061> 2014-05-19 10:47:35.574687 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:35.573481) v2 -- ?+0 0x9f428c0 con 0x96374a0 -1060> 2014-05-19 10:47:35.574730 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -1059> 2014-05-19 10:47:35.574749 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 75 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xac08700 con 0x998b340 -1058> 2014-05-19 10:47:35.574794 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -1057> 2014-05-19 10:47:35.574813 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 74 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xa4a96c0 con 0x9b92840 -1056> 2014-05-19 10:47:35.574857 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -1055> 2014-05-19 10:47:35.574866 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 74 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xac48700 con 0x9ad49a0 -1054> 2014-05-19 10:47:35.574883 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -1053> 2014-05-19 10:47:35.574905 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 71 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0x99e16c0 con 0x7b911e0 -1052> 2014-05-19 10:47:35.574944 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -1051> 2014-05-19 10:47:35.574959 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 71 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xa44ca80 con 0x7b918c0 -1050> 2014-05-19 10:47:35.574989 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -1049> 2014-05-19 10:47:35.575007 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 70 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xa857180 con 0x9aa8c60 -1048> 2014-05-19 10:47:35.575027 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -1047> 2014-05-19 10:47:35.575033 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 70 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xa266fc0 con 0x9bfa000 -1046> 2014-05-19 10:47:35.575047 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -1045> 2014-05-19 10:47:35.575061 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xa2e1c00 con 0x7c23e40 -1044> 2014-05-19 10:47:35.575093 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -1043> 2014-05-19 10:47:35.575113 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xac48fc0 con 0x998b760 -1042> 2014-05-19 10:47:35.575142 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -1041> 2014-05-19 10:47:35.575150 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xa617340 con 0x7b91080 -1040> 2014-05-19 10:47:35.575166 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -1039> 2014-05-19 10:47:35.575176 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xa873c00 con 0xa28fb80 -1038> 2014-05-19 10:47:35.575200 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -1037> 2014-05-19 10:47:35.575216 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0x9b44540 con 0x76bdce0 -1036> 2014-05-19 10:47:35.575242 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -1035> 2014-05-19 10:47:35.575251 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xa74ac40 con 0x994ab00 -1034> 2014-05-19 10:47:35.575268 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -1033> 2014-05-19 10:47:35.575275 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xa1dfdc0 con 0x9ac8b00 -1032> 2014-05-19 10:47:35.575293 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -1031> 2014-05-19 10:47:35.575301 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xa4eea80 con 0x938de40 -1030> 2014-05-19 10:47:35.575316 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -1029> 2014-05-19 10:47:35.575327 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xac29880 con 0x9970b00 -1028> 2014-05-19 10:47:35.575344 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -1027> 2014-05-19 10:47:35.575351 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xac40540 con 0x99706e0 -1026> 2014-05-19 10:47:35.575369 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -1025> 2014-05-19 10:47:35.575376 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xa2e08c0 con 0x9bb6f20 -1024> 2014-05-19 10:47:35.575393 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -1023> 2014-05-19 10:47:35.575400 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0x9e6c540 con 0x994b340 -1022> 2014-05-19 10:47:35.575415 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -1021> 2014-05-19 10:47:35.575422 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xac51dc0 con 0x98fa2c0 -1020> 2014-05-19 10:47:35.575437 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -1019> 2014-05-19 10:47:35.575444 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xac32e00 con 0x996f8c0 -1018> 2014-05-19 10:47:35.575459 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -1017> 2014-05-19 10:47:35.575469 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0x9b50a80 con 0x996fa20 -1016> 2014-05-19 10:47:35.575486 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -1015> 2014-05-19 10:47:35.575493 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xa3dac40 con 0x9ac8160 -1014> 2014-05-19 10:47:35.575507 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -1013> 2014-05-19 10:47:35.575515 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xac36c40 con 0x7b90420 -1012> 2014-05-19 10:47:35.575532 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -1011> 2014-05-19 10:47:35.575540 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xac4a540 con 0x919fe40 -1010> 2014-05-19 10:47:35.575556 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -1009> 2014-05-19 10:47:35.575563 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0x95e6540 con 0x9971760 -1008> 2014-05-19 10:47:35.575577 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -1007> 2014-05-19 10:47:35.575588 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xa857500 con 0x994af20 -1006> 2014-05-19 10:47:35.575605 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -1005> 2014-05-19 10:47:35.575613 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xa208700 con 0x989be40 -1004> 2014-05-19 10:47:35.575629 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -1003> 2014-05-19 10:47:35.575637 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xac42a80 con 0x9adf4a0 -1002> 2014-05-19 10:47:35.575651 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -1001> 2014-05-19 10:47:35.575658 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0x9e9e8c0 con 0x9776160 -1000> 2014-05-19 10:47:35.575674 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -999> 2014-05-19 10:47:35.575681 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xa36c8c0 con 0x96bd8c0 -998> 2014-05-19 10:47:35.575695 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -997> 2014-05-19 10:47:35.575707 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xac49180 con 0x96bcdc0 -996> 2014-05-19 10:47:35.575725 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -995> 2014-05-19 10:47:35.575732 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xa4ee540 con 0x96954a0 -994> 2014-05-19 10:47:35.575749 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -993> 2014-05-19 10:47:35.575756 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xa0bd500 con 0x76bd8c0 -992> 2014-05-19 10:47:35.575772 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -991> 2014-05-19 10:47:35.575780 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0x9ccf180 con 0x7b90dc0 -990> 2014-05-19 10:47:35.575794 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -989> 2014-05-19 10:47:35.575801 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0x9c09180 con 0x978d8c0 -988> 2014-05-19 10:47:35.575815 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -987> 2014-05-19 10:47:35.575820 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xac31180 con 0x978c580 -986> 2014-05-19 10:47:35.575834 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -985> 2014-05-19 10:47:35.575843 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xac51180 con 0x978d340 -984> 2014-05-19 10:47:35.575860 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -983> 2014-05-19 10:47:35.575867 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 56 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xa4a8380 con 0x96374a0 -982> 2014-05-19 10:47:35.575881 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -981> 2014-05-19 10:47:35.575889 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 76 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0xa0dcc40 con 0x9ad4420 -980> 2014-05-19 10:47:35.575906 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -979> 2014-05-19 10:47:35.575922 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 75 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:35.573481) v2 ==== 47+0+0 (3990031698 0 0) 0x9ba4a80 con 0x9bf31e0 -978> 2014-05-19 10:47:35.575939 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -977> 2014-05-19 10:47:35.638324 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.584924) v2 ==== 47+0+0 (4282594628 0 0) 0xa664700 con 0x94802c0 -976> 2014-05-19 10:47:35.638374 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.584924) v2 -- ?+0 0xac22e00 con 0x94802c0 -975> 2014-05-19 10:47:35.638456 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -974> 2014-05-19 10:47:35.638344 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.584924) v2 ==== 47+0+0 (4282594628 0 0) 0xac461c0 con 0x987b760 -973> 2014-05-19 10:47:35.638605 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.584924) v2 -- ?+0 0x9fb4540 con 0x987b760 -972> 2014-05-19 10:47:35.638714 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -971> 2014-05-19 10:47:35.926561 7f5566602700 5 osd.0 245 tick -970> 2014-05-19 10:47:35.926585 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -969> 2014-05-19 10:47:35.926590 7f5566602700 10 osd.0 245 do_waiters -- start -968> 2014-05-19 10:47:35.926592 7f5566602700 10 osd.0 245 do_waiters -- finish -967> 2014-05-19 10:47:35.926631 7f555119d700 20 OSD::recovery_tp worker waiting -966> 2014-05-19 10:47:36.012511 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.959131) v2 ==== 47+0+0 (3857874714 0 0) 0xac4bc00 con 0x95151e0 -965> 2014-05-19 10:47:36.012558 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.959131) v2 -- ?+0 0xa664700 con 0x95151e0 -964> 2014-05-19 10:47:36.012638 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -963> 2014-05-19 10:47:36.012775 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.959131) v2 ==== 47+0+0 (3857874714 0 0) 0xac42000 con 0x9bb7b80 -962> 2014-05-19 10:47:36.012828 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.959131) v2 -- ?+0 0xac461c0 con 0x9bb7b80 -961> 2014-05-19 10:47:36.012860 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -960> 2014-05-19 10:47:36.168605 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:38.775729) v2 ==== 47+0+0 (14552334 0 0) 0xa05e540 con 0x996e000 -959> 2014-05-19 10:47:36.168632 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:38.775729) v2 ==== 47+0+0 (14552334 0 0) 0xac14c40 con 0x9a0c9a0 -958> 2014-05-19 10:47:36.168702 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.775729) v2 -- ?+0 0xac42000 con 0x996e000 -957> 2014-05-19 10:47:36.168738 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -956> 2014-05-19 10:47:36.169168 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.775729) v2 -- ?+0 0xac4bc00 con 0x9a0c9a0 -955> 2014-05-19 10:47:36.169226 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -954> 2014-05-19 10:47:36.353119 7f555c1b3700 10 monclient: tick -953> 2014-05-19 10:47:36.353135 7f555c1b3700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2014-05-19 10:47:06.353133) -952> 2014-05-19 10:47:36.353152 7f555c1b3700 10 monclient: renew subs? (now: 2014-05-19 10:47:36.353152; renew after: 2014-05-19 10:49:36.352721) -- no -951> 2014-05-19 10:47:36.462851 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 77 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.069980) v2 ==== 47+0+0 (2540762656 0 0) 0xac34e00 con 0x96571e0 -950> 2014-05-19 10:47:36.462954 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.069980) v2 -- ?+0 0xac14c40 con 0x96571e0 -949> 2014-05-19 10:47:36.462878 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 77 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.069980) v2 ==== 47+0+0 (2540762656 0 0) 0xac36540 con 0x9656420 -948> 2014-05-19 10:47:36.463213 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -947> 2014-05-19 10:47:36.463444 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.069980) v2 -- ?+0 0xa05e540 con 0x9656420 -946> 2014-05-19 10:47:36.463475 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -945> 2014-05-19 10:47:36.481232 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:40.427933) v2 ==== 47+0+0 (3301683474 0 0) 0xa45e1c0 con 0x99718c0 -944> 2014-05-19 10:47:36.481279 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:40.427933) v2 -- ?+0 0xac36540 con 0x99718c0 -943> 2014-05-19 10:47:36.481314 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -942> 2014-05-19 10:47:36.481323 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:40.427933) v2 ==== 47+0+0 (3301683474 0 0) 0xac1ae00 con 0x97431e0 -941> 2014-05-19 10:47:36.481361 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:40.427933) v2 -- ?+0 0xac34e00 con 0x97431e0 -940> 2014-05-19 10:47:36.481478 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -939> 2014-05-19 10:47:36.529420 7f5565600700 20 KeyValueStore::op_tp worker waiting -938> 2014-05-19 10:47:36.582438 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 69 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.189590) v2 ==== 47+0+0 (3097711430 0 0) 0xac14540 con 0x9656f20 -937> 2014-05-19 10:47:36.582478 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 69 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.189590) v2 ==== 47+0+0 (3097711430 0 0) 0x9d021c0 con 0x9656160 -936> 2014-05-19 10:47:36.582493 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.189590) v2 -- ?+0 0xac1ae00 con 0x9656f20 -935> 2014-05-19 10:47:36.582555 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -934> 2014-05-19 10:47:36.582594 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.189590) v2 -- ?+0 0xa45e1c0 con 0x9656160 -933> 2014-05-19 10:47:36.582706 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -932> 2014-05-19 10:47:36.627985 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 76 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.235120) v2 ==== 47+0+0 (1630628852 0 0) 0xa093340 con 0x96562c0 -931> 2014-05-19 10:47:36.628062 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.235120) v2 -- ?+0 0x9d021c0 con 0x96562c0 -930> 2014-05-19 10:47:36.628098 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -929> 2014-05-19 10:47:36.628138 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 76 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.235120) v2 ==== 47+0+0 (1630628852 0 0) 0xac2a700 con 0x9657080 -928> 2014-05-19 10:47:36.628196 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.235120) v2 -- ?+0 0xac14540 con 0x9657080 -927> 2014-05-19 10:47:36.628231 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -926> 2014-05-19 10:47:36.674841 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -925> 2014-05-19 10:47:36.674862 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -924> 2014-05-19 10:47:36.674876 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xac4a700 con 0x9bdc840 -923> 2014-05-19 10:47:36.674908 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xac368c0 con 0x9ad4420 -922> 2014-05-19 10:47:36.674934 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa3db880 con 0x9bf31e0 -921> 2014-05-19 10:47:36.674960 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa264e00 con 0x998b340 -920> 2014-05-19 10:47:36.675037 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa236700 con 0x9b92840 -919> 2014-05-19 10:47:36.675062 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa23fc00 con 0x9ad49a0 -918> 2014-05-19 10:47:36.675101 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa45e700 con 0x7b911e0 -917> 2014-05-19 10:47:36.675167 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa446700 con 0x7b918c0 -916> 2014-05-19 10:47:36.675193 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0x9448380 con 0x9aa8c60 -915> 2014-05-19 10:47:36.675222 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa873340 con 0x9bfa000 -914> 2014-05-19 10:47:36.675246 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0x9fd8fc0 con 0x7c23e40 -913> 2014-05-19 10:47:36.675273 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa664000 con 0x998b760 -912> 2014-05-19 10:47:36.675307 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa74a8c0 con 0x7b91080 -911> 2014-05-19 10:47:36.675330 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0x9d22540 con 0xa28fb80 -910> 2014-05-19 10:47:36.675331 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 77 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xa0ebc00 con 0x9ad4420 -909> 2014-05-19 10:47:36.675354 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa872700 con 0x76bdce0 -908> 2014-05-19 10:47:36.675376 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa2dfc00 con 0x994ab00 -907> 2014-05-19 10:47:36.675407 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0x9b2e380 con 0x9ac8b00 -906> 2014-05-19 10:47:36.675438 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa2e0c40 con 0x938de40 -905> 2014-05-19 10:47:36.675470 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa36c8c0 con 0x9970b00 -904> 2014-05-19 10:47:36.675497 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0x9e9e8c0 con 0x99706e0 -903> 2014-05-19 10:47:36.675518 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xac42a80 con 0x9bb6f20 -902> 2014-05-19 10:47:36.675544 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa208700 con 0x994b340 -901> 2014-05-19 10:47:36.675568 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa857500 con 0x98fa2c0 -900> 2014-05-19 10:47:36.675582 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0x95e6540 con 0x996f8c0 -899> 2014-05-19 10:47:36.675596 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xac4a540 con 0x996fa20 -898> 2014-05-19 10:47:36.675609 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xac36c40 con 0x9ac8160 -897> 2014-05-19 10:47:36.675624 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa3dac40 con 0x7b90420 -896> 2014-05-19 10:47:36.675668 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0x9b50a80 con 0x919fe40 -895> 2014-05-19 10:47:36.675692 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xac32e00 con 0x9971760 -894> 2014-05-19 10:47:36.675709 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xac51dc0 con 0x994af20 -893> 2014-05-19 10:47:36.675725 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0x9e6c540 con 0x989be40 -892> 2014-05-19 10:47:36.675742 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa2e08c0 con 0x9adf4a0 -891> 2014-05-19 10:47:36.675771 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xac40540 con 0x9776160 -890> 2014-05-19 10:47:36.675799 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xac29880 con 0x96bd8c0 -889> 2014-05-19 10:47:36.675826 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa4eea80 con 0x96bcdc0 -888> 2014-05-19 10:47:36.675853 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa1dfdc0 con 0x96954a0 -887> 2014-05-19 10:47:36.675879 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa74ac40 con 0x76bd8c0 -886> 2014-05-19 10:47:36.675907 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0x9b44540 con 0x7b90dc0 -885> 2014-05-19 10:47:36.675990 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa873c00 con 0x978d8c0 -884> 2014-05-19 10:47:36.676029 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa617340 con 0x978c580 -883> 2014-05-19 10:47:36.676059 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xac48fc0 con 0x978d340 -882> 2014-05-19 10:47:36.676089 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:36.674874) v2 -- ?+0 0xa2e1c00 con 0x96374a0 -881> 2014-05-19 10:47:36.676129 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -880> 2014-05-19 10:47:36.676150 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 76 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0x9fece00 con 0x9bf31e0 -879> 2014-05-19 10:47:36.676211 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -878> 2014-05-19 10:47:36.676232 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 76 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xa36c1c0 con 0x998b340 -877> 2014-05-19 10:47:36.676257 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -876> 2014-05-19 10:47:36.676268 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 75 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0x99e0540 con 0x9b92840 -875> 2014-05-19 10:47:36.676302 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -874> 2014-05-19 10:47:36.676318 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 75 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xac48540 con 0x9ad49a0 -873> 2014-05-19 10:47:36.676336 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -872> 2014-05-19 10:47:36.676348 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 72 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0x9236380 con 0x7b911e0 -871> 2014-05-19 10:47:36.676378 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -870> 2014-05-19 10:47:36.676399 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 72 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xa4ffdc0 con 0x7b918c0 -869> 2014-05-19 10:47:36.676431 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -868> 2014-05-19 10:47:36.676451 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 71 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xa857c00 con 0x9aa8c60 -867> 2014-05-19 10:47:36.676486 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -866> 2014-05-19 10:47:36.676500 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 71 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0x94641c0 con 0x9bfa000 -865> 2014-05-19 10:47:36.676526 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -864> 2014-05-19 10:47:36.676533 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 70 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xa115a40 con 0x7c23e40 -863> 2014-05-19 10:47:36.676547 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -862> 2014-05-19 10:47:36.676557 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 70 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xac49c00 con 0x998b760 -861> 2014-05-19 10:47:36.676581 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -860> 2014-05-19 10:47:36.676592 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 70 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xa7d5a40 con 0x7b91080 -859> 2014-05-19 10:47:36.676624 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -858> 2014-05-19 10:47:36.676641 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 70 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xa8721c0 con 0xa28fb80 -857> 2014-05-19 10:47:36.676661 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -856> 2014-05-19 10:47:36.676668 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0x9c6ea80 con 0x76bdce0 -855> 2014-05-19 10:47:36.676686 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -854> 2014-05-19 10:47:36.676695 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xa0b7880 con 0x994ab00 -853> 2014-05-19 10:47:36.676712 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -852> 2014-05-19 10:47:36.676719 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xac428c0 con 0x9ac8b00 -851> 2014-05-19 10:47:36.676734 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -850> 2014-05-19 10:47:36.676742 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0x9e9f6c0 con 0x938de40 -849> 2014-05-19 10:47:36.676756 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -848> 2014-05-19 10:47:36.676764 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xac28c40 con 0x9970b00 -847> 2014-05-19 10:47:36.676781 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -846> 2014-05-19 10:47:36.676788 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xac408c0 con 0x99706e0 -845> 2014-05-19 10:47:36.676802 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -844> 2014-05-19 10:47:36.676810 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0x99e0000 con 0x9bb6f20 -843> 2014-05-19 10:47:36.676824 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -842> 2014-05-19 10:47:36.676831 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0x9f20fc0 con 0x994b340 -841> 2014-05-19 10:47:36.676845 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -840> 2014-05-19 10:47:36.676852 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xac51c00 con 0x98fa2c0 -839> 2014-05-19 10:47:36.676866 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -838> 2014-05-19 10:47:36.676880 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0x9388e00 con 0x996f8c0 -837> 2014-05-19 10:47:36.676897 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -836> 2014-05-19 10:47:36.676904 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0x9562700 con 0x996fa20 -835> 2014-05-19 10:47:36.676919 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -834> 2014-05-19 10:47:36.676926 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xa619500 con 0x9ac8160 -833> 2014-05-19 10:47:36.676940 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -832> 2014-05-19 10:47:36.676948 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0x9feca80 con 0x7b90420 -831> 2014-05-19 10:47:36.676962 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -830> 2014-05-19 10:47:36.676969 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xac4a380 con 0x919fe40 -829> 2014-05-19 10:47:36.676982 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -828> 2014-05-19 10:47:36.676989 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xa4461c0 con 0x9971760 -827> 2014-05-19 10:47:36.677003 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -826> 2014-05-19 10:47:36.677012 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xa517c00 con 0x994af20 -825> 2014-05-19 10:47:36.677028 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -824> 2014-05-19 10:47:36.677035 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xa209500 con 0x989be40 -823> 2014-05-19 10:47:36.677050 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -822> 2014-05-19 10:47:36.677059 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xac43dc0 con 0x9adf4a0 -821> 2014-05-19 10:47:36.677076 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -820> 2014-05-19 10:47:36.677083 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0x9b51880 con 0x9776160 -819> 2014-05-19 10:47:36.677097 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -818> 2014-05-19 10:47:36.677129 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xa36c700 con 0x96bd8c0 -817> 2014-05-19 10:47:36.677158 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -816> 2014-05-19 10:47:36.677166 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0x9547dc0 con 0x96bcdc0 -815> 2014-05-19 10:47:36.677181 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -814> 2014-05-19 10:47:36.677186 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xa4ee8c0 con 0x96954a0 -813> 2014-05-19 10:47:36.677203 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -812> 2014-05-19 10:47:36.677208 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xa0bd340 con 0x76bd8c0 -811> 2014-05-19 10:47:36.677231 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -810> 2014-05-19 10:47:36.677239 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0x9faa540 con 0x7b90dc0 -809> 2014-05-19 10:47:36.677253 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -808> 2014-05-19 10:47:36.677261 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0x9c08380 con 0x978d8c0 -807> 2014-05-19 10:47:36.677275 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -806> 2014-05-19 10:47:36.677285 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xac31c00 con 0x978c580 -805> 2014-05-19 10:47:36.677301 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -804> 2014-05-19 10:47:36.677308 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xac50fc0 con 0x978d340 -803> 2014-05-19 10:47:36.677322 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -802> 2014-05-19 10:47:36.677330 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 57 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xac308c0 con 0x96374a0 -801> 2014-05-19 10:47:36.677344 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -800> 2014-05-19 10:47:36.677352 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 77 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:36.674874) v2 ==== 47+0+0 (2282765023 0 0) 0xa0ba8c0 con 0x9bdc840 -799> 2014-05-19 10:47:36.677370 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -798> 2014-05-19 10:47:36.771135 7f55579aa700 20 OSD::op_tp worker waiting -797> 2014-05-19 10:47:36.771163 7f555a1af700 20 OSD::op_tp worker waiting -796> 2014-05-19 10:47:36.771186 7f55551a5700 20 OSD::op_tp worker waiting -795> 2014-05-19 10:47:36.772774 7f555b1b1700 20 OSD::op_tp worker waiting -794> 2014-05-19 10:47:36.772796 7f55569a8700 20 OSD::op_tp worker waiting -793> 2014-05-19 10:47:36.772814 7f55549a4700 20 OSD::op_tp worker waiting -792> 2014-05-19 10:47:36.772832 7f55541a3700 20 OSD::op_tp worker waiting -791> 2014-05-19 10:47:36.772847 7f555a9b0700 20 OSD::op_tp worker waiting -790> 2014-05-19 10:47:36.772860 7f55589ac700 20 OSD::op_tp worker waiting -789> 2014-05-19 10:47:36.773189 7f55581ab700 20 OSD::op_tp worker waiting -788> 2014-05-19 10:47:36.773217 7f55599ae700 20 OSD::op_tp worker waiting -787> 2014-05-19 10:47:36.773241 7f55571a9700 20 OSD::op_tp worker waiting -786> 2014-05-19 10:47:36.773340 7f55531a1700 20 OSD::op_tp worker waiting -785> 2014-05-19 10:47:36.773374 7f55591ad700 20 OSD::op_tp worker waiting -784> 2014-05-19 10:47:36.773398 7f555199e700 20 OSD::op_tp worker waiting -783> 2014-05-19 10:47:36.773409 7f55529a0700 20 OSD::op_tp worker waiting -782> 2014-05-19 10:47:36.773424 7f55561a7700 20 OSD::op_tp worker waiting -781> 2014-05-19 10:47:36.773439 7f55539a2700 20 OSD::op_tp worker waiting -780> 2014-05-19 10:47:36.773470 7f555219f700 20 OSD::op_tp worker waiting -779> 2014-05-19 10:47:36.773503 7f55559a6700 20 OSD::op_tp worker waiting -778> 2014-05-19 10:47:36.832546 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 69 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.439676) v2 ==== 47+0+0 (4169158259 0 0) 0xa516540 con 0x7b90160 -777> 2014-05-19 10:47:36.832826 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.439676) v2 -- ?+0 0xac2a700 con 0x7b90160 -776> 2014-05-19 10:47:36.832854 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -775> 2014-05-19 10:47:36.832986 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 69 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.439676) v2 ==== 47+0+0 (4169158259 0 0) 0xac4fa40 con 0x9b8db80 -774> 2014-05-19 10:47:36.833026 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.439676) v2 -- ?+0 0xa093340 con 0x9b8db80 -773> 2014-05-19 10:47:36.833099 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -772> 2014-05-19 10:47:36.886784 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 72 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.493921) v2 ==== 47+0+0 (397832082 0 0) 0xa507dc0 con 0x9937760 -771> 2014-05-19 10:47:36.886838 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.493921) v2 -- ?+0 0xa516540 con 0x9937760 -770> 2014-05-19 10:47:36.886870 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -769> 2014-05-19 10:47:36.886796 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 72 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.493921) v2 ==== 47+0+0 (397832082 0 0) 0xa102a80 con 0x9656000 -768> 2014-05-19 10:47:36.886906 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.493921) v2 -- ?+0 0xac4fa40 con 0x9656000 -767> 2014-05-19 10:47:36.886980 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -766> 2014-05-19 10:47:36.912773 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:40.859470) v2 ==== 47+0+0 (3677619673 0 0) 0xa092000 con 0x9bb69a0 -765> 2014-05-19 10:47:36.912810 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:40.859470) v2 ==== 47+0+0 (3677619673 0 0) 0xac32540 con 0x94e3e40 -764> 2014-05-19 10:47:36.912826 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:40.859470) v2 -- ?+0 0xa102a80 con 0x9bb69a0 -763> 2014-05-19 10:47:36.912857 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -762> 2014-05-19 10:47:36.912904 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:40.859470) v2 -- ?+0 0xa507dc0 con 0x94e3e40 -761> 2014-05-19 10:47:36.912983 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -760> 2014-05-19 10:47:36.926681 7f5566602700 5 osd.0 245 tick -759> 2014-05-19 10:47:36.926706 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -758> 2014-05-19 10:47:36.926711 7f5566602700 10 osd.0 245 do_waiters -- start -757> 2014-05-19 10:47:36.926714 7f5566602700 10 osd.0 245 do_waiters -- finish -756> 2014-05-19 10:47:36.926751 7f555119d700 20 OSD::recovery_tp worker waiting -755> 2014-05-19 10:47:37.084009 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 70 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.691102) v2 ==== 47+0+0 (1278254245 0 0) 0x9fa4fc0 con 0x9656160 -754> 2014-05-19 10:47:37.084008 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 70 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.691102) v2 ==== 47+0+0 (1278254245 0 0) 0x9e9ea80 con 0x9656f20 -753> 2014-05-19 10:47:37.084061 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.691102) v2 -- ?+0 0xa092000 con 0x9656160 -752> 2014-05-19 10:47:37.084141 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -751> 2014-05-19 10:47:37.084299 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.691102) v2 -- ?+0 0xac32540 con 0x9656f20 -750> 2014-05-19 10:47:37.084344 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -749> 2014-05-19 10:47:37.112741 7f5564dff700 20 KeyValueStore::op_tp worker waiting -748> 2014-05-19 10:47:37.223184 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:41.169903) v2 ==== 47+0+0 (1903628427 0 0) 0x9ffd180 con 0x9743600 -747> 2014-05-19 10:47:37.223206 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:41.169903) v2 ==== 47+0+0 (1903628427 0 0) 0xac29a40 con 0x966e000 -746> 2014-05-19 10:47:37.223227 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:41.169903) v2 -- ?+0 0x9e9ea80 con 0x9743600 -745> 2014-05-19 10:47:37.223358 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -744> 2014-05-19 10:47:37.223385 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:41.169903) v2 -- ?+0 0x9fa4fc0 con 0x966e000 -743> 2014-05-19 10:47:37.223445 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -742> 2014-05-19 10:47:37.259239 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 69 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.866497) v2 ==== 47+0+0 (1741084485 0 0) 0xac15dc0 con 0x9b8c160 -741> 2014-05-19 10:47:37.259311 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.866497) v2 -- ?+0 0xac29a40 con 0x9b8c160 -740> 2014-05-19 10:47:37.259359 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 69 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.866497) v2 ==== 47+0+0 (1741084485 0 0) 0xac4cfc0 con 0x9aa3600 -739> 2014-05-19 10:47:37.259443 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -738> 2014-05-19 10:47:37.259469 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.866497) v2 -- ?+0 0x9ffd180 con 0x9aa3600 -737> 2014-05-19 10:47:37.259529 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -736> 2014-05-19 10:47:37.339604 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:41.286279) v2 ==== 47+0+0 (3692820745 0 0) 0xac46000 con 0x987b760 -735> 2014-05-19 10:47:37.339663 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:41.286279) v2 -- ?+0 0xac15dc0 con 0x987b760 -734> 2014-05-19 10:47:37.339700 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -733> 2014-05-19 10:47:37.339604 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:41.286279) v2 ==== 47+0+0 (3692820745 0 0) 0xa664fc0 con 0x94802c0 -732> 2014-05-19 10:47:37.340185 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:41.286279) v2 -- ?+0 0xac4cfc0 con 0x94802c0 -731> 2014-05-19 10:47:37.340254 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -730> 2014-05-19 10:47:37.451769 7f555019b700 20 OSD::command_tp worker waiting -729> 2014-05-19 10:47:37.454998 7f555099c700 20 OSD::disk_tp worker waiting -728> 2014-05-19 10:47:37.724512 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:41.671315) v2 ==== 47+0+0 (3612110304 0 0) 0xac28000 con 0x966e000 -727> 2014-05-19 10:47:37.724560 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:41.671315) v2 -- ?+0 0xac46000 con 0x966e000 -726> 2014-05-19 10:47:37.724565 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:41.671315) v2 ==== 47+0+0 (3612110304 0 0) 0x9ffd340 con 0x9743600 -725> 2014-05-19 10:47:37.724596 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -724> 2014-05-19 10:47:37.724664 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:41.671315) v2 -- ?+0 0xa664fc0 con 0x9743600 -723> 2014-05-19 10:47:37.724714 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -722> 2014-05-19 10:47:37.926782 7f5566602700 5 osd.0 245 tick -721> 2014-05-19 10:47:37.926802 7f5566602700 7 osd.0 245 do_mon_report -720> 2014-05-19 10:47:37.926806 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 -719> 2014-05-19 10:47:37.926810 7f5566602700 20 osd.0 245 send_pg_stats -718> 2014-05-19 10:47:37.926819 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -717> 2014-05-19 10:47:37.926823 7f5566602700 10 osd.0 245 do_waiters -- start -716> 2014-05-19 10:47:37.926824 7f5566602700 10 osd.0 245 do_waiters -- finish -715> 2014-05-19 10:47:37.926857 7f555119d700 20 OSD::recovery_tp worker waiting -714> 2014-05-19 10:47:38.182553 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:42.129297) v2 ==== 47+0+0 (3823195533 0 0) 0xac1a000 con 0x97431e0 -713> 2014-05-19 10:47:38.182606 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:42.129297) v2 -- ?+0 0x9ffd340 con 0x97431e0 -712> 2014-05-19 10:47:38.182587 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:42.129297) v2 ==== 47+0+0 (3823195533 0 0) 0xa103880 con 0x99718c0 -711> 2014-05-19 10:47:38.182638 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -710> 2014-05-19 10:47:38.182676 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:42.129297) v2 -- ?+0 0xac28000 con 0x99718c0 -709> 2014-05-19 10:47:38.182709 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -708> 2014-05-19 10:47:38.329500 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 77 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:40.936647) v2 ==== 47+0+0 (3358447541 0 0) 0xac34700 con 0x96562c0 -707> 2014-05-19 10:47:38.329531 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 77 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:40.936647) v2 ==== 47+0+0 (3358447541 0 0) 0xac28700 con 0x9657080 -706> 2014-05-19 10:47:38.329555 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:40.936647) v2 -- ?+0 0xa103880 con 0x96562c0 -705> 2014-05-19 10:47:38.329602 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -704> 2014-05-19 10:47:38.330121 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:40.936647) v2 -- ?+0 0xac1a000 con 0x9657080 -703> 2014-05-19 10:47:38.330152 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -702> 2014-05-19 10:47:38.376240 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -701> 2014-05-19 10:47:38.376261 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -700> 2014-05-19 10:47:38.376269 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xa266fc0 con 0x9bdc840 -699> 2014-05-19 10:47:38.376295 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xa857180 con 0x9ad4420 -698> 2014-05-19 10:47:38.376334 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xa44ca80 con 0x9bf31e0 -697> 2014-05-19 10:47:38.376349 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0x99e16c0 con 0x998b340 -696> 2014-05-19 10:47:38.376377 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xac48700 con 0x9b92840 -695> 2014-05-19 10:47:38.376392 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xa4a96c0 con 0x9ad49a0 -694> 2014-05-19 10:47:38.376407 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xac08700 con 0x7b911e0 -693> 2014-05-19 10:47:38.376431 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0x9209c00 con 0x7b918c0 -692> 2014-05-19 10:47:38.376463 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xac51c00 con 0x9aa8c60 -691> 2014-05-19 10:47:38.376508 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0x9f20fc0 con 0x9bfa000 -690> 2014-05-19 10:47:38.376536 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0x99e0000 con 0x7c23e40 -689> 2014-05-19 10:47:38.376564 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xac408c0 con 0x998b760 -688> 2014-05-19 10:47:38.376588 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xac28c40 con 0x7b91080 -687> 2014-05-19 10:47:38.376602 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0x9e9f6c0 con 0xa28fb80 -686> 2014-05-19 10:47:38.376628 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xac428c0 con 0x76bdce0 -685> 2014-05-19 10:47:38.376654 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xa0b7880 con 0x994ab00 -684> 2014-05-19 10:47:38.376654 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 78 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xa23f6c0 con 0x9bdc840 -683> 2014-05-19 10:47:38.376680 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0x9c6ea80 con 0x9ac8b00 -682> 2014-05-19 10:47:38.376706 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xa8721c0 con 0x938de40 -681> 2014-05-19 10:47:38.376732 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xa7d5a40 con 0x9970b00 -680> 2014-05-19 10:47:38.376751 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xac49c00 con 0x99706e0 -679> 2014-05-19 10:47:38.376770 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xa115a40 con 0x9bb6f20 -678> 2014-05-19 10:47:38.376793 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0x94641c0 con 0x994b340 -677> 2014-05-19 10:47:38.376807 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xa857c00 con 0x98fa2c0 -676> 2014-05-19 10:47:38.376825 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xa4ffdc0 con 0x996f8c0 -675> 2014-05-19 10:47:38.376851 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0x9236380 con 0x996fa20 -674> 2014-05-19 10:47:38.376878 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xac48540 con 0x9ac8160 -673> 2014-05-19 10:47:38.376904 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0x99e0540 con 0x7b90420 -672> 2014-05-19 10:47:38.376935 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xa36c1c0 con 0x919fe40 -671> 2014-05-19 10:47:38.376960 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0x9fece00 con 0x9971760 -670> 2014-05-19 10:47:38.376986 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xa0ebc00 con 0x994af20 -669> 2014-05-19 10:47:38.377012 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0x9ba4a80 con 0x989be40 -668> 2014-05-19 10:47:38.377037 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xa0dcc40 con 0x9adf4a0 -667> 2014-05-19 10:47:38.377062 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xa4a8380 con 0x9776160 -666> 2014-05-19 10:47:38.377090 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xac51180 con 0x96bd8c0 -665> 2014-05-19 10:47:38.377146 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xac31180 con 0x96bcdc0 -664> 2014-05-19 10:47:38.377174 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0x9c09180 con 0x96954a0 -663> 2014-05-19 10:47:38.377202 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0x9ccf180 con 0x76bd8c0 -662> 2014-05-19 10:47:38.377233 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xa0bd500 con 0x7b90dc0 -661> 2014-05-19 10:47:38.377337 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xa4ee540 con 0x978d8c0 -660> 2014-05-19 10:47:38.377359 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xac49180 con 0x978c580 -659> 2014-05-19 10:47:38.377384 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xac43a40 con 0x978d340 -658> 2014-05-19 10:47:38.377413 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:38.376268) v2 -- ?+0 0xa856e00 con 0x96374a0 -657> 2014-05-19 10:47:38.377457 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -656> 2014-05-19 10:47:38.377472 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 78 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xa6441c0 con 0x9ad4420 -655> 2014-05-19 10:47:38.377502 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -654> 2014-05-19 10:47:38.377532 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 77 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xa2de700 con 0x9bf31e0 -653> 2014-05-19 10:47:38.377554 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -652> 2014-05-19 10:47:38.377560 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 77 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xa0eaa80 con 0x998b340 -651> 2014-05-19 10:47:38.377575 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -650> 2014-05-19 10:47:38.377585 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 76 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0x95bcc40 con 0x9b92840 -649> 2014-05-19 10:47:38.377599 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -648> 2014-05-19 10:47:38.377605 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 76 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xac48380 con 0x9ad49a0 -647> 2014-05-19 10:47:38.377650 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -646> 2014-05-19 10:47:38.377688 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 73 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xa07a540 con 0x7b911e0 -645> 2014-05-19 10:47:38.377710 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -644> 2014-05-19 10:47:38.377719 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 73 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xa237dc0 con 0x7b918c0 -643> 2014-05-19 10:47:38.377733 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -642> 2014-05-19 10:47:38.377740 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 72 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xa856c40 con 0x9aa8c60 -641> 2014-05-19 10:47:38.377765 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -640> 2014-05-19 10:47:38.377790 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 72 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xa103180 con 0x9bfa000 -639> 2014-05-19 10:47:38.377810 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -638> 2014-05-19 10:47:38.377821 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 71 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xac33dc0 con 0x7c23e40 -637> 2014-05-19 10:47:38.377838 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -636> 2014-05-19 10:47:38.377846 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 71 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xac496c0 con 0x998b760 -635> 2014-05-19 10:47:38.377861 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -634> 2014-05-19 10:47:38.377878 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 71 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0x9faa1c0 con 0x7b91080 -633> 2014-05-19 10:47:38.377896 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -632> 2014-05-19 10:47:38.377904 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 71 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xa873500 con 0xa28fb80 -631> 2014-05-19 10:47:38.377918 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -630> 2014-05-19 10:47:38.377925 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 70 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xac43880 con 0x76bdce0 -629> 2014-05-19 10:47:38.377939 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -628> 2014-05-19 10:47:38.377947 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 70 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xac48a80 con 0x994ab00 -627> 2014-05-19 10:47:38.377961 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -626> 2014-05-19 10:47:38.377968 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xac42c40 con 0x9ac8b00 -625> 2014-05-19 10:47:38.377983 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -624> 2014-05-19 10:47:38.377990 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0x9f6c380 con 0x938de40 -623> 2014-05-19 10:47:38.378004 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -622> 2014-05-19 10:47:38.378012 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xa208c40 con 0x9970b00 -621> 2014-05-19 10:47:38.378027 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -620> 2014-05-19 10:47:38.378035 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xac40fc0 con 0x99706e0 -619> 2014-05-19 10:47:38.378048 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -618> 2014-05-19 10:47:38.378058 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0x9ed0000 con 0x9bb6f20 -617> 2014-05-19 10:47:38.378075 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -616> 2014-05-19 10:47:38.378082 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xac368c0 con 0x994b340 -615> 2014-05-19 10:47:38.378096 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -614> 2014-05-19 10:47:38.378104 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xac51a40 con 0x98fa2c0 -613> 2014-05-19 10:47:38.378119 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -612> 2014-05-19 10:47:38.378126 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xa093880 con 0x996f8c0 -611> 2014-05-19 10:47:38.378140 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -610> 2014-05-19 10:47:38.378148 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xa4ffa40 con 0x996fa20 -609> 2014-05-19 10:47:38.378162 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -608> 2014-05-19 10:47:38.378169 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xa1e4380 con 0x9ac8160 -607> 2014-05-19 10:47:38.378183 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -606> 2014-05-19 10:47:38.378191 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xac2ba40 con 0x7b90420 -605> 2014-05-19 10:47:38.378205 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -604> 2014-05-19 10:47:38.378212 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xac4a1c0 con 0x919fe40 -603> 2014-05-19 10:47:38.378226 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -602> 2014-05-19 10:47:38.378234 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xa36ddc0 con 0x9971760 -601> 2014-05-19 10:47:38.378251 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -600> 2014-05-19 10:47:38.378259 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 64 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0x9ba41c0 con 0x994af20 -599> 2014-05-19 10:47:38.378273 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -598> 2014-05-19 10:47:38.378280 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xa2096c0 con 0x989be40 -597> 2014-05-19 10:47:38.378295 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -596> 2014-05-19 10:47:38.378302 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xac43500 con 0x9adf4a0 -595> 2014-05-19 10:47:38.378316 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -594> 2014-05-19 10:47:38.378323 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xa6aafc0 con 0x9776160 -593> 2014-05-19 10:47:38.378337 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -592> 2014-05-19 10:47:38.378344 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xa36d180 con 0x96bd8c0 -591> 2014-05-19 10:47:38.378358 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -590> 2014-05-19 10:47:38.378368 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xac33500 con 0x96bcdc0 -589> 2014-05-19 10:47:38.378384 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -588> 2014-05-19 10:47:38.378391 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xa078c40 con 0x96954a0 -587> 2014-05-19 10:47:38.378409 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -586> 2014-05-19 10:47:38.378417 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xa0bc540 con 0x76bd8c0 -585> 2014-05-19 10:47:38.378435 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -584> 2014-05-19 10:47:38.378442 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xac09dc0 con 0x7b90dc0 -583> 2014-05-19 10:47:38.378456 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -582> 2014-05-19 10:47:38.378460 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0x9c08a80 con 0x978d8c0 -581> 2014-05-19 10:47:38.378475 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -580> 2014-05-19 10:47:38.378484 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xa4d0380 con 0x978c580 -579> 2014-05-19 10:47:38.378501 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -578> 2014-05-19 10:47:38.378509 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xac50e00 con 0x978d340 -577> 2014-05-19 10:47:38.378523 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -576> 2014-05-19 10:47:38.378531 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 58 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.376268) v2 ==== 47+0+0 (647946319 0 0) 0xac30c40 con 0x96374a0 -575> 2014-05-19 10:47:38.378545 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -574> 2014-05-19 10:47:38.392022 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:42.338730) v2 ==== 47+0+0 (2973209556 0 0) 0xac34000 con 0x95142c0 -573> 2014-05-19 10:47:38.392075 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:42.338730) v2 -- ?+0 0xac28700 con 0x95142c0 -572> 2014-05-19 10:47:38.392113 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -571> 2014-05-19 10:47:38.392138 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:42.338730) v2 ==== 47+0+0 (2973209556 0 0) 0x9706c40 con 0x99d31e0 -570> 2014-05-19 10:47:38.392170 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:42.338730) v2 -- ?+0 0xac34700 con 0x99d31e0 -569> 2014-05-19 10:47:38.392247 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -568> 2014-05-19 10:47:38.515457 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 75 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:38.515275) v2 ==== 47+0+0 (2189155179 0 0) 0xa44ca80 con 0x9656580 -567> 2014-05-19 10:47:38.515501 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.515275) v2 -- ?+0 0x9706c40 con 0x9656580 -566> 2014-05-19 10:47:38.515549 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -565> 2014-05-19 10:47:38.515492 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 75 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:38.515275) v2 ==== 47+0+0 (2189155179 0 0) 0xac44540 con 0x9657340 -564> 2014-05-19 10:47:38.515567 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:38.515275) v2 -- ?+0 0xac34000 con 0x9657340 -563> 2014-05-19 10:47:38.515649 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -562> 2014-05-19 10:47:38.529502 7f5565600700 20 KeyValueStore::op_tp worker waiting -561> 2014-05-19 10:47:38.531381 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:42.478191) v2 ==== 47+0+0 (2177244102 0 0) 0xac4ec40 con 0x987b340 -560> 2014-05-19 10:47:38.531437 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:42.478191) v2 -- ?+0 0xa44ca80 con 0x987b340 -559> 2014-05-19 10:47:38.531521 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -558> 2014-05-19 10:47:38.531605 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:42.478191) v2 ==== 47+0+0 (2177244102 0 0) 0xac4d880 con 0x94e26e0 -557> 2014-05-19 10:47:38.531649 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:42.478191) v2 -- ?+0 0xac44540 con 0x94e26e0 -556> 2014-05-19 10:47:38.531756 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -555> 2014-05-19 10:47:38.771237 7f55579aa700 20 OSD::op_tp worker waiting -554> 2014-05-19 10:47:38.771265 7f55551a5700 20 OSD::op_tp worker waiting -553> 2014-05-19 10:47:38.771286 7f555a1af700 20 OSD::op_tp worker waiting -552> 2014-05-19 10:47:38.772852 7f555b1b1700 20 OSD::op_tp worker waiting -551> 2014-05-19 10:47:38.772870 7f55569a8700 20 OSD::op_tp worker waiting -550> 2014-05-19 10:47:38.772890 7f55549a4700 20 OSD::op_tp worker waiting -549> 2014-05-19 10:47:38.772912 7f55541a3700 20 OSD::op_tp worker waiting -548> 2014-05-19 10:47:38.772925 7f555a9b0700 20 OSD::op_tp worker waiting -547> 2014-05-19 10:47:38.772946 7f55589ac700 20 OSD::op_tp worker waiting -546> 2014-05-19 10:47:38.773253 7f55581ab700 20 OSD::op_tp worker waiting -545> 2014-05-19 10:47:38.773282 7f55599ae700 20 OSD::op_tp worker waiting -544> 2014-05-19 10:47:38.773307 7f55571a9700 20 OSD::op_tp worker waiting -543> 2014-05-19 10:47:38.773407 7f55531a1700 20 OSD::op_tp worker waiting -542> 2014-05-19 10:47:38.773439 7f55591ad700 20 OSD::op_tp worker waiting -541> 2014-05-19 10:47:38.773463 7f555199e700 20 OSD::op_tp worker waiting -540> 2014-05-19 10:47:38.773468 7f55529a0700 20 OSD::op_tp worker waiting -539> 2014-05-19 10:47:38.773485 7f55561a7700 20 OSD::op_tp worker waiting -538> 2014-05-19 10:47:38.773508 7f55539a2700 20 OSD::op_tp worker waiting -537> 2014-05-19 10:47:38.773531 7f555219f700 20 OSD::op_tp worker waiting -536> 2014-05-19 10:47:38.773563 7f55559a6700 20 OSD::op_tp worker waiting -535> 2014-05-19 10:47:38.826012 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:42.772757) v2 ==== 47+0+0 (1767744426 0 0) 0xac28e00 con 0x966e000 -534> 2014-05-19 10:47:38.826064 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:42.772757) v2 -- ?+0 0xac4ec40 con 0x966e000 -533> 2014-05-19 10:47:38.826166 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -532> 2014-05-19 10:47:38.826541 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:42.772757) v2 ==== 47+0+0 (1767744426 0 0) 0x9ffc000 con 0x9743600 -531> 2014-05-19 10:47:38.826630 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:42.772757) v2 -- ?+0 0xac4d880 con 0x9743600 -530> 2014-05-19 10:47:38.826707 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -529> 2014-05-19 10:47:38.828419 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:41.435610) v2 ==== 47+0+0 (3215848056 0 0) 0x9cd0c40 con 0x996fb80 -528> 2014-05-19 10:47:38.828489 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:41.435610) v2 -- ?+0 0xac28e00 con 0x996fb80 -527> 2014-05-19 10:47:38.828521 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -526> 2014-05-19 10:47:38.828533 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:41.435610) v2 ==== 47+0+0 (3215848056 0 0) 0xa4fefc0 con 0x9a0cdc0 -525> 2014-05-19 10:47:38.828585 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:41.435610) v2 -- ?+0 0x9ffc000 con 0x9a0cdc0 -524> 2014-05-19 10:47:38.828958 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -523> 2014-05-19 10:47:38.926886 7f5566602700 5 osd.0 245 tick -522> 2014-05-19 10:47:38.926909 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -521> 2014-05-19 10:47:38.926915 7f5566602700 10 osd.0 245 do_waiters -- start -520> 2014-05-19 10:47:38.926918 7f5566602700 10 osd.0 245 do_waiters -- finish -519> 2014-05-19 10:47:38.926946 7f555119d700 20 OSD::recovery_tp worker waiting -518> 2014-05-19 10:47:38.995200 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:42.941943) v2 ==== 47+0+0 (1788417508 0 0) 0x9fb5a40 con 0x99d3340 -517> 2014-05-19 10:47:38.995252 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:42.941943) v2 -- ?+0 0x9cd0c40 con 0x99d3340 -516> 2014-05-19 10:47:38.995330 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -515> 2014-05-19 10:47:38.995588 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:42.941943) v2 ==== 47+0+0 (1788417508 0 0) 0xac22380 con 0x94a5a20 -514> 2014-05-19 10:47:38.995633 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:42.941943) v2 -- ?+0 0xa4fefc0 con 0x94a5a20 -513> 2014-05-19 10:47:38.995709 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -512> 2014-05-19 10:47:39.112837 7f5564dff700 20 KeyValueStore::op_tp worker waiting -511> 2014-05-19 10:47:39.133768 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.28 172.16.96.202:0/109564 70 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:41.740923) v2 ==== 47+0+0 (2630085583 0 0) 0x9c58fc0 con 0x7b90160 -510> 2014-05-19 10:47:39.133820 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:41.740923) v2 -- ?+0 0xac22380 con 0x7b90160 -509> 2014-05-19 10:47:39.133812 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.28 172.16.96.202:0/109564 70 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:41.740923) v2 ==== 47+0+0 (2630085583 0 0) 0xac4f880 con 0x9b8db80 -508> 2014-05-19 10:47:39.133909 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -507> 2014-05-19 10:47:39.134083 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109564 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:41.740923) v2 -- ?+0 0x9fb5a40 con 0x9b8db80 -506> 2014-05-19 10:47:39.134262 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -505> 2014-05-19 10:47:39.327355 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:43.274180) v2 ==== 47+0+0 (3927474446 0 0) 0xac29340 con 0x966e000 -504> 2014-05-19 10:47:39.327397 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:43.274180) v2 -- ?+0 0xac4f880 con 0x966e000 -503> 2014-05-19 10:47:39.327478 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -502> 2014-05-19 10:47:39.327418 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:43.274180) v2 ==== 47+0+0 (3927474446 0 0) 0xa2e0fc0 con 0x9743600 -501> 2014-05-19 10:47:39.327510 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:43.274180) v2 -- ?+0 0x9c58fc0 con 0x9743600 -500> 2014-05-19 10:47:39.328064 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -499> 2014-05-19 10:47:39.329918 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 67 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:41.937083) v2 ==== 47+0+0 (52365880 0 0) 0xa506700 con 0x9a0cdc0 -498> 2014-05-19 10:47:39.329956 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 67 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:41.937083) v2 ==== 47+0+0 (52365880 0 0) 0xac22c40 con 0x996fb80 -497> 2014-05-19 10:47:39.329991 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:41.937083) v2 -- ?+0 0xa2e0fc0 con 0x9a0cdc0 -496> 2014-05-19 10:47:39.330460 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -495> 2014-05-19 10:47:39.330524 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:41.937083) v2 -- ?+0 0xac29340 con 0x996fb80 -494> 2014-05-19 10:47:39.330563 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -493> 2014-05-19 10:47:39.451870 7f555019b700 20 OSD::command_tp worker waiting -492> 2014-05-19 10:47:39.455080 7f555099c700 20 OSD::disk_tp worker waiting -491> 2014-05-19 10:47:39.600495 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:43.547231) v2 ==== 47+0+0 (2677146418 0 0) 0x9fd9340 con 0x987af20 -490> 2014-05-19 10:47:39.600547 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:43.547231) v2 -- ?+0 0xac22c40 con 0x987af20 -489> 2014-05-19 10:47:39.600578 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -488> 2014-05-19 10:47:39.600925 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 54 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:43.547231) v2 ==== 47+0+0 (2677146418 0 0) 0x9e9f500 con 0x99f1080 -487> 2014-05-19 10:47:39.600966 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:43.547231) v2 -- ?+0 0xa506700 con 0x99f1080 -486> 2014-05-19 10:47:39.600998 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -485> 2014-05-19 10:47:39.617082 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 76 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.616903) v2 ==== 47+0+0 (3288877581 0 0) 0xa3db880 con 0x9656580 -484> 2014-05-19 10:47:39.617130 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 76 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:39.616903) v2 ==== 47+0+0 (3288877581 0 0) 0xac44380 con 0x9657340 -483> 2014-05-19 10:47:39.617144 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.616903) v2 -- ?+0 0x9fd9340 con 0x9656580 -482> 2014-05-19 10:47:39.617217 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -481> 2014-05-19 10:47:39.617248 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:39.616903) v2 -- ?+0 0x9e9f500 con 0x9657340 -480> 2014-05-19 10:47:39.617298 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -479> 2014-05-19 10:47:39.788158 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 73 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:42.395316) v2 ==== 47+0+0 (2535174861 0 0) 0xa464540 con 0x9656000 -478> 2014-05-19 10:47:39.788172 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 73 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:42.395316) v2 ==== 47+0+0 (2535174861 0 0) 0xac1bdc0 con 0x9937760 -477> 2014-05-19 10:47:39.788209 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:42.395316) v2 -- ?+0 0xa3db880 con 0x9656000 -476> 2014-05-19 10:47:39.788247 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -475> 2014-05-19 10:47:39.788495 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:42.395316) v2 -- ?+0 0xac44380 con 0x9937760 -474> 2014-05-19 10:47:39.788586 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -473> 2014-05-19 10:47:39.926996 7f5566602700 5 osd.0 245 tick -472> 2014-05-19 10:47:39.927051 7f5566602700 20 osd.0 245 scrub_should_schedule loadavg 1.01 >= max 0.5 = no, load too high -471> 2014-05-19 10:47:39.927064 7f5566602700 20 osd.0 245 sched_scrub load_is_low=0 -470> 2014-05-19 10:47:39.927065 7f555119d700 20 OSD::recovery_tp worker waiting -469> 2014-05-19 10:47:39.927067 7f5566602700 10 osd.0 245 sched_scrub 0.4 at 2014-05-19 10:09:39.464620: 2280.46 < min (86400 seconds) -468> 2014-05-19 10:47:39.927086 7f5566602700 20 osd.0 245 sched_scrub done -467> 2014-05-19 10:47:39.927089 7f5566602700 10 osd.0 245 do_waiters -- start -466> 2014-05-19 10:47:39.927090 7f5566602700 10 osd.0 245 do_waiters -- finish -465> 2014-05-19 10:47:39.985493 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 71 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:42.592677) v2 ==== 47+0+0 (1117385061 0 0) 0xac42e00 con 0x9656160 -464> 2014-05-19 10:47:39.985494 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 71 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:42.592677) v2 ==== 47+0+0 (1117385061 0 0) 0xa2dee00 con 0x9656f20 -463> 2014-05-19 10:47:39.985550 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:42.592677) v2 -- ?+0 0xa464540 con 0x9656160 -462> 2014-05-19 10:47:39.985616 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -461> 2014-05-19 10:47:39.986031 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:42.592677) v2 -- ?+0 0xac1bdc0 con 0x9656f20 -460> 2014-05-19 10:47:39.986069 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -459> 2014-05-19 10:47:40.030969 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 78 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:42.638141) v2 ==== 47+0+0 (3482397728 0 0) 0xa2de8c0 con 0x96562c0 -458> 2014-05-19 10:47:40.030988 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 78 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:42.638141) v2 ==== 47+0+0 (3482397728 0 0) 0x9f21c00 con 0x9657080 -457> 2014-05-19 10:47:40.031017 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:42.638141) v2 -- ?+0 0xac42e00 con 0x96562c0 -456> 2014-05-19 10:47:40.031125 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -455> 2014-05-19 10:47:40.031216 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:42.638141) v2 -- ?+0 0xa2dee00 con 0x9657080 -454> 2014-05-19 10:47:40.031318 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -453> 2014-05-19 10:47:40.093261 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:44.040041) v2 ==== 47+0+0 (719489791 0 0) 0x9b44700 con 0x99d31e0 -452> 2014-05-19 10:47:40.093308 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.040041) v2 -- ?+0 0xa2de8c0 con 0x99d31e0 -451> 2014-05-19 10:47:40.093384 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -450> 2014-05-19 10:47:40.093669 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:44.040041) v2 ==== 47+0+0 (719489791 0 0) 0xac35340 con 0x95142c0 -449> 2014-05-19 10:47:40.093708 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.040041) v2 -- ?+0 0x9f21c00 con 0x95142c0 -448> 2014-05-19 10:47:40.093812 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -447> 2014-05-19 10:47:40.113734 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:44.060510) v2 ==== 47+0+0 (752576815 0 0) 0x9464000 con 0x9bb7b80 -446> 2014-05-19 10:47:40.113737 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 58 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:44.060510) v2 ==== 47+0+0 (752576815 0 0) 0xac4ba40 con 0x95151e0 -445> 2014-05-19 10:47:40.113785 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.060510) v2 -- ?+0 0x9b44700 con 0x9bb7b80 -444> 2014-05-19 10:47:40.113870 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -443> 2014-05-19 10:47:40.113952 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.060510) v2 -- ?+0 0xac35340 con 0x95151e0 -442> 2014-05-19 10:47:40.113990 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -441> 2014-05-19 10:47:40.167207 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 71 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:42.774423) v2 ==== 47+0+0 (4088185000 0 0) 0xa1eec40 con 0x95846e0 -440> 2014-05-19 10:47:40.167261 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:42.774423) v2 -- ?+0 0x9464000 con 0x95846e0 -439> 2014-05-19 10:47:40.167346 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 71 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:42.774423) v2 ==== 47+0+0 (4088185000 0 0) 0xac49880 con 0x9983600 -438> 2014-05-19 10:47:40.167451 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -437> 2014-05-19 10:47:40.167475 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:42.774423) v2 -- ?+0 0xac4ba40 con 0x9983600 -436> 2014-05-19 10:47:40.167508 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -435> 2014-05-19 10:47:40.240805 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:44.187620) v2 ==== 47+0+0 (997811358 0 0) 0x95636c0 con 0x987b760 -434> 2014-05-19 10:47:40.240866 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.187620) v2 -- ?+0 0xa1eec40 con 0x987b760 -433> 2014-05-19 10:47:40.240944 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -432> 2014-05-19 10:47:40.240804 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 56 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:44.187620) v2 ==== 47+0+0 (997811358 0 0) 0xa665340 con 0x94802c0 -431> 2014-05-19 10:47:40.241142 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.187620) v2 -- ?+0 0xac49880 con 0x94802c0 -430> 2014-05-19 10:47:40.241220 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -429> 2014-05-19 10:47:40.385808 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:44.332699) v2 ==== 47+0+0 (852998240 0 0) 0x9e101c0 con 0x9970840 -428> 2014-05-19 10:47:40.385858 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.332699) v2 -- ?+0 0x95636c0 con 0x9970840 -427> 2014-05-19 10:47:40.385900 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -426> 2014-05-19 10:47:40.386342 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:44.332699) v2 ==== 47+0+0 (852998240 0 0) 0xac08fc0 con 0x97434a0 -425> 2014-05-19 10:47:40.386381 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.332699) v2 -- ?+0 0xa665340 con 0x97434a0 -424> 2014-05-19 10:47:40.386410 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -423> 2014-05-19 10:47:40.529590 7f5565600700 20 KeyValueStore::op_tp worker waiting -422> 2014-05-19 10:47:40.673024 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:43.280122) v2 ==== 47+0+0 (336938380 0 0) 0xac35880 con 0x94e2160 -421> 2014-05-19 10:47:40.673081 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:43.280122) v2 -- ?+0 0xac08fc0 con 0x94e2160 -420> 2014-05-19 10:47:40.672954 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 65 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:43.280122) v2 ==== 47+0+0 (336938380 0 0) 0xa1efc00 con 0x9b8de40 -419> 2014-05-19 10:47:40.673526 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -418> 2014-05-19 10:47:40.673558 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:43.280122) v2 -- ?+0 0x9e101c0 con 0x9b8de40 -417> 2014-05-19 10:47:40.673645 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -416> 2014-05-19 10:47:40.771339 7f55579aa700 20 OSD::op_tp worker waiting -415> 2014-05-19 10:47:40.771366 7f555a1af700 20 OSD::op_tp worker waiting -414> 2014-05-19 10:47:40.771394 7f55551a5700 20 OSD::op_tp worker waiting -413> 2014-05-19 10:47:40.772950 7f55569a8700 20 OSD::op_tp worker waiting -412> 2014-05-19 10:47:40.772975 7f555b1b1700 20 OSD::op_tp worker waiting -411> 2014-05-19 10:47:40.772988 7f55549a4700 20 OSD::op_tp worker waiting -410> 2014-05-19 10:47:40.773010 7f55541a3700 20 OSD::op_tp worker waiting -409> 2014-05-19 10:47:40.773024 7f55589ac700 20 OSD::op_tp worker waiting -408> 2014-05-19 10:47:40.773060 7f555a9b0700 20 OSD::op_tp worker waiting -407> 2014-05-19 10:47:40.773316 7f55581ab700 20 OSD::op_tp worker waiting -406> 2014-05-19 10:47:40.773346 7f55599ae700 20 OSD::op_tp worker waiting -405> 2014-05-19 10:47:40.773379 7f55571a9700 20 OSD::op_tp worker waiting -404> 2014-05-19 10:47:40.773475 7f55531a1700 20 OSD::op_tp worker waiting -403> 2014-05-19 10:47:40.773500 7f55591ad700 20 OSD::op_tp worker waiting -402> 2014-05-19 10:47:40.773523 7f555199e700 20 OSD::op_tp worker waiting -401> 2014-05-19 10:47:40.773528 7f55529a0700 20 OSD::op_tp worker waiting -400> 2014-05-19 10:47:40.773545 7f55561a7700 20 OSD::op_tp worker waiting -399> 2014-05-19 10:47:40.773571 7f55539a2700 20 OSD::op_tp worker waiting -398> 2014-05-19 10:47:40.773590 7f555219f700 20 OSD::op_tp worker waiting -397> 2014-05-19 10:47:40.773626 7f55559a6700 20 OSD::op_tp worker waiting -396> 2014-05-19 10:47:40.927162 7f5566602700 5 osd.0 245 tick -395> 2014-05-19 10:47:40.927189 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -394> 2014-05-19 10:47:40.927194 7f5566602700 10 osd.0 245 do_waiters -- start -393> 2014-05-19 10:47:40.927196 7f5566602700 10 osd.0 245 do_waiters -- finish -392> 2014-05-19 10:47:40.927231 7f555119d700 20 OSD::recovery_tp worker waiting -391> 2014-05-19 10:47:41.112925 7f5564dff700 20 KeyValueStore::op_tp worker waiting -390> 2014-05-19 10:47:41.301560 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.48 172.16.96.203:0/109324 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:45.248388) v2 ==== 47+0+0 (2592597427 0 0) 0xa092700 con 0x99f1080 -389> 2014-05-19 10:47:41.301582 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.48 172.16.96.203:0/109324 55 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:45.248388) v2 ==== 47+0+0 (2592597427 0 0) 0x9fb4c40 con 0x987af20 -388> 2014-05-19 10:47:41.301615 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:45.248388) v2 -- ?+0 0xac35880 con 0x99f1080 -387> 2014-05-19 10:47:41.301738 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -386> 2014-05-19 10:47:41.301848 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109324 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:45.248388) v2 -- ?+0 0xa1efc00 con 0x987af20 -385> 2014-05-19 10:47:41.301931 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -384> 2014-05-19 10:47:41.318759 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.1 172.16.96.201:0/37984 77 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:41.318564) v2 ==== 47+0+0 (3603196874 0 0) 0xac441c0 con 0x9657340 -383> 2014-05-19 10:47:41.318810 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:41.318564) v2 -- ?+0 0xa092700 con 0x9657340 -382> 2014-05-19 10:47:41.318899 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -381> 2014-05-19 10:47:41.318751 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.1 172.16.96.201:0/37984 77 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:41.318564) v2 ==== 47+0+0 (3603196874 0 0) 0xa3dba40 con 0x9656580 -380> 2014-05-19 10:47:41.318934 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.201:0/37984 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:41.318564) v2 -- ?+0 0x9fb4c40 con 0x9656580 -379> 2014-05-19 10:47:41.318982 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -378> 2014-05-19 10:47:41.451972 7f555019b700 20 OSD::command_tp worker waiting -377> 2014-05-19 10:47:41.455162 7f555099c700 20 OSD::disk_tp worker waiting -376> 2014-05-19 10:47:41.683850 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.46 172.16.96.203:0/108547 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:45.630720) v2 ==== 47+0+0 (858283123 0 0) 0xa103500 con 0x99718c0 -375> 2014-05-19 10:47:41.683860 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.46 172.16.96.203:0/108547 63 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:45.630720) v2 ==== 47+0+0 (858283123 0 0) 0xa644c40 con 0x97431e0 -374> 2014-05-19 10:47:41.683902 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:45.630720) v2 -- ?+0 0xa3dba40 con 0x99718c0 -373> 2014-05-19 10:47:41.683931 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -372> 2014-05-19 10:47:41.684273 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108547 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:45.630720) v2 -- ?+0 0xac441c0 con 0x97431e0 -371> 2014-05-19 10:47:41.684319 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -370> 2014-05-19 10:47:41.814955 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.41 172.16.96.203:0/106171 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:45.761833) v2 ==== 47+0+0 (3060388344 0 0) 0xac4b880 con 0x95151e0 -369> 2014-05-19 10:47:41.814971 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.41 172.16.96.203:0/106171 59 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:45.761833) v2 ==== 47+0+0 (3060388344 0 0) 0xa1e5500 con 0x9bb7b80 -368> 2014-05-19 10:47:41.815005 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:45.761833) v2 -- ?+0 0xa644c40 con 0x95151e0 -367> 2014-05-19 10:47:41.815032 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -366> 2014-05-19 10:47:41.815100 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106171 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:45.761833) v2 -- ?+0 0xa103500 con 0x9bb7b80 -365> 2014-05-19 10:47:41.815195 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -364> 2014-05-19 10:47:41.927271 7f5566602700 5 osd.0 245 tick -363> 2014-05-19 10:47:41.927297 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -362> 2014-05-19 10:47:41.927302 7f5566602700 10 osd.0 245 do_waiters -- start -361> 2014-05-19 10:47:41.927304 7f5566602700 10 osd.0 245 do_waiters -- finish -360> 2014-05-19 10:47:41.927340 7f555119d700 20 OSD::recovery_tp worker waiting -359> 2014-05-19 10:47:42.032730 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.44 172.16.96.203:0/107600 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:45.979633) v2 ==== 47+0+0 (1530475980 0 0) 0xac4d6c0 con 0x94e26e0 -358> 2014-05-19 10:47:42.032676 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.44 172.16.96.203:0/107600 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:45.979633) v2 ==== 47+0+0 (1530475980 0 0) 0xac4ea80 con 0x987b340 -357> 2014-05-19 10:47:42.032781 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:45.979633) v2 -- ?+0 0xac4b880 con 0x94e26e0 -356> 2014-05-19 10:47:42.033322 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -355> 2014-05-19 10:47:42.033384 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107600 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:45.979633) v2 -- ?+0 0xa1e5500 con 0x987b340 -354> 2014-05-19 10:47:42.033466 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -353> 2014-05-19 10:47:42.070107 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.25 172.16.96.202:0/108152 67 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:44.677309) v2 ==== 47+0+0 (4266437144 0 0) 0x9ebbdc0 con 0x996e000 -352> 2014-05-19 10:47:42.070157 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.677309) v2 -- ?+0 0xac4ea80 con 0x996e000 -351> 2014-05-19 10:47:42.070189 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -350> 2014-05-19 10:47:42.070320 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.25 172.16.96.202:0/108152 67 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:44.677309) v2 ==== 47+0+0 (4266437144 0 0) 0xac15500 con 0x9a0c9a0 -349> 2014-05-19 10:47:42.070361 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108152 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.677309) v2 -- ?+0 0xac4d6c0 con 0x9a0c9a0 -348> 2014-05-19 10:47:42.070443 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -347> 2014-05-19 10:47:42.087100 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.47 172.16.96.203:0/108981 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:46.034053) v2 ==== 47+0+0 (1674287131 0 0) 0x9e11dc0 con 0x9970840 -346> 2014-05-19 10:47:42.087154 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:46.034053) v2 -- ?+0 0x9ebbdc0 con 0x9970840 -345> 2014-05-19 10:47:42.087189 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -344> 2014-05-19 10:47:42.087329 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.47 172.16.96.203:0/108981 60 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:46.034053) v2 ==== 47+0+0 (1674287131 0 0) 0xac47a40 con 0x97434a0 -343> 2014-05-19 10:47:42.087376 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/108981 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:46.034053) v2 -- ?+0 0xac15500 con 0x97434a0 -342> 2014-05-19 10:47:42.087461 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -341> 2014-05-19 10:47:42.213918 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.40 172.16.96.203:0/105719 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:46.160797) v2 ==== 47+0+0 (2537157286 0 0) 0xac32380 con 0x94e3e40 -340> 2014-05-19 10:47:42.213928 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.40 172.16.96.203:0/105719 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:46.160797) v2 ==== 47+0+0 (2537157286 0 0) 0xa092a80 con 0x9bb69a0 -339> 2014-05-19 10:47:42.213966 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:46.160797) v2 -- ?+0 0xac47a40 con 0x94e3e40 -338> 2014-05-19 10:47:42.213992 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -337> 2014-05-19 10:47:42.214277 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/105719 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:46.160797) v2 -- ?+0 0x9e11dc0 con 0x9bb69a0 -336> 2014-05-19 10:47:42.214363 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -335> 2014-05-19 10:47:42.364251 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.20 172.16.96.202:0/105880 78 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:44.971413) v2 ==== 47+0+0 (1632241353 0 0) 0xac37dc0 con 0x9656420 -334> 2014-05-19 10:47:42.364302 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.971413) v2 -- ?+0 0xa092a80 con 0x9656420 -333> 2014-05-19 10:47:42.364435 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -332> 2014-05-19 10:47:42.364435 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.20 172.16.96.202:0/105880 78 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:44.971413) v2 ==== 47+0+0 (1632241353 0 0) 0x9e77880 con 0x96571e0 -331> 2014-05-19 10:47:42.364473 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/105880 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.971413) v2 -- ?+0 0xac32380 con 0x96571e0 -330> 2014-05-19 10:47:42.364506 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -329> 2014-05-19 10:47:42.529689 7f5565600700 20 KeyValueStore::op_tp worker waiting -328> 2014-05-19 10:47:42.771443 7f55579aa700 20 OSD::op_tp worker waiting -327> 2014-05-19 10:47:42.771481 7f55551a5700 20 OSD::op_tp worker waiting -326> 2014-05-19 10:47:42.771503 7f555a1af700 20 OSD::op_tp worker waiting -325> 2014-05-19 10:47:42.773051 7f55569a8700 20 OSD::op_tp worker waiting -324> 2014-05-19 10:47:42.773075 7f555b1b1700 20 OSD::op_tp worker waiting -323> 2014-05-19 10:47:42.773098 7f55541a3700 20 OSD::op_tp worker waiting -322> 2014-05-19 10:47:42.773132 7f555a9b0700 20 OSD::op_tp worker waiting -321> 2014-05-19 10:47:42.773153 7f55589ac700 20 OSD::op_tp worker waiting -320> 2014-05-19 10:47:42.773176 7f55549a4700 20 OSD::op_tp worker waiting -319> 2014-05-19 10:47:42.773378 7f55581ab700 20 OSD::op_tp worker waiting -318> 2014-05-19 10:47:42.773407 7f55599ae700 20 OSD::op_tp worker waiting -317> 2014-05-19 10:47:42.773445 7f55571a9700 20 OSD::op_tp worker waiting -316> 2014-05-19 10:47:42.773557 7f55531a1700 20 OSD::op_tp worker waiting -315> 2014-05-19 10:47:42.773579 7f55591ad700 20 OSD::op_tp worker waiting -314> 2014-05-19 10:47:42.773599 7f55529a0700 20 OSD::op_tp worker waiting -313> 2014-05-19 10:47:42.773608 7f55561a7700 20 OSD::op_tp worker waiting -312> 2014-05-19 10:47:42.773626 7f555199e700 20 OSD::op_tp worker waiting -311> 2014-05-19 10:47:42.773641 7f55539a2700 20 OSD::op_tp worker waiting -310> 2014-05-19 10:47:42.773651 7f555219f700 20 OSD::op_tp worker waiting -309> 2014-05-19 10:47:42.773731 7f55559a6700 20 OSD::op_tp worker waiting -308> 2014-05-19 10:47:42.831418 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 68 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:45.438603) v2 ==== 47+0+0 (4174457083 0 0) 0x9e6ddc0 con 0x9a0cdc0 -307> 2014-05-19 10:47:42.831417 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 68 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:45.438603) v2 ==== 47+0+0 (4174457083 0 0) 0xac23a40 con 0x996fb80 -306> 2014-05-19 10:47:42.831485 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:45.438603) v2 -- ?+0 0xac37dc0 con 0x996fb80 -305> 2014-05-19 10:47:42.831522 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -304> 2014-05-19 10:47:42.831590 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:45.438603) v2 -- ?+0 0x9e77880 con 0x9a0cdc0 -303> 2014-05-19 10:47:42.831673 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -302> 2014-05-19 10:47:42.927368 7f5566602700 5 osd.0 245 tick -301> 2014-05-19 10:47:42.927389 7f5566602700 7 osd.0 245 do_mon_report -300> 2014-05-19 10:47:42.927393 7f5566602700 10 osd.0 245 send_alive up_thru currently 236 want 236 -299> 2014-05-19 10:47:42.927399 7f5566602700 20 osd.0 245 send_pg_stats -298> 2014-05-19 10:47:42.927410 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -297> 2014-05-19 10:47:42.927415 7f5566602700 10 osd.0 245 do_waiters -- start -296> 2014-05-19 10:47:42.927419 7f5566602700 10 osd.0 245 do_waiters -- finish -295> 2014-05-19 10:47:42.927448 7f555119d700 20 OSD::recovery_tp worker waiting -294> 2014-05-19 10:47:42.974287 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.29 172.16.96.202:0/110022 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:45.581527) v2 ==== 47+0+0 (2653375953 0 0) 0xa1ee8c0 con 0x9b8de40 -293> 2014-05-19 10:47:42.974332 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.29 172.16.96.202:0/110022 66 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:45.581527) v2 ==== 47+0+0 (2653375953 0 0) 0xac35a40 con 0x94e2160 -292> 2014-05-19 10:47:42.974360 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:45.581527) v2 -- ?+0 0xac23a40 con 0x9b8de40 -291> 2014-05-19 10:47:42.974454 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -290> 2014-05-19 10:47:42.974845 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/110022 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:45.581527) v2 -- ?+0 0x9e6ddc0 con 0x94e2160 -289> 2014-05-19 10:47:42.974929 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -288> 2014-05-19 10:47:43.096324 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:47.043225) v2 ==== 47+0+0 (2569159299 0 0) 0x9fb5c00 con 0x99d3340 -287> 2014-05-19 10:47:43.096347 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 61 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:47.043225) v2 ==== 47+0+0 (2569159299 0 0) 0xac23340 con 0x94a5a20 -286> 2014-05-19 10:47:43.096398 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:47.043225) v2 -- ?+0 0xa1ee8c0 con 0x99d3340 -285> 2014-05-19 10:47:43.096510 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -284> 2014-05-19 10:47:43.096593 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:47.043225) v2 -- ?+0 0xac35a40 con 0x94a5a20 -283> 2014-05-19 10:47:43.096676 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -282> 2014-05-19 10:47:43.113020 7f5564dff700 20 KeyValueStore::op_tp worker waiting -281> 2014-05-19 10:47:43.141986 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.49 172.16.96.203:0/109790 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:47.088908) v2 ==== 47+0+0 (1636269136 0 0) 0x9b501c0 con 0x987b760 -280> 2014-05-19 10:47:43.142040 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:47.088908) v2 -- ?+0 0x9fb5c00 con 0x987b760 -279> 2014-05-19 10:47:43.142123 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -278> 2014-05-19 10:47:43.141995 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.49 172.16.96.203:0/109790 57 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:47.088908) v2 ==== 47+0+0 (1636269136 0 0) 0xa665500 con 0x94802c0 -277> 2014-05-19 10:47:43.142263 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/109790 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:47.088908) v2 -- ?+0 0xac23340 con 0x94802c0 -276> 2014-05-19 10:47:43.142481 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -275> 2014-05-19 10:47:43.160688 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.27 172.16.96.202:0/109106 70 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:45.767885) v2 ==== 47+0+0 (1074408354 0 0) 0xac4ce00 con 0x9aa3600 -274> 2014-05-19 10:47:43.160691 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.27 172.16.96.202:0/109106 70 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:45.767885) v2 ==== 47+0+0 (1074408354 0 0) 0xa507180 con 0x9b8c160 -273> 2014-05-19 10:47:43.160768 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:45.767885) v2 -- ?+0 0xa665500 con 0x9aa3600 -272> 2014-05-19 10:47:43.160819 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -271> 2014-05-19 10:47:43.160842 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/109106 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:45.767885) v2 -- ?+0 0x9b501c0 con 0x9b8c160 -270> 2014-05-19 10:47:43.160926 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -269> 2014-05-19 10:47:43.332975 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.24 172.16.96.202:0/107673 69 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:45.940212) v2 ==== 47+0+0 (1672172078 0 0) 0xac22fc0 con 0x996fb80 -268> 2014-05-19 10:47:43.333507 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:45.940212) v2 -- ?+0 0xa507180 con 0x996fb80 -267> 2014-05-19 10:47:43.333541 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -266> 2014-05-19 10:47:43.333013 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.24 172.16.96.202:0/107673 69 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:45.940212) v2 ==== 47+0+0 (1672172078 0 0) 0x9fa4c40 con 0x9a0cdc0 -265> 2014-05-19 10:47:43.333576 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107673 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:45.940212) v2 -- ?+0 0xac4ce00 con 0x9a0cdc0 -264> 2014-05-19 10:47:43.333607 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -263> 2014-05-19 10:47:43.452068 7f555019b700 20 OSD::command_tp worker waiting -262> 2014-05-19 10:47:43.455254 7f555099c700 20 OSD::disk_tp worker waiting -261> 2014-05-19 10:47:43.668702 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 72 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:46.275917) v2 ==== 47+0+0 (731278566 0 0) 0xa209340 con 0x9983600 -260> 2014-05-19 10:47:43.668751 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:46.275917) v2 -- ?+0 0x9fa4c40 con 0x9983600 -259> 2014-05-19 10:47:43.668779 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -258> 2014-05-19 10:47:43.668798 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 72 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:46.275917) v2 ==== 47+0+0 (731278566 0 0) 0xa1ef500 con 0x95846e0 -257> 2014-05-19 10:47:43.668828 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:46.275917) v2 -- ?+0 0xac22fc0 con 0x95846e0 -256> 2014-05-19 10:47:43.668903 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -255> 2014-05-19 10:47:43.927495 7f5566602700 5 osd.0 245 tick -254> 2014-05-19 10:47:43.927520 7f5566602700 20 osd.0 245 scrub_random_backoff lost coin flip, randomly backing off -253> 2014-05-19 10:47:43.927525 7f5566602700 10 osd.0 245 do_waiters -- start -252> 2014-05-19 10:47:43.927527 7f5566602700 10 osd.0 245 do_waiters -- finish -251> 2014-05-19 10:47:43.927547 7f555119d700 20 OSD::recovery_tp worker waiting -250> 2014-05-19 10:47:44.132429 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.21 172.16.96.202:0/106357 79 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:46.739636) v2 ==== 47+0+0 (2587857879 0 0) 0x9cd1880 con 0x96562c0 -249> 2014-05-19 10:47:44.132455 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.21 172.16.96.202:0/106357 79 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:46.739636) v2 ==== 47+0+0 (2587857879 0 0) 0xa5fca80 con 0x9657080 -248> 2014-05-19 10:47:44.132481 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:46.739636) v2 -- ?+0 0xa1ef500 con 0x96562c0 -247> 2014-05-19 10:47:44.132559 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -246> 2014-05-19 10:47:44.132597 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106357 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:46.739636) v2 -- ?+0 0xa209340 con 0x9657080 -245> 2014-05-19 10:47:44.132652 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -244> 2014-05-19 10:47:44.170365 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.26 172.16.96.202:0/108627 73 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:46.777585) v2 ==== 47+0+0 (2560923720 0 0) 0xa1ef180 con 0x95846e0 -243> 2014-05-19 10:47:44.170408 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:46.777585) v2 -- ?+0 0x9cd1880 con 0x95846e0 -242> 2014-05-19 10:47:44.170343 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.26 172.16.96.202:0/108627 73 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:46.777585) v2 ==== 47+0+0 (2560923720 0 0) 0xa864a80 con 0x9983600 -241> 2014-05-19 10:47:44.170505 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -240> 2014-05-19 10:47:44.170543 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/108627 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:46.777585) v2 -- ?+0 0xa5fca80 con 0x9983600 -239> 2014-05-19 10:47:44.170615 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -238> 2014-05-19 10:47:44.194341 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.42 172.16.96.203:0/106645 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:48.141338) v2 ==== 47+0+0 (4110752432 0 0) 0xac17c00 con 0x99d31e0 -237> 2014-05-19 10:47:44.194398 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:48.141338) v2 -- ?+0 0xa1ef180 con 0x99d31e0 -236> 2014-05-19 10:47:44.194497 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.42 172.16.96.203:0/106645 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:48.141338) v2 ==== 47+0+0 (4110752432 0 0) 0xa36ce00 con 0x95142c0 -235> 2014-05-19 10:47:44.194644 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -234> 2014-05-19 10:47:44.194762 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106645 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:48.141338) v2 -- ?+0 0xa864a80 con 0x95142c0 -233> 2014-05-19 10:47:44.194800 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -232> 2014-05-19 10:47:44.277558 7f554f99a700 20 osd.0 245 update_osd_stat osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -231> 2014-05-19 10:47:44.277579 7f554f99a700 5 osd.0 245 heartbeat: osd_stat(48536 kB used, 931 GB avail, 931 GB total, peers [1,20,21,22,23,24,25,26,27,28,29,40,41,42,43,44,45,46,47,48,49]/[] op hist []) -230> 2014-05-19 10:47:44.277588 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6808/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa65a000 con 0x9bdc840 -229> 2014-05-19 10:47:44.277613 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.201:6809/37984 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa0ea8c0 con 0x9ad4420 -228> 2014-05-19 10:47:44.277653 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6802/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xac488c0 con 0x9bf31e0 -227> 2014-05-19 10:47:44.277669 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6803/105880 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa4ff340 con 0x998b340 -226> 2014-05-19 10:47:44.277685 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6807/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa1e4e00 con 0x9b92840 -225> 2014-05-19 10:47:44.277700 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6808/106357 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xac2a8c0 con 0x9ad49a0 -224> 2014-05-19 10:47:44.277715 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6812/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xac31880 con 0x7b911e0 -223> 2014-05-19 10:47:44.277739 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6813/106871 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0x9fd9180 con 0x7b918c0 -222> 2014-05-19 10:47:44.277817 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6826/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0x94b7340 con 0x9aa8c60 -221> 2014-05-19 10:47:44.277842 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6827/107183 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xac2b6c0 con 0x9bfa000 -220> 2014-05-19 10:47:44.277872 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6831/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa816a80 con 0x7c23e40 -219> 2014-05-19 10:47:44.277904 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6832/107673 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa856380 con 0x998b760 -218> 2014-05-19 10:47:44.277922 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6837/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xac1afc0 con 0x7b91080 -217> 2014-05-19 10:47:44.277936 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6838/108152 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xac29c00 con 0xa28fb80 -216> 2014-05-19 10:47:44.277961 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6842/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xac16700 con 0x76bdce0 -215> 2014-05-19 10:47:44.277988 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6843/108627 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa4ef6c0 con 0x994ab00 -214> 2014-05-19 10:47:44.278018 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6848/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa1076c0 con 0x9ac8b00 -213> 2014-05-19 10:47:44.277984 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6809/37984 79 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xa4ee000 con 0x9ad4420 -212> 2014-05-19 10:47:44.278095 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6849/109106 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0x9e6d6c0 con 0x938de40 -211> 2014-05-19 10:47:44.278126 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6851/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa102e00 con 0x9970b00 -210> 2014-05-19 10:47:44.278153 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6852/109564 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa0cb6c0 con 0x99706e0 -209> 2014-05-19 10:47:44.278178 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6856/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0x9c0efc0 con 0x9bb6f20 -208> 2014-05-19 10:47:44.278193 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.202:6857/110022 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0x94256c0 con 0x994b340 -207> 2014-05-19 10:47:44.278209 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6803/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa0eb340 con 0x98fa2c0 -206> 2014-05-19 10:47:44.278235 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6804/105719 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xac4a8c0 con 0x996f8c0 -205> 2014-05-19 10:47:44.278281 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6807/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xac49500 con 0x996fa20 -204> 2014-05-19 10:47:44.278313 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6808/106171 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa0b6fc0 con 0x9ac8160 -203> 2014-05-19 10:47:44.278336 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6812/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa0bce00 con 0x7b90420 -202> 2014-05-19 10:47:44.278353 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6813/106645 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa385340 con 0x919fe40 -201> 2014-05-19 10:47:44.278370 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6817/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa23fa40 con 0x9971760 -200> 2014-05-19 10:47:44.278396 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6818/106929 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0x97d2a80 con 0x994af20 -199> 2014-05-19 10:47:44.278424 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6832/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xac496c0 con 0x989be40 -198> 2014-05-19 10:47:44.278445 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6833/107600 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xac33dc0 con 0x9adf4a0 -197> 2014-05-19 10:47:44.278474 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6837/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa103180 con 0x9776160 -196> 2014-05-19 10:47:44.278501 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6838/107996 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa856c40 con 0x96bd8c0 -195> 2014-05-19 10:47:44.278519 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6847/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa237dc0 con 0x96bcdc0 -194> 2014-05-19 10:47:44.278538 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6848/108547 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa07a540 con 0x96954a0 -193> 2014-05-19 10:47:44.278589 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6860/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xac48380 con 0x76bd8c0 -192> 2014-05-19 10:47:44.278621 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6861/108981 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0x95bcc40 con 0x7b90dc0 -191> 2014-05-19 10:47:44.278649 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6853/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa0eaa80 con 0x978d8c0 -190> 2014-05-19 10:47:44.278679 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6854/109324 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa2de700 con 0x978c580 -189> 2014-05-19 10:47:44.278708 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6863/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa6441c0 con 0x978d340 -188> 2014-05-19 10:47:44.278734 7f554f99a700 1 -- 172.16.96.201:0/37595 --> 172.16.96.203:6864/109790 -- osd_ping(ping e245 stamp 2014-05-19 10:47:44.277586) v2 -- ?+0 0xa23f6c0 con 0x96374a0 -187> 2014-05-19 10:47:44.278780 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -186> 2014-05-19 10:47:44.278801 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.1 172.16.96.201:6808/37984 79 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0x9fa41c0 con 0x9bdc840 -185> 2014-05-19 10:47:44.278828 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb7760 already has epoch 245 -184> 2014-05-19 10:47:44.278859 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6802/105880 78 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xa74a380 con 0x9bf31e0 -183> 2014-05-19 10:47:44.278880 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -182> 2014-05-19 10:47:44.278886 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.20 172.16.96.202:6803/105880 78 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xa0ba700 con 0x998b340 -181> 2014-05-19 10:47:44.278909 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96569a0 already has epoch 245 -180> 2014-05-19 10:47:44.278916 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6807/106357 77 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xac32fc0 con 0x9b92840 -179> 2014-05-19 10:47:44.278934 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -178> 2014-05-19 10:47:44.278944 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.21 172.16.96.202:6808/106357 77 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xac481c0 con 0x9ad49a0 -177> 2014-05-19 10:47:44.278959 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9657760 already has epoch 245 -176> 2014-05-19 10:47:44.278964 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6812/106871 74 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0x95e7180 con 0x7b911e0 -175> 2014-05-19 10:47:44.278978 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -174> 2014-05-19 10:47:44.278986 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.22 172.16.96.202:6813/106871 74 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0x9d448c0 con 0x7b918c0 -173> 2014-05-19 10:47:44.279000 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -172> 2014-05-19 10:47:44.279008 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6826/107183 73 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0x9ee2e00 con 0x9aa8c60 -171> 2014-05-19 10:47:44.279023 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -170> 2014-05-19 10:47:44.279047 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.23 172.16.96.202:6827/107183 73 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xa6d5dc0 con 0x9bfa000 -169> 2014-05-19 10:47:44.279081 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -168> 2014-05-19 10:47:44.279097 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6831/107673 72 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xa6abdc0 con 0x7c23e40 -167> 2014-05-19 10:47:44.279115 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -166> 2014-05-19 10:47:44.279120 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.24 172.16.96.202:6832/107673 72 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0x9c0fdc0 con 0x998b760 -165> 2014-05-19 10:47:44.279134 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9480000 already has epoch 245 -164> 2014-05-19 10:47:44.279139 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6837/108152 72 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xa0ba540 con 0x7b91080 -163> 2014-05-19 10:47:44.279153 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -162> 2014-05-19 10:47:44.279161 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.25 172.16.96.202:6838/108152 72 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xa873880 con 0xa28fb80 -161> 2014-05-19 10:47:44.279176 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9718b00 already has epoch 245 -160> 2014-05-19 10:47:44.279189 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6842/108627 71 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xac17dc0 con 0x76bdce0 -159> 2014-05-19 10:47:44.279205 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -158> 2014-05-19 10:47:44.279214 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.26 172.16.96.202:6843/108627 71 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xa030fc0 con 0x994ab00 -157> 2014-05-19 10:47:44.279228 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9970160 already has epoch 245 -156> 2014-05-19 10:47:44.279237 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6848/109106 70 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0x9ed0a80 con 0x9ac8b00 -155> 2014-05-19 10:47:44.279253 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -154> 2014-05-19 10:47:44.279258 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.27 172.16.96.202:6849/109106 70 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0x9c09dc0 con 0x938de40 -153> 2014-05-19 10:47:44.279272 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636420 already has epoch 245 -152> 2014-05-19 10:47:44.279278 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6851/109564 70 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xa208380 con 0x9970b00 -151> 2014-05-19 10:47:44.279295 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -150> 2014-05-19 10:47:44.279303 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.28 172.16.96.202:6852/109564 70 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xac41c00 con 0x99706e0 -149> 2014-05-19 10:47:44.279317 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9bb6dc0 already has epoch 245 -148> 2014-05-19 10:47:44.279324 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6856/110022 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0x9faa380 con 0x9bb6f20 -147> 2014-05-19 10:47:44.279339 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -146> 2014-05-19 10:47:44.279347 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.29 172.16.96.202:6857/110022 69 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xac37a40 con 0x994b340 -145> 2014-05-19 10:47:44.279360 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9b8dce0 already has epoch 245 -144> 2014-05-19 10:47:44.279367 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6803/105719 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xac51880 con 0x98fa2c0 -143> 2014-05-19 10:47:44.279381 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -142> 2014-05-19 10:47:44.279389 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.40 172.16.96.203:6804/105719 68 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xa447c00 con 0x996f8c0 -141> 2014-05-19 10:47:44.279403 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x96bda20 already has epoch 245 -140> 2014-05-19 10:47:44.279412 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6807/106171 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0x9ed2a80 con 0x996fa20 -139> 2014-05-19 10:47:44.279429 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -138> 2014-05-19 10:47:44.279436 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.41 172.16.96.203:6808/106171 67 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0x9ad2fc0 con 0x9ac8160 -137> 2014-05-19 10:47:44.279450 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x978dce0 already has epoch 245 -136> 2014-05-19 10:47:44.279458 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6812/106645 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xac29500 con 0x7b90420 -135> 2014-05-19 10:47:44.279475 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -134> 2014-05-19 10:47:44.279482 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.42 172.16.96.203:6813/106645 66 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xac4a000 con 0x919fe40 -133> 2014-05-19 10:47:44.279496 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9695ce0 already has epoch 245 -132> 2014-05-19 10:47:44.279503 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6817/106929 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xa618700 con 0x9971760 -131> 2014-05-19 10:47:44.279517 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -130> 2014-05-19 10:47:44.279528 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.43 172.16.96.203:6818/106929 65 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xa6d4a80 con 0x994af20 -129> 2014-05-19 10:47:44.279544 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -128> 2014-05-19 10:47:44.279552 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6832/107600 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0x9f18c40 con 0x989be40 -127> 2014-05-19 10:47:44.279566 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -126> 2014-05-19 10:47:44.279574 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.44 172.16.96.203:6833/107600 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0x9b45c00 con 0x9adf4a0 -125> 2014-05-19 10:47:44.279590 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -124> 2014-05-19 10:47:44.279597 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6837/107996 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xa6136c0 con 0x9776160 -123> 2014-05-19 10:47:44.279611 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -122> 2014-05-19 10:47:44.279619 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.45 172.16.96.203:6838/107996 63 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xac49340 con 0x96bd8c0 -121> 2014-05-19 10:47:44.279633 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -120> 2014-05-19 10:47:44.279642 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6847/108547 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xac33a40 con 0x96bcdc0 -119> 2014-05-19 10:47:44.279659 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -118> 2014-05-19 10:47:44.279667 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.46 172.16.96.203:6848/108547 62 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xa079880 con 0x96954a0 -117> 2014-05-19 10:47:44.279681 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x90f91e0 already has epoch 245 -116> 2014-05-19 10:47:44.279688 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6860/108981 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xac40700 con 0x76bd8c0 -115> 2014-05-19 10:47:44.279702 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -114> 2014-05-19 10:47:44.279709 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.47 172.16.96.203:6861/108981 61 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0x9f19500 con 0x7b90dc0 -113> 2014-05-19 10:47:44.279723 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x94a5ce0 already has epoch 245 -112> 2014-05-19 10:47:44.279730 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6853/109324 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0x9c08000 con 0x978d8c0 -111> 2014-05-19 10:47:44.279745 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -110> 2014-05-19 10:47:44.279752 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.48 172.16.96.203:6854/109324 60 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xa4d0fc0 con 0x978c580 -109> 2014-05-19 10:47:44.279766 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x9636160 already has epoch 245 -108> 2014-05-19 10:47:44.279775 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6863/109790 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xac50c40 con 0x978d340 -107> 2014-05-19 10:47:44.279790 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -106> 2014-05-19 10:47:44.279798 7f555f9ba700 1 -- 172.16.96.201:0/37595 <== osd.49 172.16.96.203:6864/109790 59 ==== osd_ping(ping_reply e245 stamp 2014-05-19 10:47:44.277586) v2 ==== 47+0+0 (4175905091 0 0) 0xac30e00 con 0x96374a0 -105> 2014-05-19 10:47:44.279812 7f555f9ba700 20 osd.0 245 _share_map_outgoing 0x91b0f20 already has epoch 245 -104> 2014-05-19 10:47:44.489584 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.23 172.16.96.202:0/107183 74 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:47.096794) v2 ==== 47+0+0 (519009399 0 0) 0x92b1180 con 0x9656000 -103> 2014-05-19 10:47:44.489639 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:47.096794) v2 -- ?+0 0xac17c00 con 0x9656000 -102> 2014-05-19 10:47:44.489587 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.23 172.16.96.202:0/107183 74 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:47.096794) v2 ==== 47+0+0 (519009399 0 0) 0xac36000 con 0x9937760 -101> 2014-05-19 10:47:44.489872 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -100> 2014-05-19 10:47:44.489895 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/107183 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:47.096794) v2 -- ?+0 0xa36ce00 con 0x9937760 -99> 2014-05-19 10:47:44.489971 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x94a5760 already has epoch 245 -98> 2014-05-19 10:47:44.529786 7f5565600700 20 KeyValueStore::op_tp worker waiting -97> 2014-05-19 10:47:44.628439 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.45 172.16.96.203:0/107996 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:48.575398) v2 ==== 47+0+0 (1768268543 0 0) 0xac28a80 con 0x966e000 -96> 2014-05-19 10:47:44.628496 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.45 172.16.96.203:0/107996 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:48.575398) v2 ==== 47+0+0 (1768268543 0 0) 0xa2e01c0 con 0x9743600 -95> 2014-05-19 10:47:44.628582 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:48.575398) v2 -- ?+0 0x92b1180 con 0x966e000 -94> 2014-05-19 10:47:44.628955 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -93> 2014-05-19 10:47:44.628986 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/107996 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:48.575398) v2 -- ?+0 0xac36000 con 0x9743600 -92> 2014-05-19 10:47:44.629023 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x90f98c0 already has epoch 245 -91> 2014-05-19 10:47:44.686888 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.22 172.16.96.202:0/106871 72 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:47.294223) v2 ==== 47+0+0 (376659982 0 0) 0xac41a40 con 0x9656160 -90> 2014-05-19 10:47:44.686945 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:47.294223) v2 -- ?+0 0xac28a80 con 0x9656160 -89> 2014-05-19 10:47:44.686986 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -88> 2014-05-19 10:47:44.687012 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.22 172.16.96.202:0/106871 72 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:47.294223) v2 ==== 47+0+0 (376659982 0 0) 0x9cb5340 con 0x9656f20 -87> 2014-05-19 10:47:44.687104 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.202:0/106871 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:47.294223) v2 -- ?+0 0xa2e01c0 con 0x9656f20 -86> 2014-05-19 10:47:44.687171 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x9ad5a20 already has epoch 245 -85> 2014-05-19 10:47:44.771545 7f55579aa700 20 OSD::op_tp worker waiting -84> 2014-05-19 10:47:44.771579 7f55551a5700 20 OSD::op_tp worker waiting -83> 2014-05-19 10:47:44.771600 7f555a1af700 20 OSD::op_tp worker waiting -82> 2014-05-19 10:47:44.773151 7f55569a8700 20 OSD::op_tp worker waiting -81> 2014-05-19 10:47:44.773187 7f55541a3700 20 OSD::op_tp worker waiting -80> 2014-05-19 10:47:44.773203 7f555a9b0700 20 OSD::op_tp worker waiting -79> 2014-05-19 10:47:44.773220 7f555b1b1700 20 OSD::op_tp worker waiting -78> 2014-05-19 10:47:44.773237 7f55589ac700 20 OSD::op_tp worker waiting -77> 2014-05-19 10:47:44.773252 7f55549a4700 20 OSD::op_tp worker waiting -76> 2014-05-19 10:47:44.773443 7f55581ab700 20 OSD::op_tp worker waiting -75> 2014-05-19 10:47:44.773484 7f55599ae700 20 OSD::op_tp worker waiting -74> 2014-05-19 10:47:44.773512 7f55571a9700 20 OSD::op_tp worker waiting -73> 2014-05-19 10:47:44.773627 7f55531a1700 20 OSD::op_tp worker waiting -72> 2014-05-19 10:47:44.773670 7f55561a7700 20 OSD::op_tp worker waiting -71> 2014-05-19 10:47:44.773686 7f55529a0700 20 OSD::op_tp worker waiting -70> 2014-05-19 10:47:44.773701 7f55591ad700 20 OSD::op_tp worker waiting -69> 2014-05-19 10:47:44.773712 7f55539a2700 20 OSD::op_tp worker waiting -68> 2014-05-19 10:47:44.773759 7f555199e700 20 OSD::op_tp worker waiting -67> 2014-05-19 10:47:44.773786 7f555219f700 20 OSD::op_tp worker waiting -66> 2014-05-19 10:47:44.773811 7f55559a6700 20 OSD::op_tp worker waiting -65> 2014-05-19 10:47:44.797459 7f555e1b7700 1 -- 172.16.96.201:6803/37595 <== osd.43 172.16.96.203:0/106929 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:48.744428) v2 ==== 47+0+0 (2004031229 0 0) 0xac48c40 con 0x99d3340 -64> 2014-05-19 10:47:44.797514 7f555e1b7700 1 -- 172.16.96.201:6803/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:48.744428) v2 -- ?+0 0xac41a40 con 0x99d3340 -63> 2014-05-19 10:47:44.797549 7f555e1b7700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -62> 2014-05-19 10:47:44.797896 7f5549a6c700 1 -- 172.16.96.201:6800/37595 >> :/0 pipe(0x91a2a00 sd=67 :6800 s=0 pgs=0 cs=0 l=0 c=0x9600dc0).accept sd=67 172.16.96.110:55752/0 -61> 2014-05-19 10:47:44.798000 7f555f1b9700 1 -- 172.16.96.201:6804/37595 <== osd.43 172.16.96.203:0/106929 62 ==== osd_ping(ping e245 stamp 2014-05-19 10:47:48.744428) v2 ==== 47+0+0 (2004031229 0 0) 0xac22540 con 0x94a5a20 -60> 2014-05-19 10:47:44.798055 7f555f1b9700 1 -- 172.16.96.201:6804/37595 --> 172.16.96.203:0/106929 -- osd_ping(ping_reply e245 stamp 2014-05-19 10:47:48.744428) v2 -- ?+0 0x9cb5340 con 0x94a5a20 -59> 2014-05-19 10:47:44.798094 7f555f1b9700 20 osd.0 245 _share_map_outgoing 0x7b90840 already has epoch 245 -58> 2014-05-19 10:47:44.798184 7f5549a6c700 10 osd.0 245 new session 0x9318b60 con=0x9600dc0 addr=172.16.96.110:0/1060794 -57> 2014-05-19 10:47:44.827745 7f55619be700 1 -- 172.16.96.201:6800/37595 <== client.4358 172.16.96.110:0/1060794 1 ==== osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 ==== 227+0+4194304 (2613026269 0 0) 0xa322000 con 0x9600dc0 -56> 2014-05-19 10:47:44.827771 7f55619be700 10 osd.0 245 do_waiters -- start -55> 2014-05-19 10:47:44.827773 7f55619be700 10 osd.0 245 do_waiters -- finish -54> 2014-05-19 10:47:44.827774 7f55619be700 20 osd.0 245 _dispatch 0xa322000 osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 -53> 2014-05-19 10:47:44.827779 7f55619be700 5 -- op tracker -- , seq: 24052, time: 2014-05-19 10:47:44.807399, event: header_read, request: osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 -52> 2014-05-19 10:47:44.827799 7f55619be700 5 -- op tracker -- , seq: 24052, time: 2014-05-19 10:47:44.807406, event: throttled, request: osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 -51> 2014-05-19 10:47:44.827813 7f55619be700 5 -- op tracker -- , seq: 24052, time: 2014-05-19 10:47:44.827726, event: all_read, request: osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 -50> 2014-05-19 10:47:44.827822 7f55619be700 5 -- op tracker -- , seq: 24052, time: 2014-05-19 10:47:44.827769, event: dispatched, request: osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 -49> 2014-05-19 10:47:44.827830 7f55619be700 5 -- op tracker -- , seq: 24052, time: 2014-05-19 10:47:44.827830, event: waiting_for_osdmap, request: osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 -48> 2014-05-19 10:47:44.827846 7f55619be700 15 osd.0 245 require_same_or_newer_map 245 (i am 245) 0xa322000 -47> 2014-05-19 10:47:44.827849 7f55619be700 20 osd.0 245 _share_map_incoming client.4358 172.16.96.110:0/1060794 245 -46> 2014-05-19 10:47:44.827864 7f55619be700 15 osd.0 245 enqueue_op 0xa57c780 prio 63 cost 4194304 latency 0.020465 osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 -45> 2014-05-19 10:47:44.827878 7f55619be700 10 osd.0 245 do_waiters -- start -44> 2014-05-19 10:47:44.827880 7f55619be700 10 osd.0 245 do_waiters -- finish -43> 2014-05-19 10:47:44.827889 7f55579aa700 12 OSD::op_tp worker wq OSD::OpWQ start processing 0x1 (1 active) -42> 2014-05-19 10:47:44.827914 7f55579aa700 10 osd.0 245 dequeue_op 0xa57c780 prio 63 cost 4194304 latency 0.020515 osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 pg pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] -41> 2014-05-19 10:47:44.827937 7f55579aa700 5 -- op tracker -- , seq: 24052, time: 2014-05-19 10:47:44.827937, event: reached_pg, request: osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 -40> 2014-05-19 10:47:44.827957 7f55579aa700 20 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] op_has_sufficient_caps pool=3 (ceph ) owner=0 need_read_cap=0 need_write_cap=1 need_class_read_cap=0 need_class_write_cap=0 -> yes -39> 2014-05-19 10:47:44.827974 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] handle_message: 0xa57c780 -38> 2014-05-19 10:47:44.827988 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] do_op osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 may_write -> write-ordered flags ack+ondisk+write -37> 2014-05-19 10:47:44.828100 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] get_object_context: no obc for soid bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 but can_create -36> 2014-05-19 10:47:44.828185 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] create_object_context 0x99f3340 bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 -35> 2014-05-19 10:47:44.828201 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] populate_obc_watchers bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 -34> 2014-05-19 10:47:44.828211 7f55579aa700 20 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] ReplicatedPG::check_blacklisted_obc_watchers for obc bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 -33> 2014-05-19 10:47:44.828222 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] get_object_context: 0x99f3340 bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 rwstate(none n=0 w=0) oi: bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3(0'0 unknown.0.0:0 wrlock_by=unknown.0.0:0 s 0 uv0) ssc: 0x93196c0 snapset: 0=[]:[] -32> 2014-05-19 10:47:44.828239 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] find_object_context bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 @head oi=bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3(0'0 unknown.0.0:0 wrlock_by=unknown.0.0:0 s 0 uv0) -31> 2014-05-19 10:47:44.828292 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] get_object_context: no obc for soid bf28a03f/rbd_data.10426b8b4567.0000000000000004/snapdir//3 and !can_create -30> 2014-05-19 10:47:44.828308 7f55579aa700 5 -- op tracker -- , seq: 24052, time: 2014-05-19 10:47:44.828308, event: started, request: osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 -29> 2014-05-19 10:47:44.828323 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] execute_ctx 0x9d9d200 -28> 2014-05-19 10:47:44.828339 7f55579aa700 5 -- op tracker -- , seq: 24052, time: 2014-05-19 10:47:44.828339, event: started, request: osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 -27> 2014-05-19 10:47:44.828352 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] do_op bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] ov 0'0 av 245'1 snapc 0=[] snapset 0=[]:[] -26> 2014-05-19 10:47:44.828368 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] do_osd_op bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] -25> 2014-05-19 10:47:44.828380 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] do_osd_op set-alloc-hint object_size 4194304 write_size 4194304 -24> 2014-05-19 10:47:44.828412 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] do_osd_op write 0~4194304 -23> 2014-05-19 10:47:44.828437 7f55579aa700 15 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] do_osd_op_effects on session 0x9318b60 -22> 2014-05-19 10:47:44.828451 7f55579aa700 20 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] make_writeable bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 snapset=0x93196f8 snapc=0=[] -21> 2014-05-19 10:47:44.828463 7f55579aa700 20 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] setting DIRTY flag -20> 2014-05-19 10:47:44.828472 7f55579aa700 20 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] make_writeable bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 done, snapset=0=[]:[]+head -19> 2014-05-19 10:47:44.828482 7f55579aa700 20 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] finish_ctx bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 0x9d9d200 op modify -18> 2014-05-19 10:47:44.828497 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] set mtime to 2014-05-19 10:46:56.539205 -17> 2014-05-19 10:47:44.828539 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=0 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] final snapset 0=[]:[]+head in bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 -16> 2014-05-19 10:47:44.828562 7f55579aa700 20 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=1 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] zeroing write result code 0 -15> 2014-05-19 10:47:44.828576 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=1 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] new_repop rep_tid 1 on osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 -14> 2014-05-19 10:47:44.828594 7f55579aa700 7 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=1 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] issue_repop rep_tid 1 o bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 -13> 2014-05-19 10:47:44.828615 7f55579aa700 5 -- op tracker -- , seq: 24052, time: 2014-05-19 10:47:44.828615, event: waiting for subops from 44, request: osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4 -12> 2014-05-19 10:47:44.828646 7f55579aa700 20 osd.0 245 _share_map_outgoing 0x90f9760 already has epoch 245 -11> 2014-05-19 10:47:44.828651 7f55579aa700 1 -- 172.16.96.201:6802/37595 --> osd.44 172.16.96.203:6824/107600 -- osd_sub_op(client.4358.0:104 3.3f bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 [] v 245'1 snapset=0=[]:[] snapc=0=[]) v10 -- ?+4195211 0x9d27700 -10> 2014-05-19 10:47:44.828670 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( empty local-les=222 n=1 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 crt=0'0 mlcod 0'0 active+clean] append_log log((0'0,0'0], crt=0'0) [245'1 (0'0) modify bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 by client.4358.0:104 2014-05-19 10:46:56.539205] -9> 2014-05-19 10:47:44.828692 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( v 245'1 (0'0,245'1] local-les=222 n=1 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 luod=0'0 crt=0'0 lcod 0'0 mlcod 0'0 active+clean] add_log_entry 245'1 (0'0) modify bf28a03f/rbd_data.10426b8b4567.0000000000000004/head//3 by client.4358.0:104 2014-05-19 10:46:56.539205 -8> 2014-05-19 10:47:44.828717 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( v 245'1 (0'0,245'1] local-les=222 n=1 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 luod=0'0 crt=0'0 lcod 0'0 mlcod 0'0 active+clean] append_log adding 1 keys -7> 2014-05-19 10:47:44.828753 7f55579aa700 10 write_log with: dirty_to: 0'0, dirty_from: 4294967295'18446744073709551615, dirty_divergent_priors: 0, writeout_from: 245'1, trimmed: -6> 2014-05-19 10:47:44.828821 7f5564dff700 12 KeyValueStore::op_tp worker wq KeyValueStore::OpWQ start processing 0x8b7dc20 (1 active) -5> 2014-05-19 10:47:44.828818 7f55579aa700 10 osd.0 pg_epoch: 245 pg[3.3f( v 245'1 (0'0,245'1] local-les=222 n=1 ec=44 les/c 222/222 221/221/173) [0,44] r=0 lpr=221 luod=0'0 crt=0'0 lcod 0'0 mlcod 0'0 active+clean] eval_repop repgather(0x76a0840 245'1 rep_tid=1 committed?=0 applied?=0 lock=0 op=osd_op(client.4358.0:104 rbd_data.10426b8b4567.0000000000000004 [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4194304] 3.bf28a03f ack+ondisk+write e245) v4) wants=ad -4> 2014-05-19 10:47:44.828839 7f55579aa700 10 osd.0 245 dequeue_op 0xa57c780 finish -3> 2014-05-19 10:47:44.828843 7f55579aa700 15 OSD::op_tp worker wq OSD::OpWQ done processing 0x1 (0 active) -2> 2014-05-19 10:47:44.828846 7f55579aa700 20 OSD::op_tp worker waiting -1> 2014-05-19 10:47:44.829013 7f5564dff700 -1 bad op 2307 0> 2014-05-19 10:47:44.830448 7f5564dff700 -1 os/KeyValueStore.cc: In function 'unsigned int KeyValueStore::_do_transaction(ObjectStore::Transaction&, KeyValueStore::BufferTransaction&, SequencerPosition&, ThreadPool::TPHandle*)' thread 7f5564dff700 time 2014-05-19 10:47:44.829023 os/KeyValueStore.cc: 1457: FAILED assert(0) ceph version 0.80.1 (a38fe1169b6d2ac98b427334c12d7cf81f809b74) 1: (KeyValueStore::_do_transaction(ObjectStore::Transaction&, KeyValueStore::BufferTransaction&, SequencerPosition&, ThreadPool::TPHandle*)+0x1d0) [0x9d8720] 2: (KeyValueStore::_do_transactions(std::list >&, unsigned long, ThreadPool::TPHandle*)+0x8e) [0x9daa0e] 3: (KeyValueStore::_do_op(KeyValueStore::OpSequencer*, ThreadPool::TPHandle&)+0x97) [0x9dab17] 4: (ThreadPool::worker(ThreadPool::WorkThread*)+0x68a) [0xb5101a] 5: (ThreadPool::WorkThread::entry()+0x10) [0xb52270] 6: (()+0x7e9a) [0x7f556d321e9a] 7: (clone()+0x6d) [0x7f556b8ccccd] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 20/20 osd 20/20 optracker 0/ 5 objclass 20/20 filestore 1/ 3 keyvaluestore 1/ 3 journal 0/ 5 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 20/20 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle -2/-2 (syslog threshold) -1/-1 (stderr threshold) max_recent 10000 max_new 1000 log_file /var/log/ceph/osd.0.log --- end dump of recent events --- 2014-05-19 10:47:44.887715 7f5564dff700 -1 *** Caught signal (Aborted) ** in thread 7f5564dff700 ceph version 0.80.1 (a38fe1169b6d2ac98b427334c12d7cf81f809b74) 1: /usr/local/bin/ceph-osd() [0xa85780] 2: (()+0xfcb0) [0x7f556d329cb0] 3: (gsignal()+0x35) [0x7f556b80f425] 4: (abort()+0x17b) [0x7f556b812b8b] 5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7f556c10ae2d] 6: (()+0x5ef26) [0x7f556c108f26] 7: (()+0x5ef53) [0x7f556c108f53] 8: (()+0x5f17e) [0x7f556c10917e] 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x43d) [0xb5f43d] 10: (KeyValueStore::_do_transaction(ObjectStore::Transaction&, KeyValueStore::BufferTransaction&, SequencerPosition&, ThreadPool::TPHandle*)+0x1d0) [0x9d8720] 11: (KeyValueStore::_do_transactions(std::list >&, unsigned long, ThreadPool::TPHandle*)+0x8e) [0x9daa0e] 12: (KeyValueStore::_do_op(KeyValueStore::OpSequencer*, ThreadPool::TPHandle&)+0x97) [0x9dab17] 13: (ThreadPool::worker(ThreadPool::WorkThread*)+0x68a) [0xb5101a] 14: (ThreadPool::WorkThread::entry()+0x10) [0xb52270] 15: (()+0x7e9a) [0x7f556d321e9a] 16: (clone()+0x6d) [0x7f556b8ccccd] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- begin dump of recent events --- 0> 2014-05-19 10:47:44.887715 7f5564dff700 -1 *** Caught signal (Aborted) ** in thread 7f5564dff700 ceph version 0.80.1 (a38fe1169b6d2ac98b427334c12d7cf81f809b74) 1: /usr/local/bin/ceph-osd() [0xa85780] 2: (()+0xfcb0) [0x7f556d329cb0] 3: (gsignal()+0x35) [0x7f556b80f425] 4: (abort()+0x17b) [0x7f556b812b8b] 5: (__gnu_cxx::__verbose_terminate_handler()+0x11d) [0x7f556c10ae2d] 6: (()+0x5ef26) [0x7f556c108f26] 7: (()+0x5ef53) [0x7f556c108f53] 8: (()+0x5f17e) [0x7f556c10917e] 9: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x43d) [0xb5f43d] 10: (KeyValueStore::_do_transaction(ObjectStore::Transaction&, KeyValueStore::BufferTransaction&, SequencerPosition&, ThreadPool::TPHandle*)+0x1d0) [0x9d8720] 11: (KeyValueStore::_do_transactions(std::list >&, unsigned long, ThreadPool::TPHandle*)+0x8e) [0x9daa0e] 12: (KeyValueStore::_do_op(KeyValueStore::OpSequencer*, ThreadPool::TPHandle&)+0x97) [0x9dab17] 13: (ThreadPool::worker(ThreadPool::WorkThread*)+0x68a) [0xb5101a] 14: (ThreadPool::WorkThread::entry()+0x10) [0xb52270] 15: (()+0x7e9a) [0x7f556d321e9a] 16: (clone()+0x6d) [0x7f556b8ccccd] NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. --- logging levels --- 0/ 5 none 0/ 1 lockdep 0/ 1 context 1/ 1 crush 1/ 5 mds 1/ 5 mds_balancer 1/ 5 mds_locker 1/ 5 mds_log 1/ 5 mds_log_expire 1/ 5 mds_migrator 0/ 1 buffer 0/ 1 timer 0/ 1 filer 0/ 1 striper 0/ 1 objecter 0/ 5 rados 0/ 5 rbd 0/ 5 journaler 0/ 5 objectcacher 0/ 5 client 20/20 osd 20/20 optracker 0/ 5 objclass 20/20 filestore 1/ 3 keyvaluestore 1/ 3 journal 0/ 5 ms 1/ 5 mon 0/10 monc 1/ 5 paxos 20/20 tp 1/ 5 auth 1/ 5 crypto 1/ 1 finisher 1/ 5 heartbeatmap 1/ 5 perfcounter 1/ 5 rgw 1/ 5 javaclient 1/ 5 asok 1/ 1 throttle -2/-2 (syslog threshold) -1/-1 (stderr threshold) max_recent 10000 max_new 1000 log_file /var/log/ceph/osd.0.log --- end dump of recent events ---