ceph-mon.3.log - Ceph - Ceph

Bug #4811 » ceph-mon.3.log

Denis kaganovich, 04/25/2013 07:35 PM

 -04-26 04:46:46.076461 7f225a5f3880  0 ceph version 0.60-666-ga5cade1 (a5cade1fe7338602fb2bbfa867433d825f337c87), process ceph-mon, pid 15925
 -04-26 04:46:46.076475 7f225a5f3880 10 needs_conversion
 -04-26 04:46:46.255181 7f225a5f3880 10 obtain_monmap
 -04-26 04:46:46.255466 7f225a5f3880 10 obtain_monmap read last committed monmap ver 1
 -04-26 04:46:46.255913 7f225a5f3880  1 mon.3@-1(probing) e1 preinit fsid 5eacb654-3204-4ca1-9b16-83bb0140e497
 -04-26 04:46:46.256071 7f225a5f3880 10 mon.3@-1(probing) e1 check_fsid cluster_uuid contains '5eacb654-3204-4ca1-9b16-83bb0140e497'
 -04-26 04:46:46.256140 7f225a5f3880 10 mon.3@-1(probing) e1 features compat={},rocompat={},incompat={1=initial feature set (~v.18),3=single paxos with k/v store (v0.?)}
 -04-26 04:46:46.256210 7f225a5f3880 10 mon.3@-1(probing) e1 has_ever_joined = 1
 -04-26 04:46:46.256327 7f225a5f3880 10 mon.3@-1(probing) e1 init_paxos
 -04-26 04:46:46.266469 7f225a5f3880  7 mon.3@-1(probing).pg v0 update_from_paxos loading latest full pgmap v5939026
 -04-26 04:46:46.279786 7f225a5f3880  7 mon.3@-1(probing).pg v5939026 update_from_paxos  applying incremental 5939027
 -04-26 04:46:46.279826 7f225a5f3880 10 mon.3@-1(probing).pg v5939027 v5939027: 2428 pgs: 2428 active+clean; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:46:46.281108 7f225a5f3880 10 mon.3@-1(probing).pg v5939027 send_pg_creates to 0 pgs
 -04-26 04:46:46.281118 7f225a5f3880 10 mon.3@-1(probing).pg v5939027 update_logger
 -04-26 04:46:46.281200 7f225a5f3880 10 mon.3@-1(probing).mds e0 update_from_paxos version 3770, my e 0
 -04-26 04:46:46.281273 7f225a5f3880 10 mon.3@-1(probing).mds e0 update_from_paxos got 3770
 -04-26 04:46:46.281309 7f225a5f3880  4 mon.3@-1(probing).mds e3770 new map
 -04-26 04:46:46.281312 7f225a5f3880  7 mon.3@-1(probing).mds e3770 print_map
       epoch	3770
       flags	0
       created	2013-01-28 15:10:54.412329
       modified	2013-04-26 04:25:38.103275
       tableserver	0
       root	0
       session_timeout	60
       session_autoclose	300
       last_failure	3763
       last_failure_osd_epoch	10640
       compat	compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding}
       max_mds	1
       in	0
       up	{0=225856}
       failed
       stopped
       data_pools	0,6
       metadata_pool	1
 :	10.227.227.101:6800/17876 '1' mds.0.275 up:active seq 91
 :	10.227.227.103:6800/8669 '3' mds.-1.0 up:standby seq 1
 :	10.227.227.104:6800/14732 '4' mds.-1.0 up:standby seq 1
 -04-26 04:46:46.281395 7f225a5f3880 10 mon.3@-1(probing).mds e3770 update_logger
 -04-26 04:46:46.281658 7f225a5f3880  7 mon.3@-1(probing).osd e0 update_from_paxos loading latest full map e10639
 -04-26 04:46:46.281924 7f225a5f3880  7 mon.3@-1(probing).osd e10639 update_from_paxos  applying incremental 10640
 -04-26 04:46:46.282011 7f225a5f3880  1 mon.3@-1(probing).osd e10640 e10640: 12 osds: 8 up, 12 in
 -04-26 04:46:46.282063 7f225a5f3880  7 mon.3@-1(probing).osd e10640 update_from_paxos  applying incremental 10641
 -04-26 04:46:46.282126 7f225a5f3880  1 mon.3@-1(probing).osd e10641 e10641: 12 osds: 10 up, 12 in
 -04-26 04:46:46.282197 7f225a5f3880  7 mon.3@-1(probing).osd e10641 update_from_paxos  applying incremental 10642
 -04-26 04:46:46.282248 7f225a5f3880  1 mon.3@-1(probing).osd e10642 e10642: 12 osds: 9 up, 12 in
 -04-26 04:46:46.282293 7f225a5f3880  7 mon.3@-1(probing).osd e10642 update_from_paxos  applying incremental 10643
 -04-26 04:46:46.282342 7f225a5f3880  1 mon.3@-1(probing).osd e10643 e10643: 12 osds: 12 up, 12 in
 -04-26 04:46:46.282381 7f225a5f3880  7 mon.3@-1(probing).osd e10643 update_from_paxos  applying incremental 10644
 -04-26 04:46:46.282425 7f225a5f3880  1 mon.3@-1(probing).osd e10644 e10644: 12 osds: 12 up, 12 in
 -04-26 04:46:46.282467 7f225a5f3880  7 mon.3@-1(probing).osd e10644 update_from_paxos  applying incremental 10645
 -04-26 04:46:46.282513 7f225a5f3880  1 mon.3@-1(probing).osd e10645 e10645: 12 osds: 12 up, 12 in
 -04-26 04:46:46.282555 7f225a5f3880  7 mon.3@-1(probing).osd e10645 update_from_paxos  applying incremental 10646
 -04-26 04:46:46.282601 7f225a5f3880  1 mon.3@-1(probing).osd e10646 e10646: 12 osds: 12 up, 12 in
 -04-26 04:46:46.282641 7f225a5f3880  7 mon.3@-1(probing).osd e10646 update_from_paxos  applying incremental 10647
 -04-26 04:46:46.282685 7f225a5f3880  1 mon.3@-1(probing).osd e10647 e10647: 12 osds: 12 up, 12 in
 -04-26 04:46:46.282724 7f225a5f3880  7 mon.3@-1(probing).osd e10647 update_from_paxos  applying incremental 10648
 -04-26 04:46:46.282767 7f225a5f3880  1 mon.3@-1(probing).osd e10648 e10648: 12 osds: 12 up, 12 in
 -04-26 04:46:46.282806 7f225a5f3880  7 mon.3@-1(probing).osd e10648 update_from_paxos  applying incremental 10649
 -04-26 04:46:46.282849 7f225a5f3880  1 mon.3@-1(probing).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:46:46.302336 7f225a5f3880 10 mon.3@-1(probing).osd e10649 send_to_waiting 10649
 -04-26 04:46:46.302364 7f225a5f3880 10 mon.3@-1(probing).osd e10649 share_map_with_random_osd no up osd on our session map
 -04-26 04:46:46.302370 7f225a5f3880 10 mon.3@-1(probing).osd e10649 update_logger
 -04-26 04:46:46.302395 7f225a5f3880 10 mon.3@-1(probing).log v5604916 update_from_paxos
 -04-26 04:46:46.302792 7f225a5f3880 10 mon.3@-1(probing).log v5604916 update_from_paxos version 5604916 summary v 0
 -04-26 04:46:46.302903 7f225a5f3880 10 mon.3@-1(probing).log v5604916 update_from_paxos latest full 5604915
 -04-26 04:46:46.303102 7f225a5f3880  7 mon.3@-1(probing).log v5604916 update_from_paxos loading summary e5604915
 -04-26 04:46:46.303220 7f225a5f3880  7 mon.3@-1(probing).log v5604916 update_from_paxos loaded summary e5604915
 -04-26 04:46:46.303384 7f225a5f3880  7 mon.3@-1(probing).log v5604916 update_from_paxos applying incremental log 5604916 2013-04-26 04:36:13.917628 osd.5 10.227.227.104:6807/15124 89 : [INF] 1.27 deep-scrub ok
 -04-26 04:46:46.303501 7f225a5f3880  7 mon.3@-1(probing).log v5604916 update_from_paxos applying incremental log 5604916 2013-04-26 04:36:15.869539 osd.5 10.227.227.104:6807/15124 90 : [INF] 1.30 deep-scrub ok
 -04-26 04:46:46.303606 7f225a5f3880  7 mon.3@-1(probing).log v5604916 update_from_paxos applying incremental log 5604916 2013-04-26 04:36:16.848297 osd.5 10.227.227.104:6807/15124 91 : [INF] 1.37 deep-scrub ok
 -04-26 04:46:46.303704 7f225a5f3880  7 mon.3@-1(probing).log v5604916 update_from_paxos applying incremental log 5604916 2013-04-26 04:36:16.894865 osd.3 10.227.227.104:6801/14901 104 : [INF] 1.1f deep-scrub ok
 -04-26 04:46:46.303804 7f225a5f3880  7 mon.3@-1(probing).log v5604916 update_from_paxos applying incremental log 5604916 2013-04-26 04:36:17.890116 osd.3 10.227.227.104:6801/14901 105 : [INF] 1.21 deep-scrub ok
 -04-26 04:46:46.303898 7f225a5f3880  7 mon.3@-1(probing).log v5604916 update_from_paxos applying incremental log 5604916 2013-04-26 04:36:19.928398 osd.3 10.227.227.104:6801/14901 106 : [INF] 1.22 deep-scrub ok
 -04-26 04:46:46.303988 7f225a5f3880  7 mon.3@-1(probing).log v5604916 update_from_paxos applying incremental log 5604916 2013-04-26 04:36:21.848757 osd.5 10.227.227.104:6807/15124 92 : [INF] 1.38 deep-scrub ok
 -04-26 04:46:46.304081 7f225a5f3880  7 mon.3@-1(probing).log v5604916 update_from_paxos applying incremental log 5604916 2013-04-26 04:36:21.912730 osd.3 10.227.227.104:6801/14901 107 : [INF] 1.26 deep-scrub ok
 -04-26 04:46:46.304180 7f225a5f3880  7 mon.3@-1(probing).log v5604916 update_from_paxos applying incremental log 5604916 2013-04-26 04:36:22.921305 osd.5 10.227.227.104:6807/15124 93 : [INF] 1.41 deep-scrub ok
 -04-26 04:46:46.304277 7f225a5f3880  7 mon.3@-1(probing).log v5604916 update_from_paxos applying incremental log 5604916 2013-04-26 04:36:22.952672 mon.1 10.227.227.103:6789/0 305 : [INF] pgmap v5939026: 2428 pgs: 2428 active+clean; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:46:46.304478 7f225a5f3880 10 mon.3@-1(probing).log v5604916 check_subs
 -04-26 04:46:46.304668 7f225a5f3880 10 mon.3@-1(probing).auth v4469 update_from_paxos
 -04-26 04:46:46.305053 7f225a5f3880 10 mon.3@-1(probing).auth v4469 update_from_paxos version 4469 keys ver 0 latest 4467
 -04-26 04:46:46.305225 7f225a5f3880  7 mon.3@-1(probing).auth v4469 update_from_paxos loading summary e 4467
 -04-26 04:46:46.305288 7f225a5f3880  7 mon.3@-1(probing).auth v4469 update_from_paxos latest length 2392
 -04-26 04:46:46.305474 7f225a5f3880 10 mon.3@-1(probing).auth v4469 update_from_paxos key server version 4467
 -04-26 04:46:46.305714 7f225a5f3880 10 mon.3@-1(probing).auth v4469 update_from_paxos() last_allocated_id=227396 max_global_id=227396
 -04-26 04:46:46.305781 7f225a5f3880 10 mon.3@-1(probing).health(0) init
 -04-26 04:46:46.308511 7f225a5f3880  2 mon.3@-1(probing) e1 init
 -04-26 04:46:46.308749 7f225a5f3880 10 mon.3@-1(probing) e1 bootstrap
 -04-26 04:46:46.308759 7f225a5f3880 10 mon.3@-1(probing) e1 unregister_cluster_logger - not registered
 -04-26 04:46:46.308767 7f225a5f3880 10 mon.3@-1(probing) e1 cancel_probe_timeout (none scheduled)
 -04-26 04:46:46.308773 7f225a5f3880  0 mon.3@-1(probing) e1  my rank is now 1 (was -1)
 -04-26 04:46:46.308797 7f225a5f3880 10 mon.3@1(probing) e1 reset_sync
 -04-26 04:46:46.308812 7f225a5f3880 10 mon.3@1(probing) e1 reset
 -04-26 04:46:46.308817 7f225a5f3880 10 mon.3@1(probing) e1 timecheck_finish
 -04-26 04:46:46.308869 7f225a5f3880 10 mon.3@1(probing) e1 cancel_probe_timeout (none scheduled)
 -04-26 04:46:46.308889 7f225a5f3880 10 mon.3@1(probing) e1 reset_probe_timeout 0x1f863e0 after 2 seconds
 -04-26 04:46:46.308977 7f225a5f3880 10 mon.3@1(probing) e1 probing other monitors
 -04-26 04:46:46.310096 7f224f5c7700 10 mon.3@1(probing) e1 ms_get_authorizer for mon
 -04-26 04:46:46.310119 7f224f4c6700 10 mon.3@1(probing) e1 ms_get_authorizer for mon
 -04-26 04:46:46.312432 7f224f2c4700 10 mon.3@1(probing) e1 ms_verify_authorizer 10.227.227.101:6789/0 mon protocol 2
 -04-26 04:46:46.312524 7f22505c9700 10 mon.3@1(probing) e1 do not have session, making new one
 -04-26 04:46:46.312542 7f22505c9700 10 mon.3@1(probing) e1 ms_dispatch new session MonSession: mon.2 10.227.227.104:6789/0 is open for mon.2 10.227.227.104:6789/0
 -04-26 04:46:46.312554 7f22505c9700  5 mon.3@1(probing) e1 setting monitor caps on this connection
 -04-26 04:46:46.312566 7f22505c9700 10 mon.3@1(probing) e1 handle_probe mon_probe(probe 5eacb654-3204-4ca1-9b16-83bb0140e497 name 4) v4
 -04-26 04:46:46.312579 7f22505c9700 10 mon.3@1(probing) e1 handle_probe_probe mon.2 10.227.227.104:6789/0mon_probe(probe 5eacb654-3204-4ca1-9b16-83bb0140e497 name 4) v4
 -04-26 04:46:46.312577 7f224f2c4700  0 -- 10.227.227.103:6789/0 >> 10.227.227.101:6789/0 pipe(0x219e780 sd=24 :6789 s=0 pgs=0 cs=0 l=0).accept connect_seq 0 vs existing 0 state wait
 -04-26 04:46:46.312869 7f22505c9700 10 mon.3@1(probing) e1 handle_probe mon_probe(probe 5eacb654-3204-4ca1-9b16-83bb0140e497 name 4) v4
 -04-26 04:46:46.312880 7f22505c9700 10 mon.3@1(probing) e1 handle_probe_probe mon.2 10.227.227.104:6789/0mon_probe(probe 5eacb654-3204-4ca1-9b16-83bb0140e497 name 4) v4
 -04-26 04:46:46.312944 7f22505c9700 10 mon.3@1(probing) e1 handle_probe mon_probe(probe 5eacb654-3204-4ca1-9b16-83bb0140e497 name 4) v4
 -04-26 04:46:46.312951 7f22505c9700 10 mon.3@1(probing) e1 handle_probe_probe mon.2 10.227.227.104:6789/0mon_probe(probe 5eacb654-3204-4ca1-9b16-83bb0140e497 name 4) v4
 -04-26 04:46:46.313015 7f22505c9700 10 mon.3@1(probing) e1 handle_probe mon_probe(probe 5eacb654-3204-4ca1-9b16-83bb0140e497 name 4) v4
 -04-26 04:46:46.313038 7f22505c9700 10 mon.3@1(probing) e1 handle_probe_probe mon.2 10.227.227.104:6789/0mon_probe(probe 5eacb654-3204-4ca1-9b16-83bb0140e497 name 4) v4
 -04-26 04:46:46.313100 7f22505c9700 10 mon.3@1(probing) e1 handle_probe mon_probe(probe 5eacb654-3204-4ca1-9b16-83bb0140e497 name 4) v4
 -04-26 04:46:46.313112 7f22505c9700 10 mon.3@1(probing) e1 handle_probe_probe mon.2 10.227.227.104:6789/0mon_probe(probe 5eacb654-3204-4ca1-9b16-83bb0140e497 name 4) v4
 -04-26 04:46:46.313222 7f22505c9700 10 mon.3@1(probing) e1 handle_probe mon_probe(reply 5eacb654-3204-4ca1-9b16-83bb0140e497 name 4 quorum 0,2 paxos( fc 11671256 lc 11671293 )) v4
 -04-26 04:46:46.313233 7f22505c9700 10 mon.3@1(probing) e1 handle_probe_reply mon.2 10.227.227.104:6789/0mon_probe(reply 5eacb654-3204-4ca1-9b16-83bb0140e497 name 4 quorum 0,2 paxos( fc 11671256 lc 11671293 )) v4
 -04-26 04:46:46.313245 7f22505c9700 10 mon.3@1(probing) e1  monmap is e1: 3 mons at {1=10.227.227.101:6789/0,3=10.227.227.103:6789/0,4=10.227.227.104:6789/0}
 -04-26 04:46:46.313273 7f22505c9700 10 mon.3@1(probing) e1  peer name is 4
 -04-26 04:46:46.313281 7f22505c9700 10 mon.3@1(probing) e1  existing quorum 0,2
 -04-26 04:46:46.313285 7f22505c9700 10 mon.3@1(probing) e1  peer paxos version 11671293 vs my version 11671280 (too far ahead)
 -04-26 04:46:46.313291 7f22505c9700 10 mon.3@1(probing) e1 cancel_probe_timeout 0x1f863e0
 -04-26 04:46:46.313296 7f22505c9700 10 mon.3@1(probing) e1 sync_start entity( mon.2 10.227.227.104:6789/0 )
 -04-26 04:46:46.385156 7f224f1c3700 10 mon.3@1(synchronizing sync( requester state start )) e1 ms_verify_authorizer 10.227.227.103:6813/9355 osd protocol 0
 -04-26 04:46:46.394653 7f224efc1700 10 mon.3@1(synchronizing sync( requester state start )) e1 ms_verify_authorizer 10.227.227.103:6810/9229 osd protocol 0
 -04-26 04:46:46.707385 7f224c8e4700 10 mon.3@1(synchronizing sync( requester state start )) e1 ms_verify_authorizer 10.227.227.103:6807/9109 osd protocol 0
 -04-26 04:46:46.800038 7f224b069700 10 mon.3@1(synchronizing sync( requester state start )) e1 ms_verify_authorizer 10.227.227.103:6816/9474 osd protocol 0
 -04-26 04:46:46.830717 7f224a859700 10 mon.3@1(synchronizing sync( requester state start )) e1 ms_verify_authorizer 10.227.227.103:6804/8931 osd protocol 0
 -04-26 04:47:00.952077 7f22031ec700 10 mon.3@1(synchronizing sync( requester state start )) e1 ms_verify_authorizer 10.227.227.103:0/16002 client protocol 0
 -04-26 04:47:01.100200 7f22505c9700 10 mon.3@1(synchronizing sync( requester state start )).monmap v1 get_monmap ver 0
 -04-26 04:47:05.918110 7f22505c9700 10 mon.3@1(synchronizing sync( requester state start )) e1 sync_store_init backup current monmap
 -04-26 04:47:05.918486 7f22505c9700 10 mon.3@1(synchronizing sync( requester state start )) e1 ms_handle_reset 0x2af29a0 10.227.227.103:0/16002
 -04-26 04:47:10.725317 7f22505c9700 10 mon.3@1(synchronizing sync( requester state start )) e1 do not have session, making new one
 -04-26 04:47:10.725373 7f22505c9700 10 mon.3@1(synchronizing sync( requester state start )) e1 ms_dispatch new session MonSession: mon.0 10.227.227.101:6789/0 is open for mon.0 10.227.227.101:6789/0
 -04-26 04:47:10.725396 7f22505c9700  5 mon.3@1(synchronizing sync( requester state start )) e1 setting monitor caps on this connection
 -04-26 04:47:10.725403 7f22505c9700 10 mon.3@1(synchronizing sync( requester state start )) e1 handle_probe mon_probe(probe 5eacb654-3204-4ca1-9b16-83bb0140e497 name 1) v4
 -04-26 04:47:10.725418 7f22505c9700 10 mon.3@1(synchronizing sync( requester state start )) e1 handle_probe_probe mon.0 10.227.227.101:6789/0mon_probe(probe 5eacb654-3204-4ca1-9b16-83bb0140e497 name 1) v4
 -04-26 04:47:10.725509 7f22505c9700 10 mon.3@1(synchronizing sync( requester state start )) e1 handle_probe mon_probe(probe 5eacb654-3204-4ca1-9b16-83bb0140e497 name 1) v4
 -04-26 04:47:10.725518 7f22505c9700 10 mon.3@1(synchronizing sync( requester state start )) e1 handle_probe_probe mon.0 10.227.227.101:6789/0mon_probe(probe 5eacb654-3204-4ca1-9b16-83bb0140e497 name 1) v4
 -04-26 04:47:10.725813 7f22505c9700 10 mon.3@1(synchronizing sync( requester state start )) e1 handle_probe mon_probe(reply 5eacb654-3204-4ca1-9b16-83bb0140e497 name 1 quorum 0,2 paxos( fc 11671256 lc 11671293 )) v4
 -04-26 04:47:10.725830 7f22505c9700 10 mon.3@1(synchronizing sync( requester state start )) e1 handle_probe_reply mon.0 10.227.227.101:6789/0mon_probe(reply 5eacb654-3204-4ca1-9b16-83bb0140e497 name 1 quorum 0,2 paxos( fc 11671256 lc 11671293 )) v4
 -04-26 04:47:10.725844 7f22505c9700 10 mon.3@1(synchronizing sync( requester state start )) e1  monmap is e1: 3 mons at {1=10.227.227.101:6789/0,3=10.227.227.103:6789/0,4=10.227.227.104:6789/0}
 -04-26 04:47:10.725877 7f22505c9700 10 mon.3@1(synchronizing sync( requester state start )) e1 handle_sync mon_sync( start_reply flags( reply-to(mon.2 10.227.227.104:6789/0) ) ) v1
 -04-26 04:47:10.725895 7f22505c9700 10 mon.3@1(synchronizing sync( requester state start )) e1 handle_sync_start_reply mon_sync( start_reply flags( reply-to(mon.2 10.227.227.104:6789/0) ) ) v1
 -04-26 04:47:10.725906 7f22505c9700 10 mon.3@1(synchronizing sync( requester state start )) e1 handle_sync_start_reply leader told us to use mon.2 10.227.227.104:6789/0 as sync provider
 -04-26 04:47:10.725916 7f22505c9700 10 mon.3@1(synchronizing sync( requester state start )) e1 sync_send_heartbeat mon.0 10.227.227.101:6789/0 reply(0)
 -04-26 04:47:10.725943 7f22505c9700 10 mon.3@1(synchronizing sync( requester state start )) e1 sync_start_chunks provider(mon.2 10.227.227.104:6789/0)
 -04-26 04:47:10.725998 7f22505c9700  1 mon.3@1(synchronizing sync( requester state chunks )) e1 discarding message auth(proto 0 26 bytes epoch 1) v1 and sending client elsewhere
 -04-26 04:47:10.726124 7f22505c9700  1 mon.3@1(synchronizing sync( requester state chunks )) e1 discarding message auth(proto 0 26 bytes epoch 1) v1 and sending client elsewhere
 -04-26 04:47:10.726188 7f22505c9700  1 mon.3@1(synchronizing sync( requester state chunks )) e1 discarding message auth(proto 0 26 bytes epoch 1) v1 and sending client elsewhere
 -04-26 04:47:10.726320 7f22505c9700  1 mon.3@1(synchronizing sync( requester state chunks )) e1 discarding message auth(proto 0 26 bytes epoch 1) v1 and sending client elsewhere
 -04-26 04:47:10.726392 7f22505c9700  1 mon.3@1(synchronizing sync( requester state chunks )) e1 discarding message auth(proto 0 27 bytes epoch 1) v1 and sending client elsewhere
 -04-26 04:47:10.726875 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( heartbeat_reply ) v1
 -04-26 04:47:10.726880 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_heartbeat_reply mon_sync( heartbeat_reply ) v1
 -04-26 04:47:10.844648 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 1042332 bytes last_key ( logm,full_5604626 ) ) v1
 -04-26 04:47:10.844660 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 1042332 bytes last_key ( logm,full_5604626 ) ) v1
 -04-26 04:47:10.867471 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 1046937 bytes last_key ( logm,full_5604720 ) ) v1
 -04-26 04:47:10.867483 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 1046937 bytes last_key ( logm,full_5604720 ) ) v1
 -04-26 04:47:10.885689 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 1047370 bytes last_key ( logm,full_5604812 ) ) v1
 -04-26 04:47:10.885700 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 1047370 bytes last_key ( logm,full_5604812 ) ) v1
 -04-26 04:47:10.904240 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 1046435 bytes last_key ( logm,full_5604904 ) ) v1
 -04-26 04:47:10.904252 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 1046435 bytes last_key ( logm,full_5604904 ) ) v1
 -04-26 04:47:11.153905 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 1048124 bytes last_key ( mdsmap,1875 ) ) v1
 -04-26 04:47:11.153920 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 1048124 bytes last_key ( mdsmap,1875 ) ) v1
 -04-26 04:47:11.841250 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 1048135 bytes last_key ( mdsmap,3400 ) ) v1
 -04-26 04:47:11.841267 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 1048135 bytes last_key ( mdsmap,3400 ) ) v1
 -04-26 04:47:12.417502 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 1048097 bytes last_key ( osdmap,10419 ) ) v1
 -04-26 04:47:12.417516 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 1048097 bytes last_key ( osdmap,10419 ) ) v1
 -04-26 04:47:12.724119 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 1047870 bytes last_key ( osdmap,full_10254 ) ) v1
 -04-26 04:47:12.724133 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 1047870 bytes last_key ( osdmap,full_10254 ) ) v1
 -04-26 04:47:12.752970 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 1048225 bytes last_key ( osdmap,full_10385 ) ) v1
 -04-26 04:47:12.752982 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 1048225 bytes last_key ( osdmap,full_10385 ) ) v1
 -04-26 04:47:12.877309 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 1046916 bytes last_key ( osdmap,full_10515 ) ) v1
 -04-26 04:47:12.877322 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 1046916 bytes last_key ( osdmap,full_10515 ) ) v1
 -04-26 04:47:13.005222 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 1044725 bytes last_key ( osdmap,full_10634 ) ) v1
 -04-26 04:47:13.005232 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 1044725 bytes last_key ( osdmap,full_10634 ) ) v1
 -04-26 04:47:13.034959 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 976367 bytes last_key ( pgmap,5938519 ) ) v1
 -04-26 04:47:13.034970 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 976367 bytes last_key ( pgmap,5938519 ) ) v1
 -04-26 04:47:13.054044 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 674845 bytes last_key ( pgmap,5938576 ) ) v1
 -04-26 04:47:13.054055 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 674845 bytes last_key ( pgmap,5938576 ) ) v1
 -04-26 04:47:13.067022 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 906154 bytes last_key ( pgmap,5938580 ) ) v1
 -04-26 04:47:13.067033 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 906154 bytes last_key ( pgmap,5938580 ) ) v1
 -04-26 04:47:13.083663 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 958727 bytes last_key ( pgmap,5938592 ) ) v1
 -04-26 04:47:13.083673 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 958727 bytes last_key ( pgmap,5938592 ) ) v1
 -04-26 04:47:13.095933 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 862440 bytes last_key ( pgmap,5938602 ) ) v1
 -04-26 04:47:13.095943 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 862440 bytes last_key ( pgmap,5938602 ) ) v1
 -04-26 04:47:13.113735 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 926741 bytes last_key ( pgmap,5938640 ) ) v1
 -04-26 04:47:13.113745 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 926741 bytes last_key ( pgmap,5938640 ) ) v1
 -04-26 04:47:13.128830 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 1036437 bytes last_key ( pgmap,5938680 ) ) v1
 -04-26 04:47:13.128841 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 1036437 bytes last_key ( pgmap,5938680 ) ) v1
 -04-26 04:47:13.143904 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 1004547 bytes last_key ( pgmap,5938688 ) ) v1
 -04-26 04:47:13.143914 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 1004547 bytes last_key ( pgmap,5938688 ) ) v1
 -04-26 04:47:13.156292 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 890708 bytes last_key ( pgmap,5938699 ) ) v1
 -04-26 04:47:13.156303 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 890708 bytes last_key ( pgmap,5938699 ) ) v1
 -04-26 04:47:13.173771 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 832242 bytes last_key ( pgmap,5938718 ) ) v1
 -04-26 04:47:13.173782 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 832242 bytes last_key ( pgmap,5938718 ) ) v1
 -04-26 04:47:13.187126 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 977004 bytes last_key ( pgmap,5938723 ) ) v1
 -04-26 04:47:13.187140 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 977004 bytes last_key ( pgmap,5938723 ) ) v1
 -04-26 04:47:13.203460 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 905146 bytes last_key ( pgmap,5938727 ) ) v1
 -04-26 04:47:13.203471 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 905146 bytes last_key ( pgmap,5938727 ) ) v1
 -04-26 04:47:13.217184 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 1018823 bytes last_key ( pgmap,5938732 ) ) v1
 -04-26 04:47:13.217194 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 1018823 bytes last_key ( pgmap,5938732 ) ) v1
 -04-26 04:47:13.233776 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 1030128 bytes last_key ( pgmap,5938744 ) ) v1
 -04-26 04:47:13.233787 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 1030128 bytes last_key ( pgmap,5938744 ) ) v1
 -04-26 04:47:13.264531 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 853823 bytes last_key ( pgmap,5938963 ) ) v1
 -04-26 04:47:13.264542 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 853823 bytes last_key ( pgmap,5938963 ) ) v1
 -04-26 04:47:13.284588 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 712905 bytes last_key ( pgmap,first_committed ) ) v1
 -04-26 04:47:13.284598 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 712905 bytes last_key ( pgmap,first_committed ) ) v1
 -04-26 04:47:13.298863 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 964152 bytes last_key ( pgmap,full_5938714 ) ) v1
 -04-26 04:47:13.298874 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 964152 bytes last_key ( pgmap,full_5938714 ) ) v1
 -04-26 04:47:13.314457 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5938740 ) ) v1
 -04-26 04:47:13.314468 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5938740 ) ) v1
 -04-26 04:47:13.334279 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5938766 ) ) v1
 -04-26 04:47:13.334289 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5938766 ) ) v1
 -04-26 04:47:13.347753 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5938792 ) ) v1
 -04-26 04:47:13.347764 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5938792 ) ) v1
 -04-26 04:47:13.364577 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5938818 ) ) v1
 -04-26 04:47:13.364588 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5938818 ) ) v1
 -04-26 04:47:13.384268 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5938844 ) ) v1
 -04-26 04:47:13.384278 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5938844 ) ) v1
 -04-26 04:47:13.398114 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5938870 ) ) v1
 -04-26 04:47:13.398124 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5938870 ) ) v1
 -04-26 04:47:13.414476 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5938896 ) ) v1
 -04-26 04:47:13.414486 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5938896 ) ) v1
 -04-26 04:47:13.434237 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5938922 ) ) v1
 -04-26 04:47:13.434252 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5938922 ) ) v1
 -04-26 04:47:13.447748 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5938948 ) ) v1
 -04-26 04:47:13.447754 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5938948 ) ) v1
 -04-26 04:47:13.464354 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5938974 ) ) v1
 -04-26 04:47:13.464364 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5938974 ) ) v1
 -04-26 04:47:13.477785 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5939000 ) ) v1
 -04-26 04:47:13.477792 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 964168 bytes last_key ( pgmap,full_5939000 ) ) v1
 -04-26 04:47:13.494299 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 964257 bytes last_key ( pgmap,last_committed ) ) v1
 -04-26 04:47:13.494310 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 964257 bytes last_key ( pgmap,last_committed ) ) v1
 -04-26 04:47:13.506438 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk bl 869389 bytes last_key ( pgmap,latest ) ) v1
 -04-26 04:47:13.506448 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk bl 869389 bytes last_key ( pgmap,latest ) ) v1
 -04-26 04:47:13.523733 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync mon_sync( chunk v 11671317 flags( last ) bl 329237 bytes last_key ( paxos,last_pn ) ) v1
 -04-26 04:47:13.523744 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 handle_sync_chunk mon_sync( chunk v 11671317 flags( last ) bl 329237 bytes last_key ( paxos,last_pn ) ) v1
 -04-26 04:47:13.533357 7f22505c9700 10 mon.3@1(synchronizing sync( requester state chunks )) e1 sync_stop
 -04-26 04:47:13.534673 7f22505c9700 10 mon.3@1(synchronizing sync( requester state stop )) e1 handle_sync mon_sync( finish_reply ) v1
 -04-26 04:47:13.534683 7f22505c9700 10 mon.3@1(synchronizing sync( requester state stop )) e1 handle_sync_finish_reply mon_sync( finish_reply ) v1
 -04-26 04:47:13.543895 7f22505c9700 10 mon.3@1(synchronizing) e1 init_paxos
 -04-26 04:47:13.552988 7f22505c9700  7 mon.3@1(synchronizing).pg v5939027 update_from_paxos  applying incremental 5939028
 -04-26 04:47:13.554861 7f22505c9700 10 mon.3@1(synchronizing).pg v5939028 v5939028: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:13.559579 7f22505c9700  7 mon.3@1(synchronizing).pg v5939028 update_from_paxos  applying incremental 5939029
 -04-26 04:47:13.560611 7f22505c9700 10 mon.3@1(synchronizing).pg v5939029 v5939029: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:13.564075 7f22505c9700  7 mon.3@1(synchronizing).pg v5939029 update_from_paxos  applying incremental 5939030
 -04-26 04:47:13.564344 7f22505c9700 10 mon.3@1(synchronizing).pg v5939030 v5939030: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:13.567093 7f22505c9700  7 mon.3@1(synchronizing).pg v5939030 update_from_paxos  applying incremental 5939031
 -04-26 04:47:13.567113 7f22505c9700 10 mon.3@1(synchronizing).pg v5939031 v5939031: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 158B/s wr, 0op/s
 -04-26 04:47:13.569859 7f22505c9700  7 mon.3@1(synchronizing).pg v5939031 update_from_paxos  applying incremental 5939032
 -04-26 04:47:13.569878 7f22505c9700 10 mon.3@1(synchronizing).pg v5939032 v5939032: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 162B/s wr, 0op/s
 -04-26 04:47:13.572674 7f22505c9700  7 mon.3@1(synchronizing).pg v5939032 update_from_paxos  applying incremental 5939033
 -04-26 04:47:13.572704 7f22505c9700 10 mon.3@1(synchronizing).pg v5939033 v5939033: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:13.575460 7f22505c9700  7 mon.3@1(synchronizing).pg v5939033 update_from_paxos  applying incremental 5939034
 -04-26 04:47:13.575484 7f22505c9700 10 mon.3@1(synchronizing).pg v5939034 v5939034: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 760B/s wr, 0op/s
 -04-26 04:47:13.578217 7f22505c9700  7 mon.3@1(synchronizing).pg v5939034 update_from_paxos  applying incremental 5939035
 -04-26 04:47:13.578256 7f22505c9700 10 mon.3@1(synchronizing).pg v5939035 v5939035: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 546B/s wr, 0op/s
 -04-26 04:47:13.581008 7f22505c9700  7 mon.3@1(synchronizing).pg v5939035 update_from_paxos  applying incremental 5939036
 -04-26 04:47:13.581035 7f22505c9700 10 mon.3@1(synchronizing).pg v5939036 v5939036: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:13.583803 7f22505c9700  7 mon.3@1(synchronizing).pg v5939036 update_from_paxos  applying incremental 5939037
 -04-26 04:47:13.583822 7f22505c9700 10 mon.3@1(synchronizing).pg v5939037 v5939037: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:13.586559 7f22505c9700  7 mon.3@1(synchronizing).pg v5939037 update_from_paxos  applying incremental 5939038
 -04-26 04:47:13.586586 7f22505c9700 10 mon.3@1(synchronizing).pg v5939038 v5939038: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:13.589342 7f22505c9700  7 mon.3@1(synchronizing).pg v5939038 update_from_paxos  applying incremental 5939039
 -04-26 04:47:13.589368 7f22505c9700 10 mon.3@1(synchronizing).pg v5939039 v5939039: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:13.592108 7f22505c9700  7 mon.3@1(synchronizing).pg v5939039 update_from_paxos  applying incremental 5939040
 -04-26 04:47:13.592128 7f22505c9700 10 mon.3@1(synchronizing).pg v5939040 v5939040: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:13.593419 7f22505c9700 10 mon.3@1(synchronizing).pg v5939040 send_pg_creates to 0 pgs
 -04-26 04:47:13.593429 7f22505c9700 10 mon.3@1(synchronizing).pg v5939040 update_logger
 -04-26 04:47:13.593651 7f22505c9700 10 mon.3@1(synchronizing).log v5604934 update_from_paxos
 -04-26 04:47:13.593782 7f22505c9700 10 mon.3@1(synchronizing).log v5604934 update_from_paxos version 5604934 summary v 5604916
 -04-26 04:47:13.593861 7f22505c9700 10 mon.3@1(synchronizing).log v5604934 update_from_paxos latest full 5604933
 -04-26 04:47:13.593977 7f22505c9700  7 mon.3@1(synchronizing).log v5604934 update_from_paxos loading summary e5604933
 -04-26 04:47:13.594069 7f22505c9700  7 mon.3@1(synchronizing).log v5604934 update_from_paxos loaded summary e5604933
 -04-26 04:47:13.594179 7f22505c9700  7 mon.3@1(synchronizing).log v5604934 update_from_paxos applying incremental log 5604934 2013-04-26 04:47:07.924170 osd.5 10.227.227.104:6807/15124 182 : [INF] 2.81 deep-scrub ok
 -04-26 04:47:13.594295 7f22505c9700 10 mon.3@1(synchronizing).log v5604934 check_subs
 -04-26 04:47:13.594411 7f22505c9700 10 mon.3@1(synchronizing).auth v4474 update_from_paxos
 -04-26 04:47:13.594557 7f22505c9700 10 mon.3@1(synchronizing).auth v4474 update_from_paxos version 4474 keys ver 4469 latest 4467
 -04-26 04:47:13.594590 7f22505c9700 10 mon.3@1(synchronizing).auth v4474 update_from_paxos key server version 4469
 -04-26 04:47:13.594812 7f22505c9700 10 mon.3@1(synchronizing).auth v4474 update_from_paxos() last_allocated_id=227396 max_global_id=227796
 -04-26 04:47:13.594848 7f22505c9700 10 mon.3@1(synchronizing) e1 bootstrap
 -04-26 04:47:13.594851 7f22505c9700 10 mon.3@1(synchronizing) e1 unregister_cluster_logger - not registered
 -04-26 04:47:13.594853 7f22505c9700 10 mon.3@1(synchronizing) e1 cancel_probe_timeout (none scheduled)
 -04-26 04:47:13.594857 7f22505c9700 10 mon.3@1(synchronizing) e1 reset_sync
 -04-26 04:47:13.594859 7f22505c9700 10 mon.3@1(probing) e1 reset
 -04-26 04:47:13.594861 7f22505c9700 10 mon.3@1(probing) e1 timecheck_finish
 -04-26 04:47:13.594868 7f22505c9700 10 mon.3@1(probing) e1 cancel_probe_timeout (none scheduled)
 -04-26 04:47:13.594878 7f22505c9700 10 mon.3@1(probing) e1 reset_probe_timeout 0x3cfd040 after 2 seconds
 -04-26 04:47:13.594891 7f22505c9700 10 mon.3@1(probing) e1 probing other monitors
 -04-26 04:47:13.595992 7f22505c9700 10 mon.3@1(probing) e1 handle_probe mon_probe(reply 5eacb654-3204-4ca1-9b16-83bb0140e497 name 4 quorum 0,2 paxos( fc 11671287 lc 11671320 )) v4
 -04-26 04:47:13.596001 7f22505c9700 10 mon.3@1(probing) e1 handle_probe_reply mon.2 10.227.227.104:6789/0mon_probe(reply 5eacb654-3204-4ca1-9b16-83bb0140e497 name 4 quorum 0,2 paxos( fc 11671287 lc 11671320 )) v4
 -04-26 04:47:13.596009 7f22505c9700 10 mon.3@1(probing) e1  monmap is e1: 3 mons at {1=10.227.227.101:6789/0,3=10.227.227.103:6789/0,4=10.227.227.104:6789/0}
 -04-26 04:47:13.596024 7f22505c9700 10 mon.3@1(probing) e1  peer name is 4
 -04-26 04:47:13.596028 7f22505c9700 10 mon.3@1(probing) e1  existing quorum 0,2
 -04-26 04:47:13.596030 7f22505c9700 10 mon.3@1(probing) e1  peer paxos version 11671320 vs my version 11671317 (ok)
 -04-26 04:47:13.596032 7f22505c9700 10 mon.3@1(probing) e1 start_election
 -04-26 04:47:13.596034 7f22505c9700 10 mon.3@1(probing) e1 cancel_probe_timeout 0x3cfd040
 -04-26 04:47:13.596070 7f22505c9700  0 log [INF] : mon.3 calling new monitor election
 -04-26 04:47:13.596112 7f22505c9700  5 mon.3@1(electing).elector(0) start -- can i be leader?
 -04-26 04:47:13.596175 7f22505c9700  1 mon.3@1(electing).elector(2850) init, last seen epoch 2850
 -04-26 04:47:13.596184 7f22505c9700 10 mon.3@1(electing).elector(2850) bump_epoch 2850 to 2851
 -04-26 04:47:13.596459 7f22505c9700 10 mon.3@1(electing) e1 handle_probe mon_probe(reply 5eacb654-3204-4ca1-9b16-83bb0140e497 name 1 quorum 0,2 paxos( fc 11671287 lc 11671320 )) v4
 -04-26 04:47:13.596465 7f22505c9700 10 mon.3@1(electing) e1 handle_probe_reply mon.0 10.227.227.101:6789/0mon_probe(reply 5eacb654-3204-4ca1-9b16-83bb0140e497 name 1 quorum 0,2 paxos( fc 11671287 lc 11671320 )) v4
 -04-26 04:47:13.596473 7f22505c9700 10 mon.3@1(electing) e1  monmap is e1: 3 mons at {1=10.227.227.101:6789/0,3=10.227.227.103:6789/0,4=10.227.227.104:6789/0}
 -04-26 04:47:13.596490 7f22505c9700 10 mon.3@1(electing) e1 do not have session, making new one
 -04-26 04:47:13.596493 7f22505c9700 10 mon.3@1(electing) e1 ms_dispatch new session MonSession: mon.1 10.227.227.103:6789/0 is open for mon.1 10.227.227.103:6789/0
 -04-26 04:47:13.596499 7f22505c9700  5 mon.3@1(electing) e1 setting monitor caps on this connection
 -04-26 04:47:13.613194 7f22505c9700  5 mon.3@1(electing).elector(2851) handle_propose from mon.2
 -04-26 04:47:13.613212 7f22505c9700 10 mon.3@1(electing).elector(2851) bump_epoch 2851 to 2853
 -04-26 04:47:13.613449 7f22505c9700 10 mon.3@1(electing) e1 reset
 -04-26 04:47:13.613473 7f22505c9700 10 mon.3@1(electing) e1 timecheck_finish
 -04-26 04:47:13.613478 7f22505c9700 10 mon.3@1(electing) e1 start_election
 -04-26 04:47:13.613480 7f22505c9700 10 mon.3@1(electing) e1 cancel_probe_timeout (none scheduled)
 -04-26 04:47:13.613488 7f22505c9700  0 log [INF] : mon.3 calling new monitor election
 -04-26 04:47:13.613522 7f22505c9700  5 mon.3@1(electing).elector(2853) start -- can i be leader?
 -04-26 04:47:13.613606 7f22505c9700  1 mon.3@1(electing).elector(2853) init, last seen epoch 2853
 -04-26 04:47:13.613718 7f22505c9700  5 mon.3@1(electing).elector(2853) handle_ack from mon.2
 -04-26 04:47:13.613729 7f22505c9700  5 mon.3@1(electing).elector(2853)  so far i have {1=4294967295,2=4294967295}
 -04-26 04:47:13.614676 7f22505c9700  5 mon.3@1(electing).elector(2853) handle_ack from mon.2
 -04-26 04:47:13.614684 7f22505c9700  5 mon.3@1(electing).elector(2853)  so far i have {1=4294967295,2=4294967295}
 -04-26 04:47:13.620824 7f22505c9700  5 mon.3@1(electing).elector(2853) handle_propose from mon.0
 -04-26 04:47:13.620831 7f22505c9700  5 mon.3@1(electing).elector(2853) defer to 0
 -04-26 04:47:13.629182 7f22505c9700  5 mon.3@1(electing).elector(2853) handle_victory from mon.0 quorum_features 0
 -04-26 04:47:13.629190 7f22505c9700 10 mon.3@1(electing).elector(2853) bump_epoch 2853 to 2854
 -04-26 04:47:13.629413 7f22505c9700 10 mon.3@1(peon) e1 lose_election, epoch 2854 leader is mon0 quorum is 0,1,2 features are 0
 -04-26 04:47:13.629441 7f22505c9700 10 mon.3@1(peon).data_health(2854) start_epoch epoch 2854
 -04-26 04:47:13.629451 7f22505c9700 10 mon.3@1(peon) e1 timecheck_finish
 -04-26 04:47:13.629456 7f22505c9700 10 mon.3@1(peon) e1 resend_routed_requests
 -04-26 04:47:13.629460 7f22505c9700 10 mon.3@1(peon) e1 register_cluster_logger
 -04-26 04:47:13.637934 7f22505c9700 10 mon.3@1(peon) e1 handle_timecheck time_check( ping e 2854 r 1 ) v1
 -04-26 04:47:13.637955 7f22505c9700 10 mon.3@1(peon) e1 handle_timecheck_peon time_check( ping e 2854 r 1 ) v1
 -04-26 04:47:13.637961 7f22505c9700 10 mon.3@1(peon) e1 handle_timecheck_peon send time_check( ping e 2854 r 1 ) v1 to mon.0 10.227.227.101:6789/0
 -04-26 04:47:13.672357 7f22505c9700  7 mon.3@1(peon).pg v5939040 update_from_paxos  applying incremental 5939041
 -04-26 04:47:13.672407 7f22505c9700 10 mon.3@1(peon).pg v5939041 v5939041: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:13.676980 7f22505c9700  7 mon.3@1(peon).pg v5939041 update_from_paxos  applying incremental 5939042
 -04-26 04:47:13.677015 7f22505c9700 10 mon.3@1(peon).pg v5939042 v5939042: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:13.679093 7f22505c9700 10 mon.3@1(peon).pg v5939042 send_pg_creates to 0 pgs
 -04-26 04:47:13.679107 7f22505c9700 10 mon.3@1(peon).pg v5939042 update_logger
 -04-26 04:47:13.683167 7f22505c9700 10 mon.3@1(peon).pg v5939042 update_logger
 -04-26 04:47:13.683292 7f22505c9700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:47:13.683313 7f22505c9700 10 mon.3@1(peon).mds e3770 update_logger
 -04-26 04:47:13.683444 7f22505c9700 10 mon.3@1(peon).osd e10649 update_logger
 -04-26 04:47:13.683457 7f22505c9700 10 mon.3@1(peon).osd e10649 kick_all_failures on 0 osds
 -04-26 04:47:13.683461 7f22505c9700 10 mon.3@1(peon).log v5604935 update_from_paxos
 -04-26 04:47:13.683527 7f22505c9700 10 mon.3@1(peon).log v5604935 update_from_paxos version 5604935 summary v 5604934
 -04-26 04:47:13.683591 7f22505c9700 10 mon.3@1(peon).log v5604935 update_from_paxos latest full 5604934
 -04-26 04:47:13.683665 7f22505c9700  7 mon.3@1(peon).log v5604935 update_from_paxos applying incremental log 5604935 2013-04-26 04:47:06.873100 osd.1 10.227.227.101:6804/17898 188 : [INF] 2.9b deep-scrub ok
 -04-26 04:47:13.683727 7f22505c9700  7 mon.3@1(peon).log v5604935 update_from_paxos applying incremental log 5604935 2013-04-26 04:47:11.198740 mon.0 10.227.227.101:6789/0 21 : [INF] pgmap v5939041: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:13.683809 7f22505c9700 10 mon.3@1(peon).log v5604935 check_subs
 -04-26 04:47:13.683975 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:13.684084 7f22505c9700 10 mon.3@1(peon).auth v4474 AuthMonitor::on_active()
 -04-26 04:47:13.684190 7f22505c9700 10 mon.3@1(peon).log v5604935 update_from_paxos
 -04-26 04:47:13.684248 7f22505c9700 10 mon.3@1(peon).log v5604935 update_from_paxos version 5604935 summary v 5604935
 -04-26 04:47:13.684281 7f22505c9700 10 mon.3@1(peon).log v5604935 preprocess_query log(1 entries) v1 from mon.1 10.227.227.103:6789/0
 -04-26 04:47:13.684320 7f22505c9700 10 mon.3@1(peon).log v5604935 preprocess_log log(1 entries) v1 from mon.1
 -04-26 04:47:13.684369 7f22505c9700 10 mon.3@1(peon) e1 forward_request 1 request log(1 entries) v1
 -04-26 04:47:13.684451 7f22505c9700 10 mon.3@1(peon).log v5604935 update_from_paxos
 -04-26 04:47:13.684509 7f22505c9700 10 mon.3@1(peon).log v5604935 update_from_paxos version 5604935 summary v 5604935
 -04-26 04:47:13.684540 7f22505c9700 10 mon.3@1(peon).log v5604935 preprocess_query log(1 entries) v1 from mon.1 10.227.227.103:6789/0
 -04-26 04:47:13.684574 7f22505c9700 10 mon.3@1(peon).log v5604935 preprocess_log log(1 entries) v1 from mon.1
 -04-26 04:47:13.684614 7f22505c9700 10 mon.3@1(peon) e1 forward_request 2 request log(1 entries) v1
 -04-26 04:47:13.685947 7f22505c9700 10 mon.3@1(peon).log v5604935 update_from_paxos
 -04-26 04:47:13.686013 7f22505c9700 10 mon.3@1(peon).log v5604935 update_from_paxos version 5604935 summary v 5604935
 -04-26 04:47:13.686078 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:13.686156 7f22505c9700 10 mon.3@1(peon) e1 handle_timecheck time_check( report e 2854 r 2 #skews 3 #latencies 3 ) v1
 -04-26 04:47:13.686160 7f22505c9700 10 mon.3@1(peon) e1 handle_timecheck_peon time_check( report e 2854 r 2 #skews 3 #latencies 3 ) v1
 -04-26 04:47:14.150694 7f22505c9700  7 mon.3@1(peon).pg v5939042 update_from_paxos  applying incremental 5939043
 -04-26 04:47:14.150748 7f22505c9700 10 mon.3@1(peon).pg v5939043 v5939043: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:14.152618 7f22505c9700 10 mon.3@1(peon).pg v5939043 send_pg_creates to 0 pgs
 -04-26 04:47:14.152628 7f22505c9700 10 mon.3@1(peon).pg v5939043 update_logger
 -04-26 04:47:14.152766 7f22505c9700 10 mon.3@1(peon).log v5604935 update_from_paxos
 -04-26 04:47:14.152843 7f22505c9700 10 mon.3@1(peon).log v5604935 update_from_paxos version 5604935 summary v 5604935
 -04-26 04:47:14.152912 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:14.311004 7f22505c9700 10 mon.3@1(peon).log v5604936 update_from_paxos
 -04-26 04:47:14.311126 7f22505c9700 10 mon.3@1(peon).log v5604936 update_from_paxos version 5604936 summary v 5604935
 -04-26 04:47:14.311230 7f22505c9700 10 mon.3@1(peon).log v5604936 update_from_paxos latest full 5604935
 -04-26 04:47:14.311361 7f22505c9700  7 mon.3@1(peon).log v5604936 update_from_paxos applying incremental log 5604936 2013-04-26 04:47:13.033220 mon.0 10.227.227.101:6789/0 22 : [INF] pgmap v5939042: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:14.311465 7f22505c9700  7 mon.3@1(peon).log v5604936 update_from_paxos applying incremental log 5604936 2013-04-26 04:47:13.596073 mon.1 10.227.227.103:6789/0 1 : [INF] mon.3 calling new monitor election
 -04-26 04:47:14.311573 7f22505c9700  7 mon.3@1(peon).log v5604936 update_from_paxos applying incremental log 5604936 2013-04-26 04:47:13.620776 mon.0 10.227.227.101:6789/0 23 : [INF] mon.1 calling new monitor election
 -04-26 04:47:14.311665 7f22505c9700  7 mon.3@1(peon).log v5604936 update_from_paxos applying incremental log 5604936 2013-04-26 04:47:13.627575 mon.2 10.227.227.104:6789/0 2 : [INF] mon.4 calling new monitor election
 -04-26 04:47:14.311751 7f22505c9700  7 mon.3@1(peon).log v5604936 update_from_paxos applying incremental log 5604936 2013-04-26 04:47:13.652203 mon.0 10.227.227.101:6789/0 24 : [INF] mon.1@0 won leader election with quorum 0,1,2
 -04-26 04:47:14.311839 7f22505c9700  7 mon.3@1(peon).log v5604936 update_from_paxos applying incremental log 5604936 2013-04-26 04:47:13.682774 mon.0 10.227.227.101:6789/0 25 : [INF] pgmap v5939042: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:14.311930 7f22505c9700  7 mon.3@1(peon).log v5604936 update_from_paxos applying incremental log 5604936 2013-04-26 04:47:13.682967 mon.0 10.227.227.101:6789/0 26 : [INF] mdsmap e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:47:14.312019 7f22505c9700  7 mon.3@1(peon).log v5604936 update_from_paxos applying incremental log 5604936 2013-04-26 04:47:13.683170 mon.0 10.227.227.101:6789/0 27 : [INF] osdmap e10649: 12 osds: 12 up, 12 in
 -04-26 04:47:14.312180 7f22505c9700 10 mon.3@1(peon).log v5604936 check_subs
 -04-26 04:47:14.312327 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:14.312474 7f22505c9700 10 mon.3@1(peon) e1 handle_route log(last 1) v1 to unknown.0 :/0
 -04-26 04:47:15.419360 7f22505c9700 10 mon.3@1(peon).log v5604937 update_from_paxos
 -04-26 04:47:15.419487 7f22505c9700 10 mon.3@1(peon).log v5604937 update_from_paxos version 5604937 summary v 5604936
 -04-26 04:47:15.419591 7f22505c9700 10 mon.3@1(peon).log v5604937 update_from_paxos latest full 5604936
 -04-26 04:47:15.419722 7f22505c9700  7 mon.3@1(peon).log v5604937 update_from_paxos applying incremental log 5604937 2013-04-26 04:47:13.683526 mon.0 10.227.227.101:6789/0 28 : [INF] monmap e1: 3 mons at {1=10.227.227.101:6789/0,3=10.227.227.103:6789/0,4=10.227.227.104:6789/0}
 -04-26 04:47:15.419864 7f22505c9700 10 mon.3@1(peon).log v5604937 check_subs
 -04-26 04:47:15.420007 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:15.727551 7f2250dca700 10 mon.3@1(peon).pg v5939043 v5939043: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:15.727752 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:47:15.727861 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:47:15.727888 7f2250dca700 10 mon.3@1(peon).log v5604937 update_from_paxos
 -04-26 04:47:15.728012 7f2250dca700 10 mon.3@1(peon).log v5604937 update_from_paxos version 5604937 summary v 5604937
 -04-26 04:47:15.728070 7f2250dca700 10 mon.3@1(peon).log v5604937 log
 -04-26 04:47:15.728189 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:15.728307 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:47:16.451888 7f22505c9700  7 mon.3@1(peon).pg v5939043 update_from_paxos  applying incremental 5939044
 -04-26 04:47:16.451924 7f22505c9700 10 mon.3@1(peon).pg v5939044 v5939044: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:16.454035 7f22505c9700 10 mon.3@1(peon).pg v5939044 send_pg_creates to 0 pgs
 -04-26 04:47:16.454050 7f22505c9700 10 mon.3@1(peon).pg v5939044 update_logger
 -04-26 04:47:16.454286 7f22505c9700 10 mon.3@1(peon).log v5604937 update_from_paxos
 -04-26 04:47:16.454411 7f22505c9700 10 mon.3@1(peon).log v5604937 update_from_paxos version 5604937 summary v 5604937
 -04-26 04:47:16.454534 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:16.582298 7f22505c9700 10 mon.3@1(peon).data_health(2854) service_dispatch mon_health( service 1 op tell e 0 r 0 flags none ) v1
 -04-26 04:47:16.582318 7f22505c9700 10 mon.3@1(peon).data_health(2854) handle_tell mon_health( service 1 op tell e 0 r 0 flags none ) v1
 -04-26 04:47:17.545627 7f22505c9700 10 mon.3@1(peon).log v5604938 update_from_paxos
 -04-26 04:47:17.545709 7f22505c9700 10 mon.3@1(peon).log v5604938 update_from_paxos version 5604938 summary v 5604937
 -04-26 04:47:17.545773 7f22505c9700 10 mon.3@1(peon).log v5604938 update_from_paxos latest full 5604937
 -04-26 04:47:17.545857 7f22505c9700  7 mon.3@1(peon).log v5604938 update_from_paxos applying incremental log 5604938 2013-04-26 04:47:07.988767 osd.4 10.227.227.104:6804/15010 188 : [INF] 1.2bb deep-scrub ok
 -04-26 04:47:17.545922 7f22505c9700  7 mon.3@1(peon).log v5604938 update_from_paxos applying incremental log 5604938 2013-04-26 04:47:10.837836 osd.4 10.227.227.104:6804/15010 189 : [INF] 1.2bf deep-scrub ok
 -04-26 04:47:17.545986 7f22505c9700  7 mon.3@1(peon).log v5604938 update_from_paxos applying incremental log 5604938 2013-04-26 04:47:14.172439 mon.0 10.227.227.101:6789/0 29 : [INF] pgmap v5939043: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:17.546048 7f22505c9700  7 mon.3@1(peon).log v5604938 update_from_paxos applying incremental log 5604938 2013-04-26 04:47:16.472720 mon.0 10.227.227.101:6789/0 30 : [INF] pgmap v5939044: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:17.546148 7f22505c9700 10 mon.3@1(peon).log v5604938 check_subs
 -04-26 04:47:17.546235 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:17.652900 7f22505c9700  7 mon.3@1(peon).pg v5939044 update_from_paxos  applying incremental 5939045
 -04-26 04:47:17.652933 7f22505c9700 10 mon.3@1(peon).pg v5939045 v5939045: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:17.655009 7f22505c9700 10 mon.3@1(peon).pg v5939045 send_pg_creates to 0 pgs
 -04-26 04:47:17.655023 7f22505c9700 10 mon.3@1(peon).pg v5939045 update_logger
 -04-26 04:47:17.655220 7f22505c9700 10 mon.3@1(peon).log v5604938 update_from_paxos
 -04-26 04:47:17.655334 7f22505c9700 10 mon.3@1(peon).log v5604938 update_from_paxos version 5604938 summary v 5604938
 -04-26 04:47:17.655456 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:18.812040 7f22505c9700 10 mon.3@1(peon).log v5604939 update_from_paxos
 -04-26 04:47:18.812119 7f22505c9700 10 mon.3@1(peon).log v5604939 update_from_paxos version 5604939 summary v 5604938
 -04-26 04:47:18.812205 7f22505c9700 10 mon.3@1(peon).log v5604939 update_from_paxos latest full 5604938
 -04-26 04:47:18.812291 7f22505c9700  7 mon.3@1(peon).log v5604939 update_from_paxos applying incremental log 5604939 2013-04-26 04:47:17.673813 mon.0 10.227.227.101:6789/0 31 : [INF] pgmap v5939045: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:18.812462 7f22505c9700 10 mon.3@1(peon).log v5604939 check_subs
 -04-26 04:47:18.812553 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:20.730592 7f2250dca700 10 mon.3@1(peon).pg v5939045 v5939045: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:20.730787 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:47:20.730887 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:47:20.730900 7f2250dca700 10 mon.3@1(peon).log v5604939 update_from_paxos
 -04-26 04:47:20.731021 7f2250dca700 10 mon.3@1(peon).log v5604939 update_from_paxos version 5604939 summary v 5604939
 -04-26 04:47:20.731076 7f2250dca700 10 mon.3@1(peon).log v5604939 log
 -04-26 04:47:20.731191 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:20.731306 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:47:21.813193 7f22505c9700 10 mon.3@1(peon).log v5604939 update_from_paxos
 -04-26 04:47:21.813308 7f22505c9700 10 mon.3@1(peon).log v5604939 update_from_paxos version 5604939 summary v 5604939
 -04-26 04:47:21.813424 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:23.753466 7f224a859700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/16038 client protocol 0
 -04-26 04:47:23.753956 7f22505c9700 10 mon.3@1(peon) e1 do not have session, making new one
 -04-26 04:47:23.753967 7f22505c9700 10 mon.3@1(peon) e1 ms_dispatch new session MonSession: client.? 10.227.227.103:0/16038 is open for client.? 10.227.227.103:0/16038
 -04-26 04:47:23.753978 7f22505c9700 10 mon.3@1(peon) e1 setting timeout on session
 -04-26 04:47:23.754185 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:23.754285 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 0 30 bytes epoch 0) v1 from client.? 10.227.227.103:0/16038
 -04-26 04:47:23.754355 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=30
 -04-26 04:47:23.754431 7f22505c9700 10 mon.3@1(peon).auth v4474 AuthMonitor::assign_global_id m=auth(proto 0 30 bytes epoch 0) v1 mon=1/3 last_allocated=227396 max_global_id=227796
 -04-26 04:47:23.754487 7f22505c9700 10 mon.3@1(peon).auth v4474 next_global_id should be 227398
 -04-26 04:47:23.755999 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:23.756098 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 2 32 bytes epoch 0) v1 from client.? 10.227.227.103:0/16038
 -04-26 04:47:23.756155 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=32
 -04-26 04:47:23.757273 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:23.757371 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 2 165 bytes epoch 0) v1 from client.? 10.227.227.103:0/16038
 -04-26 04:47:23.757440 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=165
 -04-26 04:47:23.758458 7f22505c9700 10 mon.3@1(peon) e1 handle_subscribe mon_subscribe({monmap=0+}) v2
 -04-26 04:47:23.758473 7f22505c9700 10 mon.3@1(peon) e1 check_sub monmap next 0 have 1
 -04-26 04:47:23.758553 7f22505c9700  0 mon.3@1(peon) e1 handle_command mon_command(health v 0) v1
 -04-26 04:47:23.759151 7f22505c9700 10 mon.3@1(peon).data_health(2854) get_health
 -04-26 04:47:23.759853 7f22505c9700 10 mon.3@1(peon) e1 ms_handle_reset 0x2af38c0 10.227.227.103:0/16038
 -04-26 04:47:23.759883 7f22505c9700 10 mon.3@1(peon) e1 reset/close on session client.? 10.227.227.103:0/16038
 -04-26 04:47:23.759895 7f22505c9700 10 mon.3@1(peon) e1 remove_session MonSession: client.? 10.227.227.103:0/16038 is openallow * client.? 10.227.227.103:0/16038
 -04-26 04:47:24.813417 7f22505c9700 10 mon.3@1(peon).log v5604939 update_from_paxos
 -04-26 04:47:24.813545 7f22505c9700 10 mon.3@1(peon).log v5604939 update_from_paxos version 5604939 summary v 5604939
 -04-26 04:47:24.813659 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:25.732851 7f2250dca700 10 mon.3@1(peon).pg v5939045 v5939045: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:25.732977 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:47:25.733041 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:47:25.733052 7f2250dca700 10 mon.3@1(peon).log v5604939 update_from_paxos
 -04-26 04:47:25.733129 7f2250dca700 10 mon.3@1(peon).log v5604939 update_from_paxos version 5604939 summary v 5604939
 -04-26 04:47:25.733160 7f2250dca700 10 mon.3@1(peon).log v5604939 log
 -04-26 04:47:25.733235 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:25.733325 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:47:26.088341 7f22505c9700 10 mon.3@1(peon).data_health(2854) service_dispatch mon_health( service 1 op tell e 0 r 0 flags none ) v1
 -04-26 04:47:26.088354 7f22505c9700 10 mon.3@1(peon).data_health(2854) handle_tell mon_health( service 1 op tell e 0 r 0 flags none ) v1
 -04-26 04:47:27.813458 7f22505c9700 10 mon.3@1(peon).log v5604939 update_from_paxos
 -04-26 04:47:27.813591 7f22505c9700 10 mon.3@1(peon).log v5604939 update_from_paxos version 5604939 summary v 5604939
 -04-26 04:47:27.813707 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:30.735637 7f2250dca700 10 mon.3@1(peon).pg v5939045 v5939045: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:30.735815 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:47:30.735916 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:47:30.735929 7f2250dca700 10 mon.3@1(peon).log v5604939 update_from_paxos
 -04-26 04:47:30.736048 7f2250dca700 10 mon.3@1(peon).log v5604939 update_from_paxos version 5604939 summary v 5604939
 -04-26 04:47:30.736101 7f2250dca700 10 mon.3@1(peon).log v5604939 log
 -04-26 04:47:30.736221 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:30.736338 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:47:30.813207 7f22505c9700 10 mon.3@1(peon).log v5604939 update_from_paxos
 -04-26 04:47:30.813320 7f22505c9700 10 mon.3@1(peon).log v5604939 update_from_paxos version 5604939 summary v 5604939
 -04-26 04:47:30.813440 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:31.659971 7f22505c9700 10 mon.3@1(peon).log v5604940 update_from_paxos
 -04-26 04:47:31.660103 7f22505c9700 10 mon.3@1(peon).log v5604940 update_from_paxos version 5604940 summary v 5604939
 -04-26 04:47:31.660208 7f22505c9700 10 mon.3@1(peon).log v5604940 update_from_paxos latest full 5604939
 -04-26 04:47:31.660339 7f22505c9700  7 mon.3@1(peon).log v5604940 update_from_paxos applying incremental log 5604940 2013-04-26 04:47:28.189595 osd.1 10.227.227.101:6804/17898 189 : [INF] 2.ab deep-scrub ok
 -04-26 04:47:31.660491 7f22505c9700 10 mon.3@1(peon).log v5604940 check_subs
 -04-26 04:47:31.660636 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:32.735030 7f22505c9700 10 mon.3@1(peon).log v5604941 update_from_paxos
 -04-26 04:47:32.735144 7f22505c9700 10 mon.3@1(peon).log v5604941 update_from_paxos version 5604941 summary v 5604940
 -04-26 04:47:32.735260 7f22505c9700 10 mon.3@1(peon).log v5604941 update_from_paxos latest full 5604940
 -04-26 04:47:32.735378 7f22505c9700  7 mon.3@1(peon).log v5604941 update_from_paxos applying incremental log 5604941 2013-04-26 04:47:31.570906 osd.2 10.227.227.101:6807/17905 168 : [INF] 2.c1 deep-scrub ok
 -04-26 04:47:32.735535 7f22505c9700 10 mon.3@1(peon).log v5604941 check_subs
 -04-26 04:47:32.735673 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:32.813732 7f22505c9700  7 mon.3@1(peon).pg v5939045 update_from_paxos  applying incremental 5939046
 -04-26 04:47:32.813786 7f22505c9700 10 mon.3@1(peon).pg v5939046 v5939046: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:32.815885 7f22505c9700 10 mon.3@1(peon).pg v5939046 send_pg_creates to 0 pgs
 -04-26 04:47:32.815899 7f22505c9700 10 mon.3@1(peon).pg v5939046 update_logger
 -04-26 04:47:32.816070 7f22505c9700 10 mon.3@1(peon).log v5604941 update_from_paxos
 -04-26 04:47:32.816181 7f22505c9700 10 mon.3@1(peon).log v5604941 update_from_paxos version 5604941 summary v 5604941
 -04-26 04:47:32.816300 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:33.977020 7f22505c9700 10 mon.3@1(peon).log v5604942 update_from_paxos
 -04-26 04:47:33.977134 7f22505c9700 10 mon.3@1(peon).log v5604942 update_from_paxos version 5604942 summary v 5604941
 -04-26 04:47:33.977235 7f22505c9700 10 mon.3@1(peon).log v5604942 update_from_paxos latest full 5604941
 -04-26 04:47:33.977357 7f22505c9700  7 mon.3@1(peon).log v5604942 update_from_paxos applying incremental log 5604942 2013-04-26 04:47:32.834766 mon.0 10.227.227.101:6789/0 32 : [INF] pgmap v5939046: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:33.977501 7f22505c9700 10 mon.3@1(peon).log v5604942 check_subs
 -04-26 04:47:33.977640 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:35.738437 7f2250dca700 10 mon.3@1(peon).pg v5939046 v5939046: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:35.738666 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:47:35.738744 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:47:35.738752 7f2250dca700 10 mon.3@1(peon).log v5604942 update_from_paxos
 -04-26 04:47:35.738878 7f2250dca700 10 mon.3@1(peon).log v5604942 update_from_paxos version 5604942 summary v 5604942
 -04-26 04:47:35.738937 7f2250dca700 10 mon.3@1(peon).log v5604942 log
 -04-26 04:47:35.739055 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:35.739175 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:47:36.491453 7f22505c9700  7 mon.3@1(peon).pg v5939046 update_from_paxos  applying incremental 5939047
 -04-26 04:47:36.491510 7f22505c9700 10 mon.3@1(peon).pg v5939047 v5939047: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:36.493041 7f22505c9700 10 mon.3@1(peon).pg v5939047 send_pg_creates to 0 pgs
 -04-26 04:47:36.493050 7f22505c9700 10 mon.3@1(peon).pg v5939047 update_logger
 -04-26 04:47:36.493198 7f22505c9700 10 mon.3@1(peon).log v5604942 update_from_paxos
 -04-26 04:47:36.493276 7f22505c9700 10 mon.3@1(peon).log v5604942 update_from_paxos version 5604942 summary v 5604942
 -04-26 04:47:36.493345 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:37.610488 7f22505c9700 10 mon.3@1(peon).log v5604943 update_from_paxos
 -04-26 04:47:37.610569 7f22505c9700 10 mon.3@1(peon).log v5604943 update_from_paxos version 5604943 summary v 5604942
 -04-26 04:47:37.610634 7f22505c9700 10 mon.3@1(peon).log v5604943 update_from_paxos latest full 5604942
 -04-26 04:47:37.610718 7f22505c9700  7 mon.3@1(peon).log v5604943 update_from_paxos applying incremental log 5604943 2013-04-26 04:47:36.510735 mon.0 10.227.227.101:6789/0 33 : [INF] pgmap v5939047: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:37.610816 7f22505c9700 10 mon.3@1(peon).log v5604943 check_subs
 -04-26 04:47:37.610930 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:37.800810 7f22505c9700  7 mon.3@1(peon).pg v5939047 update_from_paxos  applying incremental 5939048
 -04-26 04:47:37.800857 7f22505c9700 10 mon.3@1(peon).pg v5939048 v5939048: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:37.803009 7f22505c9700 10 mon.3@1(peon).pg v5939048 send_pg_creates to 0 pgs
 -04-26 04:47:37.803025 7f22505c9700 10 mon.3@1(peon).pg v5939048 update_logger
 -04-26 04:47:37.803242 7f22505c9700 10 mon.3@1(peon).log v5604943 update_from_paxos
 -04-26 04:47:37.803365 7f22505c9700 10 mon.3@1(peon).log v5604943 update_from_paxos version 5604943 summary v 5604943
 -04-26 04:47:37.803488 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:38.869647 7f22505c9700 10 mon.3@1(peon).log v5604944 update_from_paxos
 -04-26 04:47:38.869774 7f22505c9700 10 mon.3@1(peon).log v5604944 update_from_paxos version 5604944 summary v 5604943
 -04-26 04:47:38.869856 7f22505c9700 10 mon.3@1(peon).log v5604944 update_from_paxos latest full 5604943
 -04-26 04:47:38.869942 7f22505c9700  7 mon.3@1(peon).log v5604944 update_from_paxos applying incremental log 5604944 2013-04-26 04:47:37.820694 mon.0 10.227.227.101:6789/0 34 : [INF] pgmap v5939048: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:38.870062 7f22505c9700 10 mon.3@1(peon).log v5604944 check_subs
 -04-26 04:47:38.870155 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:40.740809 7f2250dca700 10 mon.3@1(peon).pg v5939048 v5939048: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:40.740990 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:47:40.741093 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:47:40.741106 7f2250dca700 10 mon.3@1(peon).log v5604944 update_from_paxos
 -04-26 04:47:40.741339 7f2250dca700 10 mon.3@1(peon).log v5604944 update_from_paxos version 5604944 summary v 5604944
 -04-26 04:47:40.741411 7f2250dca700 10 mon.3@1(peon).log v5604944 log
 -04-26 04:47:40.741514 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:40.741632 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:47:41.869780 7f22505c9700 10 mon.3@1(peon).log v5604944 update_from_paxos
 -04-26 04:47:41.869864 7f22505c9700 10 mon.3@1(peon).log v5604944 update_from_paxos version 5604944 summary v 5604944
 -04-26 04:47:41.869934 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:44.869067 7f22505c9700 10 mon.3@1(peon).log v5604944 update_from_paxos
 -04-26 04:47:44.869147 7f22505c9700 10 mon.3@1(peon).log v5604944 update_from_paxos version 5604944 summary v 5604944
 -04-26 04:47:44.869218 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:45.743941 7f2250dca700 10 mon.3@1(peon).pg v5939048 v5939048: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:45.744121 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:47:45.744226 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:47:45.744239 7f2250dca700 10 mon.3@1(peon).log v5604944 update_from_paxos
 -04-26 04:47:45.744361 7f2250dca700 10 mon.3@1(peon).log v5604944 update_from_paxos version 5604944 summary v 5604944
 -04-26 04:47:45.744438 7f2250dca700 10 mon.3@1(peon).log v5604944 log
 -04-26 04:47:45.744546 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:45.744620 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:47:46.305896 7f2250dca700 10 mon.3@1(peon).data_health(2854) service_tick
 -04-26 04:47:46.305978 7f2250dca700  0 mon.3@1(peon).data_health(2854) update_stats avail 54% total 1826117064 used 830788152 avail 995328912
 -04-26 04:47:46.305990 7f2250dca700 10 mon.3@1(peon).data_health(2854) share_stats
 -04-26 04:47:47.870106 7f22505c9700 10 mon.3@1(peon).log v5604944 update_from_paxos
 -04-26 04:47:47.870233 7f22505c9700 10 mon.3@1(peon).log v5604944 update_from_paxos version 5604944 summary v 5604944
 -04-26 04:47:47.870345 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:50.746837 7f2250dca700 10 mon.3@1(peon).pg v5939048 v5939048: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:50.746970 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:47:50.747039 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:47:50.747048 7f2250dca700 10 mon.3@1(peon).log v5604944 update_from_paxos
 -04-26 04:47:50.747131 7f2250dca700 10 mon.3@1(peon).log v5604944 update_from_paxos version 5604944 summary v 5604944
 -04-26 04:47:50.747164 7f2250dca700 10 mon.3@1(peon).log v5604944 log
 -04-26 04:47:50.747237 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:50.747311 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:47:50.916347 7f22505c9700 10 mon.3@1(peon).log v5604944 update_from_paxos
 -04-26 04:47:50.916469 7f22505c9700 10 mon.3@1(peon).log v5604944 update_from_paxos version 5604944 summary v 5604944
 -04-26 04:47:50.916580 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:51.063966 7f22505c9700  7 mon.3@1(peon).pg v5939048 update_from_paxos  applying incremental 5939049
 -04-26 04:47:51.064000 7f22505c9700 10 mon.3@1(peon).pg v5939049 v5939049: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:51.065248 7f22505c9700 10 mon.3@1(peon).pg v5939049 send_pg_creates to 0 pgs
 -04-26 04:47:51.065256 7f22505c9700 10 mon.3@1(peon).pg v5939049 update_logger
 -04-26 04:47:51.065385 7f22505c9700 10 mon.3@1(peon).log v5604944 update_from_paxos
 -04-26 04:47:51.065457 7f22505c9700 10 mon.3@1(peon).log v5604944 update_from_paxos version 5604944 summary v 5604944
 -04-26 04:47:51.065524 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:52.158237 7f22505c9700 10 mon.3@1(peon).log v5604945 update_from_paxos
 -04-26 04:47:52.158339 7f22505c9700 10 mon.3@1(peon).log v5604945 update_from_paxos version 5604945 summary v 5604944
 -04-26 04:47:52.158405 7f22505c9700 10 mon.3@1(peon).log v5604945 update_from_paxos latest full 5604944
 -04-26 04:47:52.158477 7f22505c9700  7 mon.3@1(peon).log v5604945 update_from_paxos applying incremental log 5604945 2013-04-26 04:47:49.019090 osd.1 10.227.227.101:6804/17898 190 : [INF] 2.af deep-scrub ok
 -04-26 04:47:52.158642 7f22505c9700  7 mon.3@1(peon).log v5604945 update_from_paxos applying incremental log 5604945 2013-04-26 04:47:51.087343 mon.0 10.227.227.101:6789/0 35 : [INF] pgmap v5939049: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:52.158747 7f22505c9700 10 mon.3@1(peon).log v5604945 check_subs
 -04-26 04:47:52.158910 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:53.282660 7f22505c9700  7 mon.3@1(peon).pg v5939049 update_from_paxos  applying incremental 5939050
 -04-26 04:47:53.282703 7f22505c9700 10 mon.3@1(peon).pg v5939050 v5939050: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:53.283961 7f22505c9700 10 mon.3@1(peon).pg v5939050 send_pg_creates to 0 pgs
 -04-26 04:47:53.283970 7f22505c9700 10 mon.3@1(peon).pg v5939050 update_logger
 -04-26 04:47:53.284110 7f22505c9700 10 mon.3@1(peon).log v5604945 update_from_paxos
 -04-26 04:47:53.284187 7f22505c9700 10 mon.3@1(peon).log v5604945 update_from_paxos version 5604945 summary v 5604945
 -04-26 04:47:53.284257 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:54.392662 7f22505c9700 10 mon.3@1(peon).log v5604946 update_from_paxos
 -04-26 04:47:54.392790 7f22505c9700 10 mon.3@1(peon).log v5604946 update_from_paxos version 5604946 summary v 5604945
 -04-26 04:47:54.392871 7f22505c9700 10 mon.3@1(peon).log v5604946 update_from_paxos latest full 5604945
 -04-26 04:47:54.393022 7f22505c9700  7 mon.3@1(peon).log v5604946 update_from_paxos applying incremental log 5604946 2013-04-26 04:47:53.297353 mon.0 10.227.227.101:6789/0 36 : [INF] pgmap v5939050: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:54.393183 7f22505c9700 10 mon.3@1(peon).log v5604946 check_subs
 -04-26 04:47:54.393327 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:55.507651 7f22505c9700  7 mon.3@1(peon).pg v5939050 update_from_paxos  applying incremental 5939051
 -04-26 04:47:55.507722 7f22505c9700 10 mon.3@1(peon).pg v5939051 v5939051: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:55.509792 7f22505c9700 10 mon.3@1(peon).pg v5939051 send_pg_creates to 0 pgs
 -04-26 04:47:55.509806 7f22505c9700 10 mon.3@1(peon).pg v5939051 update_logger
 -04-26 04:47:55.509999 7f22505c9700 10 mon.3@1(peon).log v5604946 update_from_paxos
 -04-26 04:47:55.510106 7f22505c9700 10 mon.3@1(peon).log v5604946 update_from_paxos version 5604946 summary v 5604946
 -04-26 04:47:55.510203 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:55.749190 7f2250dca700 10 mon.3@1(peon).pg v5939051 v5939051: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:55.749363 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:47:55.749445 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:47:55.749460 7f2250dca700 10 mon.3@1(peon).log v5604946 update_from_paxos
 -04-26 04:47:55.749568 7f2250dca700 10 mon.3@1(peon).log v5604946 update_from_paxos version 5604946 summary v 5604946
 -04-26 04:47:55.749614 7f2250dca700 10 mon.3@1(peon).log v5604946 log
 -04-26 04:47:55.749723 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:55.749842 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:47:56.560184 7f22505c9700 10 mon.3@1(peon).log v5604947 update_from_paxos
 -04-26 04:47:56.560309 7f22505c9700 10 mon.3@1(peon).log v5604947 update_from_paxos version 5604947 summary v 5604946
 -04-26 04:47:56.560413 7f22505c9700 10 mon.3@1(peon).log v5604947 update_from_paxos latest full 5604946
 -04-26 04:47:56.560546 7f22505c9700  7 mon.3@1(peon).log v5604947 update_from_paxos applying incremental log 5604947 2013-04-26 04:47:55.529801 mon.0 10.227.227.101:6789/0 37 : [INF] pgmap v5939051: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:56.560705 7f22505c9700 10 mon.3@1(peon).log v5604947 check_subs
 -04-26 04:47:56.560850 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:56.696421 7f22505c9700  7 mon.3@1(peon).pg v5939051 update_from_paxos  applying incremental 5939052
 -04-26 04:47:56.696463 7f22505c9700 10 mon.3@1(peon).pg v5939052 v5939052: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:56.697736 7f22505c9700 10 mon.3@1(peon).pg v5939052 send_pg_creates to 0 pgs
 -04-26 04:47:56.697745 7f22505c9700 10 mon.3@1(peon).pg v5939052 update_logger
 -04-26 04:47:56.697860 7f22505c9700 10 mon.3@1(peon).log v5604947 update_from_paxos
 -04-26 04:47:56.697931 7f22505c9700 10 mon.3@1(peon).log v5604947 update_from_paxos version 5604947 summary v 5604947
 -04-26 04:47:56.697999 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:57.802005 7f22505c9700 10 mon.3@1(peon).log v5604948 update_from_paxos
 -04-26 04:47:57.802223 7f22505c9700 10 mon.3@1(peon).log v5604948 update_from_paxos version 5604948 summary v 5604947
 -04-26 04:47:57.802525 7f22505c9700 10 mon.3@1(peon).log v5604948 update_from_paxos latest full 5604947
 -04-26 04:47:57.802631 7f22505c9700  7 mon.3@1(peon).log v5604948 update_from_paxos applying incremental log 5604948 2013-04-26 04:47:49.872255 osd.4 10.227.227.104:6804/15010 190 : [INF] 1.2c6 deep-scrub ok
 -04-26 04:47:57.802715 7f22505c9700  7 mon.3@1(peon).log v5604948 update_from_paxos applying incremental log 5604948 2013-04-26 04:47:50.884965 osd.4 10.227.227.104:6804/15010 191 : [INF] 1.2da deep-scrub ok
 -04-26 04:47:57.802797 7f22505c9700  7 mon.3@1(peon).log v5604948 update_from_paxos applying incremental log 5604948 2013-04-26 04:47:52.787786 osd.4 10.227.227.104:6804/15010 192 : [INF] 1.2e2 deep-scrub ok
 -04-26 04:47:57.802868 7f22505c9700  7 mon.3@1(peon).log v5604948 update_from_paxos applying incremental log 5604948 2013-04-26 04:47:54.791730 osd.4 10.227.227.104:6804/15010 193 : [INF] 1.2ec deep-scrub ok
 -04-26 04:47:57.802936 7f22505c9700  7 mon.3@1(peon).log v5604948 update_from_paxos applying incremental log 5604948 2013-04-26 04:47:55.809361 osd.4 10.227.227.104:6804/15010 194 : [INF] 1.2fb deep-scrub ok
 -04-26 04:47:57.803008 7f22505c9700  7 mon.3@1(peon).log v5604948 update_from_paxos applying incremental log 5604948 2013-04-26 04:47:56.721268 mon.0 10.227.227.101:6789/0 38 : [INF] pgmap v5939052: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:57.803392 7f22505c9700 10 mon.3@1(peon).log v5604948 check_subs
 -04-26 04:47:57.803517 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:58.153592 7f22505c9700  7 mon.3@1(peon).pg v5939052 update_from_paxos  applying incremental 5939053
 -04-26 04:47:58.153649 7f22505c9700 10 mon.3@1(peon).pg v5939053 v5939053: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:58.155757 7f22505c9700 10 mon.3@1(peon).pg v5939053 send_pg_creates to 0 pgs
 -04-26 04:47:58.155772 7f22505c9700 10 mon.3@1(peon).pg v5939053 update_logger
 -04-26 04:47:58.155977 7f22505c9700 10 mon.3@1(peon).log v5604948 update_from_paxos
 -04-26 04:47:58.156096 7f22505c9700 10 mon.3@1(peon).log v5604948 update_from_paxos version 5604948 summary v 5604948
 -04-26 04:47:58.156210 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:59.169624 7f22505c9700 10 mon.3@1(peon).log v5604949 update_from_paxos
 -04-26 04:47:59.169748 7f22505c9700 10 mon.3@1(peon).log v5604949 update_from_paxos version 5604949 summary v 5604948
 -04-26 04:47:59.169853 7f22505c9700 10 mon.3@1(peon).log v5604949 update_from_paxos latest full 5604948
 -04-26 04:47:59.169991 7f22505c9700  7 mon.3@1(peon).log v5604949 update_from_paxos applying incremental log 5604949 2013-04-26 04:47:50.062454 osd.3 10.227.227.104:6801/14901 184 : [INF] 1.271 deep-scrub ok
 -04-26 04:47:59.170097 7f22505c9700  7 mon.3@1(peon).log v5604949 update_from_paxos applying incremental log 5604949 2013-04-26 04:47:50.591760 osd.5 10.227.227.104:6807/15124 183 : [INF] 2.8d deep-scrub ok
 -04-26 04:47:59.170191 7f22505c9700  7 mon.3@1(peon).log v5604949 update_from_paxos applying incremental log 5604949 2013-04-26 04:47:52.087171 osd.3 10.227.227.104:6801/14901 185 : [INF] 1.274 deep-scrub ok
 -04-26 04:47:59.170280 7f22505c9700  7 mon.3@1(peon).log v5604949 update_from_paxos applying incremental log 5604949 2013-04-26 04:47:54.024987 osd.3 10.227.227.104:6801/14901 186 : [INF] 1.27f deep-scrub ok
 -04-26 04:47:59.170367 7f22505c9700  7 mon.3@1(peon).log v5604949 update_from_paxos applying incremental log 5604949 2013-04-26 04:47:58.129296 mon.0 10.227.227.101:6789/0 39 : [INF] pgmap v5939053: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:59.170514 7f22505c9700 10 mon.3@1(peon).log v5604949 check_subs
 -04-26 04:47:59.170656 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:47:59.292534 7f22505c9700  7 mon.3@1(peon).pg v5939053 update_from_paxos  applying incremental 5939054
 -04-26 04:47:59.292609 7f22505c9700 10 mon.3@1(peon).pg v5939054 v5939054: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:47:59.294730 7f22505c9700 10 mon.3@1(peon).pg v5939054 send_pg_creates to 0 pgs
 -04-26 04:47:59.294745 7f22505c9700 10 mon.3@1(peon).pg v5939054 update_logger
 -04-26 04:47:59.294941 7f22505c9700 10 mon.3@1(peon).log v5604949 update_from_paxos
 -04-26 04:47:59.295059 7f22505c9700 10 mon.3@1(peon).log v5604949 update_from_paxos version 5604949 summary v 5604949
 -04-26 04:47:59.295178 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:00.395029 7f22505c9700 10 mon.3@1(peon).log v5604950 update_from_paxos
 -04-26 04:48:00.395157 7f22505c9700 10 mon.3@1(peon).log v5604950 update_from_paxos version 5604950 summary v 5604949
 -04-26 04:48:00.395259 7f22505c9700 10 mon.3@1(peon).log v5604950 update_from_paxos latest full 5604949
 -04-26 04:48:00.395391 7f22505c9700  7 mon.3@1(peon).log v5604950 update_from_paxos applying incremental log 5604950 2013-04-26 04:47:59.306712 mon.0 10.227.227.101:6789/0 40 : [INF] pgmap v5939054: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:00.395511 7f22505c9700 10 mon.3@1(peon).log v5604950 check_subs
 -04-26 04:48:00.395656 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:00.752080 7f2250dca700 10 mon.3@1(peon).pg v5939054 v5939054: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:00.752209 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:48:00.752277 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:48:00.752284 7f2250dca700 10 mon.3@1(peon).log v5604950 update_from_paxos
 -04-26 04:48:00.752360 7f2250dca700 10 mon.3@1(peon).log v5604950 update_from_paxos version 5604950 summary v 5604950
 -04-26 04:48:00.752400 7f2250dca700 10 mon.3@1(peon).log v5604950 log
 -04-26 04:48:00.752473 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:00.752545 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:48:01.503997 7f22505c9700 10 mon.3@1(peon).log v5604951 update_from_paxos
 -04-26 04:48:01.504128 7f22505c9700 10 mon.3@1(peon).log v5604951 update_from_paxos version 5604951 summary v 5604950
 -04-26 04:48:01.504238 7f22505c9700 10 mon.3@1(peon).log v5604951 update_from_paxos latest full 5604950
 -04-26 04:48:01.504367 7f22505c9700  7 mon.3@1(peon).log v5604951 update_from_paxos applying incremental log 5604951 2013-04-26 04:47:51.339387 osd.0 10.227.227.101:6801/17890 184 : [INF] 1.21d deep-scrub ok
 -04-26 04:48:01.504531 7f22505c9700 10 mon.3@1(peon).log v5604951 check_subs
 -04-26 04:48:01.504674 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:02.579453 7f22505c9700 10 mon.3@1(peon).log v5604952 update_from_paxos
 -04-26 04:48:02.579575 7f22505c9700 10 mon.3@1(peon).log v5604952 update_from_paxos version 5604952 summary v 5604951
 -04-26 04:48:02.579679 7f22505c9700 10 mon.3@1(peon).log v5604952 update_from_paxos latest full 5604951
 -04-26 04:48:02.579806 7f22505c9700  7 mon.3@1(peon).log v5604952 update_from_paxos applying incremental log 5604952 2013-04-26 04:48:01.388270 osd.2 10.227.227.101:6807/17905 169 : [INF] 2.c4 deep-scrub ok
 -04-26 04:48:02.579960 7f22505c9700 10 mon.3@1(peon).log v5604952 check_subs
 -04-26 04:48:02.580101 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:02.641650 7f22505c9700  7 mon.3@1(peon).pg v5939054 update_from_paxos  applying incremental 5939055
 -04-26 04:48:02.641696 7f22505c9700 10 mon.3@1(peon).pg v5939055 v5939055: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:02.643008 7f22505c9700 10 mon.3@1(peon).pg v5939055 send_pg_creates to 0 pgs
 -04-26 04:48:02.643018 7f22505c9700 10 mon.3@1(peon).pg v5939055 update_logger
 -04-26 04:48:02.643131 7f22505c9700 10 mon.3@1(peon).log v5604952 update_from_paxos
 -04-26 04:48:02.643199 7f22505c9700 10 mon.3@1(peon).log v5604952 update_from_paxos version 5604952 summary v 5604952
 -04-26 04:48:02.643273 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:03.796337 7f22505c9700 10 mon.3@1(peon).log v5604953 update_from_paxos
 -04-26 04:48:03.796415 7f22505c9700 10 mon.3@1(peon).log v5604953 update_from_paxos version 5604953 summary v 5604952
 -04-26 04:48:03.796479 7f22505c9700 10 mon.3@1(peon).log v5604953 update_from_paxos latest full 5604952
 -04-26 04:48:03.796564 7f22505c9700  7 mon.3@1(peon).log v5604953 update_from_paxos applying incremental log 5604953 2013-04-26 04:48:02.667095 mon.0 10.227.227.101:6789/0 41 : [INF] pgmap v5939055: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:03.796669 7f22505c9700 10 mon.3@1(peon).log v5604953 check_subs
 -04-26 04:48:03.796756 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:05.135208 7f22505c9700  7 mon.3@1(peon).pg v5939055 update_from_paxos  applying incremental 5939056
 -04-26 04:48:05.135268 7f22505c9700 10 mon.3@1(peon).pg v5939056 v5939056: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:05.137399 7f22505c9700 10 mon.3@1(peon).pg v5939056 send_pg_creates to 0 pgs
 -04-26 04:48:05.137414 7f22505c9700 10 mon.3@1(peon).pg v5939056 update_logger
 -04-26 04:48:05.137618 7f22505c9700 10 mon.3@1(peon).log v5604953 update_from_paxos
 -04-26 04:48:05.137746 7f22505c9700 10 mon.3@1(peon).log v5604953 update_from_paxos version 5604953 summary v 5604953
 -04-26 04:48:05.137864 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:05.754855 7f2250dca700 10 mon.3@1(peon).pg v5939056 v5939056: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:05.755029 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:48:05.755097 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:48:05.755104 7f2250dca700 10 mon.3@1(peon).log v5604953 update_from_paxos
 -04-26 04:48:05.755183 7f2250dca700 10 mon.3@1(peon).log v5604953 update_from_paxos version 5604953 summary v 5604953
 -04-26 04:48:05.755232 7f2250dca700 10 mon.3@1(peon).log v5604953 log
 -04-26 04:48:05.755342 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:05.755459 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:48:06.130071 7f22505c9700  7 mon.3@1(peon).pg v5939056 update_from_paxos  applying incremental 5939057
 -04-26 04:48:06.130112 7f22505c9700 10 mon.3@1(peon).pg v5939057 v5939057: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:06.132305 7f22505c9700 10 mon.3@1(peon).pg v5939057 send_pg_creates to 0 pgs
 -04-26 04:48:06.132319 7f22505c9700 10 mon.3@1(peon).pg v5939057 update_logger
 -04-26 04:48:06.132528 7f22505c9700 10 mon.3@1(peon).log v5604953 update_from_paxos
 -04-26 04:48:06.132647 7f22505c9700 10 mon.3@1(peon).log v5604953 update_from_paxos version 5604953 summary v 5604953
 -04-26 04:48:06.132761 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:06.363439 7f22505c9700 10 mon.3@1(peon).log v5604954 update_from_paxos
 -04-26 04:48:06.363560 7f22505c9700 10 mon.3@1(peon).log v5604954 update_from_paxos version 5604954 summary v 5604953
 -04-26 04:48:06.363664 7f22505c9700 10 mon.3@1(peon).log v5604954 update_from_paxos latest full 5604953
 -04-26 04:48:06.363794 7f22505c9700  7 mon.3@1(peon).log v5604954 update_from_paxos applying incremental log 5604954 2013-04-26 04:48:05.157305 mon.0 10.227.227.101:6789/0 42 : [INF] pgmap v5939056: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:06.363953 7f22505c9700 10 mon.3@1(peon).log v5604954 check_subs
 -04-26 04:48:06.364093 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:07.447189 7f22505c9700 10 mon.3@1(peon).log v5604955 update_from_paxos
 -04-26 04:48:07.447282 7f22505c9700 10 mon.3@1(peon).log v5604955 update_from_paxos version 5604955 summary v 5604954
 -04-26 04:48:07.447391 7f22505c9700 10 mon.3@1(peon).log v5604955 update_from_paxos latest full 5604954
 -04-26 04:48:07.447519 7f22505c9700  7 mon.3@1(peon).log v5604955 update_from_paxos applying incremental log 5604955 2013-04-26 04:47:56.823212 osd.4 10.227.227.104:6804/15010 195 : [INF] 1.2fc deep-scrub ok
 -04-26 04:48:07.447675 7f22505c9700 10 mon.3@1(peon).log v5604955 check_subs
 -04-26 04:48:07.447811 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:08.462550 7f22505c9700  7 mon.3@1(peon).pg v5939057 update_from_paxos  applying incremental 5939058
 -04-26 04:48:08.462594 7f22505c9700 10 mon.3@1(peon).pg v5939058 v5939058: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:08.463871 7f22505c9700 10 mon.3@1(peon).pg v5939058 send_pg_creates to 0 pgs
 -04-26 04:48:08.463881 7f22505c9700 10 mon.3@1(peon).pg v5939058 update_logger
 -04-26 04:48:08.464018 7f22505c9700 10 mon.3@1(peon).log v5604955 update_from_paxos
 -04-26 04:48:08.464095 7f22505c9700 10 mon.3@1(peon).log v5604955 update_from_paxos version 5604955 summary v 5604955
 -04-26 04:48:08.464164 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:08.675561 7f22505c9700 10 mon.3@1(peon).log v5604956 update_from_paxos
 -04-26 04:48:08.675640 7f22505c9700 10 mon.3@1(peon).log v5604956 update_from_paxos version 5604956 summary v 5604955
 -04-26 04:48:08.675752 7f22505c9700 10 mon.3@1(peon).log v5604956 update_from_paxos latest full 5604955
 -04-26 04:48:08.675884 7f22505c9700  7 mon.3@1(peon).log v5604956 update_from_paxos applying incremental log 5604956 2013-04-26 04:48:04.060277 osd.3 10.227.227.104:6801/14901 187 : [INF] 1.28c deep-scrub ok
 -04-26 04:48:08.676058 7f22505c9700 10 mon.3@1(peon).log v5604956 check_subs
 -04-26 04:48:08.676207 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:09.856392 7f22505c9700 10 mon.3@1(peon).log v5604957 update_from_paxos
 -04-26 04:48:09.856524 7f22505c9700 10 mon.3@1(peon).log v5604957 update_from_paxos version 5604957 summary v 5604956
 -04-26 04:48:09.856629 7f22505c9700 10 mon.3@1(peon).log v5604957 update_from_paxos latest full 5604956
 -04-26 04:48:09.856762 7f22505c9700  7 mon.3@1(peon).log v5604957 update_from_paxos applying incremental log 5604957 2013-04-26 04:48:06.151437 mon.0 10.227.227.101:6789/0 43 : [INF] pgmap v5939057: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:09.856870 7f22505c9700  7 mon.3@1(peon).log v5604957 update_from_paxos applying incremental log 5604957 2013-04-26 04:48:08.484246 mon.0 10.227.227.101:6789/0 44 : [INF] pgmap v5939058: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:09.857020 7f22505c9700 10 mon.3@1(peon).log v5604957 check_subs
 -04-26 04:48:09.857169 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:10.757633 7f2250dca700 10 mon.3@1(peon).pg v5939058 v5939058: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:10.757807 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:48:10.757918 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:48:10.757931 7f2250dca700 10 mon.3@1(peon).log v5604957 update_from_paxos
 -04-26 04:48:10.758052 7f2250dca700 10 mon.3@1(peon).log v5604957 update_from_paxos version 5604957 summary v 5604957
 -04-26 04:48:10.758105 7f2250dca700 10 mon.3@1(peon).log v5604957 log
 -04-26 04:48:10.758222 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:10.758340 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:48:10.780484 7f22505c9700  7 mon.3@1(peon).pg v5939058 update_from_paxos  applying incremental 5939059
 -04-26 04:48:10.780550 7f22505c9700 10 mon.3@1(peon).pg v5939059 v5939059: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:10.782781 7f22505c9700 10 mon.3@1(peon).pg v5939059 send_pg_creates to 0 pgs
 -04-26 04:48:10.782796 7f22505c9700 10 mon.3@1(peon).pg v5939059 update_logger
 -04-26 04:48:10.782973 7f22505c9700 10 mon.3@1(peon).log v5604957 update_from_paxos
 -04-26 04:48:10.783073 7f22505c9700 10 mon.3@1(peon).log v5604957 update_from_paxos version 5604957 summary v 5604957
 -04-26 04:48:10.783166 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:11.955766 7f22505c9700 10 mon.3@1(peon).log v5604958 update_from_paxos
 -04-26 04:48:11.955890 7f22505c9700 10 mon.3@1(peon).log v5604958 update_from_paxos version 5604958 summary v 5604957
 -04-26 04:48:11.955996 7f22505c9700 10 mon.3@1(peon).log v5604958 update_from_paxos latest full 5604957
 -04-26 04:48:11.956126 7f22505c9700  7 mon.3@1(peon).log v5604958 update_from_paxos applying incremental log 5604958 2013-04-26 04:48:03.323805 osd.0 10.227.227.101:6801/17890 185 : [INF] 1.234 deep-scrub ok
 -04-26 04:48:11.956232 7f22505c9700  7 mon.3@1(peon).log v5604958 update_from_paxos applying incremental log 5604958 2013-04-26 04:48:05.317465 osd.0 10.227.227.101:6801/17890 186 : [INF] 1.236 deep-scrub ok
 -04-26 04:48:11.956337 7f22505c9700  7 mon.3@1(peon).log v5604958 update_from_paxos applying incremental log 5604958 2013-04-26 04:48:08.291376 osd.0 10.227.227.101:6801/17890 187 : [INF] 1.237 deep-scrub ok
 -04-26 04:48:11.956428 7f22505c9700  7 mon.3@1(peon).log v5604958 update_from_paxos applying incremental log 5604958 2013-04-26 04:48:10.785965 mon.0 10.227.227.101:6789/0 45 : [INF] pgmap v5939059: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:11.956680 7f22505c9700 10 mon.3@1(peon).log v5604958 check_subs
 -04-26 04:48:11.956839 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:13.292277 7f22505c9700  7 mon.3@1(peon).pg v5939059 update_from_paxos  applying incremental 5939060
 -04-26 04:48:13.292329 7f22505c9700 10 mon.3@1(peon).pg v5939060 v5939060: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:13.294428 7f22505c9700 10 mon.3@1(peon).pg v5939060 send_pg_creates to 0 pgs
 -04-26 04:48:13.294442 7f22505c9700 10 mon.3@1(peon).pg v5939060 update_logger
 -04-26 04:48:13.294648 7f22505c9700 10 mon.3@1(peon).log v5604958 update_from_paxos
 -04-26 04:48:13.294769 7f22505c9700 10 mon.3@1(peon).log v5604958 update_from_paxos version 5604958 summary v 5604958
 -04-26 04:48:13.294881 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:14.456146 7f22505c9700 10 mon.3@1(peon).log v5604959 update_from_paxos
 -04-26 04:48:14.456271 7f22505c9700 10 mon.3@1(peon).log v5604959 update_from_paxos version 5604959 summary v 5604958
 -04-26 04:48:14.456375 7f22505c9700 10 mon.3@1(peon).log v5604959 update_from_paxos latest full 5604958
 -04-26 04:48:14.456507 7f22505c9700  7 mon.3@1(peon).log v5604959 update_from_paxos applying incremental log 5604959 2013-04-26 04:48:13.311741 mon.0 10.227.227.101:6789/0 46 : [INF] pgmap v5939060: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:14.456674 7f22505c9700 10 mon.3@1(peon).log v5604959 check_subs
 -04-26 04:48:14.456819 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:15.581532 7f22505c9700  7 mon.3@1(peon).pg v5939060 update_from_paxos  applying incremental 5939061
 -04-26 04:48:15.581603 7f22505c9700 10 mon.3@1(peon).pg v5939061 v5939061: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:15.583750 7f22505c9700 10 mon.3@1(peon).pg v5939061 send_pg_creates to 0 pgs
 -04-26 04:48:15.583766 7f22505c9700 10 mon.3@1(peon).pg v5939061 update_logger
 -04-26 04:48:15.583975 7f22505c9700 10 mon.3@1(peon).log v5604959 update_from_paxos
 -04-26 04:48:15.584097 7f22505c9700 10 mon.3@1(peon).log v5604959 update_from_paxos version 5604959 summary v 5604959
 -04-26 04:48:15.584212 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:15.760700 7f2250dca700 10 mon.3@1(peon).pg v5939061 v5939061: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:15.760882 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:48:15.760984 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:48:15.760997 7f2250dca700 10 mon.3@1(peon).log v5604959 update_from_paxos
 -04-26 04:48:15.761119 7f2250dca700 10 mon.3@1(peon).log v5604959 update_from_paxos version 5604959 summary v 5604959
 -04-26 04:48:15.761171 7f2250dca700 10 mon.3@1(peon).log v5604959 log
 -04-26 04:48:15.761292 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:15.761410 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:48:16.680056 7f22505c9700 10 mon.3@1(peon).data_health(2854) service_dispatch mon_health( service 1 op tell e 0 r 0 flags none ) v1
 -04-26 04:48:16.680064 7f22505c9700 10 mon.3@1(peon).data_health(2854) handle_tell mon_health( service 1 op tell e 0 r 0 flags none ) v1
 -04-26 04:48:16.785754 7f22505c9700 10 mon.3@1(peon).log v5604960 update_from_paxos
 -04-26 04:48:16.785834 7f22505c9700 10 mon.3@1(peon).log v5604960 update_from_paxos version 5604960 summary v 5604959
 -04-26 04:48:16.785898 7f22505c9700 10 mon.3@1(peon).log v5604960 update_from_paxos latest full 5604959
 -04-26 04:48:16.785977 7f22505c9700  7 mon.3@1(peon).log v5604960 update_from_paxos applying incremental log 5604960 2013-04-26 04:48:15.602906 mon.0 10.227.227.101:6789/0 47 : [INF] pgmap v5939061: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:16.786102 7f22505c9700 10 mon.3@1(peon).log v5604960 check_subs
 -04-26 04:48:16.786230 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:16.907616 7f22505c9700  7 mon.3@1(peon).pg v5939061 update_from_paxos  applying incremental 5939062
 -04-26 04:48:16.907670 7f22505c9700 10 mon.3@1(peon).pg v5939062 v5939062: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:16.909752 7f22505c9700 10 mon.3@1(peon).pg v5939062 send_pg_creates to 0 pgs
 -04-26 04:48:16.909768 7f22505c9700 10 mon.3@1(peon).pg v5939062 update_logger
 -04-26 04:48:16.909946 7f22505c9700 10 mon.3@1(peon).log v5604960 update_from_paxos
 -04-26 04:48:16.910028 7f22505c9700 10 mon.3@1(peon).log v5604960 update_from_paxos version 5604960 summary v 5604960
 -04-26 04:48:16.910107 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:16.949564 7f22505c9700 10 mon.3@1(peon).log v5604960 update_from_paxos
 -04-26 04:48:16.949646 7f22505c9700 10 mon.3@1(peon).log v5604960 update_from_paxos version 5604960 summary v 5604960
 -04-26 04:48:16.949712 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:18.058575 7f22505c9700 10 mon.3@1(peon).log v5604961 update_from_paxos
 -04-26 04:48:18.058699 7f22505c9700 10 mon.3@1(peon).log v5604961 update_from_paxos version 5604961 summary v 5604960
 -04-26 04:48:18.058804 7f22505c9700 10 mon.3@1(peon).log v5604961 update_from_paxos latest full 5604960
 -04-26 04:48:18.058938 7f22505c9700  7 mon.3@1(peon).log v5604961 update_from_paxos applying incremental log 5604961 2013-04-26 04:48:16.928080 mon.0 10.227.227.101:6789/0 48 : [INF] pgmap v5939062: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:18.059125 7f22505c9700 10 mon.3@1(peon).log v5604961 check_subs
 -04-26 04:48:18.059273 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:19.283965 7f22505c9700 10 mon.3@1(peon).log v5604962 update_from_paxos
 -04-26 04:48:19.284097 7f22505c9700 10 mon.3@1(peon).log v5604962 update_from_paxos version 5604962 summary v 5604961
 -04-26 04:48:19.284207 7f22505c9700 10 mon.3@1(peon).log v5604962 update_from_paxos latest full 5604961
 -04-26 04:48:19.284337 7f22505c9700  7 mon.3@1(peon).log v5604962 update_from_paxos applying incremental log 5604962 2013-04-26 04:48:12.156534 osd.5 10.227.227.104:6807/15124 184 : [INF] 2.8e deep-scrub ok
 -04-26 04:48:19.284442 7f22505c9700  7 mon.3@1(peon).log v5604962 update_from_paxos applying incremental log 5604962 2013-04-26 04:48:18.025516 osd.3 10.227.227.104:6801/14901 188 : [INF] 1.29a deep-scrub ok
 -04-26 04:48:19.284606 7f22505c9700 10 mon.3@1(peon).log v5604962 check_subs
 -04-26 04:48:19.284750 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:19.532363 7f22505c9700  7 mon.3@1(peon).pg v5939062 update_from_paxos  applying incremental 5939063
 -04-26 04:48:19.532400 7f22505c9700 10 mon.3@1(peon).pg v5939063 v5939063: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:19.533673 7f22505c9700 10 mon.3@1(peon).pg v5939063 send_pg_creates to 0 pgs
 -04-26 04:48:19.533690 7f22505c9700 10 mon.3@1(peon).pg v5939063 update_logger
 -04-26 04:48:19.533830 7f22505c9700 10 mon.3@1(peon).log v5604962 update_from_paxos
 -04-26 04:48:19.533906 7f22505c9700 10 mon.3@1(peon).log v5604962 update_from_paxos version 5604962 summary v 5604962
 -04-26 04:48:19.533976 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:20.708951 7f22505c9700 10 mon.3@1(peon).log v5604963 update_from_paxos
 -04-26 04:48:20.709030 7f22505c9700 10 mon.3@1(peon).log v5604963 update_from_paxos version 5604963 summary v 5604962
 -04-26 04:48:20.709093 7f22505c9700 10 mon.3@1(peon).log v5604963 update_from_paxos latest full 5604962
 -04-26 04:48:20.709176 7f22505c9700  7 mon.3@1(peon).log v5604963 update_from_paxos applying incremental log 5604963 2013-04-26 04:48:19.545261 mon.0 10.227.227.101:6789/0 49 : [INF] pgmap v5939063: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:20.709278 7f22505c9700 10 mon.3@1(peon).log v5604963 check_subs
 -04-26 04:48:20.709439 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:20.763822 7f2250dca700 10 mon.3@1(peon).pg v5939063 v5939063: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:20.763988 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:48:20.764097 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:48:20.764106 7f2250dca700 10 mon.3@1(peon).log v5604963 update_from_paxos
 -04-26 04:48:20.764212 7f2250dca700 10 mon.3@1(peon).log v5604963 update_from_paxos version 5604963 summary v 5604963
 -04-26 04:48:20.764274 7f2250dca700 10 mon.3@1(peon).log v5604963 log
 -04-26 04:48:20.764348 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:20.764472 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:48:20.942632 7f22505c9700  7 mon.3@1(peon).pg v5939063 update_from_paxos  applying incremental 5939064
 -04-26 04:48:20.942701 7f22505c9700 10 mon.3@1(peon).pg v5939064 v5939064: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:20.944604 7f22505c9700 10 mon.3@1(peon).pg v5939064 send_pg_creates to 0 pgs
 -04-26 04:48:20.944617 7f22505c9700 10 mon.3@1(peon).pg v5939064 update_logger
 -04-26 04:48:20.944814 7f22505c9700 10 mon.3@1(peon).log v5604963 update_from_paxos
 -04-26 04:48:20.944935 7f22505c9700 10 mon.3@1(peon).log v5604963 update_from_paxos version 5604963 summary v 5604963
 -04-26 04:48:20.945049 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:22.058880 7f22505c9700 10 mon.3@1(peon).log v5604964 update_from_paxos
 -04-26 04:48:22.059005 7f22505c9700 10 mon.3@1(peon).log v5604964 update_from_paxos version 5604964 summary v 5604963
 -04-26 04:48:22.059111 7f22505c9700 10 mon.3@1(peon).log v5604964 update_from_paxos latest full 5604963
 -04-26 04:48:22.059243 7f22505c9700  7 mon.3@1(peon).log v5604964 update_from_paxos applying incremental log 5604964 2013-04-26 04:48:11.293684 osd.0 10.227.227.101:6801/17890 188 : [INF] 1.23b deep-scrub ok
 -04-26 04:48:22.059349 7f22505c9700  7 mon.3@1(peon).log v5604964 update_from_paxos applying incremental log 5604964 2013-04-26 04:48:12.301760 osd.0 10.227.227.101:6801/17890 189 : [INF] 1.241 deep-scrub ok
 -04-26 04:48:22.059450 7f22505c9700  7 mon.3@1(peon).log v5604964 update_from_paxos applying incremental log 5604964 2013-04-26 04:48:12.530370 osd.1 10.227.227.101:6804/17898 191 : [INF] 2.b1 deep-scrub ok
 -04-26 04:48:22.059541 7f22505c9700  7 mon.3@1(peon).log v5604964 update_from_paxos applying incremental log 5604964 2013-04-26 04:48:13.306219 osd.0 10.227.227.101:6801/17890 190 : [INF] 1.243 deep-scrub ok
 -04-26 04:48:22.059629 7f22505c9700  7 mon.3@1(peon).log v5604964 update_from_paxos applying incremental log 5604964 2013-04-26 04:48:18.321402 osd.0 10.227.227.101:6801/17890 191 : [INF] 1.24b deep-scrub ok
 -04-26 04:48:22.059718 7f22505c9700  7 mon.3@1(peon).log v5604964 update_from_paxos applying incremental log 5604964 2013-04-26 04:48:20.959461 mon.0 10.227.227.101:6789/0 50 : [INF] pgmap v5939064: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:22.059942 7f22505c9700 10 mon.3@1(peon).log v5604964 check_subs
 -04-26 04:48:22.060090 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:23.228231 7f22505c9700  7 mon.3@1(peon).pg v5939064 update_from_paxos  applying incremental 5939065
 -04-26 04:48:23.228274 7f22505c9700 10 mon.3@1(peon).pg v5939065 v5939065: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:23.229737 7f22505c9700 10 mon.3@1(peon).pg v5939065 send_pg_creates to 0 pgs
 -04-26 04:48:23.229747 7f22505c9700 10 mon.3@1(peon).pg v5939065 update_logger
 -04-26 04:48:23.229967 7f22505c9700 10 mon.3@1(peon).log v5604964 update_from_paxos
 -04-26 04:48:23.230087 7f22505c9700 10 mon.3@1(peon).log v5604964 update_from_paxos version 5604964 summary v 5604964
 -04-26 04:48:23.230213 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:24.455453 7f22505c9700 10 mon.3@1(peon).log v5604965 update_from_paxos
 -04-26 04:48:24.455582 7f22505c9700 10 mon.3@1(peon).log v5604965 update_from_paxos version 5604965 summary v 5604964
 -04-26 04:48:24.455687 7f22505c9700 10 mon.3@1(peon).log v5604965 update_from_paxos latest full 5604964
 -04-26 04:48:24.455818 7f22505c9700  7 mon.3@1(peon).log v5604965 update_from_paxos applying incremental log 5604965 2013-04-26 04:48:23.250248 mon.0 10.227.227.101:6789/0 51 : [INF] pgmap v5939065: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:24.455982 7f22505c9700 10 mon.3@1(peon).log v5604965 check_subs
 -04-26 04:48:24.456128 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:25.766874 7f2250dca700 10 mon.3@1(peon).pg v5939065 v5939065: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:25.767052 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:48:25.767155 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:48:25.767168 7f2250dca700 10 mon.3@1(peon).log v5604965 update_from_paxos
 -04-26 04:48:25.767292 7f2250dca700 10 mon.3@1(peon).log v5604965 update_from_paxos version 5604965 summary v 5604965
 -04-26 04:48:25.767344 7f2250dca700 10 mon.3@1(peon).log v5604965 log
 -04-26 04:48:25.767461 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:25.767578 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:48:26.087944 7f22505c9700 10 mon.3@1(peon).data_health(2854) service_dispatch mon_health( service 1 op tell e 0 r 0 flags none ) v1
 -04-26 04:48:26.087958 7f22505c9700 10 mon.3@1(peon).data_health(2854) handle_tell mon_health( service 1 op tell e 0 r 0 flags none ) v1
 -04-26 04:48:27.443545 7f22505c9700 10 mon.3@1(peon).log v5604965 update_from_paxos
 -04-26 04:48:27.443622 7f22505c9700 10 mon.3@1(peon).log v5604965 update_from_paxos version 5604965 summary v 5604965
 -04-26 04:48:27.443726 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:28.456624 7f22505c9700  7 mon.3@1(peon).pg v5939065 update_from_paxos  applying incremental 5939066
 -04-26 04:48:28.456686 7f22505c9700 10 mon.3@1(peon).pg v5939066 v5939066: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:28.458649 7f22505c9700 10 mon.3@1(peon).pg v5939066 send_pg_creates to 0 pgs
 -04-26 04:48:28.458659 7f22505c9700 10 mon.3@1(peon).pg v5939066 update_logger
 -04-26 04:48:28.458795 7f22505c9700 10 mon.3@1(peon).log v5604965 update_from_paxos
 -04-26 04:48:28.458871 7f22505c9700 10 mon.3@1(peon).log v5604965 update_from_paxos version 5604965 summary v 5604965
 -04-26 04:48:28.458943 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:29.675248 7f22505c9700 10 mon.3@1(peon).log v5604966 update_from_paxos
 -04-26 04:48:29.675375 7f22505c9700 10 mon.3@1(peon).log v5604966 update_from_paxos version 5604966 summary v 5604965
 -04-26 04:48:29.675481 7f22505c9700 10 mon.3@1(peon).log v5604966 update_from_paxos latest full 5604965
 -04-26 04:48:29.675614 7f22505c9700  7 mon.3@1(peon).log v5604966 update_from_paxos applying incremental log 5604966 2013-04-26 04:48:28.479421 mon.0 10.227.227.101:6789/0 52 : [INF] pgmap v5939066: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:29.675776 7f22505c9700 10 mon.3@1(peon).log v5604966 check_subs
 -04-26 04:48:29.675920 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:30.769883 7f2250dca700 10 mon.3@1(peon).pg v5939066 v5939066: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:30.770012 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:48:30.770102 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:48:30.770115 7f2250dca700 10 mon.3@1(peon).log v5604966 update_from_paxos
 -04-26 04:48:30.770224 7f2250dca700 10 mon.3@1(peon).log v5604966 update_from_paxos version 5604966 summary v 5604966
 -04-26 04:48:30.770277 7f2250dca700 10 mon.3@1(peon).log v5604966 log
 -04-26 04:48:30.770385 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:30.770487 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:48:32.350965 7f22505c9700 10 mon.3@1(peon).log v5604967 update_from_paxos
 -04-26 04:48:32.351110 7f22505c9700 10 mon.3@1(peon).log v5604967 update_from_paxos version 5604967 summary v 5604966
 -04-26 04:48:32.351215 7f22505c9700 10 mon.3@1(peon).log v5604967 update_from_paxos latest full 5604966
 -04-26 04:48:32.351348 7f22505c9700  7 mon.3@1(peon).log v5604967 update_from_paxos applying incremental log 5604967 2013-04-26 04:48:24.824770 osd.2 10.227.227.101:6807/17905 170 : [INF] 2.cd deep-scrub ok
 -04-26 04:48:32.351507 7f22505c9700 10 mon.3@1(peon).log v5604967 check_subs
 -04-26 04:48:32.351650 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:35.350297 7f22505c9700 10 mon.3@1(peon).log v5604967 update_from_paxos
 -04-26 04:48:35.350376 7f22505c9700 10 mon.3@1(peon).log v5604967 update_from_paxos version 5604967 summary v 5604967
 -04-26 04:48:35.350448 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:35.772910 7f2250dca700 10 mon.3@1(peon).pg v5939066 v5939066: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:35.773093 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:48:35.773204 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:48:35.773215 7f2250dca700 10 mon.3@1(peon).log v5604967 update_from_paxos
 -04-26 04:48:35.773344 7f2250dca700 10 mon.3@1(peon).log v5604967 update_from_paxos version 5604967 summary v 5604967
 -04-26 04:48:35.773403 7f2250dca700 10 mon.3@1(peon).log v5604967 log
 -04-26 04:48:35.773523 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:35.773638 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:48:38.351055 7f22505c9700 10 mon.3@1(peon).log v5604967 update_from_paxos
 -04-26 04:48:38.351132 7f22505c9700 10 mon.3@1(peon).log v5604967 update_from_paxos version 5604967 summary v 5604967
 -04-26 04:48:38.351202 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:38.741842 7f22505c9700 10 mon.3@1(peon).log v5604968 update_from_paxos
 -04-26 04:48:38.741959 7f22505c9700 10 mon.3@1(peon).log v5604968 update_from_paxos version 5604968 summary v 5604967
 -04-26 04:48:38.742068 7f22505c9700 10 mon.3@1(peon).log v5604968 update_from_paxos latest full 5604967
 -04-26 04:48:38.742238 7f22505c9700  7 mon.3@1(peon).log v5604968 update_from_paxos applying incremental log 5604968 2013-04-26 04:48:36.356271 osd.5 10.227.227.104:6807/15124 185 : [INF] 2.9e deep-scrub ok
 -04-26 04:48:38.742416 7f22505c9700 10 mon.3@1(peon).log v5604968 check_subs
 -04-26 04:48:38.742564 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:39.732238 7f22505c9700  7 mon.3@1(peon).pg v5939066 update_from_paxos  applying incremental 5939067
 -04-26 04:48:39.732308 7f22505c9700 10 mon.3@1(peon).pg v5939067 v5939067: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:39.734394 7f22505c9700 10 mon.3@1(peon).pg v5939067 send_pg_creates to 0 pgs
 -04-26 04:48:39.734409 7f22505c9700 10 mon.3@1(peon).pg v5939067 update_logger
 -04-26 04:48:39.734606 7f22505c9700 10 mon.3@1(peon).log v5604968 update_from_paxos
 -04-26 04:48:39.734725 7f22505c9700 10 mon.3@1(peon).log v5604968 update_from_paxos version 5604968 summary v 5604968
 -04-26 04:48:39.734837 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:40.775995 7f2250dca700 10 mon.3@1(peon).pg v5939067 v5939067: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:40.776181 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:48:40.776283 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:48:40.776296 7f2250dca700 10 mon.3@1(peon).log v5604968 update_from_paxos
 -04-26 04:48:40.776418 7f2250dca700 10 mon.3@1(peon).log v5604968 update_from_paxos version 5604968 summary v 5604968
 -04-26 04:48:40.776471 7f2250dca700 10 mon.3@1(peon).log v5604968 log
 -04-26 04:48:40.776589 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:40.776708 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:48:40.895658 7f22505c9700 10 mon.3@1(peon).log v5604969 update_from_paxos
 -04-26 04:48:40.895771 7f22505c9700 10 mon.3@1(peon).log v5604969 update_from_paxos version 5604969 summary v 5604968
 -04-26 04:48:40.895874 7f22505c9700 10 mon.3@1(peon).log v5604969 update_from_paxos latest full 5604968
 -04-26 04:48:40.896005 7f22505c9700  7 mon.3@1(peon).log v5604969 update_from_paxos applying incremental log 5604969 2013-04-26 04:48:39.748820 mon.0 10.227.227.101:6789/0 53 : [INF] pgmap v5939067: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:40.896163 7f22505c9700 10 mon.3@1(peon).log v5604969 check_subs
 -04-26 04:48:40.896300 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:40.984402 7f22505c9700  7 mon.3@1(peon).pg v5939067 update_from_paxos  applying incremental 5939068
 -04-26 04:48:40.984441 7f22505c9700 10 mon.3@1(peon).pg v5939068 v5939068: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:40.986521 7f22505c9700 10 mon.3@1(peon).pg v5939068 send_pg_creates to 0 pgs
 -04-26 04:48:40.986535 7f22505c9700 10 mon.3@1(peon).pg v5939068 update_logger
 -04-26 04:48:40.986716 7f22505c9700 10 mon.3@1(peon).log v5604969 update_from_paxos
 -04-26 04:48:40.986829 7f22505c9700 10 mon.3@1(peon).log v5604969 update_from_paxos version 5604969 summary v 5604969
 -04-26 04:48:40.986937 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:42.201859 7f22505c9700 10 mon.3@1(peon).log v5604970 update_from_paxos
 -04-26 04:48:42.201969 7f22505c9700 10 mon.3@1(peon).log v5604970 update_from_paxos version 5604970 summary v 5604969
 -04-26 04:48:42.202071 7f22505c9700 10 mon.3@1(peon).log v5604970 update_from_paxos latest full 5604969
 -04-26 04:48:42.202246 7f22505c9700  7 mon.3@1(peon).log v5604970 update_from_paxos applying incremental log 5604970 2013-04-26 04:48:39.314527 osd.0 10.227.227.101:6801/17890 192 : [INF] 1.253 deep-scrub ok
 -04-26 04:48:42.202350 7f22505c9700  7 mon.3@1(peon).log v5604970 update_from_paxos applying incremental log 5604970 2013-04-26 04:48:40.335687 osd.0 10.227.227.101:6801/17890 193 : [INF] 1.257 deep-scrub ok
 -04-26 04:48:42.202453 7f22505c9700  7 mon.3@1(peon).log v5604970 update_from_paxos applying incremental log 5604970 2013-04-26 04:48:41.006337 mon.0 10.227.227.101:6789/0 54 : [INF] pgmap v5939068: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:42.202609 7f22505c9700 10 mon.3@1(peon).log v5604970 check_subs
 -04-26 04:48:42.202747 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:45.274543 7f22505c9700  7 mon.3@1(peon).pg v5939068 update_from_paxos  applying incremental 5939069
 -04-26 04:48:45.274620 7f22505c9700 10 mon.3@1(peon).pg v5939069 v5939069: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:45.276733 7f22505c9700 10 mon.3@1(peon).pg v5939069 send_pg_creates to 0 pgs
 -04-26 04:48:45.276747 7f22505c9700 10 mon.3@1(peon).pg v5939069 update_logger
 -04-26 04:48:45.276952 7f22505c9700 10 mon.3@1(peon).log v5604970 update_from_paxos
 -04-26 04:48:45.277044 7f22505c9700 10 mon.3@1(peon).log v5604970 update_from_paxos version 5604970 summary v 5604970
 -04-26 04:48:45.277126 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:45.779051 7f2250dca700 10 mon.3@1(peon).pg v5939069 v5939069: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:45.779232 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:48:45.779334 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:48:45.779347 7f2250dca700 10 mon.3@1(peon).log v5604970 update_from_paxos
 -04-26 04:48:45.779469 7f2250dca700 10 mon.3@1(peon).log v5604970 update_from_paxos version 5604970 summary v 5604970
 -04-26 04:48:45.779522 7f2250dca700 10 mon.3@1(peon).log v5604970 log
 -04-26 04:48:45.779639 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:45.779757 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:48:46.209140 7f22505c9700  7 mon.3@1(peon).pg v5939069 update_from_paxos  applying incremental 5939070
 -04-26 04:48:46.209189 7f22505c9700 10 mon.3@1(peon).pg v5939070 v5939070: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:46.211338 7f22505c9700 10 mon.3@1(peon).pg v5939070 send_pg_creates to 0 pgs
 -04-26 04:48:46.211352 7f22505c9700 10 mon.3@1(peon).pg v5939070 update_logger
 -04-26 04:48:46.211567 7f22505c9700 10 mon.3@1(peon).log v5604970 update_from_paxos
 -04-26 04:48:46.211686 7f22505c9700 10 mon.3@1(peon).log v5604970 update_from_paxos version 5604970 summary v 5604970
 -04-26 04:48:46.211809 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:46.306168 7f2250dca700 10 mon.3@1(peon).data_health(2854) service_tick
 -04-26 04:48:46.306214 7f2250dca700  0 mon.3@1(peon).data_health(2854) update_stats avail 54% total 1826117064 used 830792108 avail 995324956
 -04-26 04:48:46.306224 7f2250dca700 10 mon.3@1(peon).data_health(2854) share_stats
 -04-26 04:48:46.418353 7f22505c9700 10 mon.3@1(peon).log v5604971 update_from_paxos
 -04-26 04:48:46.418468 7f22505c9700 10 mon.3@1(peon).log v5604971 update_from_paxos version 5604971 summary v 5604970
 -04-26 04:48:46.418571 7f22505c9700 10 mon.3@1(peon).log v5604971 update_from_paxos latest full 5604970
 -04-26 04:48:46.418703 7f22505c9700  7 mon.3@1(peon).log v5604971 update_from_paxos applying incremental log 5604971 2013-04-26 04:48:45.296710 mon.0 10.227.227.101:6789/0 55 : [INF] pgmap v5939069: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:46.418871 7f22505c9700 10 mon.3@1(peon).log v5604971 check_subs
 -04-26 04:48:46.419029 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:47.292477 7f22505c9700  7 mon.3@1(peon).pg v5939070 update_from_paxos  applying incremental 5939071
 -04-26 04:48:47.292503 7f22505c9700 10 mon.3@1(peon).pg v5939071 v5939071: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:47.294600 7f22505c9700 10 mon.3@1(peon).pg v5939071 send_pg_creates to 0 pgs
 -04-26 04:48:47.294614 7f22505c9700 10 mon.3@1(peon).pg v5939071 update_logger
 -04-26 04:48:47.294791 7f22505c9700 10 mon.3@1(peon).log v5604971 update_from_paxos
 -04-26 04:48:47.294904 7f22505c9700 10 mon.3@1(peon).log v5604971 update_from_paxos version 5604971 summary v 5604971
 -04-26 04:48:47.295009 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:47.518364 7f22505c9700 10 mon.3@1(peon).log v5604972 update_from_paxos
 -04-26 04:48:47.518435 7f22505c9700 10 mon.3@1(peon).log v5604972 update_from_paxos version 5604972 summary v 5604971
 -04-26 04:48:47.518498 7f22505c9700 10 mon.3@1(peon).log v5604972 update_from_paxos latest full 5604971
 -04-26 04:48:47.518579 7f22505c9700  7 mon.3@1(peon).log v5604972 update_from_paxos applying incremental log 5604972 2013-04-26 04:48:38.509088 osd.4 10.227.227.104:6804/15010 196 : [INF] 2.8 deep-scrub ok
 -04-26 04:48:47.518683 7f22505c9700  7 mon.3@1(peon).log v5604972 update_from_paxos applying incremental log 5604972 2013-04-26 04:48:46.230547 mon.0 10.227.227.101:6789/0 56 : [INF] pgmap v5939070: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:47.518782 7f22505c9700  7 mon.3@1(peon).log v5604972 update_from_paxos applying incremental log 5604972 2013-04-26 04:48:47.304601 mon.0 10.227.227.101:6789/0 57 : [INF] pgmap v5939071: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:47.518925 7f22505c9700 10 mon.3@1(peon).log v5604972 check_subs
 -04-26 04:48:47.519062 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:48.644600 7f22505c9700 10 mon.3@1(peon).log v5604973 update_from_paxos
 -04-26 04:48:48.644697 7f22505c9700 10 mon.3@1(peon).log v5604973 update_from_paxos version 5604973 summary v 5604972
 -04-26 04:48:48.644767 7f22505c9700 10 mon.3@1(peon).log v5604973 update_from_paxos latest full 5604972
 -04-26 04:48:48.644847 7f22505c9700  7 mon.3@1(peon).log v5604973 update_from_paxos applying incremental log 5604973 2013-04-26 04:48:40.051828 osd.3 10.227.227.104:6801/14901 189 : [INF] 1.29b deep-scrub ok
 -04-26 04:48:48.644912 7f22505c9700  7 mon.3@1(peon).log v5604973 update_from_paxos applying incremental log 5604973 2013-04-26 04:48:42.069021 osd.3 10.227.227.104:6801/14901 190 : [INF] 1.29c deep-scrub ok
 -04-26 04:48:48.645097 7f22505c9700 10 mon.3@1(peon).log v5604973 check_subs
 -04-26 04:48:48.645207 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:49.842031 7f22505c9700  7 mon.3@1(peon).pg v5939071 update_from_paxos  applying incremental 5939072
 -04-26 04:48:49.842074 7f22505c9700 10 mon.3@1(peon).pg v5939072 v5939072: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:49.844021 7f22505c9700 10 mon.3@1(peon).pg v5939072 send_pg_creates to 0 pgs
 -04-26 04:48:49.844037 7f22505c9700 10 mon.3@1(peon).pg v5939072 update_logger
 -04-26 04:48:49.844262 7f22505c9700 10 mon.3@1(peon).log v5604973 update_from_paxos
 -04-26 04:48:49.844521 7f22505c9700 10 mon.3@1(peon).log v5604973 update_from_paxos version 5604973 summary v 5604973
 -04-26 04:48:49.844652 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:50.782620 7f2250dca700 10 mon.3@1(peon).pg v5939072 v5939072: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:50.782804 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:48:50.782900 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:48:50.782914 7f2250dca700 10 mon.3@1(peon).log v5604973 update_from_paxos
 -04-26 04:48:50.783040 7f2250dca700 10 mon.3@1(peon).log v5604973 update_from_paxos version 5604973 summary v 5604973
 -04-26 04:48:50.783103 7f2250dca700 10 mon.3@1(peon).log v5604973 log
 -04-26 04:48:50.783234 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:50.783353 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:48:50.995816 7f22505c9700 10 mon.3@1(peon).log v5604974 update_from_paxos
 -04-26 04:48:50.995949 7f22505c9700 10 mon.3@1(peon).log v5604974 update_from_paxos version 5604974 summary v 5604973
 -04-26 04:48:50.996055 7f22505c9700 10 mon.3@1(peon).log v5604974 update_from_paxos latest full 5604973
 -04-26 04:48:50.996187 7f22505c9700  7 mon.3@1(peon).log v5604974 update_from_paxos applying incremental log 5604974 2013-04-26 04:48:49.864268 mon.0 10.227.227.101:6789/0 58 : [INF] pgmap v5939072: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:50.996418 7f22505c9700 10 mon.3@1(peon).log v5604974 check_subs
 -04-26 04:48:50.996571 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:53.984757 7f22505c9700 10 mon.3@1(peon).log v5604974 update_from_paxos
 -04-26 04:48:53.984890 7f22505c9700 10 mon.3@1(peon).log v5604974 update_from_paxos version 5604974 summary v 5604974
 -04-26 04:48:53.985006 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:55.785255 7f2250dca700 10 mon.3@1(peon).pg v5939072 v5939072: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:48:55.785415 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:48:55.785549 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:48:55.785561 7f2250dca700 10 mon.3@1(peon).log v5604974 update_from_paxos
 -04-26 04:48:55.785683 7f2250dca700 10 mon.3@1(peon).log v5604974 update_from_paxos version 5604974 summary v 5604974
 -04-26 04:48:55.785737 7f2250dca700 10 mon.3@1(peon).log v5604974 log
 -04-26 04:48:55.785867 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:55.785986 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:48:56.984863 7f22505c9700 10 mon.3@1(peon).log v5604974 update_from_paxos
 -04-26 04:48:56.984992 7f22505c9700 10 mon.3@1(peon).log v5604974 update_from_paxos version 5604974 summary v 5604974
 -04-26 04:48:56.985108 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:48:59.984959 7f22505c9700 10 mon.3@1(peon).log v5604974 update_from_paxos
 -04-26 04:48:59.985086 7f22505c9700 10 mon.3@1(peon).log v5604974 update_from_paxos version 5604974 summary v 5604974
 -04-26 04:48:59.985201 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:00.715909 7f22505c9700  7 mon.3@1(peon).pg v5939072 update_from_paxos  applying incremental 5939073
 -04-26 04:49:00.715964 7f22505c9700 10 mon.3@1(peon).pg v5939073 v5939073: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:00.718064 7f22505c9700 10 mon.3@1(peon).pg v5939073 send_pg_creates to 0 pgs
 -04-26 04:49:00.718078 7f22505c9700 10 mon.3@1(peon).pg v5939073 update_logger
 -04-26 04:49:00.718310 7f22505c9700 10 mon.3@1(peon).log v5604974 update_from_paxos
 -04-26 04:49:00.718432 7f22505c9700 10 mon.3@1(peon).log v5604974 update_from_paxos version 5604974 summary v 5604974
 -04-26 04:49:00.718546 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:00.787481 7f2250dca700 10 mon.3@1(peon).pg v5939073 v5939073: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:00.787601 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:49:00.787664 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:49:00.787674 7f2250dca700 10 mon.3@1(peon).log v5604974 update_from_paxos
 -04-26 04:49:00.787753 7f2250dca700 10 mon.3@1(peon).log v5604974 update_from_paxos version 5604974 summary v 5604974
 -04-26 04:49:00.787788 7f2250dca700 10 mon.3@1(peon).log v5604974 log
 -04-26 04:49:00.787860 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:00.788020 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:49:01.075246 7f224a859700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:0/1029446 client protocol 0
 -04-26 04:49:01.075918 7f22505c9700 10 mon.3@1(peon) e1 do not have session, making new one
 -04-26 04:49:01.075928 7f22505c9700 10 mon.3@1(peon) e1 ms_dispatch new session MonSession: client.? 10.227.227.104:0/1029446 is open for client.? 10.227.227.104:0/1029446
 -04-26 04:49:01.075939 7f22505c9700 10 mon.3@1(peon) e1 setting timeout on session
 -04-26 04:49:01.076098 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:01.076199 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 0 30 bytes epoch 0) v1 from client.? 10.227.227.104:0/1029446
 -04-26 04:49:01.076266 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=30
 -04-26 04:49:01.076333 7f22505c9700 10 mon.3@1(peon).auth v4474 AuthMonitor::assign_global_id m=auth(proto 0 30 bytes epoch 0) v1 mon=1/3 last_allocated=227398 max_global_id=227796
 -04-26 04:49:01.076391 7f22505c9700 10 mon.3@1(peon).auth v4474 next_global_id should be 227401
 -04-26 04:49:01.078218 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:01.078319 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 2 32 bytes epoch 0) v1 from client.? 10.227.227.104:0/1029446
 -04-26 04:49:01.078392 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=32
 -04-26 04:49:01.079629 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:01.079729 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 2 165 bytes epoch 0) v1 from client.? 10.227.227.104:0/1029446
 -04-26 04:49:01.079785 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=165
 -04-26 04:49:01.080865 7f22505c9700 10 mon.3@1(peon) e1 handle_subscribe mon_subscribe({monmap=0+}) v2
 -04-26 04:49:01.080880 7f22505c9700 10 mon.3@1(peon) e1 check_sub monmap next 0 have 1
 -04-26 04:49:01.081095 7f22505c9700 10 mon.3@1(peon) e1 handle_subscribe mon_subscribe({monmap=2+,osdmap=0}) v2
 -04-26 04:49:01.081109 7f22505c9700 10 mon.3@1(peon) e1 check_sub monmap next 2 have 1
 -04-26 04:49:01.081440 7f22505c9700 10 mon.3@1(peon) e1 handle_subscribe mon_subscribe({monmap=2+,osdmap=0}) v2
 -04-26 04:49:01.081452 7f22505c9700 10 mon.3@1(peon) e1 check_sub monmap next 2 have 1
 -04-26 04:49:01.088786 7f22505c9700 10 mon.3@1(peon) e1 ms_handle_reset 0x2af3760 10.227.227.104:0/1029446
 -04-26 04:49:01.088814 7f22505c9700 10 mon.3@1(peon) e1 reset/close on session client.? 10.227.227.104:0/1029446
 -04-26 04:49:01.088827 7f22505c9700 10 mon.3@1(peon) e1 remove_session MonSession: client.? 10.227.227.104:0/1029446 is openallow * client.? 10.227.227.104:0/1029446
 -04-26 04:49:01.559801 7f22505c9700 10 mon.3@1(peon).log v5604975 update_from_paxos
 -04-26 04:49:01.559928 7f22505c9700 10 mon.3@1(peon).log v5604975 update_from_paxos version 5604975 summary v 5604974
 -04-26 04:49:01.560043 7f22505c9700 10 mon.3@1(peon).log v5604975 update_from_paxos latest full 5604974
 -04-26 04:49:01.560174 7f22505c9700  7 mon.3@1(peon).log v5604975 update_from_paxos applying incremental log 5604975 2013-04-26 04:49:00.738475 mon.0 10.227.227.101:6789/0 59 : [INF] pgmap v5939073: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:01.560338 7f22505c9700 10 mon.3@1(peon).log v5604975 check_subs
 -04-26 04:49:01.560480 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:04.560125 7f22505c9700 10 mon.3@1(peon).log v5604975 update_from_paxos
 -04-26 04:49:04.560253 7f22505c9700 10 mon.3@1(peon).log v5604975 update_from_paxos version 5604975 summary v 5604975
 -04-26 04:49:04.560368 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:05.633026 7f22505c9700  7 mon.3@1(peon).pg v5939073 update_from_paxos  applying incremental 5939074
 -04-26 04:49:05.633102 7f22505c9700 10 mon.3@1(peon).pg v5939074 v5939074: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:05.635189 7f22505c9700 10 mon.3@1(peon).pg v5939074 send_pg_creates to 0 pgs
 -04-26 04:49:05.635206 7f22505c9700 10 mon.3@1(peon).pg v5939074 update_logger
 -04-26 04:49:05.635396 7f22505c9700 10 mon.3@1(peon).log v5604975 update_from_paxos
 -04-26 04:49:05.635510 7f22505c9700 10 mon.3@1(peon).log v5604975 update_from_paxos version 5604975 summary v 5604975
 -04-26 04:49:05.635622 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:05.790342 7f2250dca700 10 mon.3@1(peon).pg v5939074 v5939074: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:05.790527 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:49:05.790630 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:49:05.790642 7f2250dca700 10 mon.3@1(peon).log v5604975 update_from_paxos
 -04-26 04:49:05.790767 7f2250dca700 10 mon.3@1(peon).log v5604975 update_from_paxos version 5604975 summary v 5604975
 -04-26 04:49:05.790827 7f2250dca700 10 mon.3@1(peon).log v5604975 log
 -04-26 04:49:05.790950 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:05.791068 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:49:06.784718 7f22505c9700 10 mon.3@1(peon).log v5604976 update_from_paxos
 -04-26 04:49:06.784837 7f22505c9700 10 mon.3@1(peon).log v5604976 update_from_paxos version 5604976 summary v 5604975
 -04-26 04:49:06.784943 7f22505c9700 10 mon.3@1(peon).log v5604976 update_from_paxos latest full 5604975
 -04-26 04:49:06.785075 7f22505c9700  7 mon.3@1(peon).log v5604976 update_from_paxos applying incremental log 5604976 2013-04-26 04:49:05.654585 mon.0 10.227.227.101:6789/0 60 : [INF] pgmap v5939074: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:06.785235 7f22505c9700 10 mon.3@1(peon).log v5604976 check_subs
 -04-26 04:49:06.785377 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:06.933081 7f22505c9700  7 mon.3@1(peon).pg v5939074 update_from_paxos  applying incremental 5939075
 -04-26 04:49:06.933131 7f22505c9700 10 mon.3@1(peon).pg v5939075 v5939075: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:06.935227 7f22505c9700 10 mon.3@1(peon).pg v5939075 send_pg_creates to 0 pgs
 -04-26 04:49:06.935241 7f22505c9700 10 mon.3@1(peon).pg v5939075 update_logger
 -04-26 04:49:06.935415 7f22505c9700 10 mon.3@1(peon).log v5604976 update_from_paxos
 -04-26 04:49:06.935659 7f22505c9700 10 mon.3@1(peon).log v5604976 update_from_paxos version 5604976 summary v 5604976
 -04-26 04:49:06.935780 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:07.952285 7f22505c9700 10 mon.3@1(peon).log v5604977 update_from_paxos
 -04-26 04:49:07.952413 7f22505c9700 10 mon.3@1(peon).log v5604977 update_from_paxos version 5604977 summary v 5604976
 -04-26 04:49:07.952523 7f22505c9700 10 mon.3@1(peon).log v5604977 update_from_paxos latest full 5604976
 -04-26 04:49:07.952654 7f22505c9700  7 mon.3@1(peon).log v5604977 update_from_paxos applying incremental log 5604977 2013-04-26 04:49:04.455431 osd.4 10.227.227.104:6804/15010 197 : [INF] 2.12 deep-scrub ok
 -04-26 04:49:07.952757 7f22505c9700  7 mon.3@1(peon).log v5604977 update_from_paxos applying incremental log 5604977 2013-04-26 04:49:06.955997 mon.0 10.227.227.101:6789/0 61 : [INF] pgmap v5939075: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:07.952911 7f22505c9700 10 mon.3@1(peon).log v5604977 check_subs
 -04-26 04:49:07.953056 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:08.143781 7f22505c9700 10 mon.3@1(peon).log v5604977 update_from_paxos
 -04-26 04:49:08.143894 7f22505c9700 10 mon.3@1(peon).log v5604977 update_from_paxos version 5604977 summary v 5604977
 -04-26 04:49:08.143959 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:09.194277 7f22505c9700 10 mon.3@1(peon).log v5604978 update_from_paxos
 -04-26 04:49:09.194399 7f22505c9700 10 mon.3@1(peon).log v5604978 update_from_paxos version 5604978 summary v 5604977
 -04-26 04:49:09.194503 7f22505c9700 10 mon.3@1(peon).log v5604978 update_from_paxos latest full 5604977
 -04-26 04:49:09.194633 7f22505c9700  7 mon.3@1(peon).log v5604978 update_from_paxos applying incremental log 5604978 2013-04-26 04:49:03.221185 osd.5 10.227.227.104:6807/15124 186 : [INF] 2.a1 deep-scrub ok
 -04-26 04:49:09.194737 7f22505c9700  7 mon.3@1(peon).log v5604978 update_from_paxos applying incremental log 5604978 2013-04-26 04:49:05.103090 osd.3 10.227.227.104:6801/14901 191 : [INF] 1.2aa deep-scrub ok
 -04-26 04:49:09.194832 7f22505c9700  7 mon.3@1(peon).log v5604978 update_from_paxos applying incremental log 5604978 2013-04-26 04:49:07.095668 osd.3 10.227.227.104:6801/14901 192 : [INF] 1.2b2 deep-scrub ok
 -04-26 04:49:09.194975 7f22505c9700 10 mon.3@1(peon).log v5604978 check_subs
 -04-26 04:49:09.195118 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:10.134251 7f22505c9700  7 mon.3@1(peon).pg v5939075 update_from_paxos  applying incremental 5939076
 -04-26 04:49:10.134311 7f22505c9700 10 mon.3@1(peon).pg v5939076 v5939076: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:10.136327 7f22505c9700 10 mon.3@1(peon).pg v5939076 send_pg_creates to 0 pgs
 -04-26 04:49:10.136342 7f22505c9700 10 mon.3@1(peon).pg v5939076 update_logger
 -04-26 04:49:10.136550 7f22505c9700 10 mon.3@1(peon).log v5604978 update_from_paxos
 -04-26 04:49:10.136678 7f22505c9700 10 mon.3@1(peon).log v5604978 update_from_paxos version 5604978 summary v 5604978
 -04-26 04:49:10.136794 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:10.793419 7f2250dca700 10 mon.3@1(peon).pg v5939076 v5939076: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:10.793595 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:49:10.793715 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:49:10.793726 7f2250dca700 10 mon.3@1(peon).log v5604978 update_from_paxos
 -04-26 04:49:10.793846 7f2250dca700 10 mon.3@1(peon).log v5604978 update_from_paxos version 5604978 summary v 5604978
 -04-26 04:49:10.793910 7f2250dca700 10 mon.3@1(peon).log v5604978 log
 -04-26 04:49:10.794030 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:10.794146 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:49:11.355795 7f22505c9700 10 mon.3@1(peon).log v5604979 update_from_paxos
 -04-26 04:49:11.355920 7f22505c9700 10 mon.3@1(peon).log v5604979 update_from_paxos version 5604979 summary v 5604978
 -04-26 04:49:11.356024 7f22505c9700 10 mon.3@1(peon).log v5604979 update_from_paxos latest full 5604978
 -04-26 04:49:11.356156 7f22505c9700  7 mon.3@1(peon).log v5604979 update_from_paxos applying incremental log 5604979 2013-04-26 04:49:10.157074 mon.0 10.227.227.101:6789/0 62 : [INF] pgmap v5939076: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:11.356317 7f22505c9700 10 mon.3@1(peon).log v5604979 check_subs
 -04-26 04:49:11.356470 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:12.309982 7f22505c9700  7 mon.3@1(peon).pg v5939076 update_from_paxos  applying incremental 5939077
 -04-26 04:49:12.310051 7f22505c9700 10 mon.3@1(peon).pg v5939077 v5939077: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:12.312223 7f22505c9700 10 mon.3@1(peon).pg v5939077 send_pg_creates to 0 pgs
 -04-26 04:49:12.312233 7f22505c9700 10 mon.3@1(peon).pg v5939077 update_logger
 -04-26 04:49:12.312360 7f22505c9700 10 mon.3@1(peon).log v5604979 update_from_paxos
 -04-26 04:49:12.312435 7f22505c9700 10 mon.3@1(peon).log v5604979 update_from_paxos version 5604979 summary v 5604979
 -04-26 04:49:12.312503 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:13.502894 7f22505c9700 10 mon.3@1(peon).log v5604980 update_from_paxos
 -04-26 04:49:13.503075 7f22505c9700 10 mon.3@1(peon).log v5604980 update_from_paxos version 5604980 summary v 5604979
 -04-26 04:49:13.503229 7f22505c9700 10 mon.3@1(peon).log v5604980 update_from_paxos latest full 5604979
 -04-26 04:49:13.503368 7f22505c9700  7 mon.3@1(peon).log v5604980 update_from_paxos applying incremental log 5604980 2013-04-26 04:49:12.331813 mon.0 10.227.227.101:6789/0 63 : [INF] pgmap v5939077: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:13.503543 7f22505c9700 10 mon.3@1(peon).log v5604980 check_subs
 -04-26 04:49:13.503689 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:15.142668 7f22505c9700  7 mon.3@1(peon).pg v5939077 update_from_paxos  applying incremental 5939078
 -04-26 04:49:15.142707 7f22505c9700 10 mon.3@1(peon).pg v5939078 v5939078: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:15.144568 7f22505c9700 10 mon.3@1(peon).pg v5939078 send_pg_creates to 0 pgs
 -04-26 04:49:15.144578 7f22505c9700 10 mon.3@1(peon).pg v5939078 update_logger
 -04-26 04:49:15.144770 7f22505c9700 10 mon.3@1(peon).log v5604980 update_from_paxos
 -04-26 04:49:15.144893 7f22505c9700 10 mon.3@1(peon).log v5604980 update_from_paxos version 5604980 summary v 5604980
 -04-26 04:49:15.145008 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:15.796459 7f2250dca700 10 mon.3@1(peon).pg v5939078 v5939078: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:15.796615 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:49:15.796710 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:49:15.796722 7f2250dca700 10 mon.3@1(peon).log v5604980 update_from_paxos
 -04-26 04:49:15.796837 7f2250dca700 10 mon.3@1(peon).log v5604980 update_from_paxos version 5604980 summary v 5604980
 -04-26 04:49:15.796890 7f2250dca700 10 mon.3@1(peon).log v5604980 log
 -04-26 04:49:15.797002 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:15.797113 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:49:16.344802 7f22505c9700 10 mon.3@1(peon).log v5604981 update_from_paxos
 -04-26 04:49:16.344927 7f22505c9700 10 mon.3@1(peon).log v5604981 update_from_paxos version 5604981 summary v 5604980
 -04-26 04:49:16.345059 7f22505c9700 10 mon.3@1(peon).log v5604981 update_from_paxos latest full 5604980
 -04-26 04:49:16.345193 7f22505c9700  7 mon.3@1(peon).log v5604981 update_from_paxos applying incremental log 5604981 2013-04-26 04:49:15.157119 mon.0 10.227.227.101:6789/0 64 : [INF] pgmap v5939078: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:16.345355 7f22505c9700 10 mon.3@1(peon).log v5604981 check_subs
 -04-26 04:49:16.345502 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:16.683588 7f22505c9700  7 mon.3@1(peon).pg v5939078 update_from_paxos  applying incremental 5939079
 -04-26 04:49:16.683626 7f22505c9700 10 mon.3@1(peon).pg v5939079 v5939079: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:16.685705 7f22505c9700 10 mon.3@1(peon).pg v5939079 send_pg_creates to 0 pgs
 -04-26 04:49:16.685720 7f22505c9700 10 mon.3@1(peon).pg v5939079 update_logger
 -04-26 04:49:16.685928 7f22505c9700 10 mon.3@1(peon).log v5604981 update_from_paxos
 -04-26 04:49:16.686051 7f22505c9700 10 mon.3@1(peon).log v5604981 update_from_paxos version 5604981 summary v 5604981
 -04-26 04:49:16.686166 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:16.777363 7f22505c9700 10 mon.3@1(peon).data_health(2854) service_dispatch mon_health( service 1 op tell e 0 r 0 flags none ) v1
 -04-26 04:49:16.777373 7f22505c9700 10 mon.3@1(peon).data_health(2854) handle_tell mon_health( service 1 op tell e 0 r 0 flags none ) v1
 -04-26 04:49:17.684218 7f22505c9700 10 mon.3@1(peon).log v5604982 update_from_paxos
 -04-26 04:49:17.684340 7f22505c9700 10 mon.3@1(peon).log v5604982 update_from_paxos version 5604982 summary v 5604981
 -04-26 04:49:17.684447 7f22505c9700 10 mon.3@1(peon).log v5604982 update_from_paxos latest full 5604981
 -04-26 04:49:17.684579 7f22505c9700  7 mon.3@1(peon).log v5604982 update_from_paxos applying incremental log 5604982 2013-04-26 04:49:16.664609 mon.0 10.227.227.101:6789/0 65 : [INF] pgmap v5939079: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:17.684740 7f22505c9700 10 mon.3@1(peon).log v5604982 check_subs
 -04-26 04:49:17.684883 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:17.768832 7f22505c9700  7 mon.3@1(peon).pg v5939079 update_from_paxos  applying incremental 5939080
 -04-26 04:49:17.768886 7f22505c9700 10 mon.3@1(peon).pg v5939080 v5939080: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:17.770969 7f22505c9700 10 mon.3@1(peon).pg v5939080 send_pg_creates to 0 pgs
 -04-26 04:49:17.770982 7f22505c9700 10 mon.3@1(peon).pg v5939080 update_logger
 -04-26 04:49:17.771158 7f22505c9700 10 mon.3@1(peon).log v5604982 update_from_paxos
 -04-26 04:49:17.771270 7f22505c9700 10 mon.3@1(peon).log v5604982 update_from_paxos version 5604982 summary v 5604982
 -04-26 04:49:17.771377 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:18.248493 7f224a859700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016118 client protocol 0
 -04-26 04:49:18.248976 7f22505c9700 10 mon.3@1(peon) e1 do not have session, making new one
 -04-26 04:49:18.248984 7f22505c9700 10 mon.3@1(peon) e1 ms_dispatch new session MonSession: client.? 10.227.227.103:0/1016118 is open for client.? 10.227.227.103:0/1016118
 -04-26 04:49:18.248995 7f22505c9700 10 mon.3@1(peon) e1 setting timeout on session
 -04-26 04:49:18.249157 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:18.249257 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 0 30 bytes epoch 0) v1 from client.? 10.227.227.103:0/1016118
 -04-26 04:49:18.249313 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=30
 -04-26 04:49:18.249381 7f22505c9700 10 mon.3@1(peon).auth v4474 AuthMonitor::assign_global_id m=auth(proto 0 30 bytes epoch 0) v1 mon=1/3 last_allocated=227401 max_global_id=227796
 -04-26 04:49:18.249438 7f22505c9700 10 mon.3@1(peon).auth v4474 next_global_id should be 227404
 -04-26 04:49:18.250847 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:18.250946 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 2 32 bytes epoch 0) v1 from client.? 10.227.227.103:0/1016118
 -04-26 04:49:18.251001 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=32
 -04-26 04:49:18.252127 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:18.252277 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 2 165 bytes epoch 0) v1 from client.? 10.227.227.103:0/1016118
 -04-26 04:49:18.252338 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=165
 -04-26 04:49:18.253076 7f22505c9700 10 mon.3@1(peon) e1 handle_subscribe mon_subscribe({monmap=0+}) v2
 -04-26 04:49:18.253085 7f22505c9700 10 mon.3@1(peon) e1 check_sub monmap next 0 have 1
 -04-26 04:49:18.253334 7f22505c9700 10 mon.3@1(peon) e1 handle_subscribe mon_subscribe({monmap=2+,osdmap=0}) v2
 -04-26 04:49:18.253340 7f22505c9700 10 mon.3@1(peon) e1 check_sub monmap next 2 have 1
 -04-26 04:49:18.253560 7f22505c9700 10 mon.3@1(peon) e1 handle_subscribe mon_subscribe({monmap=2+,osdmap=0}) v2
 -04-26 04:49:18.253568 7f22505c9700 10 mon.3@1(peon) e1 check_sub monmap next 2 have 1
 -04-26 04:49:18.260459 7f22505c9700 10 mon.3@1(peon) e1 ms_handle_reset 0x2af3600 10.227.227.103:0/1016118
 -04-26 04:49:18.260494 7f22505c9700 10 mon.3@1(peon) e1 reset/close on session client.? 10.227.227.103:0/1016118
 -04-26 04:49:18.260502 7f22505c9700 10 mon.3@1(peon) e1 remove_session MonSession: client.? 10.227.227.103:0/1016118 is openallow * client.? 10.227.227.103:0/1016118
 -04-26 04:49:18.937738 7f22505c9700 10 mon.3@1(peon).log v5604983 update_from_paxos
 -04-26 04:49:18.937861 7f22505c9700 10 mon.3@1(peon).log v5604983 update_from_paxos version 5604983 summary v 5604982
 -04-26 04:49:18.937967 7f22505c9700 10 mon.3@1(peon).log v5604983 update_from_paxos latest full 5604982
 -04-26 04:49:18.938100 7f22505c9700  7 mon.3@1(peon).log v5604983 update_from_paxos applying incremental log 5604983 2013-04-26 04:49:12.127724 osd.3 10.227.227.104:6801/14901 193 : [INF] 1.2b9 deep-scrub ok
 -04-26 04:49:18.938208 7f22505c9700  7 mon.3@1(peon).log v5604983 update_from_paxos applying incremental log 5604983 2013-04-26 04:49:17.793543 mon.0 10.227.227.101:6789/0 66 : [INF] pgmap v5939080: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:18.938366 7f22505c9700 10 mon.3@1(peon).log v5604983 check_subs
 -04-26 04:49:18.938510 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:20.362835 7f22505c9700  7 mon.3@1(peon).pg v5939080 update_from_paxos  applying incremental 5939081
 -04-26 04:49:20.362886 7f22505c9700 10 mon.3@1(peon).pg v5939081 v5939081: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:20.364989 7f22505c9700 10 mon.3@1(peon).pg v5939081 send_pg_creates to 0 pgs
 -04-26 04:49:20.365010 7f22505c9700 10 mon.3@1(peon).pg v5939081 update_logger
 -04-26 04:49:20.365218 7f22505c9700 10 mon.3@1(peon).log v5604983 update_from_paxos
 -04-26 04:49:20.365342 7f22505c9700 10 mon.3@1(peon).log v5604983 update_from_paxos version 5604983 summary v 5604983
 -04-26 04:49:20.365458 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:20.799457 7f2250dca700 10 mon.3@1(peon).pg v5939081 v5939081: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:20.799640 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:49:20.799743 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:49:20.799768 7f2250dca700 10 mon.3@1(peon).log v5604983 update_from_paxos
 -04-26 04:49:20.799892 7f2250dca700 10 mon.3@1(peon).log v5604983 update_from_paxos version 5604983 summary v 5604983
 -04-26 04:49:20.799948 7f2250dca700 10 mon.3@1(peon).log v5604983 log
 -04-26 04:49:20.800066 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:20.800184 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:49:21.562793 7f22505c9700 10 mon.3@1(peon).log v5604984 update_from_paxos
 -04-26 04:49:21.562919 7f22505c9700 10 mon.3@1(peon).log v5604984 update_from_paxos version 5604984 summary v 5604983
 -04-26 04:49:21.563024 7f22505c9700 10 mon.3@1(peon).log v5604984 update_from_paxos latest full 5604983
 -04-26 04:49:21.563156 7f22505c9700  7 mon.3@1(peon).log v5604984 update_from_paxos applying incremental log 5604984 2013-04-26 04:49:20.382749 mon.0 10.227.227.101:6789/0 67 : [INF] pgmap v5939081: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:21.563315 7f22505c9700 10 mon.3@1(peon).log v5604984 check_subs
 -04-26 04:49:21.563458 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:21.753054 7f22505c9700  7 mon.3@1(peon).pg v5939081 update_from_paxos  applying incremental 5939082
 -04-26 04:49:21.753113 7f22505c9700 10 mon.3@1(peon).pg v5939082 v5939082: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:21.755199 7f22505c9700 10 mon.3@1(peon).pg v5939082 send_pg_creates to 0 pgs
 -04-26 04:49:21.755212 7f22505c9700 10 mon.3@1(peon).pg v5939082 update_logger
 -04-26 04:49:21.755410 7f22505c9700 10 mon.3@1(peon).log v5604984 update_from_paxos
 -04-26 04:49:21.755533 7f22505c9700 10 mon.3@1(peon).log v5604984 update_from_paxos version 5604984 summary v 5604984
 -04-26 04:49:21.755645 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:22.865744 7f22505c9700 10 mon.3@1(peon).log v5604985 update_from_paxos
 -04-26 04:49:22.865866 7f22505c9700 10 mon.3@1(peon).log v5604985 update_from_paxos version 5604985 summary v 5604984
 -04-26 04:49:22.865970 7f22505c9700 10 mon.3@1(peon).log v5604985 update_from_paxos latest full 5604984
 -04-26 04:49:22.866101 7f22505c9700  7 mon.3@1(peon).log v5604985 update_from_paxos applying incremental log 5604985 2013-04-26 04:49:21.776069 mon.0 10.227.227.101:6789/0 68 : [INF] pgmap v5939082: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:22.866265 7f22505c9700 10 mon.3@1(peon).log v5604985 check_subs
 -04-26 04:49:22.866410 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:25.409004 7f22505c9700  7 mon.3@1(peon).pg v5939082 update_from_paxos  applying incremental 5939083
 -04-26 04:49:25.409042 7f22505c9700 10 mon.3@1(peon).pg v5939083 v5939083: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:25.410297 7f22505c9700 10 mon.3@1(peon).pg v5939083 send_pg_creates to 0 pgs
 -04-26 04:49:25.410305 7f22505c9700 10 mon.3@1(peon).pg v5939083 update_logger
 -04-26 04:49:25.410441 7f22505c9700 10 mon.3@1(peon).log v5604985 update_from_paxos
 -04-26 04:49:25.410518 7f22505c9700 10 mon.3@1(peon).log v5604985 update_from_paxos version 5604985 summary v 5604985
 -04-26 04:49:25.410589 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:25.518333 7f224a859700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016304 client protocol 0
 -04-26 04:49:25.518678 7f22505c9700 10 mon.3@1(peon) e1 do not have session, making new one
 -04-26 04:49:25.518684 7f22505c9700 10 mon.3@1(peon) e1 ms_dispatch new session MonSession: client.? 10.227.227.103:0/1016304 is open for client.? 10.227.227.103:0/1016304
 -04-26 04:49:25.518692 7f22505c9700 10 mon.3@1(peon) e1 setting timeout on session
 -04-26 04:49:25.518841 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:25.518904 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 0 30 bytes epoch 0) v1 from client.? 10.227.227.103:0/1016304
 -04-26 04:49:25.518939 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=30
 -04-26 04:49:25.519001 7f22505c9700 10 mon.3@1(peon).auth v4474 AuthMonitor::assign_global_id m=auth(proto 0 30 bytes epoch 0) v1 mon=1/3 last_allocated=227404 max_global_id=227796
 -04-26 04:49:25.519055 7f22505c9700 10 mon.3@1(peon).auth v4474 next_global_id should be 227407
 -04-26 04:49:25.520654 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:25.520753 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 2 32 bytes epoch 0) v1 from client.? 10.227.227.103:0/1016304
 -04-26 04:49:25.520808 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=32
 -04-26 04:49:25.521876 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:25.521977 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 2 165 bytes epoch 0) v1 from client.? 10.227.227.103:0/1016304
 -04-26 04:49:25.522033 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=165
 -04-26 04:49:25.523038 7f22505c9700 10 mon.3@1(peon) e1 handle_subscribe mon_subscribe({monmap=0+}) v2
 -04-26 04:49:25.523057 7f22505c9700 10 mon.3@1(peon) e1 check_sub monmap next 0 have 1
 -04-26 04:49:25.523314 7f22505c9700 10 mon.3@1(peon) e1 handle_subscribe mon_subscribe({monmap=2+,osdmap=0}) v2
 -04-26 04:49:25.523320 7f22505c9700 10 mon.3@1(peon) e1 check_sub monmap next 2 have 1
 -04-26 04:49:25.523505 7f22505c9700 10 mon.3@1(peon) e1 handle_subscribe mon_subscribe({monmap=2+,osdmap=0}) v2
 -04-26 04:49:25.523509 7f22505c9700 10 mon.3@1(peon) e1 check_sub monmap next 2 have 1
 -04-26 04:49:25.530728 7f22505c9700 10 mon.3@1(peon) e1 ms_handle_reset 0x2af34a0 10.227.227.103:0/1016304
 -04-26 04:49:25.530760 7f22505c9700 10 mon.3@1(peon) e1 reset/close on session client.? 10.227.227.103:0/1016304
 -04-26 04:49:25.530771 7f22505c9700 10 mon.3@1(peon) e1 remove_session MonSession: client.? 10.227.227.103:0/1016304 is openallow * client.? 10.227.227.103:0/1016304
 -04-26 04:49:25.802560 7f2250dca700 10 mon.3@1(peon).pg v5939083 v5939083: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:25.802739 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:49:25.802839 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:49:25.802854 7f2250dca700 10 mon.3@1(peon).log v5604985 update_from_paxos
 -04-26 04:49:25.802975 7f2250dca700 10 mon.3@1(peon).log v5604985 update_from_paxos version 5604985 summary v 5604985
 -04-26 04:49:25.803028 7f2250dca700 10 mon.3@1(peon).log v5604985 log
 -04-26 04:49:25.803145 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:25.803263 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:49:26.087242 7f22505c9700 10 mon.3@1(peon).data_health(2854) service_dispatch mon_health( service 1 op tell e 0 r 0 flags none ) v1
 -04-26 04:49:26.087251 7f22505c9700 10 mon.3@1(peon).data_health(2854) handle_tell mon_health( service 1 op tell e 0 r 0 flags none ) v1
 -04-26 04:49:26.376479 7f22505c9700  7 mon.3@1(peon).pg v5939083 update_from_paxos  applying incremental 5939084
 -04-26 04:49:26.376533 7f22505c9700 10 mon.3@1(peon).pg v5939084 v5939084: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:26.378664 7f22505c9700 10 mon.3@1(peon).pg v5939084 send_pg_creates to 0 pgs
 -04-26 04:49:26.378679 7f22505c9700 10 mon.3@1(peon).pg v5939084 update_logger
 -04-26 04:49:26.378886 7f22505c9700 10 mon.3@1(peon).log v5604985 update_from_paxos
 -04-26 04:49:26.379034 7f22505c9700 10 mon.3@1(peon).log v5604985 update_from_paxos version 5604985 summary v 5604985
 -04-26 04:49:26.379157 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:26.554534 7f22505c9700 10 mon.3@1(peon).log v5604986 update_from_paxos
 -04-26 04:49:26.554650 7f22505c9700 10 mon.3@1(peon).log v5604986 update_from_paxos version 5604986 summary v 5604985
 -04-26 04:49:26.554754 7f22505c9700 10 mon.3@1(peon).log v5604986 update_from_paxos latest full 5604985
 -04-26 04:49:26.554887 7f22505c9700  7 mon.3@1(peon).log v5604986 update_from_paxos applying incremental log 5604986 2013-04-26 04:49:25.430347 mon.0 10.227.227.101:6789/0 69 : [INF] pgmap v5939083: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:26.555048 7f22505c9700 10 mon.3@1(peon).log v5604986 check_subs
 -04-26 04:49:26.555188 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:27.523019 7f22505c9700  7 mon.3@1(peon).pg v5939084 update_from_paxos  applying incremental 5939085
 -04-26 04:49:27.523071 7f22505c9700 10 mon.3@1(peon).pg v5939085 v5939085: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:27.525156 7f22505c9700 10 mon.3@1(peon).pg v5939085 send_pg_creates to 0 pgs
 -04-26 04:49:27.525175 7f22505c9700 10 mon.3@1(peon).pg v5939085 update_logger
 -04-26 04:49:27.525442 7f22505c9700 10 mon.3@1(peon).log v5604986 update_from_paxos
 -04-26 04:49:27.525569 7f22505c9700 10 mon.3@1(peon).log v5604986 update_from_paxos version 5604986 summary v 5604986
 -04-26 04:49:27.525684 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:28.638821 7f22505c9700 10 mon.3@1(peon).log v5604987 update_from_paxos
 -04-26 04:49:28.638944 7f22505c9700 10 mon.3@1(peon).log v5604987 update_from_paxos version 5604987 summary v 5604986
 -04-26 04:49:28.639048 7f22505c9700 10 mon.3@1(peon).log v5604987 update_from_paxos latest full 5604986
 -04-26 04:49:28.639179 7f22505c9700  7 mon.3@1(peon).log v5604987 update_from_paxos applying incremental log 5604987 2013-04-26 04:49:26.398534 mon.0 10.227.227.101:6789/0 70 : [INF] pgmap v5939084: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:28.639398 7f22505c9700  7 mon.3@1(peon).log v5604987 update_from_paxos applying incremental log 5604987 2013-04-26 04:49:27.542665 mon.0 10.227.227.101:6789/0 71 : [INF] pgmap v5939085: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:28.639503 7f22505c9700 10 mon.3@1(peon).log v5604987 check_subs
 -04-26 04:49:28.639590 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:30.175495 7f22505c9700  7 mon.3@1(peon).pg v5939085 update_from_paxos  applying incremental 5939086
 -04-26 04:49:30.175563 7f22505c9700 10 mon.3@1(peon).pg v5939086 v5939086: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:30.177532 7f22505c9700 10 mon.3@1(peon).pg v5939086 send_pg_creates to 0 pgs
 -04-26 04:49:30.177542 7f22505c9700 10 mon.3@1(peon).pg v5939086 update_logger
 -04-26 04:49:30.177678 7f22505c9700 10 mon.3@1(peon).log v5604987 update_from_paxos
 -04-26 04:49:30.177756 7f22505c9700 10 mon.3@1(peon).log v5604987 update_from_paxos version 5604987 summary v 5604987
 -04-26 04:49:30.177829 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:30.805662 7f2250dca700 10 mon.3@1(peon).pg v5939086 v5939086: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:30.805841 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:49:30.805941 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:49:30.805952 7f2250dca700 10 mon.3@1(peon).log v5604987 update_from_paxos
 -04-26 04:49:30.806075 7f2250dca700 10 mon.3@1(peon).log v5604987 update_from_paxos version 5604987 summary v 5604987
 -04-26 04:49:30.806139 7f2250dca700 10 mon.3@1(peon).log v5604987 log
 -04-26 04:49:30.806259 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:30.806374 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:49:31.354407 7f22505c9700 10 mon.3@1(peon).log v5604988 update_from_paxos
 -04-26 04:49:31.354487 7f22505c9700 10 mon.3@1(peon).log v5604988 update_from_paxos version 5604988 summary v 5604987
 -04-26 04:49:31.354551 7f22505c9700 10 mon.3@1(peon).log v5604988 update_from_paxos latest full 5604987
 -04-26 04:49:31.354634 7f22505c9700  7 mon.3@1(peon).log v5604988 update_from_paxos applying incremental log 5604988 2013-04-26 04:49:30.196110 mon.0 10.227.227.101:6789/0 72 : [INF] pgmap v5939086: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:31.354732 7f22505c9700 10 mon.3@1(peon).log v5604988 check_subs
 -04-26 04:49:31.354821 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:31.483756 7f22505c9700  7 mon.3@1(peon).pg v5939086 update_from_paxos  applying incremental 5939087
 -04-26 04:49:31.483794 7f22505c9700 10 mon.3@1(peon).pg v5939087 v5939087: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:31.485045 7f22505c9700 10 mon.3@1(peon).pg v5939087 send_pg_creates to 0 pgs
 -04-26 04:49:31.485054 7f22505c9700 10 mon.3@1(peon).pg v5939087 update_logger
 -04-26 04:49:31.485177 7f22505c9700 10 mon.3@1(peon).log v5604988 update_from_paxos
 -04-26 04:49:31.485247 7f22505c9700 10 mon.3@1(peon).log v5604988 update_from_paxos version 5604988 summary v 5604988
 -04-26 04:49:31.485314 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:32.572418 7f22505c9700 10 mon.3@1(peon).log v5604989 update_from_paxos
 -04-26 04:49:32.572500 7f22505c9700 10 mon.3@1(peon).log v5604989 update_from_paxos version 5604989 summary v 5604988
 -04-26 04:49:32.572602 7f22505c9700 10 mon.3@1(peon).log v5604989 update_from_paxos latest full 5604988
 -04-26 04:49:32.572718 7f22505c9700  7 mon.3@1(peon).log v5604989 update_from_paxos applying incremental log 5604989 2013-04-26 04:49:31.510244 mon.0 10.227.227.101:6789/0 73 : [INF] pgmap v5939087: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:32.572849 7f22505c9700 10 mon.3@1(peon).log v5604989 check_subs
 -04-26 04:49:32.572976 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:32.689837 7f22505c9700  7 mon.3@1(peon).pg v5939087 update_from_paxos  applying incremental 5939088
 -04-26 04:49:32.689887 7f22505c9700 10 mon.3@1(peon).pg v5939088 v5939088: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:32.691156 7f22505c9700 10 mon.3@1(peon).pg v5939088 send_pg_creates to 0 pgs
 -04-26 04:49:32.691165 7f22505c9700 10 mon.3@1(peon).pg v5939088 update_logger
 -04-26 04:49:32.691281 7f22505c9700 10 mon.3@1(peon).log v5604989 update_from_paxos
 -04-26 04:49:32.691350 7f22505c9700 10 mon.3@1(peon).log v5604989 update_from_paxos version 5604989 summary v 5604989
 -04-26 04:49:32.691416 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:33.805733 7f22505c9700 10 mon.3@1(peon).log v5604990 update_from_paxos
 -04-26 04:49:33.805812 7f22505c9700 10 mon.3@1(peon).log v5604990 update_from_paxos version 5604990 summary v 5604989
 -04-26 04:49:33.805868 7f22505c9700 10 mon.3@1(peon).log v5604990 update_from_paxos latest full 5604989
 -04-26 04:49:33.805963 7f22505c9700  7 mon.3@1(peon).log v5604990 update_from_paxos applying incremental log 5604990 2013-04-26 04:49:32.716333 mon.0 10.227.227.101:6789/0 74 : [INF] pgmap v5939088: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:33.806052 7f22505c9700 10 mon.3@1(peon).log v5604990 check_subs
 -04-26 04:49:33.806129 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:33.919517 7f22505c9700  7 mon.3@1(peon).pg v5939088 update_from_paxos  applying incremental 5939089
 -04-26 04:49:33.919566 7f22505c9700 10 mon.3@1(peon).pg v5939089 v5939089: 2428 pgs: 2428 active+clean; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:33.920608 7f22505c9700 10 mon.3@1(peon).pg v5939089 send_pg_creates to 0 pgs
 -04-26 04:49:33.920616 7f22505c9700 10 mon.3@1(peon).pg v5939089 update_logger
 -04-26 04:49:33.920732 7f22505c9700 10 mon.3@1(peon).log v5604990 update_from_paxos
 -04-26 04:49:33.920798 7f22505c9700 10 mon.3@1(peon).log v5604990 update_from_paxos version 5604990 summary v 5604990
 -04-26 04:49:33.920857 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:35.073133 7f22505c9700 10 mon.3@1(peon).log v5604991 update_from_paxos
 -04-26 04:49:35.073212 7f22505c9700 10 mon.3@1(peon).log v5604991 update_from_paxos version 5604991 summary v 5604990
 -04-26 04:49:35.073268 7f22505c9700 10 mon.3@1(peon).log v5604991 update_from_paxos latest full 5604990
 -04-26 04:49:35.073377 7f22505c9700  7 mon.3@1(peon).log v5604991 update_from_paxos applying incremental log 5604991 2013-04-26 04:49:33.946853 mon.0 10.227.227.101:6789/0 75 : [INF] pgmap v5939089: 2428 pgs: 2428 active+clean; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:35.073467 7f22505c9700 10 mon.3@1(peon).log v5604991 check_subs
 -04-26 04:49:35.073567 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:35.808703 7f2250dca700 10 mon.3@1(peon).pg v5939089 v5939089: 2428 pgs: 2428 active+clean; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:35.808872 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:49:35.808971 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:49:35.808985 7f2250dca700 10 mon.3@1(peon).log v5604991 update_from_paxos
 -04-26 04:49:35.809107 7f2250dca700 10 mon.3@1(peon).log v5604991 update_from_paxos version 5604991 summary v 5604991
 -04-26 04:49:35.809161 7f2250dca700 10 mon.3@1(peon).log v5604991 log
 -04-26 04:49:35.809277 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:35.809391 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:49:36.159804 7f22505c9700  7 mon.3@1(peon).pg v5939089 update_from_paxos  applying incremental 5939090
 -04-26 04:49:36.159879 7f22505c9700 10 mon.3@1(peon).pg v5939090 v5939090: 2428 pgs: 2428 active+clean; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 2040B/s wr, 1op/s
 -04-26 04:49:36.160901 7f22505c9700 10 mon.3@1(peon).pg v5939090 send_pg_creates to 0 pgs
 -04-26 04:49:36.160909 7f22505c9700 10 mon.3@1(peon).pg v5939090 update_logger
 -04-26 04:49:36.161047 7f22505c9700 10 mon.3@1(peon).log v5604991 update_from_paxos
 -04-26 04:49:36.161122 7f22505c9700 10 mon.3@1(peon).log v5604991 update_from_paxos version 5604991 summary v 5604991
 -04-26 04:49:36.161183 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:37.323702 7f22505c9700 10 mon.3@1(peon).log v5604992 update_from_paxos
 -04-26 04:49:37.323776 7f22505c9700 10 mon.3@1(peon).log v5604992 update_from_paxos version 5604992 summary v 5604991
 -04-26 04:49:37.323831 7f22505c9700 10 mon.3@1(peon).log v5604992 update_from_paxos latest full 5604991
 -04-26 04:49:37.323925 7f22505c9700  7 mon.3@1(peon).log v5604992 update_from_paxos applying incremental log 5604992 2013-04-26 04:49:31.177536 osd.4 10.227.227.104:6804/15010 198 : [INF] 2.1f deep-scrub ok
 -04-26 04:49:37.323994 7f22505c9700  7 mon.3@1(peon).log v5604992 update_from_paxos applying incremental log 5604992 2013-04-26 04:49:36.187142 mon.0 10.227.227.101:6789/0 76 : [INF] pgmap v5939090: 2428 pgs: 2428 active+clean; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 2040B/s wr, 1op/s
 -04-26 04:49:37.324123 7f22505c9700 10 mon.3@1(peon).log v5604992 check_subs
 -04-26 04:49:37.324199 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:37.493818 7f22505c9700  7 mon.3@1(peon).pg v5939090 update_from_paxos  applying incremental 5939091
 -04-26 04:49:37.493905 7f22505c9700 10 mon.3@1(peon).pg v5939091 v5939091: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 3191B/s wr, 3op/s
 -04-26 04:49:37.494962 7f22505c9700 10 mon.3@1(peon).pg v5939091 send_pg_creates to 0 pgs
 -04-26 04:49:37.494970 7f22505c9700 10 mon.3@1(peon).pg v5939091 update_logger
 -04-26 04:49:37.495098 7f22505c9700 10 mon.3@1(peon).log v5604992 update_from_paxos
 -04-26 04:49:37.495333 7f22505c9700 10 mon.3@1(peon).log v5604992 update_from_paxos version 5604992 summary v 5604992
 -04-26 04:49:37.495406 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:37.557015 7f22505c9700 10 mon.3@1(peon).log v5604992 update_from_paxos
 -04-26 04:49:37.557085 7f22505c9700 10 mon.3@1(peon).log v5604992 update_from_paxos version 5604992 summary v 5604992
 -04-26 04:49:37.557145 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:38.616196 7f22505c9700 10 mon.3@1(peon).log v5604993 update_from_paxos
 -04-26 04:49:38.616275 7f22505c9700 10 mon.3@1(peon).log v5604993 update_from_paxos version 5604993 summary v 5604992
 -04-26 04:49:38.616331 7f22505c9700 10 mon.3@1(peon).log v5604993 update_from_paxos latest full 5604992
 -04-26 04:49:38.616425 7f22505c9700  7 mon.3@1(peon).log v5604993 update_from_paxos applying incremental log 5604993 2013-04-26 04:49:34.041840 osd.3 10.227.227.104:6801/14901 194 : [INF] 1.2bd deep-scrub ok
 -04-26 04:49:38.616495 7f22505c9700  7 mon.3@1(peon).log v5604993 update_from_paxos applying incremental log 5604993 2013-04-26 04:49:37.066278 osd.3 10.227.227.104:6801/14901 195 : [INF] 1.2c2 deep-scrub ok
 -04-26 04:49:38.616560 7f22505c9700  7 mon.3@1(peon).log v5604993 update_from_paxos applying incremental log 5604993 2013-04-26 04:49:37.521300 mon.0 10.227.227.101:6789/0 77 : [INF] pgmap v5939091: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 3191B/s wr, 3op/s
 -04-26 04:49:38.616650 7f22505c9700 10 mon.3@1(peon).log v5604993 check_subs
 -04-26 04:49:38.616737 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:38.807347 7f22505c9700  7 mon.3@1(peon).pg v5939091 update_from_paxos  applying incremental 5939092
 -04-26 04:49:38.807402 7f22505c9700 10 mon.3@1(peon).pg v5939092 v5939092: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 1575B/s wr, 1op/s
 -04-26 04:49:38.808432 7f22505c9700 10 mon.3@1(peon).pg v5939092 send_pg_creates to 0 pgs
 -04-26 04:49:38.808440 7f22505c9700 10 mon.3@1(peon).pg v5939092 update_logger
 -04-26 04:49:38.808552 7f22505c9700 10 mon.3@1(peon).log v5604993 update_from_paxos
 -04-26 04:49:38.808624 7f22505c9700 10 mon.3@1(peon).log v5604993 update_from_paxos version 5604993 summary v 5604993
 -04-26 04:49:38.808678 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:39.716735 7f22505c9700 10 mon.3@1(peon).log v5604994 update_from_paxos
 -04-26 04:49:39.716810 7f22505c9700 10 mon.3@1(peon).log v5604994 update_from_paxos version 5604994 summary v 5604993
 -04-26 04:49:39.716866 7f22505c9700 10 mon.3@1(peon).log v5604994 update_from_paxos latest full 5604993
 -04-26 04:49:39.716960 7f22505c9700  7 mon.3@1(peon).log v5604994 update_from_paxos applying incremental log 5604994 2013-04-26 04:49:29.992185 osd.5 10.227.227.104:6807/15124 187 : [INF] 2.b3 deep-scrub ok
 -04-26 04:49:39.717015 7f22505c9700  7 mon.3@1(peon).log v5604994 update_from_paxos applying incremental log 5604994 2013-04-26 04:49:38.831369 mon.0 10.227.227.101:6789/0 78 : [INF] pgmap v5939092: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 1575B/s wr, 1op/s
 -04-26 04:49:39.717101 7f22505c9700 10 mon.3@1(peon).log v5604994 check_subs
 -04-26 04:49:39.717184 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:40.706324 7f22505c9700  7 mon.3@1(peon).pg v5939092 update_from_paxos  applying incremental 5939093
 -04-26 04:49:40.706374 7f22505c9700 10 mon.3@1(peon).pg v5939093 v5939093: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:40.707418 7f22505c9700 10 mon.3@1(peon).pg v5939093 send_pg_creates to 0 pgs
 -04-26 04:49:40.707426 7f22505c9700 10 mon.3@1(peon).pg v5939093 update_logger
 -04-26 04:49:40.707568 7f22505c9700 10 mon.3@1(peon).log v5604994 update_from_paxos
 -04-26 04:49:40.707645 7f22505c9700 10 mon.3@1(peon).log v5604994 update_from_paxos version 5604994 summary v 5604994
 -04-26 04:49:40.707714 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:40.811635 7f2250dca700 10 mon.3@1(peon).pg v5939093 v5939093: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:40.811766 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:49:40.811849 7f2250dca700 10 mon.3@1(peon).osd e10649 e10649: 12 osds: 12 up, 12 in
 -04-26 04:49:40.811861 7f2250dca700 10 mon.3@1(peon).log v5604994 update_from_paxos
 -04-26 04:49:40.811973 7f2250dca700 10 mon.3@1(peon).log v5604994 update_from_paxos version 5604994 summary v 5604994
 -04-26 04:49:40.812025 7f2250dca700 10 mon.3@1(peon).log v5604994 log
 -04-26 04:49:40.812170 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:40.812293 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:49:41.536325 7f22505c9700  7 mon.3@1(peon).osd e10649 update_from_paxos  applying incremental 10650
 -04-26 04:49:41.536411 7f22505c9700  1 mon.3@1(peon).osd e10650 e10650: 12 osds: 12 up, 12 in
 -04-26 04:49:41.542787 7f22505c9700 10 mon.3@1(peon).osd e10650 send_to_waiting 10650
 -04-26 04:49:41.542815 7f22505c9700 10 mon.3@1(peon).osd e10650 share_map_with_random_osd no up osd on our session map
 -04-26 04:49:41.542818 7f22505c9700 10 mon.3@1(peon).osd e10650 update_logger
 -04-26 04:49:41.542827 7f22505c9700 10 mon.3@1(peon).log v5604994 update_from_paxos
 -04-26 04:49:41.542901 7f22505c9700 10 mon.3@1(peon).log v5604994 update_from_paxos version 5604994 summary v 5604994
 -04-26 04:49:41.542981 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:41.718034 7f22505c9700  7 mon.3@1(peon).pg v5939093 update_from_paxos  applying incremental 5939094
 -04-26 04:49:41.718073 7f22505c9700 10 mon.3@1(peon).pg v5939094 v5939094: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:41.719117 7f22505c9700 10 mon.3@1(peon).pg v5939094 send_pg_creates to 0 pgs
 -04-26 04:49:41.719125 7f22505c9700 10 mon.3@1(peon).pg v5939094 update_logger
 -04-26 04:49:41.719217 7f22505c9700 10 mon.3@1(peon).log v5604994 update_from_paxos
 -04-26 04:49:41.719274 7f22505c9700 10 mon.3@1(peon).log v5604994 update_from_paxos version 5604994 summary v 5604994
 -04-26 04:49:41.719328 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:41.867037 7f22505c9700 10 mon.3@1(peon).log v5604995 update_from_paxos
 -04-26 04:49:41.867106 7f22505c9700 10 mon.3@1(peon).log v5604995 update_from_paxos version 5604995 summary v 5604994
 -04-26 04:49:41.867169 7f22505c9700 10 mon.3@1(peon).log v5604995 update_from_paxos latest full 5604994
 -04-26 04:49:41.867255 7f22505c9700  7 mon.3@1(peon).log v5604995 update_from_paxos applying incremental log 5604995 2013-04-26 04:49:40.733509 mon.0 10.227.227.101:6789/0 79 : [INF] pgmap v5939093: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:41.867361 7f22505c9700 10 mon.3@1(peon).log v5604995 check_subs
 -04-26 04:49:41.867432 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:42.994367 7f22505c9700 10 mon.3@1(peon).log v5604996 update_from_paxos
 -04-26 04:49:42.994447 7f22505c9700 10 mon.3@1(peon).log v5604996 update_from_paxos version 5604996 summary v 5604995
 -04-26 04:49:42.994503 7f22505c9700 10 mon.3@1(peon).log v5604996 update_from_paxos latest full 5604995
 -04-26 04:49:42.994598 7f22505c9700  7 mon.3@1(peon).log v5604996 update_from_paxos applying incremental log 5604996 2013-04-26 04:49:41.674886 mon.0 10.227.227.101:6789/0 80 : [INF] osdmap e10650: 12 osds: 12 up, 12 in
 -04-26 04:49:42.994682 7f22505c9700 10 mon.3@1(peon).log v5604996 check_subs
 -04-26 04:49:42.994782 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:44.172055 7f22505c9700  7 mon.3@1(peon).pg v5939094 update_from_paxos  applying incremental 5939095
 -04-26 04:49:44.173613 7f22505c9700 10 mon.3@1(peon).pg v5939095 v5939095: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:44.174695 7f22505c9700 10 mon.3@1(peon).pg v5939095 send_pg_creates to 0 pgs
 -04-26 04:49:44.174703 7f22505c9700 10 mon.3@1(peon).pg v5939095 update_logger
 -04-26 04:49:44.174845 7f22505c9700 10 mon.3@1(peon).log v5604996 update_from_paxos
 -04-26 04:49:44.174924 7f22505c9700 10 mon.3@1(peon).log v5604996 update_from_paxos version 5604996 summary v 5604996
 -04-26 04:49:44.174989 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:45.310670 7f22505c9700 10 mon.3@1(peon).log v5604997 update_from_paxos
 -04-26 04:49:45.310750 7f22505c9700 10 mon.3@1(peon).log v5604997 update_from_paxos version 5604997 summary v 5604996
 -04-26 04:49:45.310805 7f22505c9700 10 mon.3@1(peon).log v5604997 update_from_paxos latest full 5604996
 -04-26 04:49:45.310902 7f22505c9700  7 mon.3@1(peon).log v5604997 update_from_paxos applying incremental log 5604997 2013-04-26 04:49:41.742611 mon.0 10.227.227.101:6789/0 81 : [INF] pgmap v5939094: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:45.310967 7f22505c9700  7 mon.3@1(peon).log v5604997 update_from_paxos applying incremental log 5604997 2013-04-26 04:49:44.199509 mon.0 10.227.227.101:6789/0 82 : [INF] pgmap v5939095: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:45.311053 7f22505c9700 10 mon.3@1(peon).log v5604997 check_subs
 -04-26 04:49:45.311143 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:45.489702 7f22505c9700  7 mon.3@1(peon).pg v5939095 update_from_paxos  applying incremental 5939096
 -04-26 04:49:45.490673 7f22505c9700 10 mon.3@1(peon).pg v5939096 v5939096: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:45.491782 7f22505c9700 10 mon.3@1(peon).pg v5939096 send_pg_creates to 0 pgs
 -04-26 04:49:45.491790 7f22505c9700 10 mon.3@1(peon).pg v5939096 update_logger
 -04-26 04:49:45.491907 7f22505c9700 10 mon.3@1(peon).log v5604997 update_from_paxos
 -04-26 04:49:45.491976 7f22505c9700 10 mon.3@1(peon).log v5604997 update_from_paxos version 5604997 summary v 5604997
 -04-26 04:49:45.492032 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:45.814595 7f2250dca700 10 mon.3@1(peon).pg v5939096 v5939096: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:45.814772 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:49:45.814895 7f2250dca700 10 mon.3@1(peon).osd e10650 e10650: 12 osds: 12 up, 12 in
 -04-26 04:49:45.814928 7f2250dca700 10 mon.3@1(peon).log v5604997 update_from_paxos
 -04-26 04:49:45.815077 7f2250dca700 10 mon.3@1(peon).log v5604997 update_from_paxos version 5604997 summary v 5604997
 -04-26 04:49:45.815134 7f2250dca700 10 mon.3@1(peon).log v5604997 log
 -04-26 04:49:45.815253 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:45.815465 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:49:46.306379 7f2250dca700 10 mon.3@1(peon).data_health(2854) service_tick
 -04-26 04:49:46.306414 7f2250dca700  0 mon.3@1(peon).data_health(2854) update_stats avail 54% total 1826117064 used 830797196 avail 995319868
 -04-26 04:49:46.306423 7f2250dca700 10 mon.3@1(peon).data_health(2854) share_stats
 -04-26 04:49:46.606953 7f22505c9700  7 mon.3@1(peon).pg v5939096 update_from_paxos  applying incremental 5939097
 -04-26 04:49:46.609184 7f22505c9700 10 mon.3@1(peon).pg v5939097 v5939097: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:46.610293 7f22505c9700 10 mon.3@1(peon).pg v5939097 send_pg_creates to 0 pgs
 -04-26 04:49:46.610300 7f22505c9700 10 mon.3@1(peon).pg v5939097 update_logger
 -04-26 04:49:46.610436 7f22505c9700 10 mon.3@1(peon).log v5604997 update_from_paxos
 -04-26 04:49:46.610512 7f22505c9700 10 mon.3@1(peon).log v5604997 update_from_paxos version 5604997 summary v 5604997
 -04-26 04:49:46.610581 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:46.761556 7f22505c9700 10 mon.3@1(peon).log v5604998 update_from_paxos
 -04-26 04:49:46.761626 7f22505c9700 10 mon.3@1(peon).log v5604998 update_from_paxos version 5604998 summary v 5604997
 -04-26 04:49:46.761690 7f22505c9700 10 mon.3@1(peon).log v5604998 update_from_paxos latest full 5604997
 -04-26 04:49:46.761785 7f22505c9700  7 mon.3@1(peon).log v5604998 update_from_paxos applying incremental log 5604998 2013-04-26 04:49:45.520853 mon.0 10.227.227.101:6789/0 83 : [INF] pgmap v5939096: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:46.761891 7f22505c9700 10 mon.3@1(peon).log v5604998 check_subs
 -04-26 04:49:46.761974 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:47.724875 7f22505c9700  7 mon.3@1(peon).pg v5939097 update_from_paxos  applying incremental 5939098
 -04-26 04:49:47.726914 7f22505c9700 10 mon.3@1(peon).pg v5939098 v5939098: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:47.728033 7f22505c9700 10 mon.3@1(peon).pg v5939098 send_pg_creates to 0 pgs
 -04-26 04:49:47.728041 7f22505c9700 10 mon.3@1(peon).pg v5939098 update_logger
 -04-26 04:49:47.728181 7f22505c9700 10 mon.3@1(peon).log v5604998 update_from_paxos
 -04-26 04:49:47.728257 7f22505c9700 10 mon.3@1(peon).log v5604998 update_from_paxos version 5604998 summary v 5604998
 -04-26 04:49:47.728325 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:48.787767 7f22505c9700 10 mon.3@1(peon).log v5604999 update_from_paxos
 -04-26 04:49:48.787849 7f22505c9700 10 mon.3@1(peon).log v5604999 update_from_paxos version 5604999 summary v 5604998
 -04-26 04:49:48.787907 7f22505c9700 10 mon.3@1(peon).log v5604999 update_from_paxos latest full 5604998
 -04-26 04:49:48.788012 7f22505c9700  7 mon.3@1(peon).log v5604999 update_from_paxos applying incremental log 5604999 2013-04-26 04:49:46.640871 mon.0 10.227.227.101:6789/0 84 : [INF] pgmap v5939097: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:48.788077 7f22505c9700  7 mon.3@1(peon).log v5604999 update_from_paxos applying incremental log 5604999 2013-04-26 04:49:47.757840 mon.0 10.227.227.101:6789/0 85 : [INF] pgmap v5939098: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:48.788174 7f22505c9700 10 mon.3@1(peon).log v5604999 check_subs
 -04-26 04:49:48.788270 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:48.919406 7f22505c9700  7 mon.3@1(peon).pg v5939098 update_from_paxos  applying incremental 5939099
 -04-26 04:49:48.919458 7f22505c9700 10 mon.3@1(peon).pg v5939099 v5939099: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:48.921588 7f22505c9700 10 mon.3@1(peon).pg v5939099 send_pg_creates to 0 pgs
 -04-26 04:49:48.921605 7f22505c9700 10 mon.3@1(peon).pg v5939099 update_logger
 -04-26 04:49:48.921791 7f22505c9700 10 mon.3@1(peon).log v5604999 update_from_paxos
 -04-26 04:49:48.921905 7f22505c9700 10 mon.3@1(peon).log v5604999 update_from_paxos version 5604999 summary v 5604999
 -04-26 04:49:48.922018 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:49.185449 7f224a859700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/13284 client protocol 0
 -04-26 04:49:49.185846 7f22505c9700 10 mon.3@1(peon) e1 do not have session, making new one
 -04-26 04:49:49.185852 7f22505c9700 10 mon.3@1(peon) e1 ms_dispatch new session MonSession: client.? 10.227.227.101:0/13284 is open for client.? 10.227.227.101:0/13284
 -04-26 04:49:49.185859 7f22505c9700 10 mon.3@1(peon) e1 setting timeout on session
 -04-26 04:49:49.185964 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:49.186018 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 0 30 bytes epoch 0) v1 from client.? 10.227.227.101:0/13284
 -04-26 04:49:49.186050 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=30
 -04-26 04:49:49.186120 7f22505c9700 10 mon.3@1(peon).auth v4474 AuthMonitor::assign_global_id m=auth(proto 0 30 bytes epoch 0) v1 mon=1/3 last_allocated=227407 max_global_id=227796
 -04-26 04:49:49.186218 7f22505c9700 10 mon.3@1(peon).auth v4474 next_global_id should be 227410
 -04-26 04:49:49.187534 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:49.187587 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 2 32 bytes epoch 0) v1 from client.? 10.227.227.101:0/13284
 -04-26 04:49:49.187617 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=32
 -04-26 04:49:49.188482 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:49.188535 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 2 165 bytes epoch 0) v1 from client.? 10.227.227.101:0/13284
 -04-26 04:49:49.188567 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=165
 -04-26 04:49:49.189291 7f22505c9700 10 mon.3@1(peon) e1 handle_subscribe mon_subscribe({monmap=0+}) v2
 -04-26 04:49:49.189301 7f22505c9700 10 mon.3@1(peon) e1 check_sub monmap next 0 have 1
 -04-26 04:49:49.189372 7f22505c9700  0 mon.3@1(peon) e1 handle_command mon_command(health v 0) v1
 -04-26 04:49:49.189663 7f22505c9700 10 mon.3@1(peon).data_health(2854) get_health
 -04-26 04:49:49.190229 7f22505c9700 10 mon.3@1(peon) e1 ms_handle_reset 0x2af3340 10.227.227.101:0/13284
 -04-26 04:49:49.190246 7f22505c9700 10 mon.3@1(peon) e1 reset/close on session client.? 10.227.227.101:0/13284
 -04-26 04:49:49.190250 7f22505c9700 10 mon.3@1(peon) e1 remove_session MonSession: client.? 10.227.227.101:0/13284 is openallow * client.? 10.227.227.101:0/13284
 -04-26 04:49:50.030183 7f22505c9700 10 mon.3@1(peon).log v5605000 update_from_paxos
 -04-26 04:49:50.030261 7f22505c9700 10 mon.3@1(peon).log v5605000 update_from_paxos version 5605000 summary v 5604999
 -04-26 04:49:50.030326 7f22505c9700 10 mon.3@1(peon).log v5605000 update_from_paxos latest full 5604999
 -04-26 04:49:50.030409 7f22505c9700  7 mon.3@1(peon).log v5605000 update_from_paxos applying incremental log 5605000 2013-04-26 04:49:48.940277 mon.0 10.227.227.101:6789/0 86 : [INF] pgmap v5939099: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:50.030507 7f22505c9700 10 mon.3@1(peon).log v5605000 check_subs
 -04-26 04:49:50.030598 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:50.816700 7f2250dca700 10 mon.3@1(peon).pg v5939099 v5939099: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:50.816801 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:49:50.816849 7f2250dca700 10 mon.3@1(peon).osd e10650 e10650: 12 osds: 12 up, 12 in
 -04-26 04:49:50.816857 7f2250dca700 10 mon.3@1(peon).log v5605000 update_from_paxos
 -04-26 04:49:50.816918 7f2250dca700 10 mon.3@1(peon).log v5605000 update_from_paxos version 5605000 summary v 5605000
 -04-26 04:49:50.816943 7f2250dca700 10 mon.3@1(peon).log v5605000 log
 -04-26 04:49:50.817001 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:50.817058 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:49:51.088029 7f22505c9700  7 mon.3@1(peon).pg v5939099 update_from_paxos  applying incremental 5939100
 -04-26 04:49:51.088086 7f22505c9700 10 mon.3@1(peon).pg v5939100 v5939100: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:51.089140 7f22505c9700 10 mon.3@1(peon).pg v5939100 send_pg_creates to 0 pgs
 -04-26 04:49:51.089147 7f22505c9700 10 mon.3@1(peon).pg v5939100 update_logger
 -04-26 04:49:51.089259 7f22505c9700 10 mon.3@1(peon).log v5605000 update_from_paxos
 -04-26 04:49:51.089324 7f22505c9700 10 mon.3@1(peon).log v5605000 update_from_paxos version 5605000 summary v 5605000
 -04-26 04:49:51.089384 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:52.289514 7f22505c9700 10 mon.3@1(peon).log v5605001 update_from_paxos
 -04-26 04:49:52.289665 7f22505c9700 10 mon.3@1(peon).log v5605001 update_from_paxos version 5605001 summary v 5605000
 -04-26 04:49:52.289798 7f22505c9700 10 mon.3@1(peon).log v5605001 update_from_paxos latest full 5605000
 -04-26 04:49:52.289952 7f22505c9700  7 mon.3@1(peon).log v5605001 update_from_paxos applying incremental log 5605001 2013-04-26 04:49:51.105411 mon.0 10.227.227.101:6789/0 87 : [INF] pgmap v5939100: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:52.290126 7f22505c9700 10 mon.3@1(peon).log v5605001 check_subs
 -04-26 04:49:52.290280 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:52.413326 7f22505c9700  7 mon.3@1(peon).pg v5939100 update_from_paxos  applying incremental 5939101
 -04-26 04:49:52.413389 7f22505c9700 10 mon.3@1(peon).pg v5939101 v5939101: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:52.414691 7f22505c9700 10 mon.3@1(peon).pg v5939101 send_pg_creates to 0 pgs
 -04-26 04:49:52.414706 7f22505c9700 10 mon.3@1(peon).pg v5939101 update_logger
 -04-26 04:49:52.414861 7f22505c9700 10 mon.3@1(peon).log v5605001 update_from_paxos
 -04-26 04:49:52.414941 7f22505c9700 10 mon.3@1(peon).log v5605001 update_from_paxos version 5605001 summary v 5605001
 -04-26 04:49:52.415016 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:53.564682 7f22505c9700 10 mon.3@1(peon).log v5605002 update_from_paxos
 -04-26 04:49:53.564764 7f22505c9700 10 mon.3@1(peon).log v5605002 update_from_paxos version 5605002 summary v 5605001
 -04-26 04:49:53.564829 7f22505c9700 10 mon.3@1(peon).log v5605002 update_from_paxos latest full 5605001
 -04-26 04:49:53.565030 7f22505c9700  7 mon.3@1(peon).log v5605002 update_from_paxos applying incremental log 5605002 2013-04-26 04:49:52.440214 mon.0 10.227.227.101:6789/0 88 : [INF] pgmap v5939101: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:53.565140 7f22505c9700 10 mon.3@1(peon).log v5605002 check_subs
 -04-26 04:49:53.565232 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:53.656095 7f22505c9700  7 mon.3@1(peon).pg v5939101 update_from_paxos  applying incremental 5939102
 -04-26 04:49:53.656135 7f22505c9700 10 mon.3@1(peon).pg v5939102 v5939102: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:53.657387 7f22505c9700 10 mon.3@1(peon).pg v5939102 send_pg_creates to 0 pgs
 -04-26 04:49:53.657397 7f22505c9700 10 mon.3@1(peon).pg v5939102 update_logger
 -04-26 04:49:53.657505 7f22505c9700 10 mon.3@1(peon).log v5605002 update_from_paxos
 -04-26 04:49:53.657573 7f22505c9700 10 mon.3@1(peon).log v5605002 update_from_paxos version 5605002 summary v 5605002
 -04-26 04:49:53.657649 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:54.773810 7f22505c9700 10 mon.3@1(peon).log v5605003 update_from_paxos
 -04-26 04:49:54.773893 7f22505c9700 10 mon.3@1(peon).log v5605003 update_from_paxos version 5605003 summary v 5605002
 -04-26 04:49:54.773959 7f22505c9700 10 mon.3@1(peon).log v5605003 update_from_paxos latest full 5605002
 -04-26 04:49:54.774044 7f22505c9700  7 mon.3@1(peon).log v5605003 update_from_paxos applying incremental log 5605003 2013-04-26 04:49:53.678982 mon.0 10.227.227.101:6789/0 89 : [INF] pgmap v5939102: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:54.774144 7f22505c9700 10 mon.3@1(peon).log v5605003 check_subs
 -04-26 04:49:54.774256 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:54.879768 7f22505c9700  7 mon.3@1(peon).pg v5939102 update_from_paxos  applying incremental 5939103
 -04-26 04:49:54.879806 7f22505c9700 10 mon.3@1(peon).pg v5939103 v5939103: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:54.881059 7f22505c9700 10 mon.3@1(peon).pg v5939103 send_pg_creates to 0 pgs
 -04-26 04:49:54.881068 7f22505c9700 10 mon.3@1(peon).pg v5939103 update_logger
 -04-26 04:49:54.881201 7f22505c9700 10 mon.3@1(peon).log v5605003 update_from_paxos
 -04-26 04:49:54.881311 7f22505c9700 10 mon.3@1(peon).log v5605003 update_from_paxos version 5605003 summary v 5605003
 -04-26 04:49:54.881394 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:55.819448 7f2250dca700 10 mon.3@1(peon).pg v5939103 v5939103: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:55.819624 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:49:55.819724 7f2250dca700 10 mon.3@1(peon).osd e10650 e10650: 12 osds: 12 up, 12 in
 -04-26 04:49:55.819738 7f2250dca700 10 mon.3@1(peon).log v5605003 update_from_paxos
 -04-26 04:49:55.819863 7f2250dca700 10 mon.3@1(peon).log v5605003 update_from_paxos version 5605003 summary v 5605003
 -04-26 04:49:55.819916 7f2250dca700 10 mon.3@1(peon).log v5605003 log
 -04-26 04:49:55.820036 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:55.820153 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:49:55.982256 7f22505c9700 10 mon.3@1(peon).log v5605004 update_from_paxos
 -04-26 04:49:55.982365 7f22505c9700 10 mon.3@1(peon).log v5605004 update_from_paxos version 5605004 summary v 5605003
 -04-26 04:49:55.982435 7f22505c9700 10 mon.3@1(peon).log v5605004 update_from_paxos latest full 5605003
 -04-26 04:49:55.982521 7f22505c9700  7 mon.3@1(peon).log v5605004 update_from_paxos applying incremental log 5605004 2013-04-26 04:49:54.906483 mon.0 10.227.227.101:6789/0 90 : [INF] pgmap v5939103: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:55.982620 7f22505c9700 10 mon.3@1(peon).log v5605004 check_subs
 -04-26 04:49:55.982709 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:56.179904 7f22505c9700  7 mon.3@1(peon).pg v5939103 update_from_paxos  applying incremental 5939104
 -04-26 04:49:56.179952 7f22505c9700 10 mon.3@1(peon).pg v5939104 v5939104: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:56.181205 7f22505c9700 10 mon.3@1(peon).pg v5939104 send_pg_creates to 0 pgs
 -04-26 04:49:56.181216 7f22505c9700 10 mon.3@1(peon).pg v5939104 update_logger
 -04-26 04:49:56.181348 7f22505c9700 10 mon.3@1(peon).log v5605004 update_from_paxos
 -04-26 04:49:56.181425 7f22505c9700 10 mon.3@1(peon).log v5605004 update_from_paxos version 5605004 summary v 5605004
 -04-26 04:49:56.181495 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:57.258313 7f22505c9700 10 mon.3@1(peon).log v5605005 update_from_paxos
 -04-26 04:49:57.258395 7f22505c9700 10 mon.3@1(peon).log v5605005 update_from_paxos version 5605005 summary v 5605004
 -04-26 04:49:57.258460 7f22505c9700 10 mon.3@1(peon).log v5605005 update_from_paxos latest full 5605004
 -04-26 04:49:57.258543 7f22505c9700  7 mon.3@1(peon).log v5605005 update_from_paxos applying incremental log 5605005 2013-04-26 04:49:56.206665 mon.0 10.227.227.101:6789/0 91 : [INF] pgmap v5939104: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:49:57.258690 7f22505c9700 10 mon.3@1(peon).log v5605005 check_subs
 -04-26 04:49:57.258807 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:57.569928 7f22505c9700  7 mon.3@1(peon).pg v5939104 update_from_paxos  applying incremental 5939105
 -04-26 04:49:57.570009 7f22505c9700 10 mon.3@1(peon).pg v5939105 v5939105: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 9995B/s wr, 2op/s
 -04-26 04:49:57.571275 7f22505c9700 10 mon.3@1(peon).pg v5939105 send_pg_creates to 0 pgs
 -04-26 04:49:57.571284 7f22505c9700 10 mon.3@1(peon).pg v5939105 update_logger
 -04-26 04:49:57.571421 7f22505c9700 10 mon.3@1(peon).log v5605005 update_from_paxos
 -04-26 04:49:57.571498 7f22505c9700 10 mon.3@1(peon).log v5605005 update_from_paxos version 5605005 summary v 5605005
 -04-26 04:49:57.571571 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:58.734114 7f22505c9700 10 mon.3@1(peon).log v5605006 update_from_paxos
 -04-26 04:49:58.734195 7f22505c9700 10 mon.3@1(peon).log v5605006 update_from_paxos version 5605006 summary v 5605005
 -04-26 04:49:58.734260 7f22505c9700 10 mon.3@1(peon).log v5605006 update_from_paxos latest full 5605005
 -04-26 04:49:58.734345 7f22505c9700  7 mon.3@1(peon).log v5605006 update_from_paxos applying incremental log 5605006 2013-04-26 04:49:57.573701 mon.0 10.227.227.101:6789/0 92 : [INF] pgmap v5939105: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 9995B/s wr, 2op/s
 -04-26 04:49:58.734445 7f22505c9700 10 mon.3@1(peon).log v5605006 check_subs
 -04-26 04:49:58.734536 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:58.979622 7f22505c9700  7 mon.3@1(peon).pg v5939105 update_from_paxos  applying incremental 5939106
 -04-26 04:49:58.979694 7f22505c9700 10 mon.3@1(peon).pg v5939106 v5939106: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 25497B/s wr, 6op/s
 -04-26 04:49:58.981466 7f22505c9700 10 mon.3@1(peon).pg v5939106 send_pg_creates to 0 pgs
 -04-26 04:49:58.981480 7f22505c9700 10 mon.3@1(peon).pg v5939106 update_logger
 -04-26 04:49:58.981699 7f22505c9700 10 mon.3@1(peon).log v5605006 update_from_paxos
 -04-26 04:49:58.981843 7f22505c9700 10 mon.3@1(peon).log v5605006 update_from_paxos version 5605006 summary v 5605006
 -04-26 04:49:58.981948 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:49:59.093427 7f22505c9700 10 mon.3@1(peon).log v5605006 update_from_paxos
 -04-26 04:49:59.093506 7f22505c9700 10 mon.3@1(peon).log v5605006 update_from_paxos version 5605006 summary v 5605006
 -04-26 04:49:59.093578 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:00.034663 7f22505c9700 10 mon.3@1(peon).log v5605007 update_from_paxos
 -04-26 04:50:00.034743 7f22505c9700 10 mon.3@1(peon).log v5605007 update_from_paxos version 5605007 summary v 5605006
 -04-26 04:50:00.034810 7f22505c9700 10 mon.3@1(peon).log v5605007 update_from_paxos latest full 5605006
 -04-26 04:50:00.034897 7f22505c9700  7 mon.3@1(peon).log v5605007 update_from_paxos applying incremental log 5605007 2013-04-26 04:49:59.000155 mon.0 10.227.227.101:6789/0 93 : [INF] pgmap v5939106: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 25497B/s wr, 6op/s
 -04-26 04:50:00.035000 7f22505c9700 10 mon.3@1(peon).log v5605007 check_subs
 -04-26 04:50:00.035092 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:00.169133 7f22505c9700  7 mon.3@1(peon).pg v5939106 update_from_paxos  applying incremental 5939107
 -04-26 04:50:00.169186 7f22505c9700 10 mon.3@1(peon).pg v5939107 v5939107: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 18987B/s wr, 4op/s
 -04-26 04:50:00.170488 7f22505c9700 10 mon.3@1(peon).pg v5939107 send_pg_creates to 0 pgs
 -04-26 04:50:00.170499 7f22505c9700 10 mon.3@1(peon).pg v5939107 update_logger
 -04-26 04:50:00.170632 7f22505c9700 10 mon.3@1(peon).log v5605007 update_from_paxos
 -04-26 04:50:00.170709 7f22505c9700 10 mon.3@1(peon).log v5605007 update_from_paxos version 5605007 summary v 5605007
 -04-26 04:50:00.170780 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:00.822490 7f2250dca700 10 mon.3@1(peon).pg v5939107 v5939107: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 18987B/s wr, 4op/s
 -04-26 04:50:00.822689 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:50:00.822795 7f2250dca700 10 mon.3@1(peon).osd e10650 e10650: 12 osds: 12 up, 12 in
 -04-26 04:50:00.822805 7f2250dca700 10 mon.3@1(peon).log v5605007 update_from_paxos
 -04-26 04:50:00.822930 7f2250dca700 10 mon.3@1(peon).log v5605007 update_from_paxos version 5605007 summary v 5605007
 -04-26 04:50:00.822983 7f2250dca700 10 mon.3@1(peon).log v5605007 log
 -04-26 04:50:00.823101 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:00.823218 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:50:01.364386 7f22505c9700 10 mon.3@1(peon).log v5605008 update_from_paxos
 -04-26 04:50:01.364474 7f22505c9700 10 mon.3@1(peon).log v5605008 update_from_paxos version 5605008 summary v 5605007
 -04-26 04:50:01.364539 7f22505c9700 10 mon.3@1(peon).log v5605008 update_from_paxos latest full 5605007
 -04-26 04:50:01.364620 7f22505c9700  7 mon.3@1(peon).log v5605008 update_from_paxos applying incremental log 5605008 2013-04-26 04:50:00.191503 mon.0 10.227.227.101:6789/0 94 : [INF] pgmap v5939107: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 18987B/s wr, 4op/s
 -04-26 04:50:01.364724 7f22505c9700 10 mon.3@1(peon).log v5605008 check_subs
 -04-26 04:50:01.364809 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:01.528271 7f22505c9700  7 mon.3@1(peon).pg v5939107 update_from_paxos  applying incremental 5939108
 -04-26 04:50:01.528361 7f22505c9700 10 mon.3@1(peon).pg v5939108 v5939108: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 18238B/s wr, 4op/s
 -04-26 04:50:01.529663 7f22505c9700 10 mon.3@1(peon).pg v5939108 send_pg_creates to 0 pgs
 -04-26 04:50:01.529674 7f22505c9700 10 mon.3@1(peon).pg v5939108 update_logger
 -04-26 04:50:01.529810 7f22505c9700 10 mon.3@1(peon).log v5605008 update_from_paxos
 -04-26 04:50:01.529888 7f22505c9700 10 mon.3@1(peon).log v5605008 update_from_paxos version 5605008 summary v 5605008
 -04-26 04:50:01.529959 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:02.519836 7f22505c9700 10 mon.3@1(peon).log v5605009 update_from_paxos
 -04-26 04:50:02.519918 7f22505c9700 10 mon.3@1(peon).log v5605009 update_from_paxos version 5605009 summary v 5605008
 -04-26 04:50:02.519984 7f22505c9700 10 mon.3@1(peon).log v5605009 update_from_paxos latest full 5605008
 -04-26 04:50:02.520066 7f22505c9700  7 mon.3@1(peon).log v5605009 update_from_paxos applying incremental log 5605009 2013-04-26 04:49:54.116921 osd.1 10.227.227.101:6804/17898 192 : [INF] 2.b6 deep-scrub ok
 -04-26 04:50:02.520134 7f22505c9700  7 mon.3@1(peon).log v5605009 update_from_paxos applying incremental log 5605009 2013-04-26 04:49:54.363058 osd.0 10.227.227.101:6801/17890 194 : [INF] 1.258 deep-scrub ok
 -04-26 04:50:02.520218 7f22505c9700  7 mon.3@1(peon).log v5605009 update_from_paxos applying incremental log 5605009 2013-04-26 04:49:54.634832 osd.2 10.227.227.101:6807/17905 171 : [INF] 2.d1 deep-scrub ok
 -04-26 04:50:02.520282 7f22505c9700  7 mon.3@1(peon).log v5605009 update_from_paxos applying incremental log 5605009 2013-04-26 04:50:01.549899 mon.0 10.227.227.101:6789/0 95 : [INF] pgmap v5939108: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 18238B/s wr, 4op/s
 -04-26 04:50:02.520431 7f22505c9700 10 mon.3@1(peon).log v5605009 check_subs
 -04-26 04:50:02.520524 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:02.718292 7f22505c9700  7 mon.3@1(peon).pg v5939108 update_from_paxos  applying incremental 5939109
 -04-26 04:50:02.718379 7f22505c9700 10 mon.3@1(peon).pg v5939109 v5939109: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 22548B/s wr, 5op/s
 -04-26 04:50:02.719636 7f22505c9700 10 mon.3@1(peon).pg v5939109 send_pg_creates to 0 pgs
 -04-26 04:50:02.719645 7f22505c9700 10 mon.3@1(peon).pg v5939109 update_logger
 -04-26 04:50:02.719778 7f22505c9700 10 mon.3@1(peon).log v5605009 update_from_paxos
 -04-26 04:50:02.719856 7f22505c9700 10 mon.3@1(peon).log v5605009 update_from_paxos version 5605009 summary v 5605009
 -04-26 04:50:02.719926 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:03.740492 7f22505c9700  7 mon.3@1(peon).pg v5939109 update_from_paxos  applying incremental 5939110
 -04-26 04:50:03.740558 7f22505c9700 10 mon.3@1(peon).pg v5939110 v5939110: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 7033B/s wr, 1op/s
 -04-26 04:50:03.741812 7f22505c9700 10 mon.3@1(peon).pg v5939110 send_pg_creates to 0 pgs
 -04-26 04:50:03.741821 7f22505c9700 10 mon.3@1(peon).pg v5939110 update_logger
 -04-26 04:50:03.741957 7f22505c9700 10 mon.3@1(peon).log v5605009 update_from_paxos
 -04-26 04:50:03.742034 7f22505c9700 10 mon.3@1(peon).log v5605009 update_from_paxos version 5605009 summary v 5605009
 -04-26 04:50:03.742106 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:03.874329 7f22505c9700 10 mon.3@1(peon).log v5605010 update_from_paxos
 -04-26 04:50:03.874402 7f22505c9700 10 mon.3@1(peon).log v5605010 update_from_paxos version 5605010 summary v 5605009
 -04-26 04:50:03.874467 7f22505c9700 10 mon.3@1(peon).log v5605010 update_from_paxos latest full 5605009
 -04-26 04:50:03.874562 7f22505c9700  7 mon.3@1(peon).log v5605010 update_from_paxos applying incremental log 5605010 2013-04-26 04:50:02.737653 mon.0 10.227.227.101:6789/0 96 : [INF] pgmap v5939109: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 22548B/s wr, 5op/s
 -04-26 04:50:03.874664 7f22505c9700 10 mon.3@1(peon).log v5605010 check_subs
 -04-26 04:50:03.874748 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:04.570014 7f224a859700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/14220 client protocol 0
 -04-26 04:50:04.570480 7f22505c9700 10 mon.3@1(peon) e1 do not have session, making new one
 -04-26 04:50:04.570487 7f22505c9700 10 mon.3@1(peon) e1 ms_dispatch new session MonSession: client.? 10.227.227.101:0/14220 is open for client.? 10.227.227.101:0/14220
 -04-26 04:50:04.570494 7f22505c9700 10 mon.3@1(peon) e1 setting timeout on session
 -04-26 04:50:04.570634 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:04.570693 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 0 30 bytes epoch 0) v1 from client.? 10.227.227.101:0/14220
 -04-26 04:50:04.570729 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=30
 -04-26 04:50:04.570775 7f22505c9700 10 mon.3@1(peon).auth v4474 AuthMonitor::assign_global_id m=auth(proto 0 30 bytes epoch 0) v1 mon=1/3 last_allocated=227410 max_global_id=227796
 -04-26 04:50:04.570811 7f22505c9700 10 mon.3@1(peon).auth v4474 next_global_id should be 227413
 -04-26 04:50:04.572196 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:04.572258 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 2 32 bytes epoch 0) v1 from client.? 10.227.227.101:0/14220
 -04-26 04:50:04.572292 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=32
 -04-26 04:50:04.573374 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:04.573435 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 2 165 bytes epoch 0) v1 from client.? 10.227.227.101:0/14220
 -04-26 04:50:04.573469 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=165
 -04-26 04:50:04.574357 7f22505c9700 10 mon.3@1(peon) e1 handle_subscribe mon_subscribe({monmap=0+}) v2
 -04-26 04:50:04.574367 7f22505c9700 10 mon.3@1(peon) e1 check_sub monmap next 0 have 1
 -04-26 04:50:04.574410 7f22505c9700  0 mon.3@1(peon) e1 handle_command mon_command(osd deep-scrub 0 v 0) v1
 -04-26 04:50:04.574545 7f22505c9700 10 mon.3@1(peon).osd e10650 preprocess_query mon_command(osd deep-scrub 0 v 0) v1 from client.? 10.227.227.101:0/14220
 -04-26 04:50:04.574597 7f22505c9700 10 mon.3@1(peon) e1 try_send_message scrub(osd deep) v2 to osd.0 10.227.227.101:6801/17890
 -04-26 04:50:04.575426 7f22505c9700 10 mon.3@1(peon) e1 ms_handle_reset 0x7a8be40 10.227.227.101:0/14220
 -04-26 04:50:04.575434 7f22505c9700 10 mon.3@1(peon) e1 reset/close on session client.? 10.227.227.101:0/14220
 -04-26 04:50:04.575439 7f22505c9700 10 mon.3@1(peon) e1 remove_session MonSession: client.? 10.227.227.101:0/14220 is openallow * client.? 10.227.227.101:0/14220
 -04-26 04:50:04.593969 7f224a859700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/14230 client protocol 0
 -04-26 04:50:04.594404 7f22505c9700 10 mon.3@1(peon) e1 do not have session, making new one
 -04-26 04:50:04.594408 7f22505c9700 10 mon.3@1(peon) e1 ms_dispatch new session MonSession: client.? 10.227.227.101:0/14230 is open for client.? 10.227.227.101:0/14230
 -04-26 04:50:04.594418 7f22505c9700 10 mon.3@1(peon) e1 setting timeout on session
 -04-26 04:50:04.594508 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:04.594564 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 0 30 bytes epoch 0) v1 from client.? 10.227.227.101:0/14230
 -04-26 04:50:04.594599 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=30
 -04-26 04:50:04.594636 7f22505c9700 10 mon.3@1(peon).auth v4474 AuthMonitor::assign_global_id m=auth(proto 0 30 bytes epoch 0) v1 mon=1/3 last_allocated=227413 max_global_id=227796
 -04-26 04:50:04.594668 7f22505c9700 10 mon.3@1(peon).auth v4474 next_global_id should be 227416
 -04-26 04:50:04.596043 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:04.596103 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 2 32 bytes epoch 0) v1 from client.? 10.227.227.101:0/14230
 -04-26 04:50:04.596137 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=32
 -04-26 04:50:04.597088 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:04.597148 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 2 165 bytes epoch 0) v1 from client.? 10.227.227.101:0/14230
 -04-26 04:50:04.597181 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=165
 -04-26 04:50:04.597965 7f22505c9700 10 mon.3@1(peon) e1 handle_subscribe mon_subscribe({monmap=0+}) v2
 -04-26 04:50:04.597973 7f22505c9700 10 mon.3@1(peon) e1 check_sub monmap next 0 have 1
 -04-26 04:50:04.598225 7f22505c9700  0 mon.3@1(peon) e1 handle_command mon_command(osd deep-scrub 1 v 0) v1
 -04-26 04:50:04.598345 7f22505c9700 10 mon.3@1(peon).osd e10650 preprocess_query mon_command(osd deep-scrub 1 v 0) v1 from client.? 10.227.227.101:0/14230
 -04-26 04:50:04.598364 7f22505c9700 10 mon.3@1(peon) e1 try_send_message scrub(osd deep) v2 to osd.1 10.227.227.101:6804/17898
 -04-26 04:50:04.599157 7f22505c9700 10 mon.3@1(peon) e1 ms_handle_reset 0x7a8bce0 10.227.227.101:0/14230
 -04-26 04:50:04.599175 7f22505c9700 10 mon.3@1(peon) e1 reset/close on session client.? 10.227.227.101:0/14230
 -04-26 04:50:04.599183 7f22505c9700 10 mon.3@1(peon) e1 remove_session MonSession: client.? 10.227.227.101:0/14230 is openallow * client.? 10.227.227.101:0/14230
 -04-26 04:50:04.625149 7f22505c9700 10 mon.3@1(peon) e1 handle_route scrub(osd deep) v2 to osd.2 10.227.227.101:6807/17905
 -04-26 04:50:04.625155 7f22505c9700 10 mon.3@1(peon) e1  not a routed request, trying to send anyway
 -04-26 04:50:04.990516 7f22505c9700  7 mon.3@1(peon).pg v5939110 update_from_paxos  applying incremental 5939111
 -04-26 04:50:04.990573 7f22505c9700 10 mon.3@1(peon).pg v5939111 v5939111: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:04.991831 7f22505c9700 10 mon.3@1(peon).pg v5939111 send_pg_creates to 0 pgs
 -04-26 04:50:04.991840 7f22505c9700 10 mon.3@1(peon).pg v5939111 update_logger
 -04-26 04:50:04.991975 7f22505c9700 10 mon.3@1(peon).log v5605010 update_from_paxos
 -04-26 04:50:04.992054 7f22505c9700 10 mon.3@1(peon).log v5605010 update_from_paxos version 5605010 summary v 5605010
 -04-26 04:50:04.992126 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:05.825552 7f2250dca700 10 mon.3@1(peon).pg v5939111 v5939111: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:05.825723 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:50:05.825825 7f2250dca700 10 mon.3@1(peon).osd e10650 e10650: 12 osds: 12 up, 12 in
 -04-26 04:50:05.825838 7f2250dca700 10 mon.3@1(peon).log v5605010 update_from_paxos
 -04-26 04:50:05.825961 7f2250dca700 10 mon.3@1(peon).log v5605010 update_from_paxos version 5605010 summary v 5605010
 -04-26 04:50:05.826014 7f2250dca700 10 mon.3@1(peon).log v5605010 log
 -04-26 04:50:05.826132 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:05.826249 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:50:06.061081 7f22505c9700  7 mon.3@1(peon).pg v5939111 update_from_paxos  applying incremental 5939112
 -04-26 04:50:06.061265 7f22505c9700 10 mon.3@1(peon).pg v5939112 v5939112: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:06.063538 7f22505c9700 10 mon.3@1(peon).pg v5939112 send_pg_creates to 0 pgs
 -04-26 04:50:06.063555 7f22505c9700 10 mon.3@1(peon).pg v5939112 update_logger
 -04-26 04:50:06.063858 7f22505c9700 10 mon.3@1(peon).log v5605010 update_from_paxos
 -04-26 04:50:06.064004 7f22505c9700 10 mon.3@1(peon).log v5605010 update_from_paxos version 5605010 summary v 5605010
 -04-26 04:50:06.064123 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:06.194774 7f22505c9700 10 mon.3@1(peon).log v5605011 update_from_paxos
 -04-26 04:50:06.194856 7f22505c9700 10 mon.3@1(peon).log v5605011 update_from_paxos version 5605011 summary v 5605010
 -04-26 04:50:06.194923 7f22505c9700 10 mon.3@1(peon).log v5605011 update_from_paxos latest full 5605010
 -04-26 04:50:06.195004 7f22505c9700  7 mon.3@1(peon).log v5605011 update_from_paxos applying incremental log 5605011 2013-04-26 04:50:03.767534 mon.0 10.227.227.101:6789/0 97 : [INF] pgmap v5939110: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 7033B/s wr, 1op/s
 -04-26 04:50:06.195074 7f22505c9700  7 mon.3@1(peon).log v5605011 update_from_paxos applying incremental log 5605011 2013-04-26 04:50:05.014445 mon.0 10.227.227.101:6789/0 98 : [INF] pgmap v5939111: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:06.195179 7f22505c9700 10 mon.3@1(peon).log v5605011 check_subs
 -04-26 04:50:06.195275 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:07.265800 7f22505c9700  7 mon.3@1(peon).pg v5939112 update_from_paxos  applying incremental 5939113
 -04-26 04:50:07.265942 7f22505c9700 10 mon.3@1(peon).pg v5939113 v5939113: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 878B/s wr, 0op/s
 -04-26 04:50:07.267304 7f22505c9700 10 mon.3@1(peon).pg v5939113 send_pg_creates to 0 pgs
 -04-26 04:50:07.267316 7f22505c9700 10 mon.3@1(peon).pg v5939113 update_logger
 -04-26 04:50:07.267456 7f22505c9700 10 mon.3@1(peon).log v5605011 update_from_paxos
 -04-26 04:50:07.267534 7f22505c9700 10 mon.3@1(peon).log v5605011 update_from_paxos version 5605011 summary v 5605011
 -04-26 04:50:07.267613 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:08.590429 7f22505c9700  7 mon.3@1(peon).pg v5939113 update_from_paxos  applying incremental 5939114
 -04-26 04:50:08.590493 7f22505c9700 10 mon.3@1(peon).pg v5939114 v5939114: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 889B/s wr, 0op/s
 -04-26 04:50:08.591795 7f22505c9700 10 mon.3@1(peon).pg v5939114 send_pg_creates to 0 pgs
 -04-26 04:50:08.591804 7f22505c9700 10 mon.3@1(peon).pg v5939114 update_logger
 -04-26 04:50:08.591943 7f22505c9700 10 mon.3@1(peon).log v5605011 update_from_paxos
 -04-26 04:50:08.592021 7f22505c9700 10 mon.3@1(peon).log v5605011 update_from_paxos version 5605011 summary v 5605011
 -04-26 04:50:08.592097 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:08.694731 7f22505c9700 10 mon.3@1(peon).log v5605012 update_from_paxos
 -04-26 04:50:08.694804 7f22505c9700 10 mon.3@1(peon).log v5605012 update_from_paxos version 5605012 summary v 5605011
 -04-26 04:50:08.694872 7f22505c9700 10 mon.3@1(peon).log v5605012 update_from_paxos latest full 5605011
 -04-26 04:50:08.694955 7f22505c9700  7 mon.3@1(peon).log v5605012 update_from_paxos applying incremental log 5605012 2013-04-26 04:50:06.083991 mon.0 10.227.227.101:6789/0 99 : [INF] pgmap v5939112: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:08.695025 7f22505c9700  7 mon.3@1(peon).log v5605012 update_from_paxos applying incremental log 5605012 2013-04-26 04:50:07.292733 mon.0 10.227.227.101:6789/0 100 : [INF] pgmap v5939113: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 878B/s wr, 0op/s
 -04-26 04:50:08.695119 7f22505c9700 10 mon.3@1(peon).log v5605012 check_subs
 -04-26 04:50:08.695204 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:09.574221 7f22505c9700  7 mon.3@1(peon).pg v5939114 update_from_paxos  applying incremental 5939115
 -04-26 04:50:09.574299 7f22505c9700 10 mon.3@1(peon).pg v5939115 v5939115: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:09.575547 7f22505c9700 10 mon.3@1(peon).pg v5939115 send_pg_creates to 0 pgs
 -04-26 04:50:09.575554 7f22505c9700 10 mon.3@1(peon).pg v5939115 update_logger
 -04-26 04:50:09.575690 7f22505c9700 10 mon.3@1(peon).log v5605012 update_from_paxos
 -04-26 04:50:09.575765 7f22505c9700 10 mon.3@1(peon).log v5605012 update_from_paxos version 5605012 summary v 5605012
 -04-26 04:50:09.575837 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:10.662312 7f22505c9700  7 mon.3@1(peon).pg v5939115 update_from_paxos  applying incremental 5939116
 -04-26 04:50:10.662470 7f22505c9700 10 mon.3@1(peon).pg v5939116 v5939116: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:10.663735 7f22505c9700 10 mon.3@1(peon).pg v5939116 send_pg_creates to 0 pgs
 -04-26 04:50:10.663744 7f22505c9700 10 mon.3@1(peon).pg v5939116 update_logger
 -04-26 04:50:10.663878 7f22505c9700 10 mon.3@1(peon).log v5605012 update_from_paxos
 -04-26 04:50:10.663955 7f22505c9700 10 mon.3@1(peon).log v5605012 update_from_paxos version 5605012 summary v 5605012
 -04-26 04:50:10.664026 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:10.779756 7f22505c9700 10 mon.3@1(peon).log v5605013 update_from_paxos
 -04-26 04:50:10.779876 7f22505c9700 10 mon.3@1(peon).log v5605013 update_from_paxos version 5605013 summary v 5605012
 -04-26 04:50:10.779983 7f22505c9700 10 mon.3@1(peon).log v5605013 update_from_paxos latest full 5605012
 -04-26 04:50:10.780114 7f22505c9700  7 mon.3@1(peon).log v5605013 update_from_paxos applying incremental log 5605013 2013-04-26 04:50:08.617641 mon.0 10.227.227.101:6789/0 101 : [INF] pgmap v5939114: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 889B/s wr, 0op/s
 -04-26 04:50:10.780222 7f22505c9700  7 mon.3@1(peon).log v5605013 update_from_paxos applying incremental log 5605013 2013-04-26 04:50:09.601470 mon.0 10.227.227.101:6789/0 102 : [INF] pgmap v5939115: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:10.780372 7f22505c9700 10 mon.3@1(peon).log v5605013 check_subs
 -04-26 04:50:10.780515 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:10.827852 7f2250dca700 10 mon.3@1(peon).pg v5939116 v5939116: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:10.827969 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:50:10.828030 7f2250dca700 10 mon.3@1(peon).osd e10650 e10650: 12 osds: 12 up, 12 in
 -04-26 04:50:10.828040 7f2250dca700 10 mon.3@1(peon).log v5605013 update_from_paxos
 -04-26 04:50:10.828117 7f2250dca700 10 mon.3@1(peon).log v5605013 update_from_paxos version 5605013 summary v 5605013
 -04-26 04:50:10.828148 7f2250dca700 10 mon.3@1(peon).log v5605013 log
 -04-26 04:50:10.828223 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:10.828298 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:50:12.002223 7f22505c9700  7 mon.3@1(peon).pg v5939116 update_from_paxos  applying incremental 5939117
 -04-26 04:50:12.002345 7f22505c9700 10 mon.3@1(peon).pg v5939117 v5939117: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:12.003989 7f22505c9700 10 mon.3@1(peon).pg v5939117 send_pg_creates to 0 pgs
 -04-26 04:50:12.003999 7f22505c9700 10 mon.3@1(peon).pg v5939117 update_logger
 -04-26 04:50:12.004164 7f22505c9700 10 mon.3@1(peon).log v5605013 update_from_paxos
 -04-26 04:50:12.004299 7f22505c9700 10 mon.3@1(peon).log v5605013 update_from_paxos version 5605013 summary v 5605013
 -04-26 04:50:12.004390 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:13.012338 7f22505c9700  7 mon.3@1(peon).pg v5939117 update_from_paxos  applying incremental 5939118
 -04-26 04:50:13.012467 7f22505c9700 10 mon.3@1(peon).pg v5939118 v5939118: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:13.013734 7f22505c9700 10 mon.3@1(peon).pg v5939118 send_pg_creates to 0 pgs
 -04-26 04:50:13.013743 7f22505c9700 10 mon.3@1(peon).pg v5939118 update_logger
 -04-26 04:50:13.013881 7f22505c9700 10 mon.3@1(peon).log v5605013 update_from_paxos
 -04-26 04:50:13.013957 7f22505c9700 10 mon.3@1(peon).log v5605013 update_from_paxos version 5605013 summary v 5605013
 -04-26 04:50:13.014027 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:13.724824 7f22505c9700 10 mon.3@1(peon).log v5605014 update_from_paxos
 -04-26 04:50:13.724902 7f22505c9700 10 mon.3@1(peon).log v5605014 update_from_paxos version 5605014 summary v 5605013
 -04-26 04:50:13.724966 7f22505c9700 10 mon.3@1(peon).log v5605014 update_from_paxos latest full 5605013
 -04-26 04:50:13.725048 7f22505c9700  7 mon.3@1(peon).log v5605014 update_from_paxos applying incremental log 5605014 2013-04-26 04:50:10.673502 mon.0 10.227.227.101:6789/0 103 : [INF] pgmap v5939116: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:13.725114 7f22505c9700  7 mon.3@1(peon).log v5605014 update_from_paxos applying incremental log 5605014 2013-04-26 04:50:12.016011 mon.0 10.227.227.101:6789/0 104 : [INF] pgmap v5939117: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:13.725230 7f22505c9700 10 mon.3@1(peon).log v5605014 check_subs
 -04-26 04:50:13.725321 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:14.432576 7f22505c9700  7 mon.3@1(peon).pg v5939118 update_from_paxos  applying incremental 5939119
 -04-26 04:50:14.432702 7f22505c9700 10 mon.3@1(peon).pg v5939119 v5939119: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:14.434798 7f22505c9700 10 mon.3@1(peon).pg v5939119 send_pg_creates to 0 pgs
 -04-26 04:50:14.434813 7f22505c9700 10 mon.3@1(peon).pg v5939119 update_logger
 -04-26 04:50:14.435019 7f22505c9700 10 mon.3@1(peon).log v5605014 update_from_paxos
 -04-26 04:50:14.435142 7f22505c9700 10 mon.3@1(peon).log v5605014 update_from_paxos version 5605014 summary v 5605014
 -04-26 04:50:14.435267 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:15.625615 7f22505c9700 10 mon.3@1(peon).log v5605015 update_from_paxos
 -04-26 04:50:15.625736 7f22505c9700 10 mon.3@1(peon).log v5605015 update_from_paxos version 5605015 summary v 5605014
 -04-26 04:50:15.625841 7f22505c9700 10 mon.3@1(peon).log v5605015 update_from_paxos latest full 5605014
 -04-26 04:50:15.625972 7f22505c9700  7 mon.3@1(peon).log v5605015 update_from_paxos applying incremental log 5605015 2013-04-26 04:50:13.030731 mon.0 10.227.227.101:6789/0 105 : [INF] pgmap v5939118: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:15.626080 7f22505c9700  7 mon.3@1(peon).log v5605015 update_from_paxos applying incremental log 5605015 2013-04-26 04:50:14.453061 mon.0 10.227.227.101:6789/0 106 : [INF] pgmap v5939119: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:15.626237 7f22505c9700 10 mon.3@1(peon).log v5605015 check_subs
 -04-26 04:50:15.626382 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:15.831429 7f22505c9700  7 mon.3@1(peon).pg v5939119 update_from_paxos  applying incremental 5939120
 -04-26 04:50:15.831604 7f22505c9700 10 mon.3@1(peon).pg v5939120 v5939120: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:15.833205 7f22505c9700 10 mon.3@1(peon).pg v5939120 send_pg_creates to 0 pgs
 -04-26 04:50:15.833216 7f22505c9700 10 mon.3@1(peon).pg v5939120 update_logger
 -04-26 04:50:15.833352 7f22505c9700 10 mon.3@1(peon).log v5605015 update_from_paxos
 -04-26 04:50:15.833429 7f22505c9700 10 mon.3@1(peon).log v5605015 update_from_paxos version 5605015 summary v 5605015
 -04-26 04:50:15.833537 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:15.835956 7f2250dca700 10 mon.3@1(peon).pg v5939120 v5939120: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:15.836145 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:50:15.836265 7f2250dca700 10 mon.3@1(peon).osd e10650 e10650: 12 osds: 12 up, 12 in
 -04-26 04:50:15.836283 7f2250dca700 10 mon.3@1(peon).log v5605015 update_from_paxos
 -04-26 04:50:15.836411 7f2250dca700 10 mon.3@1(peon).log v5605015 update_from_paxos version 5605015 summary v 5605015
 -04-26 04:50:15.836465 7f2250dca700 10 mon.3@1(peon).log v5605015 log
 -04-26 04:50:15.836597 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:15.836722 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:50:16.776630 7f22505c9700 10 mon.3@1(peon).data_health(2854) service_dispatch mon_health( service 1 op tell e 0 r 0 flags none ) v1
 -04-26 04:50:16.776643 7f22505c9700 10 mon.3@1(peon).data_health(2854) handle_tell mon_health( service 1 op tell e 0 r 0 flags none ) v1
 -04-26 04:50:17.045536 7f22505c9700 10 mon.3@1(peon).log v5605016 update_from_paxos
 -04-26 04:50:17.045663 7f22505c9700 10 mon.3@1(peon).log v5605016 update_from_paxos version 5605016 summary v 5605015
 -04-26 04:50:17.045768 7f22505c9700 10 mon.3@1(peon).log v5605016 update_from_paxos latest full 5605015
 -04-26 04:50:17.045876 7f22505c9700  7 mon.3@1(peon).log v5605016 update_from_paxos applying incremental log 5605016 2013-04-26 04:50:15.854069 mon.0 10.227.227.101:6789/0 107 : [INF] pgmap v5939120: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:17.046041 7f22505c9700 10 mon.3@1(peon).log v5605016 check_subs
 -04-26 04:50:17.046196 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:17.272405 7f22505c9700  7 mon.3@1(peon).pg v5939120 update_from_paxos  applying incremental 5939121
 -04-26 04:50:17.272626 7f22505c9700 10 mon.3@1(peon).pg v5939121 v5939121: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 676B/s wr, 0op/s
 -04-26 04:50:17.274725 7f22505c9700 10 mon.3@1(peon).pg v5939121 send_pg_creates to 0 pgs
 -04-26 04:50:17.274739 7f22505c9700 10 mon.3@1(peon).pg v5939121 update_logger
 -04-26 04:50:17.274945 7f22505c9700 10 mon.3@1(peon).log v5605016 update_from_paxos
 -04-26 04:50:17.275070 7f22505c9700 10 mon.3@1(peon).log v5605016 update_from_paxos version 5605016 summary v 5605016
 -04-26 04:50:17.275187 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:18.374400 7f22505c9700 10 mon.3@1(peon).log v5605017 update_from_paxos
 -04-26 04:50:18.374527 7f22505c9700 10 mon.3@1(peon).log v5605017 update_from_paxos version 5605017 summary v 5605016
 -04-26 04:50:18.374632 7f22505c9700 10 mon.3@1(peon).log v5605017 update_from_paxos latest full 5605016
 -04-26 04:50:18.374764 7f22505c9700  7 mon.3@1(peon).log v5605017 update_from_paxos applying incremental log 5605017 2013-04-26 04:50:17.290554 mon.0 10.227.227.101:6789/0 108 : [INF] pgmap v5939121: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 676B/s wr, 0op/s
 -04-26 04:50:18.374939 7f22505c9700 10 mon.3@1(peon).log v5605017 check_subs
 -04-26 04:50:18.375087 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:18.612462 7f22505c9700  7 mon.3@1(peon).pg v5939121 update_from_paxos  applying incremental 5939122
 -04-26 04:50:18.612666 7f22505c9700 10 mon.3@1(peon).pg v5939122 v5939122: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 739B/s wr, 0op/s
 -04-26 04:50:18.614759 7f22505c9700 10 mon.3@1(peon).pg v5939122 send_pg_creates to 0 pgs
 -04-26 04:50:18.614774 7f22505c9700 10 mon.3@1(peon).pg v5939122 update_logger
 -04-26 04:50:18.614973 7f22505c9700 10 mon.3@1(peon).log v5605017 update_from_paxos
 -04-26 04:50:18.615092 7f22505c9700 10 mon.3@1(peon).log v5605017 update_from_paxos version 5605017 summary v 5605017
 -04-26 04:50:18.615208 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:19.501271 7f22505c9700 10 mon.3@1(peon).log v5605018 update_from_paxos
 -04-26 04:50:19.501398 7f22505c9700 10 mon.3@1(peon).log v5605018 update_from_paxos version 5605018 summary v 5605017
 -04-26 04:50:19.501504 7f22505c9700 10 mon.3@1(peon).log v5605018 update_from_paxos latest full 5605017
 -04-26 04:50:19.501637 7f22505c9700  7 mon.3@1(peon).log v5605018 update_from_paxos applying incremental log 5605018 2013-04-26 04:50:17.226923 osd.5 10.227.227.104:6807/15124 188 : [INF] 2.b5 deep-scrub ok
 -04-26 04:50:19.501745 7f22505c9700  7 mon.3@1(peon).log v5605018 update_from_paxos applying incremental log 5605018 2013-04-26 04:50:18.633209 mon.0 10.227.227.101:6789/0 109 : [INF] pgmap v5939122: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 739B/s wr, 0op/s
 -04-26 04:50:19.501902 7f22505c9700 10 mon.3@1(peon).log v5605018 check_subs
 -04-26 04:50:19.502048 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:19.762296 7f22505c9700  7 mon.3@1(peon).pg v5939122 update_from_paxos  applying incremental 5939123
 -04-26 04:50:19.762419 7f22505c9700 10 mon.3@1(peon).pg v5939123 v5939123: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:19.764513 7f22505c9700 10 mon.3@1(peon).pg v5939123 send_pg_creates to 0 pgs
 -04-26 04:50:19.764535 7f22505c9700 10 mon.3@1(peon).pg v5939123 update_logger
 -04-26 04:50:19.764743 7f22505c9700 10 mon.3@1(peon).log v5605018 update_from_paxos
 -04-26 04:50:19.764864 7f22505c9700 10 mon.3@1(peon).log v5605018 update_from_paxos version 5605018 summary v 5605018
 -04-26 04:50:19.764992 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:19.866880 7f22505c9700 10 mon.3@1(peon).log v5605018 update_from_paxos
 -04-26 04:50:19.867004 7f22505c9700 10 mon.3@1(peon).log v5605018 update_from_paxos version 5605018 summary v 5605018
 -04-26 04:50:19.867119 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:20.838890 7f2250dca700 10 mon.3@1(peon).pg v5939123 v5939123: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:20.839017 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:50:20.839082 7f2250dca700 10 mon.3@1(peon).osd e10650 e10650: 12 osds: 12 up, 12 in
 -04-26 04:50:20.839089 7f2250dca700 10 mon.3@1(peon).log v5605018 update_from_paxos
 -04-26 04:50:20.839166 7f2250dca700 10 mon.3@1(peon).log v5605018 update_from_paxos version 5605018 summary v 5605018
 -04-26 04:50:20.839209 7f2250dca700 10 mon.3@1(peon).log v5605018 log
 -04-26 04:50:20.839282 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:20.839383 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:50:20.908985 7f22505c9700 10 mon.3@1(peon).log v5605019 update_from_paxos
 -04-26 04:50:20.909120 7f22505c9700 10 mon.3@1(peon).log v5605019 update_from_paxos version 5605019 summary v 5605018
 -04-26 04:50:20.909188 7f22505c9700 10 mon.3@1(peon).log v5605019 update_from_paxos latest full 5605018
 -04-26 04:50:20.909326 7f22505c9700  7 mon.3@1(peon).log v5605019 update_from_paxos applying incremental log 5605019 2013-04-26 04:50:19.781527 mon.0 10.227.227.101:6789/0 110 : [INF] pgmap v5939123: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:20.909503 7f22505c9700 10 mon.3@1(peon).log v5605019 check_subs
 -04-26 04:50:20.909652 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:21.120413 7f22505c9700  7 mon.3@1(peon).pg v5939123 update_from_paxos  applying incremental 5939124
 -04-26 04:50:21.120606 7f22505c9700 10 mon.3@1(peon).pg v5939124 v5939124: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 7573B/s wr, 2op/s
 -04-26 04:50:21.121868 7f22505c9700 10 mon.3@1(peon).pg v5939124 send_pg_creates to 0 pgs
 -04-26 04:50:21.121877 7f22505c9700 10 mon.3@1(peon).pg v5939124 update_logger
 -04-26 04:50:21.122015 7f22505c9700 10 mon.3@1(peon).log v5605019 update_from_paxos
 -04-26 04:50:21.122094 7f22505c9700 10 mon.3@1(peon).log v5605019 update_from_paxos version 5605019 summary v 5605019
 -04-26 04:50:21.122192 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:22.155755 7f22505c9700 10 mon.3@1(peon).log v5605020 update_from_paxos
 -04-26 04:50:22.155881 7f22505c9700 10 mon.3@1(peon).log v5605020 update_from_paxos version 5605020 summary v 5605019
 -04-26 04:50:22.155985 7f22505c9700 10 mon.3@1(peon).log v5605020 update_from_paxos latest full 5605019
 -04-26 04:50:22.156116 7f22505c9700  7 mon.3@1(peon).log v5605020 update_from_paxos applying incremental log 5605020 2013-04-26 04:50:17.949175 osd.1 10.227.227.101:6804/17898 193 : [INF] 2.b9 deep-scrub ok
 -04-26 04:50:22.156223 7f22505c9700  7 mon.3@1(peon).log v5605020 update_from_paxos applying incremental log 5605020 2013-04-26 04:50:20.997484 osd.0 10.227.227.101:6801/17890 195 : [INF] 0.d deep-scrub ok
 -04-26 04:50:22.156331 7f22505c9700  7 mon.3@1(peon).log v5605020 update_from_paxos applying incremental log 5605020 2013-04-26 04:50:21.143080 mon.0 10.227.227.101:6789/0 111 : [INF] pgmap v5939124: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 7573B/s wr, 2op/s
 -04-26 04:50:22.156505 7f22505c9700 10 mon.3@1(peon).log v5605020 check_subs
 -04-26 04:50:22.156653 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:22.282841 7f22505c9700  7 mon.3@1(peon).pg v5939124 update_from_paxos  applying incremental 5939125
 -04-26 04:50:22.283012 7f22505c9700 10 mon.3@1(peon).pg v5939125 v5939125: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 7620B/s wr, 2op/s
 -04-26 04:50:22.285112 7f22505c9700 10 mon.3@1(peon).pg v5939125 send_pg_creates to 0 pgs
 -04-26 04:50:22.285126 7f22505c9700 10 mon.3@1(peon).pg v5939125 update_logger
 -04-26 04:50:22.285344 7f22505c9700 10 mon.3@1(peon).log v5605020 update_from_paxos
 -04-26 04:50:22.285469 7f22505c9700 10 mon.3@1(peon).log v5605020 update_from_paxos version 5605020 summary v 5605020
 -04-26 04:50:22.285582 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:23.268974 7f22505c9700 10 mon.3@1(peon).log v5605021 update_from_paxos
 -04-26 04:50:23.269101 7f22505c9700 10 mon.3@1(peon).log v5605021 update_from_paxos version 5605021 summary v 5605020
 -04-26 04:50:23.269205 7f22505c9700 10 mon.3@1(peon).log v5605021 update_from_paxos latest full 5605020
 -04-26 04:50:23.269341 7f22505c9700  7 mon.3@1(peon).log v5605021 update_from_paxos applying incremental log 5605021 2013-04-26 04:50:18.484401 osd.2 10.227.227.101:6807/17905 172 : [INF] 2.ee deep-scrub ok
 -04-26 04:50:23.269450 7f22505c9700  7 mon.3@1(peon).log v5605021 update_from_paxos applying incremental log 5605021 2013-04-26 04:50:21.896909 osd.2 10.227.227.101:6807/17905 173 : [INF] 0.8 deep-scrub ok
 -04-26 04:50:23.269551 7f22505c9700  7 mon.3@1(peon).log v5605021 update_from_paxos applying incremental log 5605021 2013-04-26 04:50:22.306598 mon.0 10.227.227.101:6789/0 112 : [INF] pgmap v5939125: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 7620B/s wr, 2op/s
 -04-26 04:50:23.269768 7f22505c9700 10 mon.3@1(peon).log v5605021 check_subs
 -04-26 04:50:23.269919 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:23.420157 7f22505c9700  7 mon.3@1(peon).pg v5939125 update_from_paxos  applying incremental 5939126
 -04-26 04:50:23.420369 7f22505c9700 10 mon.3@1(peon).pg v5939126 v5939126: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 1691B/s wr, 0op/s
 -04-26 04:50:23.422413 7f22505c9700 10 mon.3@1(peon).pg v5939126 send_pg_creates to 0 pgs
 -04-26 04:50:23.422423 7f22505c9700 10 mon.3@1(peon).pg v5939126 update_logger
 -04-26 04:50:23.422556 7f22505c9700 10 mon.3@1(peon).log v5605021 update_from_paxos
 -04-26 04:50:23.422631 7f22505c9700 10 mon.3@1(peon).log v5605021 update_from_paxos version 5605021 summary v 5605021
 -04-26 04:50:23.422700 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:24.544883 7f22505c9700 10 mon.3@1(peon).log v5605022 update_from_paxos
 -04-26 04:50:24.545022 7f22505c9700 10 mon.3@1(peon).log v5605022 update_from_paxos version 5605022 summary v 5605021
 -04-26 04:50:24.545129 7f22505c9700 10 mon.3@1(peon).log v5605022 update_from_paxos latest full 5605021
 -04-26 04:50:24.545261 7f22505c9700  7 mon.3@1(peon).log v5605022 update_from_paxos applying incremental log 5605022 2013-04-26 04:50:23.442605 mon.0 10.227.227.101:6789/0 113 : [INF] pgmap v5939126: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 1691B/s wr, 0op/s
 -04-26 04:50:24.545425 7f22505c9700 10 mon.3@1(peon).log v5605022 check_subs
 -04-26 04:50:24.545573 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:24.843618 7f22505c9700  7 mon.3@1(peon).pg v5939126 update_from_paxos  applying incremental 5939127
 -04-26 04:50:24.843757 7f22505c9700 10 mon.3@1(peon).pg v5939127 v5939127: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 1759B/s wr, 0op/s
 -04-26 04:50:24.845856 7f22505c9700 10 mon.3@1(peon).pg v5939127 send_pg_creates to 0 pgs
 -04-26 04:50:24.845873 7f22505c9700 10 mon.3@1(peon).pg v5939127 update_logger
 -04-26 04:50:24.846050 7f22505c9700 10 mon.3@1(peon).log v5605022 update_from_paxos
 -04-26 04:50:24.846161 7f22505c9700 10 mon.3@1(peon).log v5605022 update_from_paxos version 5605022 summary v 5605022
 -04-26 04:50:24.846268 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:25.848456 7f2250dca700  7 mon.3@1(peon).pg v5939127 update_from_paxos  applying incremental 5939128
 -04-26 04:50:25.848826 7f2250dca700 10 mon.3@1(peon).pg v5939128 v5939128: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 54845B/s wr, 1op/s
 -04-26 04:50:25.850931 7f2250dca700 10 mon.3@1(peon).pg v5939128 send_pg_creates to 0 pgs
 -04-26 04:50:25.850945 7f2250dca700 10 mon.3@1(peon).pg v5939128 update_logger
 -04-26 04:50:25.850954 7f2250dca700 10 mon.3@1(peon).pg v5939128 v5939128: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 54845B/s wr, 1op/s
 -04-26 04:50:25.851092 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:50:25.851213 7f2250dca700 10 mon.3@1(peon).osd e10650 e10650: 12 osds: 12 up, 12 in
 -04-26 04:50:25.851230 7f2250dca700 10 mon.3@1(peon).log v5605022 update_from_paxos
 -04-26 04:50:25.851356 7f2250dca700 10 mon.3@1(peon).log v5605022 update_from_paxos version 5605022 summary v 5605022
 -04-26 04:50:25.851409 7f2250dca700 10 mon.3@1(peon).log v5605022 log
 -04-26 04:50:25.851531 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:25.851662 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:50:25.862701 7f22505c9700 10 mon.3@1(peon).log v5605022 update_from_paxos
 -04-26 04:50:25.862815 7f22505c9700 10 mon.3@1(peon).log v5605022 update_from_paxos version 5605022 summary v 5605022
 -04-26 04:50:25.862922 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:25.987599 7f22505c9700 10 mon.3@1(peon).log v5605023 update_from_paxos
 -04-26 04:50:25.987814 7f22505c9700 10 mon.3@1(peon).log v5605023 update_from_paxos version 5605023 summary v 5605022
 -04-26 04:50:25.987953 7f22505c9700 10 mon.3@1(peon).log v5605023 update_from_paxos latest full 5605022
 -04-26 04:50:25.988088 7f22505c9700  7 mon.3@1(peon).log v5605023 update_from_paxos applying incremental log 5605023 2013-04-26 04:50:24.867709 mon.0 10.227.227.101:6789/0 114 : [INF] pgmap v5939127: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 1759B/s wr, 0op/s
 -04-26 04:50:25.988251 7f22505c9700 10 mon.3@1(peon).log v5605023 check_subs
 -04-26 04:50:25.988399 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:26.086813 7f22505c9700 10 mon.3@1(peon).data_health(2854) service_dispatch mon_health( service 1 op tell e 0 r 0 flags none ) v1
 -04-26 04:50:26.086830 7f22505c9700 10 mon.3@1(peon).data_health(2854) handle_tell mon_health( service 1 op tell e 0 r 0 flags none ) v1
 -04-26 04:50:27.068363 7f22505c9700  7 mon.3@1(peon).pg v5939128 update_from_paxos  applying incremental 5939129
 -04-26 04:50:27.068583 7f22505c9700 10 mon.3@1(peon).pg v5939129 v5939129: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 55714B/s wr, 1op/s
 -04-26 04:50:27.070654 7f22505c9700 10 mon.3@1(peon).pg v5939129 send_pg_creates to 0 pgs
 -04-26 04:50:27.070669 7f22505c9700 10 mon.3@1(peon).pg v5939129 update_logger
 -04-26 04:50:27.070879 7f22505c9700 10 mon.3@1(peon).log v5605023 update_from_paxos
 -04-26 04:50:27.071025 7f22505c9700 10 mon.3@1(peon).log v5605023 update_from_paxos version 5605023 summary v 5605023
 -04-26 04:50:27.071274 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:28.129292 7f22505c9700 10 mon.3@1(peon).log v5605024 update_from_paxos
 -04-26 04:50:28.129419 7f22505c9700 10 mon.3@1(peon).log v5605024 update_from_paxos version 5605024 summary v 5605023
 -04-26 04:50:28.129527 7f22505c9700 10 mon.3@1(peon).log v5605024 update_from_paxos latest full 5605023
 -04-26 04:50:28.129660 7f22505c9700  7 mon.3@1(peon).log v5605024 update_from_paxos applying incremental log 5605024 2013-04-26 04:50:25.893164 mon.0 10.227.227.101:6789/0 115 : [INF] pgmap v5939128: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 54845B/s wr, 1op/s
 -04-26 04:50:28.129771 7f22505c9700  7 mon.3@1(peon).log v5605024 update_from_paxos applying incremental log 5605024 2013-04-26 04:50:27.092875 mon.0 10.227.227.101:6789/0 116 : [INF] pgmap v5939129: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 55714B/s wr, 1op/s
 -04-26 04:50:28.129933 7f22505c9700 10 mon.3@1(peon).log v5605024 check_subs
 -04-26 04:50:28.130079 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:28.252300 7f22505c9700  7 mon.3@1(peon).pg v5939129 update_from_paxos  applying incremental 5939130
 -04-26 04:50:28.252407 7f22505c9700 10 mon.3@1(peon).pg v5939130 v5939130: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 23777B/s wr, 2op/s
 -04-26 04:50:28.253672 7f22505c9700 10 mon.3@1(peon).pg v5939130 send_pg_creates to 0 pgs
 -04-26 04:50:28.253682 7f22505c9700 10 mon.3@1(peon).pg v5939130 update_logger
 -04-26 04:50:28.253799 7f22505c9700 10 mon.3@1(peon).log v5605024 update_from_paxos
 -04-26 04:50:28.253869 7f22505c9700 10 mon.3@1(peon).log v5605024 update_from_paxos version 5605024 summary v 5605024
 -04-26 04:50:28.253936 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:29.164661 7f22505c9700 10 mon.3@1(peon) e1 handle_route scrub(osd deep) v2 to osd.3 10.227.227.104:6801/14901
 -04-26 04:50:29.164676 7f22505c9700 10 mon.3@1(peon) e1  not a routed request, trying to send anyway
 -04-26 04:50:29.184932 7f224a859700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:0/1425 client protocol 0
 -04-26 04:50:29.185519 7f22505c9700 10 mon.3@1(peon) e1 do not have session, making new one
 -04-26 04:50:29.185537 7f22505c9700 10 mon.3@1(peon) e1 ms_dispatch new session MonSession: client.? 10.227.227.104:0/1425 is open for client.? 10.227.227.104:0/1425
 -04-26 04:50:29.185549 7f22505c9700 10 mon.3@1(peon) e1 setting timeout on session
 -04-26 04:50:29.185770 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:29.185871 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 0 30 bytes epoch 0) v1 from client.? 10.227.227.104:0/1425
 -04-26 04:50:29.185931 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=30
 -04-26 04:50:29.186007 7f22505c9700 10 mon.3@1(peon).auth v4474 AuthMonitor::assign_global_id m=auth(proto 0 30 bytes epoch 0) v1 mon=1/3 last_allocated=227416 max_global_id=227796
 -04-26 04:50:29.186064 7f22505c9700 10 mon.3@1(peon).auth v4474 next_global_id should be 227419
 -04-26 04:50:29.187730 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:29.187831 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 2 32 bytes epoch 0) v1 from client.? 10.227.227.104:0/1425
 -04-26 04:50:29.187890 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=32
 -04-26 04:50:29.189199 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:29.189341 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 2 165 bytes epoch 0) v1 from client.? 10.227.227.104:0/1425
 -04-26 04:50:29.189404 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=165
 -04-26 04:50:29.190486 7f22505c9700 10 mon.3@1(peon) e1 handle_subscribe mon_subscribe({monmap=0+}) v2
 -04-26 04:50:29.190504 7f22505c9700 10 mon.3@1(peon) e1 check_sub monmap next 0 have 1
 -04-26 04:50:29.190625 7f22505c9700  0 mon.3@1(peon) e1 handle_command mon_command(osd deep-scrub 4 v 0) v1
 -04-26 04:50:29.190840 7f22505c9700 10 mon.3@1(peon).osd e10650 preprocess_query mon_command(osd deep-scrub 4 v 0) v1 from client.? 10.227.227.104:0/1425
 -04-26 04:50:29.190877 7f22505c9700 10 mon.3@1(peon) e1 try_send_message scrub(osd deep) v2 to osd.4 10.227.227.104:6804/15010
 -04-26 04:50:29.191872 7f22505c9700 10 mon.3@1(peon) e1 ms_handle_reset 0x7a8bb80 10.227.227.104:0/1425
 -04-26 04:50:29.191903 7f22505c9700 10 mon.3@1(peon) e1 reset/close on session client.? 10.227.227.104:0/1425
 -04-26 04:50:29.191912 7f22505c9700 10 mon.3@1(peon) e1 remove_session MonSession: client.? 10.227.227.104:0/1425 is openallow * client.? 10.227.227.104:0/1425
 -04-26 04:50:29.211386 7f224a859700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:0/1435 client protocol 0
 -04-26 04:50:29.211900 7f22505c9700 10 mon.3@1(peon) e1 do not have session, making new one
 -04-26 04:50:29.211908 7f22505c9700 10 mon.3@1(peon) e1 ms_dispatch new session MonSession: client.? 10.227.227.104:0/1435 is open for client.? 10.227.227.104:0/1435
 -04-26 04:50:29.211924 7f22505c9700 10 mon.3@1(peon) e1 setting timeout on session
 -04-26 04:50:29.212056 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:29.212204 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 0 30 bytes epoch 0) v1 from client.? 10.227.227.104:0/1435
 -04-26 04:50:29.212269 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=30
 -04-26 04:50:29.212331 7f22505c9700 10 mon.3@1(peon).auth v4474 AuthMonitor::assign_global_id m=auth(proto 0 30 bytes epoch 0) v1 mon=1/3 last_allocated=227419 max_global_id=227796
 -04-26 04:50:29.212384 7f22505c9700 10 mon.3@1(peon).auth v4474 next_global_id should be 227422
 -04-26 04:50:29.213902 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:29.213996 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 2 32 bytes epoch 0) v1 from client.? 10.227.227.104:0/1435
 -04-26 04:50:29.214050 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=32
 -04-26 04:50:29.215275 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:29.215373 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 2 165 bytes epoch 0) v1 from client.? 10.227.227.104:0/1435
 -04-26 04:50:29.215428 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=165
 -04-26 04:50:29.216531 7f22505c9700 10 mon.3@1(peon) e1 handle_subscribe mon_subscribe({monmap=0+}) v2
 -04-26 04:50:29.216543 7f22505c9700 10 mon.3@1(peon) e1 check_sub monmap next 0 have 1
 -04-26 04:50:29.216634 7f22505c9700  0 mon.3@1(peon) e1 handle_command mon_command(osd deep-scrub 5 v 0) v1
 -04-26 04:50:29.216826 7f22505c9700 10 mon.3@1(peon).osd e10650 preprocess_query mon_command(osd deep-scrub 5 v 0) v1 from client.? 10.227.227.104:0/1435
 -04-26 04:50:29.216857 7f22505c9700 10 mon.3@1(peon) e1 try_send_message scrub(osd deep) v2 to osd.5 10.227.227.104:6807/15124
 -04-26 04:50:29.217757 7f22505c9700 10 mon.3@1(peon) e1 ms_handle_reset 0x7a8ba20 10.227.227.104:0/1435
 -04-26 04:50:29.217788 7f22505c9700 10 mon.3@1(peon) e1 reset/close on session client.? 10.227.227.104:0/1435
 -04-26 04:50:29.217797 7f22505c9700 10 mon.3@1(peon) e1 remove_session MonSession: client.? 10.227.227.104:0/1435 is openallow * client.? 10.227.227.104:0/1435
 -04-26 04:50:29.272749 7f224a859700  0 -- 10.227.227.103:6789/0 >> 10.227.227.104:0/481060714 pipe(0x8a42000 sd=6 :6789 s=0 pgs=0 cs=0 l=0).accept peer addr is really 10.227.227.104:0/481060714 (socket is 10.227.227.104:48853/0)
 -04-26 04:50:29.272903 7f224a859700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:0/481060714 client protocol 0
 -04-26 04:50:29.273419 7f22505c9700 10 mon.3@1(peon) e1 do not have session, making new one
 -04-26 04:50:29.273425 7f22505c9700 10 mon.3@1(peon) e1 ms_dispatch new session MonSession: unknown.0 10.227.227.104:0/481060714 is open for unknown.0 10.227.227.104:0/481060714
 -04-26 04:50:29.273439 7f22505c9700 10 mon.3@1(peon) e1 setting timeout on session
 -04-26 04:50:29.273572 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:29.273670 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 0 34 bytes epoch 0) from unknown.0 10.227.227.104:0/481060714
 -04-26 04:50:29.273725 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=34
 -04-26 04:50:29.273789 7f22505c9700 10 mon.3@1(peon).auth v4474 AuthMonitor::assign_global_id m=auth(proto 0 34 bytes epoch 0) mon=1/3 last_allocated=227422 max_global_id=227796
 -04-26 04:50:29.273855 7f22505c9700 10 mon.3@1(peon).auth v4474 next_global_id should be 227425
 -04-26 04:50:29.344714 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:29.344814 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 2 32 bytes epoch 0) from unknown.0 10.227.227.104:0/481060714
 -04-26 04:50:29.344872 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=32
 -04-26 04:50:29.347491 7f22505c9700 10 mon.3@1(peon).log v5605025 update_from_paxos
 -04-26 04:50:29.347616 7f22505c9700 10 mon.3@1(peon).log v5605025 update_from_paxos version 5605025 summary v 5605024
 -04-26 04:50:29.347740 7f22505c9700 10 mon.3@1(peon).log v5605025 update_from_paxos latest full 5605024
 -04-26 04:50:29.347872 7f22505c9700  7 mon.3@1(peon).log v5605025 update_from_paxos applying incremental log 5605025 2013-04-26 04:50:19.085151 osd.3 10.227.227.104:6801/14901 196 : [INF] 1.2c9 deep-scrub ok
 -04-26 04:50:29.347981 7f22505c9700  7 mon.3@1(peon).log v5605025 update_from_paxos applying incremental log 5605025 2013-04-26 04:50:21.048600 osd.3 10.227.227.104:6801/14901 197 : [INF] 1.2d7 deep-scrub ok
 -04-26 04:50:29.348085 7f22505c9700  7 mon.3@1(peon).log v5605025 update_from_paxos applying incremental log 5605025 2013-04-26 04:50:28.265281 mon.0 10.227.227.101:6789/0 117 : [INF] pgmap v5939130: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 23777B/s wr, 2op/s
 -04-26 04:50:29.348239 7f22505c9700 10 mon.3@1(peon).log v5605025 check_subs
 -04-26 04:50:29.348384 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:29.348609 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:29.348703 7f22505c9700 10 mon.3@1(peon).auth v4474 preprocess_query auth(proto 2 165 bytes epoch 0) from unknown.0 10.227.227.104:0/481060714
 -04-26 04:50:29.348760 7f22505c9700 10 mon.3@1(peon).auth v4474 prep_auth() blob_size=165
 -04-26 04:50:29.349799 7f22505c9700 10 mon.3@1(peon) e1 handle_subscribe mon_subscribe({mdsmap=0+,monmap=0+,osdmap=0})
 -04-26 04:50:29.349935 7f22505c9700 10 mon.3@1(peon) e1 check_sub monmap next 0 have 1
 -04-26 04:50:29.634396 7f22505c9700  7 mon.3@1(peon).pg v5939130 update_from_paxos  applying incremental 5939131
 -04-26 04:50:29.634512 7f22505c9700 10 mon.3@1(peon).pg v5939131 v5939131: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 34749B/s wr, 1op/s
 -04-26 04:50:29.636629 7f22505c9700 10 mon.3@1(peon).pg v5939131 send_pg_creates to 0 pgs
 -04-26 04:50:29.636644 7f22505c9700 10 mon.3@1(peon).pg v5939131 update_logger
 -04-26 04:50:29.636854 7f22505c9700 10 mon.3@1(peon).log v5605025 update_from_paxos
 -04-26 04:50:29.636978 7f22505c9700 10 mon.3@1(peon).log v5605025 update_from_paxos version 5605025 summary v 5605025
 -04-26 04:50:29.637098 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:30.723236 7f22505c9700 10 mon.3@1(peon).log v5605026 update_from_paxos
 -04-26 04:50:30.723363 7f22505c9700 10 mon.3@1(peon).log v5605026 update_from_paxos version 5605026 summary v 5605025
 -04-26 04:50:30.723470 7f22505c9700 10 mon.3@1(peon).log v5605026 update_from_paxos latest full 5605025
 -04-26 04:50:30.723817 7f22505c9700  7 mon.3@1(peon).log v5605026 update_from_paxos applying incremental log 5605026 2013-04-26 04:50:29.655741 mon.0 10.227.227.101:6789/0 118 : [INF] pgmap v5939131: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 34749B/s wr, 1op/s
 -04-26 04:50:30.723995 7f22505c9700 10 mon.3@1(peon).log v5605026 check_subs
 -04-26 04:50:30.724144 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:30.855289 7f22505c9700  7 mon.3@1(peon).pg v5939131 update_from_paxos  applying incremental 5939132
 -04-26 04:50:30.855652 7f22505c9700 10 mon.3@1(peon).pg v5939132 v5939132: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 30792B/s wr, 5op/s
 -04-26 04:50:30.857783 7f22505c9700 10 mon.3@1(peon).pg v5939132 send_pg_creates to 0 pgs
 -04-26 04:50:30.857803 7f22505c9700 10 mon.3@1(peon).pg v5939132 update_logger
 -04-26 04:50:30.858001 7f22505c9700 10 mon.3@1(peon).log v5605026 update_from_paxos
 -04-26 04:50:30.858120 7f22505c9700 10 mon.3@1(peon).log v5605026 update_from_paxos version 5605026 summary v 5605026
 -04-26 04:50:30.858246 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:30.860667 7f2250dca700 10 mon.3@1(peon).pg v5939132 v5939132: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 30792B/s wr, 5op/s
 -04-26 04:50:30.860852 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:50:30.860957 7f2250dca700 10 mon.3@1(peon).osd e10650 e10650: 12 osds: 12 up, 12 in
 -04-26 04:50:30.860970 7f2250dca700 10 mon.3@1(peon).log v5605026 update_from_paxos
 -04-26 04:50:30.861096 7f2250dca700 10 mon.3@1(peon).log v5605026 update_from_paxos version 5605026 summary v 5605026
 -04-26 04:50:30.861151 7f2250dca700 10 mon.3@1(peon).log v5605026 log
 -04-26 04:50:30.861268 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:30.861386 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:50:32.004727 7f22505c9700 10 mon.3@1(peon).log v5605027 update_from_paxos
 -04-26 04:50:32.004807 7f22505c9700 10 mon.3@1(peon).log v5605027 update_from_paxos version 5605027 summary v 5605026
 -04-26 04:50:32.004873 7f22505c9700 10 mon.3@1(peon).log v5605027 update_from_paxos latest full 5605026
 -04-26 04:50:32.004956 7f22505c9700  7 mon.3@1(peon).log v5605027 update_from_paxos applying incremental log 5605027 2013-04-26 04:50:24.160582 osd.0 10.227.227.101:6801/17890 196 : [INF] 0.15 deep-scrub ok
 -04-26 04:50:32.005024 7f22505c9700  7 mon.3@1(peon).log v5605027 update_from_paxos applying incremental log 5605027 2013-04-26 04:50:30.877955 mon.0 10.227.227.101:6789/0 119 : [INF] pgmap v5939132: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 30792B/s wr, 5op/s
 -04-26 04:50:32.005116 7f22505c9700 10 mon.3@1(peon).log v5605027 check_subs
 -04-26 04:50:32.005208 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:32.138688 7f22505c9700  7 mon.3@1(peon).pg v5939132 update_from_paxos  applying incremental 5939133
 -04-26 04:50:32.138875 7f22505c9700 10 mon.3@1(peon).pg v5939133 v5939133: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 19674B/s wr, 5op/s
 -04-26 04:50:32.141018 7f22505c9700 10 mon.3@1(peon).pg v5939133 send_pg_creates to 0 pgs
 -04-26 04:50:32.141034 7f22505c9700 10 mon.3@1(peon).pg v5939133 update_logger
 -04-26 04:50:32.141250 7f22505c9700 10 mon.3@1(peon).log v5605027 update_from_paxos
 -04-26 04:50:32.141374 7f22505c9700 10 mon.3@1(peon).log v5605027 update_from_paxos version 5605027 summary v 5605027
 -04-26 04:50:32.141495 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:33.484727 7f22505c9700 10 mon.3@1(peon).log v5605028 update_from_paxos
 -04-26 04:50:33.484806 7f22505c9700 10 mon.3@1(peon).log v5605028 update_from_paxos version 5605028 summary v 5605027
 -04-26 04:50:33.484870 7f22505c9700 10 mon.3@1(peon).log v5605028 update_from_paxos latest full 5605027
 -04-26 04:50:33.484953 7f22505c9700  7 mon.3@1(peon).log v5605028 update_from_paxos applying incremental log 5605028 2013-04-26 04:50:27.132358 osd.2 10.227.227.101:6807/17905 174 : [INF] 0.1a deep-scrub ok
 -04-26 04:50:33.485025 7f22505c9700  7 mon.3@1(peon).log v5605028 update_from_paxos applying incremental log 5605028 2013-04-26 04:50:29.578487 osd.2 10.227.227.101:6807/17905 175 : [INF] 0.1c deep-scrub ok
 -04-26 04:50:33.485085 7f22505c9700  7 mon.3@1(peon).log v5605028 update_from_paxos applying incremental log 5605028 2013-04-26 04:50:32.163010 mon.0 10.227.227.101:6789/0 120 : [INF] pgmap v5939133: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 19674B/s wr, 5op/s
 -04-26 04:50:33.485181 7f22505c9700 10 mon.3@1(peon).log v5605028 check_subs
 -04-26 04:50:33.485272 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:33.618134 7f22505c9700  7 mon.3@1(peon).pg v5939133 update_from_paxos  applying incremental 5939134
 -04-26 04:50:33.618253 7f22505c9700 10 mon.3@1(peon).pg v5939134 v5939134: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 34563B/s wr, 6op/s
 -04-26 04:50:33.619562 7f22505c9700 10 mon.3@1(peon).pg v5939134 send_pg_creates to 0 pgs
 -04-26 04:50:33.619574 7f22505c9700 10 mon.3@1(peon).pg v5939134 update_logger
 -04-26 04:50:33.619713 7f22505c9700 10 mon.3@1(peon).log v5605028 update_from_paxos
 -04-26 04:50:33.619790 7f22505c9700 10 mon.3@1(peon).log v5605028 update_from_paxos version 5605028 summary v 5605028
 -04-26 04:50:33.619861 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:34.685098 7f22505c9700 10 mon.3@1(peon).log v5605029 update_from_paxos
 -04-26 04:50:34.685183 7f22505c9700 10 mon.3@1(peon).log v5605029 update_from_paxos version 5605029 summary v 5605028
 -04-26 04:50:34.685248 7f22505c9700 10 mon.3@1(peon).log v5605029 update_from_paxos latest full 5605028
 -04-26 04:50:34.685331 7f22505c9700  7 mon.3@1(peon).log v5605029 update_from_paxos applying incremental log 5605029 2013-04-26 04:50:33.645622 mon.0 10.227.227.101:6789/0 121 : [INF] pgmap v5939134: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 34563B/s wr, 6op/s
 -04-26 04:50:34.685432 7f22505c9700 10 mon.3@1(peon).log v5605029 check_subs
 -04-26 04:50:34.685524 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:34.801606 7f22505c9700  7 mon.3@1(peon).pg v5939134 update_from_paxos  applying incremental 5939135
 -04-26 04:50:34.801686 7f22505c9700 10 mon.3@1(peon).pg v5939135 v5939135: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 46252B/s wr, 8op/s
 -04-26 04:50:34.802971 7f22505c9700 10 mon.3@1(peon).pg v5939135 send_pg_creates to 0 pgs
 -04-26 04:50:34.802980 7f22505c9700 10 mon.3@1(peon).pg v5939135 update_logger
 -04-26 04:50:34.803117 7f22505c9700 10 mon.3@1(peon).log v5605029 update_from_paxos
 -04-26 04:50:34.803195 7f22505c9700 10 mon.3@1(peon).log v5605029 update_from_paxos version 5605029 summary v 5605029
 -04-26 04:50:34.803268 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:35.863814 7f2250dca700 10 mon.3@1(peon).pg v5939135 v5939135: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 46252B/s wr, 8op/s
 -04-26 04:50:35.863997 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:50:35.864100 7f2250dca700 10 mon.3@1(peon).osd e10650 e10650: 12 osds: 12 up, 12 in
 -04-26 04:50:35.864115 7f2250dca700 10 mon.3@1(peon).log v5605029 update_from_paxos
 -04-26 04:50:35.864238 7f2250dca700 10 mon.3@1(peon).log v5605029 update_from_paxos version 5605029 summary v 5605029
 -04-26 04:50:35.864292 7f2250dca700 10 mon.3@1(peon).log v5605029 log
 -04-26 04:50:35.864410 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:35.864528 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:50:35.898808 7f22505c9700 10 mon.3@1(peon).log v5605030 update_from_paxos
 -04-26 04:50:35.898938 7f22505c9700 10 mon.3@1(peon).log v5605030 update_from_paxos version 5605030 summary v 5605029
 -04-26 04:50:35.899044 7f22505c9700 10 mon.3@1(peon).log v5605030 update_from_paxos latest full 5605029
 -04-26 04:50:35.899176 7f22505c9700  7 mon.3@1(peon).log v5605030 update_from_paxos applying incremental log 5605030 2013-04-26 04:50:34.826354 mon.0 10.227.227.101:6789/0 122 : [INF] pgmap v5939135: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 46252B/s wr, 8op/s
 -04-26 04:50:35.899338 7f22505c9700 10 mon.3@1(peon).log v5605030 check_subs
 -04-26 04:50:35.899489 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:36.030606 7f22505c9700  7 mon.3@1(peon).pg v5939135 update_from_paxos  applying incremental 5939136
 -04-26 04:50:36.030889 7f22505c9700 10 mon.3@1(peon).pg v5939136 v5939136: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 48482B/s wr, 5op/s
 -04-26 04:50:36.032730 7f22505c9700 10 mon.3@1(peon).pg v5939136 send_pg_creates to 0 pgs
 -04-26 04:50:36.032742 7f22505c9700 10 mon.3@1(peon).pg v5939136 update_logger
 -04-26 04:50:36.032849 7f22505c9700 10 mon.3@1(peon).log v5605030 update_from_paxos
 -04-26 04:50:36.032915 7f22505c9700 10 mon.3@1(peon).log v5605030 update_from_paxos version 5605030 summary v 5605030
 -04-26 04:50:36.032987 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:37.085700 7f22505c9700 10 mon.3@1(peon).log v5605031 update_from_paxos
 -04-26 04:50:37.085828 7f22505c9700 10 mon.3@1(peon).log v5605031 update_from_paxos version 5605031 summary v 5605030
 -04-26 04:50:37.085933 7f22505c9700 10 mon.3@1(peon).log v5605031 update_from_paxos latest full 5605030
 -04-26 04:50:37.086064 7f22505c9700  7 mon.3@1(peon).log v5605031 update_from_paxos applying incremental log 5605031 2013-04-26 04:50:36.055108 mon.0 10.227.227.101:6789/0 123 : [INF] pgmap v5939136: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 48482B/s wr, 5op/s
 -04-26 04:50:37.086228 7f22505c9700 10 mon.3@1(peon).log v5605031 check_subs
 -04-26 04:50:37.086377 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:37.230785 7f22505c9700  7 mon.3@1(peon).pg v5939136 update_from_paxos  applying incremental 5939137
 -04-26 04:50:37.231213 7f22505c9700 10 mon.3@1(peon).pg v5939137 v5939137: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 50722B/s wr, 4op/s
 -04-26 04:50:37.232910 7f22505c9700 10 mon.3@1(peon).pg v5939137 send_pg_creates to 0 pgs
 -04-26 04:50:37.232920 7f22505c9700 10 mon.3@1(peon).pg v5939137 update_logger
 -04-26 04:50:37.233046 7f22505c9700 10 mon.3@1(peon).log v5605031 update_from_paxos
 -04-26 04:50:37.233119 7f22505c9700 10 mon.3@1(peon).log v5605031 update_from_paxos version 5605031 summary v 5605031
 -04-26 04:50:37.233187 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:38.290853 7f22505c9700 10 mon.3@1(peon).log v5605032 update_from_paxos
 -04-26 04:50:38.290980 7f22505c9700 10 mon.3@1(peon).log v5605032 update_from_paxos version 5605032 summary v 5605031
 -04-26 04:50:38.291087 7f22505c9700 10 mon.3@1(peon).log v5605032 update_from_paxos latest full 5605031
 -04-26 04:50:38.291222 7f22505c9700  7 mon.3@1(peon).log v5605032 update_from_paxos applying incremental log 5605032 2013-04-26 04:50:37.253579 mon.0 10.227.227.101:6789/0 124 : [INF] pgmap v5939137: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 50722B/s wr, 4op/s
 -04-26 04:50:38.291387 7f22505c9700 10 mon.3@1(peon).log v5605032 check_subs
 -04-26 04:50:38.291538 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:38.422706 7f22505c9700  7 mon.3@1(peon).pg v5939137 update_from_paxos  applying incremental 5939138
 -04-26 04:50:38.423107 7f22505c9700 10 mon.3@1(peon).pg v5939138 v5939138: 2428 pgs: 2424 active+clean, 4 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 14974B/s wr, 3op/s
 -04-26 04:50:38.425234 7f22505c9700 10 mon.3@1(peon).pg v5939138 send_pg_creates to 0 pgs
 -04-26 04:50:38.425251 7f22505c9700 10 mon.3@1(peon).pg v5939138 update_logger
 -04-26 04:50:38.425458 7f22505c9700 10 mon.3@1(peon).log v5605032 update_from_paxos
 -04-26 04:50:38.425579 7f22505c9700 10 mon.3@1(peon).log v5605032 update_from_paxos version 5605032 summary v 5605032
 -04-26 04:50:38.425706 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:39.374570 7f22505c9700 10 mon.3@1(peon).log v5605033 update_from_paxos
 -04-26 04:50:39.374719 7f22505c9700 10 mon.3@1(peon).log v5605033 update_from_paxos version 5605033 summary v 5605032
 -04-26 04:50:39.374827 7f22505c9700 10 mon.3@1(peon).log v5605033 update_from_paxos latest full 5605032
 -04-26 04:50:39.374961 7f22505c9700  7 mon.3@1(peon).log v5605033 update_from_paxos applying incremental log 5605033 2013-04-26 04:50:30.630805 osd.5 10.227.227.104:6807/15124 189 : [INF] 0.1 deep-scrub ok
 -04-26 04:50:39.375070 7f22505c9700  7 mon.3@1(peon).log v5605033 update_from_paxos applying incremental log 5605033 2013-04-26 04:50:35.121316 osd.3 10.227.227.104:6801/14901 198 : [INF] 0.0 deep-scrub ok
 -04-26 04:50:39.375175 7f22505c9700  7 mon.3@1(peon).log v5605033 update_from_paxos applying incremental log 5605033 2013-04-26 04:50:38.236764 osd.5 10.227.227.104:6807/15124 190 : [INF] 0.7 deep-scrub ok
 -04-26 04:50:39.375270 7f22505c9700  7 mon.3@1(peon).log v5605033 update_from_paxos applying incremental log 5605033 2013-04-26 04:50:38.438344 mon.0 10.227.227.101:6789/0 125 : [INF] pgmap v5939138: 2428 pgs: 2424 active+clean, 4 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 14974B/s wr, 3op/s
 -04-26 04:50:39.375427 7f22505c9700 10 mon.3@1(peon).log v5605033 check_subs
 -04-26 04:50:39.375575 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:39.523151 7f22505c9700  7 mon.3@1(peon).pg v5939138 update_from_paxos  applying incremental 5939139
 -04-26 04:50:39.523369 7f22505c9700 10 mon.3@1(peon).pg v5939139 v5939139: 2428 pgs: 2424 active+clean, 4 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:39.525468 7f22505c9700 10 mon.3@1(peon).pg v5939139 send_pg_creates to 0 pgs
 -04-26 04:50:39.525486 7f22505c9700 10 mon.3@1(peon).pg v5939139 update_logger
 -04-26 04:50:39.525691 7f22505c9700 10 mon.3@1(peon).log v5605033 update_from_paxos
 -04-26 04:50:39.525814 7f22505c9700 10 mon.3@1(peon).log v5605033 update_from_paxos version 5605033 summary v 5605033
 -04-26 04:50:39.525942 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:39.625071 7f22505c9700 10 mon.3@1(peon).log v5605033 update_from_paxos
 -04-26 04:50:39.625197 7f22505c9700 10 mon.3@1(peon).log v5605033 update_from_paxos version 5605033 summary v 5605033
 -04-26 04:50:39.625312 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:40.608360 7f22505c9700 10 mon.3@1(peon).log v5605034 update_from_paxos
 -04-26 04:50:40.608490 7f22505c9700 10 mon.3@1(peon).log v5605034 update_from_paxos version 5605034 summary v 5605033
 -04-26 04:50:40.608597 7f22505c9700 10 mon.3@1(peon).log v5605034 update_from_paxos latest full 5605033
 -04-26 04:50:40.608731 7f22505c9700  7 mon.3@1(peon).log v5605034 update_from_paxos applying incremental log 5605034 2013-04-26 04:50:39.546643 mon.0 10.227.227.101:6789/0 126 : [INF] pgmap v5939139: 2428 pgs: 2424 active+clean, 4 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail
 -04-26 04:50:40.608909 7f22505c9700 10 mon.3@1(peon).log v5605034 check_subs
 -04-26 04:50:40.609061 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:40.732613 7f22505c9700  7 mon.3@1(peon).pg v5939139 update_from_paxos  applying incremental 5939140
 -04-26 04:50:40.733541 7f22505c9700 10 mon.3@1(peon).pg v5939140 v5939140: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 67533B/s wr, 3op/s
 -04-26 04:50:40.735655 7f22505c9700 10 mon.3@1(peon).pg v5939140 send_pg_creates to 0 pgs
 -04-26 04:50:40.735670 7f22505c9700 10 mon.3@1(peon).pg v5939140 update_logger
 -04-26 04:50:40.735855 7f22505c9700 10 mon.3@1(peon).log v5605034 update_from_paxos
 -04-26 04:50:40.735982 7f22505c9700 10 mon.3@1(peon).log v5605034 update_from_paxos version 5605034 summary v 5605034
 -04-26 04:50:40.736098 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:40.866882 7f2250dca700 10 mon.3@1(peon).pg v5939140 v5939140: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 67533B/s wr, 3op/s
 -04-26 04:50:40.867060 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:50:40.867164 7f2250dca700 10 mon.3@1(peon).osd e10650 e10650: 12 osds: 12 up, 12 in
 -04-26 04:50:40.867178 7f2250dca700 10 mon.3@1(peon).log v5605034 update_from_paxos
 -04-26 04:50:40.867305 7f2250dca700 10 mon.3@1(peon).log v5605034 update_from_paxos version 5605034 summary v 5605034
 -04-26 04:50:40.867359 7f2250dca700 10 mon.3@1(peon).log v5605034 log
 -04-26 04:50:40.867481 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:40.867599 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:50:42.085478 7f22505c9700 10 mon.3@1(peon).log v5605035 update_from_paxos
 -04-26 04:50:42.085608 7f22505c9700 10 mon.3@1(peon).log v5605035 update_from_paxos version 5605035 summary v 5605034
 -04-26 04:50:42.085752 7f22505c9700 10 mon.3@1(peon).log v5605035 update_from_paxos latest full 5605034
 -04-26 04:50:42.085888 7f22505c9700  7 mon.3@1(peon).log v5605035 update_from_paxos applying incremental log 5605035 2013-04-26 04:50:32.855340 osd.0 10.227.227.101:6801/17890 197 : [INF] 0.1e deep-scrub ok
 -04-26 04:50:42.085996 7f22505c9700  7 mon.3@1(peon).log v5605035 update_from_paxos applying incremental log 5605035 2013-04-26 04:50:36.318411 osd.0 10.227.227.101:6801/17890 198 : [INF] 0.36 deep-scrub ok
 -04-26 04:50:42.086105 7f22505c9700  7 mon.3@1(peon).log v5605035 update_from_paxos applying incremental log 5605035 2013-04-26 04:50:40.753574 mon.0 10.227.227.101:6789/0 127 : [INF] pgmap v5939140: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 67533B/s wr, 3op/s
 -04-26 04:50:42.086366 7f22505c9700 10 mon.3@1(peon).log v5605035 check_subs
 -04-26 04:50:42.086525 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:42.516247 7f22505c9700  7 mon.3@1(peon).pg v5939140 update_from_paxos  applying incremental 5939141
 -04-26 04:50:42.516682 7f22505c9700 10 mon.3@1(peon).pg v5939141 v5939141: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 77761B/s wr, 5op/s
 -04-26 04:50:42.518801 7f22505c9700 10 mon.3@1(peon).pg v5939141 send_pg_creates to 0 pgs
 -04-26 04:50:42.518824 7f22505c9700 10 mon.3@1(peon).pg v5939141 update_logger
 -04-26 04:50:42.519104 7f22505c9700 10 mon.3@1(peon).log v5605035 update_from_paxos
 -04-26 04:50:42.519276 7f22505c9700 10 mon.3@1(peon).log v5605035 update_from_paxos version 5605035 summary v 5605035
 -04-26 04:50:42.519447 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:43.010016 7f22505c9700 10 mon.3@1(peon).log v5605036 update_from_paxos
 -04-26 04:50:43.010182 7f22505c9700 10 mon.3@1(peon).log v5605036 update_from_paxos version 5605036 summary v 5605035
 -04-26 04:50:43.010358 7f22505c9700 10 mon.3@1(peon).log v5605036 update_from_paxos latest full 5605035
 -04-26 04:50:43.010545 7f22505c9700  7 mon.3@1(peon).log v5605036 update_from_paxos applying incremental log 5605036 2013-04-26 04:50:41.130578 osd.2 10.227.227.101:6807/17905 176 : [INF] 0.1d deep-scrub ok
 -04-26 04:50:43.010674 7f22505c9700  7 mon.3@1(peon).log v5605036 update_from_paxos applying incremental log 5605036 2013-04-26 04:50:42.540103 mon.0 10.227.227.101:6789/0 128 : [INF] pgmap v5939141: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 77761B/s wr, 5op/s
 -04-26 04:50:43.010874 7f22505c9700 10 mon.3@1(peon).log v5605036 check_subs
 -04-26 04:50:43.011088 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:43.392509 7f22505c9700  7 mon.3@1(peon).pg v5939141 update_from_paxos  applying incremental 5939142
 -04-26 04:50:43.393112 7f22505c9700 10 mon.3@1(peon).pg v5939142 v5939142: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 94540B/s wr, 6op/s
 -04-26 04:50:43.395223 7f22505c9700 10 mon.3@1(peon).pg v5939142 send_pg_creates to 0 pgs
 -04-26 04:50:43.395238 7f22505c9700 10 mon.3@1(peon).pg v5939142 update_logger
 -04-26 04:50:43.395448 7f22505c9700 10 mon.3@1(peon).log v5605036 update_from_paxos
 -04-26 04:50:43.395573 7f22505c9700 10 mon.3@1(peon).log v5605036 update_from_paxos version 5605036 summary v 5605036
 -04-26 04:50:43.395695 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:44.544608 7f22505c9700 10 mon.3@1(peon).log v5605037 update_from_paxos
 -04-26 04:50:44.544740 7f22505c9700 10 mon.3@1(peon).log v5605037 update_from_paxos version 5605037 summary v 5605036
 -04-26 04:50:44.544850 7f22505c9700 10 mon.3@1(peon).log v5605037 update_from_paxos latest full 5605036
 -04-26 04:50:44.544993 7f22505c9700  7 mon.3@1(peon).log v5605037 update_from_paxos applying incremental log 5605037 2013-04-26 04:50:43.414876 mon.0 10.227.227.101:6789/0 129 : [INF] pgmap v5939142: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 94540B/s wr, 6op/s
 -04-26 04:50:44.545164 7f22505c9700 10 mon.3@1(peon).log v5605037 check_subs
 -04-26 04:50:44.545315 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:45.533796 7f22505c9700  7 mon.3@1(peon).pg v5939142 update_from_paxos  applying incremental 5939143
 -04-26 04:50:45.534191 7f22505c9700 10 mon.3@1(peon).pg v5939143 v5939143: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 61701B/s wr, 3op/s
 -04-26 04:50:45.535499 7f22505c9700 10 mon.3@1(peon).pg v5939143 send_pg_creates to 0 pgs
 -04-26 04:50:45.535509 7f22505c9700 10 mon.3@1(peon).pg v5939143 update_logger
 -04-26 04:50:45.535700 7f22505c9700 10 mon.3@1(peon).log v5605037 update_from_paxos
 -04-26 04:50:45.535929 7f22505c9700 10 mon.3@1(peon).log v5605037 update_from_paxos version 5605037 summary v 5605037
 -04-26 04:50:45.536046 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:45.869118 7f2250dca700 10 mon.3@1(peon).pg v5939143 v5939143: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 61701B/s wr, 3op/s
 -04-26 04:50:45.869241 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:50:45.869305 7f2250dca700 10 mon.3@1(peon).osd e10650 e10650: 12 osds: 12 up, 12 in
 -04-26 04:50:45.869329 7f2250dca700 10 mon.3@1(peon).log v5605037 update_from_paxos
 -04-26 04:50:45.869410 7f2250dca700 10 mon.3@1(peon).log v5605037 update_from_paxos version 5605037 summary v 5605037
 -04-26 04:50:45.869443 7f2250dca700 10 mon.3@1(peon).log v5605037 log
 -04-26 04:50:45.869517 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:45.869591 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:50:46.306578 7f2250dca700 10 mon.3@1(peon).data_health(2854) service_tick
 -04-26 04:50:46.306609 7f2250dca700  0 mon.3@1(peon).data_health(2854) update_stats avail 54% total 1826117064 used 830807948 avail 995309116
 -04-26 04:50:46.306616 7f2250dca700 10 mon.3@1(peon).data_health(2854) share_stats
 -04-26 04:50:46.667909 7f22505c9700  7 mon.3@1(peon).pg v5939143 update_from_paxos  applying incremental 5939144
 -04-26 04:50:46.668960 7f22505c9700 10 mon.3@1(peon).pg v5939144 v5939144: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 85488B/s wr, 1op/s
 -04-26 04:50:46.671088 7f22505c9700 10 mon.3@1(peon).pg v5939144 send_pg_creates to 0 pgs
 -04-26 04:50:46.671103 7f22505c9700 10 mon.3@1(peon).pg v5939144 update_logger
 -04-26 04:50:46.671309 7f22505c9700 10 mon.3@1(peon).log v5605037 update_from_paxos
 -04-26 04:50:46.671433 7f22505c9700 10 mon.3@1(peon).log v5605037 update_from_paxos version 5605037 summary v 5605037
 -04-26 04:50:46.671557 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:46.786039 7f22505c9700 10 mon.3@1(peon).log v5605038 update_from_paxos
 -04-26 04:50:46.786160 7f22505c9700 10 mon.3@1(peon).log v5605038 update_from_paxos version 5605038 summary v 5605037
 -04-26 04:50:46.786266 7f22505c9700 10 mon.3@1(peon).log v5605038 update_from_paxos latest full 5605037
 -04-26 04:50:46.786400 7f22505c9700  7 mon.3@1(peon).log v5605038 update_from_paxos applying incremental log 5605038 2013-04-26 04:50:45.558866 mon.0 10.227.227.101:6789/0 130 : [INF] pgmap v5939143: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 61701B/s wr, 3op/s
 -04-26 04:50:46.786560 7f22505c9700 10 mon.3@1(peon).log v5605038 check_subs
 -04-26 04:50:46.786706 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:47.918921 7f22505c9700  7 mon.3@1(peon).pg v5939144 update_from_paxos  applying incremental 5939145
 -04-26 04:50:47.919144 7f22505c9700 10 mon.3@1(peon).pg v5939145 v5939145: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 115KB/s wr, 2op/s
 -04-26 04:50:47.921268 7f22505c9700 10 mon.3@1(peon).pg v5939145 send_pg_creates to 0 pgs
 -04-26 04:50:47.921286 7f22505c9700 10 mon.3@1(peon).pg v5939145 update_logger
 -04-26 04:50:47.921498 7f22505c9700 10 mon.3@1(peon).log v5605038 update_from_paxos
 -04-26 04:50:47.921625 7f22505c9700 10 mon.3@1(peon).log v5605038 update_from_paxos version 5605038 summary v 5605038
 -04-26 04:50:47.921746 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:48.156502 7f22505c9700 10 mon.3@1(peon).log v5605039 update_from_paxos
 -04-26 04:50:48.156630 7f22505c9700 10 mon.3@1(peon).log v5605039 update_from_paxos version 5605039 summary v 5605038
 -04-26 04:50:48.156736 7f22505c9700 10 mon.3@1(peon).log v5605039 update_from_paxos latest full 5605038
 -04-26 04:50:48.156889 7f22505c9700  7 mon.3@1(peon).log v5605039 update_from_paxos applying incremental log 5605039 2013-04-26 04:50:43.985410 osd.4 10.227.227.104:6804/15010 199 : [INF] 2.23 deep-scrub ok
 -04-26 04:50:48.157050 7f22505c9700 10 mon.3@1(peon).log v5605039 check_subs
 -04-26 04:50:48.157197 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:49.001664 7f22505c9700  7 mon.3@1(peon).pg v5939145 update_from_paxos  applying incremental 5939146
 -04-26 04:50:49.002245 7f22505c9700 10 mon.3@1(peon).pg v5939146 v5939146: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 162KB/s wr, 2op/s
 -04-26 04:50:49.004512 7f22505c9700 10 mon.3@1(peon).pg v5939146 send_pg_creates to 0 pgs
 -04-26 04:50:49.004529 7f22505c9700 10 mon.3@1(peon).pg v5939146 update_logger
 -04-26 04:50:49.004741 7f22505c9700 10 mon.3@1(peon).log v5605039 update_from_paxos
 -04-26 04:50:49.004869 7f22505c9700 10 mon.3@1(peon).log v5605039 update_from_paxos version 5605039 summary v 5605039
 -04-26 04:50:49.004989 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:49.120170 7f22505c9700 10 mon.3@1(peon).log v5605040 update_from_paxos
 -04-26 04:50:49.120288 7f22505c9700 10 mon.3@1(peon).log v5605040 update_from_paxos version 5605040 summary v 5605039
 -04-26 04:50:49.120394 7f22505c9700 10 mon.3@1(peon).log v5605040 update_from_paxos latest full 5605039
 -04-26 04:50:49.120527 7f22505c9700  7 mon.3@1(peon).log v5605040 update_from_paxos applying incremental log 5605040 2013-04-26 04:50:46.693584 mon.0 10.227.227.101:6789/0 131 : [INF] pgmap v5939144: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 85488B/s wr, 1op/s
 -04-26 04:50:49.120638 7f22505c9700  7 mon.3@1(peon).log v5605040 update_from_paxos applying incremental log 5605040 2013-04-26 04:50:47.942329 mon.0 10.227.227.101:6789/0 132 : [INF] pgmap v5939145: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 115KB/s wr, 2op/s
 -04-26 04:50:49.120792 7f22505c9700 10 mon.3@1(peon).log v5605040 check_subs
 -04-26 04:50:49.120933 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:50.252371 7f22505c9700  7 mon.3@1(peon).pg v5939146 update_from_paxos  applying incremental 5939147
 -04-26 04:50:50.252619 7f22505c9700 10 mon.3@1(peon).pg v5939147 v5939147: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 164KB/s wr, 1op/s
 -04-26 04:50:50.253919 7f22505c9700 10 mon.3@1(peon).pg v5939147 send_pg_creates to 0 pgs
 -04-26 04:50:50.253929 7f22505c9700 10 mon.3@1(peon).pg v5939147 update_logger
 -04-26 04:50:50.254077 7f22505c9700 10 mon.3@1(peon).log v5605040 update_from_paxos
 -04-26 04:50:50.254170 7f22505c9700 10 mon.3@1(peon).log v5605040 update_from_paxos version 5605040 summary v 5605040
 -04-26 04:50:50.254254 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:50.871954 7f2250dca700 10 mon.3@1(peon).pg v5939147 v5939147: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 164KB/s wr, 1op/s
 -04-26 04:50:50.872159 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:50:50.872264 7f2250dca700 10 mon.3@1(peon).osd e10650 e10650: 12 osds: 12 up, 12 in
 -04-26 04:50:50.872278 7f2250dca700 10 mon.3@1(peon).log v5605040 update_from_paxos
 -04-26 04:50:50.872408 7f2250dca700 10 mon.3@1(peon).log v5605040 update_from_paxos version 5605040 summary v 5605040
 -04-26 04:50:50.872461 7f2250dca700 10 mon.3@1(peon).log v5605040 log
 -04-26 04:50:50.872580 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:50.872696 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:50:51.379231 7f22505c9700 10 mon.3@1(peon).log v5605041 update_from_paxos
 -04-26 04:50:51.379361 7f22505c9700 10 mon.3@1(peon).log v5605041 update_from_paxos version 5605041 summary v 5605040
 -04-26 04:50:51.379476 7f22505c9700 10 mon.3@1(peon).log v5605041 update_from_paxos latest full 5605040
 -04-26 04:50:51.379614 7f22505c9700  7 mon.3@1(peon).log v5605041 update_from_paxos applying incremental log 5605041 2013-04-26 04:50:49.025926 mon.0 10.227.227.101:6789/0 133 : [INF] pgmap v5939146: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 162KB/s wr, 2op/s
 -04-26 04:50:51.379728 7f22505c9700  7 mon.3@1(peon).log v5605041 update_from_paxos applying incremental log 5605041 2013-04-26 04:50:50.276287 mon.0 10.227.227.101:6789/0 134 : [INF] pgmap v5939147: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 164KB/s wr, 1op/s
 -04-26 04:50:51.379900 7f22505c9700 10 mon.3@1(peon).log v5605041 check_subs
 -04-26 04:50:51.380047 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:51.552506 7f22505c9700  7 mon.3@1(peon).pg v5939147 update_from_paxos  applying incremental 5939148
 -04-26 04:50:51.553663 7f22505c9700 10 mon.3@1(peon).pg v5939148 v5939148: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 1672B/s wr, 0op/s
 -04-26 04:50:51.555778 7f22505c9700 10 mon.3@1(peon).pg v5939148 send_pg_creates to 0 pgs
 -04-26 04:50:51.555794 7f22505c9700 10 mon.3@1(peon).pg v5939148 update_logger
 -04-26 04:50:51.555997 7f22505c9700 10 mon.3@1(peon).log v5605041 update_from_paxos
 -04-26 04:50:51.556120 7f22505c9700 10 mon.3@1(peon).log v5605041 update_from_paxos version 5605041 summary v 5605041
 -04-26 04:50:51.556246 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:52.446091 7f22505c9700 10 mon.3@1(peon).log v5605042 update_from_paxos
 -04-26 04:50:52.446219 7f22505c9700 10 mon.3@1(peon).log v5605042 update_from_paxos version 5605042 summary v 5605041
 -04-26 04:50:52.446325 7f22505c9700 10 mon.3@1(peon).log v5605042 update_from_paxos latest full 5605041
 -04-26 04:50:52.446460 7f22505c9700  7 mon.3@1(peon).log v5605042 update_from_paxos applying incremental log 5605042 2013-04-26 04:50:42.118912 osd.0 10.227.227.101:6801/17890 199 : [INF] 0.3b deep-scrub ok
 -04-26 04:50:52.446586 7f22505c9700  7 mon.3@1(peon).log v5605042 update_from_paxos applying incremental log 5605042 2013-04-26 04:50:44.610267 osd.2 10.227.227.101:6807/17905 177 : [INF] 0.2a deep-scrub ok
 -04-26 04:50:52.446683 7f22505c9700  7 mon.3@1(peon).log v5605042 update_from_paxos applying incremental log 5605042 2013-04-26 04:50:47.171862 osd.0 10.227.227.101:6801/17890 200 : [INF] 0.3d deep-scrub ok
 -04-26 04:50:52.446773 7f22505c9700  7 mon.3@1(peon).log v5605042 update_from_paxos applying incremental log 5605042 2013-04-26 04:50:48.611082 osd.0 10.227.227.101:6801/17890 201 : [INF] 0.43 deep-scrub ok
 -04-26 04:50:52.446860 7f22505c9700  7 mon.3@1(peon).log v5605042 update_from_paxos applying incremental log 5605042 2013-04-26 04:50:50.876992 osd.0 10.227.227.101:6801/17890 202 : [INF] 0.4f deep-scrub ok
 -04-26 04:50:52.446951 7f22505c9700  7 mon.3@1(peon).log v5605042 update_from_paxos applying incremental log 5605042 2013-04-26 04:50:51.380370 osd.2 10.227.227.101:6807/17905 178 : [INF] 0.35 deep-scrub ok
 -04-26 04:50:52.447043 7f22505c9700  7 mon.3@1(peon).log v5605042 update_from_paxos applying incremental log 5605042 2013-04-26 04:50:51.578901 mon.0 10.227.227.101:6789/0 135 : [INF] pgmap v5939148: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 1672B/s wr, 0op/s
 -04-26 04:50:52.447193 7f22505c9700 10 mon.3@1(peon).log v5605042 check_subs
 -04-26 04:50:52.447342 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:52.627754 7f22505c9700  7 mon.3@1(peon).pg v5939148 update_from_paxos  applying incremental 5939149
 -04-26 04:50:52.628248 7f22505c9700 10 mon.3@1(peon).pg v5939149 v5939149: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 167KB/s wr, 2op/s
 -04-26 04:50:52.630380 7f22505c9700 10 mon.3@1(peon).pg v5939149 send_pg_creates to 0 pgs
 -04-26 04:50:52.630395 7f22505c9700 10 mon.3@1(peon).pg v5939149 update_logger
 -04-26 04:50:52.630587 7f22505c9700 10 mon.3@1(peon).log v5605042 update_from_paxos
 -04-26 04:50:52.630703 7f22505c9700 10 mon.3@1(peon).log v5605042 update_from_paxos version 5605042 summary v 5605042
 -04-26 04:50:52.630827 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:53.746110 7f22505c9700 10 mon.3@1(peon).log v5605043 update_from_paxos
 -04-26 04:50:53.746239 7f22505c9700 10 mon.3@1(peon).log v5605043 update_from_paxos version 5605043 summary v 5605042
 -04-26 04:50:53.746347 7f22505c9700 10 mon.3@1(peon).log v5605043 update_from_paxos latest full 5605042
 -04-26 04:50:53.746483 7f22505c9700  7 mon.3@1(peon).log v5605043 update_from_paxos applying incremental log 5605043 2013-04-26 04:50:52.652432 mon.0 10.227.227.101:6789/0 136 : [INF] pgmap v5939149: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 167KB/s wr, 2op/s
 -04-26 04:50:53.746657 7f22505c9700 10 mon.3@1(peon).log v5605043 check_subs
 -04-26 04:50:53.746808 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:53.894690 7f22505c9700  7 mon.3@1(peon).pg v5939149 update_from_paxos  applying incremental 5939150
 -04-26 04:50:53.895240 7f22505c9700 10 mon.3@1(peon).pg v5939150 v5939150: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 177KB/s wr, 3op/s
 -04-26 04:50:53.897346 7f22505c9700 10 mon.3@1(peon).pg v5939150 send_pg_creates to 0 pgs
 -04-26 04:50:53.897361 7f22505c9700 10 mon.3@1(peon).pg v5939150 update_logger
 -04-26 04:50:53.897538 7f22505c9700 10 mon.3@1(peon).log v5605043 update_from_paxos
 -04-26 04:50:53.897650 7f22505c9700 10 mon.3@1(peon).log v5605043 update_from_paxos version 5605043 summary v 5605043
 -04-26 04:50:53.897770 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:54.975850 7f22505c9700 10 mon.3@1(peon).log v5605044 update_from_paxos
 -04-26 04:50:54.975975 7f22505c9700 10 mon.3@1(peon).log v5605044 update_from_paxos version 5605044 summary v 5605043
 -04-26 04:50:54.976081 7f22505c9700 10 mon.3@1(peon).log v5605044 update_from_paxos latest full 5605043
 -04-26 04:50:54.976216 7f22505c9700  7 mon.3@1(peon).log v5605044 update_from_paxos applying incremental log 5605044 2013-04-26 04:50:53.918920 mon.0 10.227.227.101:6789/0 137 : [INF] pgmap v5939150: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 177KB/s wr, 3op/s
 -04-26 04:50:54.976391 7f22505c9700 10 mon.3@1(peon).log v5605044 check_subs
 -04-26 04:50:54.976541 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:55.086472 7f22505c9700  7 mon.3@1(peon).pg v5939150 update_from_paxos  applying incremental 5939151
 -04-26 04:50:55.086930 7f22505c9700 10 mon.3@1(peon).pg v5939151 v5939151: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 7219B/s wr, 2op/s
 -04-26 04:50:55.089042 7f22505c9700 10 mon.3@1(peon).pg v5939151 send_pg_creates to 0 pgs
 -04-26 04:50:55.089057 7f22505c9700 10 mon.3@1(peon).pg v5939151 update_logger
 -04-26 04:50:55.089235 7f22505c9700 10 mon.3@1(peon).log v5605044 update_from_paxos
 -04-26 04:50:55.089348 7f22505c9700 10 mon.3@1(peon).log v5605044 update_from_paxos version 5605044 summary v 5605044
 -04-26 04:50:55.089456 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:55.875039 7f2250dca700 10 mon.3@1(peon).pg v5939151 v5939151: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 7219B/s wr, 2op/s
 -04-26 04:50:55.875223 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:50:55.875320 7f2250dca700 10 mon.3@1(peon).osd e10650 e10650: 12 osds: 12 up, 12 in
 -04-26 04:50:55.875351 7f2250dca700 10 mon.3@1(peon).log v5605044 update_from_paxos
 -04-26 04:50:55.875478 7f2250dca700 10 mon.3@1(peon).log v5605044 update_from_paxos version 5605044 summary v 5605044
 -04-26 04:50:55.875533 7f2250dca700 10 mon.3@1(peon).log v5605044 log
 -04-26 04:50:55.875653 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:55.875770 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:50:56.292691 7f22505c9700  7 mon.3@1(peon).pg v5939151 update_from_paxos  applying incremental 5939152
 -04-26 04:50:56.294035 7f22505c9700 10 mon.3@1(peon).pg v5939152 v5939152: 2428 pgs: 2428 active+clean; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 101KB/s wr, 2op/s
 -04-26 04:50:56.296325 7f22505c9700 10 mon.3@1(peon).pg v5939152 send_pg_creates to 0 pgs
 -04-26 04:50:56.296343 7f22505c9700 10 mon.3@1(peon).pg v5939152 update_logger
 -04-26 04:50:56.296560 7f22505c9700 10 mon.3@1(peon).log v5605044 update_from_paxos
 -04-26 04:50:56.296688 7f22505c9700 10 mon.3@1(peon).log v5605044 update_from_paxos version 5605044 summary v 5605044
 -04-26 04:50:56.296814 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:56.445698 7f22505c9700 10 mon.3@1(peon).log v5605045 update_from_paxos
 -04-26 04:50:56.445819 7f22505c9700 10 mon.3@1(peon).log v5605045 update_from_paxos version 5605045 summary v 5605044
 -04-26 04:50:56.445925 7f22505c9700 10 mon.3@1(peon).log v5605045 update_from_paxos latest full 5605044
 -04-26 04:50:56.446060 7f22505c9700  7 mon.3@1(peon).log v5605045 update_from_paxos applying incremental log 5605045 2013-04-26 04:50:55.111054 mon.0 10.227.227.101:6789/0 138 : [INF] pgmap v5939151: 2428 pgs: 2427 active+clean, 1 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 7219B/s wr, 2op/s
 -04-26 04:50:56.446216 7f22505c9700 10 mon.3@1(peon).log v5605045 check_subs
 -04-26 04:50:56.446363 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:57.421274 7f22505c9700  7 mon.3@1(peon).pg v5939152 update_from_paxos  applying incremental 5939153
 -04-26 04:50:57.421982 7f22505c9700 10 mon.3@1(peon).pg v5939153 v5939153: 2428 pgs: 2428 active+clean; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 107KB/s wr, 3op/s
 -04-26 04:50:57.424138 7f22505c9700 10 mon.3@1(peon).pg v5939153 send_pg_creates to 0 pgs
 -04-26 04:50:57.424153 7f22505c9700 10 mon.3@1(peon).pg v5939153 update_logger
 -04-26 04:50:57.424613 7f22505c9700 10 mon.3@1(peon).log v5605045 update_from_paxos
 -04-26 04:50:57.424743 7f22505c9700 10 mon.3@1(peon).log v5605045 update_from_paxos version 5605045 summary v 5605045
 -04-26 04:50:57.424877 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:57.545761 7f22505c9700 10 mon.3@1(peon).log v5605046 update_from_paxos
 -04-26 04:50:57.545882 7f22505c9700 10 mon.3@1(peon).log v5605046 update_from_paxos version 5605046 summary v 5605045
 -04-26 04:50:57.545990 7f22505c9700 10 mon.3@1(peon).log v5605046 update_from_paxos latest full 5605045
 -04-26 04:50:57.546124 7f22505c9700  7 mon.3@1(peon).log v5605046 update_from_paxos applying incremental log 5605046 2013-04-26 04:50:48.045397 osd.4 10.227.227.104:6804/15010 200 : [INF] 0.a deep-scrub ok
 -04-26 04:50:57.546233 7f22505c9700  7 mon.3@1(peon).log v5605046 update_from_paxos applying incremental log 5605046 2013-04-26 04:50:50.253964 osd.4 10.227.227.104:6804/15010 201 : [INF] 0.14 deep-scrub ok
 -04-26 04:50:57.546327 7f22505c9700  7 mon.3@1(peon).log v5605046 update_from_paxos applying incremental log 5605046 2013-04-26 04:50:53.345501 osd.4 10.227.227.104:6804/15010 202 : [INF] 0.21 deep-scrub ok
 -04-26 04:50:57.546463 7f22505c9700 10 mon.3@1(peon).log v5605046 check_subs
 -04-26 04:50:57.546613 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:58.639593 7f22505c9700 10 mon.3@1(peon).log v5605047 update_from_paxos
 -04-26 04:50:58.639725 7f22505c9700 10 mon.3@1(peon).log v5605047 update_from_paxos version 5605047 summary v 5605046
 -04-26 04:50:58.639835 7f22505c9700 10 mon.3@1(peon).log v5605047 update_from_paxos latest full 5605046
 -04-26 04:50:58.639970 7f22505c9700  7 mon.3@1(peon).log v5605047 update_from_paxos applying incremental log 5605047 2013-04-26 04:50:56.307745 mon.0 10.227.227.101:6789/0 139 : [INF] pgmap v5939152: 2428 pgs: 2428 active+clean; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 101KB/s wr, 2op/s
 -04-26 04:50:58.640081 7f22505c9700  7 mon.3@1(peon).log v5605047 update_from_paxos applying incremental log 5605047 2013-04-26 04:50:57.445903 mon.0 10.227.227.101:6789/0 140 : [INF] pgmap v5939153: 2428 pgs: 2428 active+clean; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 107KB/s wr, 3op/s
 -04-26 04:50:58.640234 7f22505c9700 10 mon.3@1(peon).log v5605047 check_subs
 -04-26 04:50:58.640383 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:58.772754 7f22505c9700  7 mon.3@1(peon).pg v5939153 update_from_paxos  applying incremental 5939154
 -04-26 04:50:58.773197 7f22505c9700 10 mon.3@1(peon).pg v5939154 v5939154: 2428 pgs: 2428 active+clean; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 112KB/s wr, 7op/s
 -04-26 04:50:58.774463 7f22505c9700 10 mon.3@1(peon).pg v5939154 send_pg_creates to 0 pgs
 -04-26 04:50:58.774472 7f22505c9700 10 mon.3@1(peon).pg v5939154 update_logger
 -04-26 04:50:58.774593 7f22505c9700 10 mon.3@1(peon).log v5605047 update_from_paxos
 -04-26 04:50:58.774666 7f22505c9700 10 mon.3@1(peon).log v5605047 update_from_paxos version 5605047 summary v 5605047
 -04-26 04:50:58.774735 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:58.881626 7f22505c9700 10 mon.3@1(peon).log v5605047 update_from_paxos
 -04-26 04:50:58.881744 7f22505c9700 10 mon.3@1(peon).log v5605047 update_from_paxos version 5605047 summary v 5605047
 -04-26 04:50:58.881866 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:50:59.825836 7f22505c9700 10 mon.3@1(peon).log v5605048 update_from_paxos
 -04-26 04:50:59.825968 7f22505c9700 10 mon.3@1(peon).log v5605048 update_from_paxos version 5605048 summary v 5605047
 -04-26 04:50:59.826073 7f22505c9700 10 mon.3@1(peon).log v5605048 update_from_paxos latest full 5605047
 -04-26 04:50:59.826207 7f22505c9700  7 mon.3@1(peon).log v5605048 update_from_paxos applying incremental log 5605048 2013-04-26 04:50:58.790427 mon.0 10.227.227.101:6789/0 141 : [INF] pgmap v5939154: 2428 pgs: 2428 active+clean; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 112KB/s wr, 7op/s
 -04-26 04:50:59.826366 7f22505c9700 10 mon.3@1(peon).log v5605048 check_subs
 -04-26 04:50:59.826519 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:51:00.878113 7f2250dca700 10 mon.3@1(peon).pg v5939154 v5939154: 2428 pgs: 2428 active+clean; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 112KB/s wr, 7op/s
 -04-26 04:51:00.878290 7f2250dca700 10 mon.3@1(peon).mds e3770 e3770: 1/1/1 up {0=1=up:active}, 2 up:standby
 -04-26 04:51:00.878392 7f2250dca700 10 mon.3@1(peon).osd e10650 e10650: 12 osds: 12 up, 12 in
 -04-26 04:51:00.878406 7f2250dca700 10 mon.3@1(peon).log v5605048 update_from_paxos
 -04-26 04:51:00.878535 7f2250dca700 10 mon.3@1(peon).log v5605048 update_from_paxos version 5605048 summary v 5605048
 -04-26 04:51:00.878588 7f2250dca700 10 mon.3@1(peon).log v5605048 log
 -04-26 04:51:00.878706 7f2250dca700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:51:00.878838 7f2250dca700 10 mon.3@1(peon).auth v4474 auth
 -04-26 04:51:00.964367 7f22505c9700  7 mon.3@1(peon).pg v5939154 update_from_paxos  applying incremental 5939155
 -04-26 04:51:00.966289 7f22505c9700 10 mon.3@1(peon).pg v5939155 v5939155: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 152KB/s wr, 12op/s
 -04-26 04:51:00.968455 7f22505c9700 10 mon.3@1(peon).pg v5939155 send_pg_creates to 0 pgs
 -04-26 04:51:00.968471 7f22505c9700 10 mon.3@1(peon).pg v5939155 update_logger
 -04-26 04:51:00.968796 7f22505c9700 10 mon.3@1(peon).log v5605048 update_from_paxos
 -04-26 04:51:00.968938 7f22505c9700 10 mon.3@1(peon).log v5605048 update_from_paxos version 5605048 summary v 5605048
 -04-26 04:51:00.969060 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:51:02.048123 7f22505c9700 10 mon.3@1(peon).log v5605049 update_from_paxos
 -04-26 04:51:02.048346 7f22505c9700 10 mon.3@1(peon).log v5605049 update_from_paxos version 5605049 summary v 5605048
 -04-26 04:51:02.048563 7f22505c9700 10 mon.3@1(peon).log v5605049 update_from_paxos latest full 5605048
 -04-26 04:51:02.048815 7f22505c9700  7 mon.3@1(peon).log v5605049 update_from_paxos applying incremental log 5605049 2013-04-26 04:50:58.726156 osd.0 10.227.227.101:6801/17890 203 : [INF] 0.55 deep-scrub ok
 -04-26 04:51:02.049019 7f22505c9700  7 mon.3@1(peon).log v5605049 update_from_paxos applying incremental log 5605049 2013-04-26 04:51:00.989841 mon.0 10.227.227.101:6789/0 142 : [INF] pgmap v5939155: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 152KB/s wr, 12op/s
 -04-26 04:51:02.049373 7f22505c9700 10 mon.3@1(peon).log v5605049 check_subs
 -04-26 04:51:02.049635 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:51:02.197955 7f22505c9700  7 mon.3@1(peon).pg v5939155 update_from_paxos  applying incremental 5939156
 -04-26 04:51:02.199204 7f22505c9700 10 mon.3@1(peon).pg v5939156 v5939156: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 106KB/s wr, 13op/s
 -04-26 04:51:02.201400 7f22505c9700 10 mon.3@1(peon).pg v5939156 send_pg_creates to 0 pgs
 -04-26 04:51:02.201423 7f22505c9700 10 mon.3@1(peon).pg v5939156 update_logger
 -04-26 04:51:02.201664 7f22505c9700 10 mon.3@1(peon).log v5605049 update_from_paxos
 -04-26 04:51:02.201793 7f22505c9700 10 mon.3@1(peon).log v5605049 update_from_paxos version 5605049 summary v 5605049
 -04-26 04:51:02.201974 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:51:03.396280 7f22505c9700 10 mon.3@1(peon).log v5605050 update_from_paxos
 -04-26 04:51:03.396448 7f22505c9700 10 mon.3@1(peon).log v5605050 update_from_paxos version 5605050 summary v 5605049
 -04-26 04:51:03.396642 7f22505c9700 10 mon.3@1(peon).log v5605050 update_from_paxos latest full 5605049
 -04-26 04:51:03.396849 7f22505c9700  7 mon.3@1(peon).log v5605050 update_from_paxos applying incremental log 5605050 2013-04-26 04:50:52.947830 osd.2 10.227.227.101:6807/17905 179 : [INF] 0.41 deep-scrub ok
 -04-26 04:51:03.397013 7f22505c9700  7 mon.3@1(peon).log v5605050 update_from_paxos applying incremental log 5605050 2013-04-26 04:50:55.376587 osd.2 10.227.227.101:6807/17905 180 : [INF] 0.45 deep-scrub ok
 -04-26 04:51:03.397204 7f22505c9700  7 mon.3@1(peon).log v5605050 update_from_paxos applying incremental log 5605050 2013-04-26 04:51:01.195401 osd.2 10.227.227.101:6807/17905 181 : [INF] 0.49 deep-scrub ok
 -04-26 04:51:03.397346 7f22505c9700  7 mon.3@1(peon).log v5605050 update_from_paxos applying incremental log 5605050 2013-04-26 04:51:02.222037 mon.0 10.227.227.101:6789/0 143 : [INF] pgmap v5939156: 2428 pgs: 2426 active+clean, 2 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 106KB/s wr, 13op/s
 -04-26 04:51:03.397547 7f22505c9700 10 mon.3@1(peon).log v5605050 check_subs
 -04-26 04:51:03.397767 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:51:03.694237 7f22505c9700  7 mon.3@1(peon).pg v5939156 update_from_paxos  applying incremental 5939157
 -04-26 04:51:03.695104 7f22505c9700 10 mon.3@1(peon).pg v5939157 v5939157: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 48698B/s wr, 8op/s
 -04-26 04:51:03.697224 7f22505c9700 10 mon.3@1(peon).pg v5939157 send_pg_creates to 0 pgs
 -04-26 04:51:03.697239 7f22505c9700 10 mon.3@1(peon).pg v5939157 update_logger
 -04-26 04:51:03.697455 7f22505c9700 10 mon.3@1(peon).log v5605050 update_from_paxos
 -04-26 04:51:03.697642 7f22505c9700 10 mon.3@1(peon).log v5605050 update_from_paxos version 5605050 summary v 5605050
 -04-26 04:51:03.697843 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:51:04.649370 7f22505c9700 10 mon.3@1(peon).log v5605051 update_from_paxos
 -04-26 04:51:04.649501 7f22505c9700 10 mon.3@1(peon).log v5605051 update_from_paxos version 5605051 summary v 5605050
 -04-26 04:51:04.649659 7f22505c9700 10 mon.3@1(peon).log v5605051 update_from_paxos latest full 5605050
 -04-26 04:51:04.649805 7f22505c9700  7 mon.3@1(peon).log v5605051 update_from_paxos applying incremental log 5605051 2013-04-26 04:51:03.673352 mon.0 10.227.227.101:6789/0 144 : [INF] pgmap v5939157: 2428 pgs: 2425 active+clean, 3 active+clean+scrubbing+deep; 1836 GB data, 3208 GB used, 13535 GB / 16744 GB avail; 48698B/s wr, 8op/s
 -04-26 04:51:04.649979 7f22505c9700 10 mon.3@1(peon).log v5605051 check_subs
 -04-26 04:51:04.650139 7f22505c9700 10 mon.3@1(peon).auth v4474 update_from_paxos
 -04-26 04:51:32.278766 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1016852 client protocol 0
 -04-26 04:51:37.167398 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017033 client protocol 0
 -04-26 04:51:37.629944 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6810/9229 osd protocol 0
 -04-26 04:51:37.630223 7f224c7e3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:51:46.027450 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017119 client protocol 0
 -04-26 04:51:49.515218 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017187 client protocol 0
 -04-26 04:51:57.287618 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017443 client protocol 0
 -04-26 04:52:27.662640 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6804/8931 osd protocol 0
 -04-26 04:52:27.662798 7f224af68700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016175 client protocol 0
 -04-26 04:52:27.662837 7f224c7e3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016297 client protocol 0
 -04-26 04:52:27.663120 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/2016297 client protocol 0
 -04-26 04:52:27.663344 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017187 client protocol 0
 -04-26 04:52:27.663524 7f224f0c2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017443 client protocol 0
 -04-26 04:52:28.271529 7f2202ce8700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6801/14901 osd protocol 0
 -04-26 04:52:28.488308 7f2202ae6700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6807/15124 osd protocol 0
 -04-26 04:52:29.920554 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:52:33.446680 7f224f0c2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6810/9229 osd protocol 0
 -04-26 04:52:33.692263 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:52:33.697020 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:52:34.558045 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016297 client protocol 0
 -04-26 04:52:34.721842 7f224f0c2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/2016297 client protocol 0
 -04-26 04:52:35.606807 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6807/15124 osd protocol 0
 -04-26 04:52:36.287924 7f224af68700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017443 client protocol 0
 -04-26 04:52:36.732383 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6804/15010 osd protocol 0
 -04-26 04:52:36.801219 7f2202ae6700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6807/17905 osd protocol 0
 -04-26 04:52:36.846000 7f2202ce8700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6810/9229 osd protocol 0
 -04-26 04:52:36.858103 7f224c7e3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6801/14901 osd protocol 0
 -04-26 04:52:37.987505 7f224f0c2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:52:38.102473 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6800/8669 mds protocol 0
 -04-26 04:52:38.347482 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016175 client protocol 0
 -04-26 04:52:38.516059 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017187 client protocol 0
 -04-26 04:52:40.662661 7f2202ce8700  0 -- 10.227.227.103:6789/0 >> 10.227.227.103:0/576935661 pipe(0x9b2b900 sd=25 :6789 s=0 pgs=0 cs=0 l=0).accept peer addr is really 10.227.227.103:0/576935661 (socket is 10.227.227.103:43813/0)
 -04-26 04:52:40.662690 7f2202ce8700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/576935661 client protocol 0
 -04-26 04:52:42.664802 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6807/9109 osd protocol 0
 -04-26 04:52:42.664845 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6801/8813 osd protocol 0
 -04-26 04:52:42.664861 7f224eec0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6813/9355 osd protocol 0
 -04-26 04:52:42.665024 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6816/9474 osd protocol 0
 -04-26 04:52:42.665098 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6801/17890 osd protocol 0
 -04-26 04:52:42.665082 7f224af68700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6804/17898 osd protocol 0
 -04-26 04:52:43.089367 7f22026e2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:52:43.312611 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6804/8931 osd protocol 0
 -04-26 04:52:44.247429 7f22024e0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:52:45.733779 7f22024e0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6804/15010 osd protocol 0
 -04-26 04:52:45.847198 7f22026e2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6810/9229 osd protocol 0
 -04-26 04:52:46.273659 7f22022de700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6801/14901 osd protocol 0
 -04-26 04:52:46.490071 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6807/15124 osd protocol 0
 -04-26 04:52:47.922220 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:52:48.722678 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:52:49.313435 7f22022de700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6804/8931 osd protocol 0
 -04-26 04:52:49.559756 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016297 client protocol 0
 -04-26 04:52:49.723085 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/2016297 client protocol 0
 -04-26 04:52:49.785963 7f22026e2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6807/9109 osd protocol 0
 -04-26 04:52:50.066349 7f22024e0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6813/9355 osd protocol 0
 -04-26 04:52:50.261561 7f224eec0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6816/9474 osd protocol 0
 -04-26 04:52:50.372430 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:52:50.922343 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:52:51.289390 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017443 client protocol 0
 -04-26 04:52:52.275142 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6801/14901 osd protocol 0
 -04-26 04:52:52.490848 7f22022de700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6807/15124 osd protocol 0
 -04-26 04:52:53.102606 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6800/8669 mds protocol 0
 -04-26 04:52:53.326978 7f224eec0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:52:53.349292 7f22024e0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016175 client protocol 0
 -04-26 04:52:53.518360 7f22026e2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017187 client protocol 0
 -04-26 04:52:53.922713 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:52:54.223597 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6801/17890 osd protocol 0
 -04-26 04:52:54.441480 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6804/17898 osd protocol 0
 -04-26 04:52:54.734890 7f224eec0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6804/15010 osd protocol 0
 -04-26 04:52:54.848370 7f224af68700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6810/9229 osd protocol 0
 -04-26 04:52:55.090733 7f2202ce8700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6801/8813 osd protocol 0
 -04-26 04:52:55.431853 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:52:55.560667 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016297 client protocol 0
 -04-26 04:52:55.723879 7f22022de700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/2016297 client protocol 0
 -04-26 04:52:57.290363 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017443 client protocol 0
 -04-26 04:52:58.275212 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6801/14901 osd protocol 0
 -04-26 04:52:58.314382 7f2202ce8700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6804/8931 osd protocol 0
 -04-26 04:52:58.428015 7f224af68700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:52:58.469202 7f224af68700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:52:58.494212 7f224eec0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6807/15124 osd protocol 0
 -04-26 04:52:58.787205 7f22022de700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6807/9109 osd protocol 0
 -04-26 04:52:59.067515 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6813/9355 osd protocol 0
 -04-26 04:52:59.262662 7f224af68700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6816/9474 osd protocol 0
 -04-26 04:52:59.349871 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016175 client protocol 0
 -04-26 04:52:59.521109 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017187 client protocol 0
 -04-26 04:53:00.849250 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6810/9229 osd protocol 0
 -04-26 04:53:01.561192 7f224eec0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016297 client protocol 0
 -04-26 04:53:01.724560 7f2202ce8700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/2016297 client protocol 0
 -04-26 04:53:02.923606 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:53:03.229066 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6801/17890 osd protocol 0
 -04-26 04:53:03.281467 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6801/8813 osd protocol 0
 -04-26 04:53:03.290404 7f224af68700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017443 client protocol 0
 -04-26 04:53:03.442537 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6804/17898 osd protocol 0
 -04-26 04:53:04.275766 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6801/14901 osd protocol 0
 -04-26 04:53:04.495073 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6807/15124 osd protocol 0
 -04-26 04:53:04.787796 7f2202ce8700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6807/9109 osd protocol 0
 -04-26 04:53:05.068362 7f224eec0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6813/9355 osd protocol 0
 -04-26 04:53:05.350855 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016175 client protocol 0
 -04-26 04:53:05.491825 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:53:05.518082 7f22022de700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017187 client protocol 0
 -04-26 04:53:05.924151 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:53:06.459165 7f224af68700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6816/9474 osd protocol 0
 -04-26 04:53:06.488279 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6804/8931 osd protocol 0
 -04-26 04:53:06.736850 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6804/15010 osd protocol 0
 -04-26 04:53:06.850107 7f22026e2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6810/9229 osd protocol 0
 -04-26 04:53:07.276845 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6801/14901 osd protocol 0
 -04-26 04:53:07.492686 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6807/15124 osd protocol 0
 -04-26 04:53:07.561990 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016297 client protocol 0
 -04-26 04:53:07.725299 7f2202ae6700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/2016297 client protocol 0
 -04-26 04:53:08.103022 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6800/8669 mds protocol 0
 -04-26 04:53:08.924381 7f22022de700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:53:09.247556 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:53:09.291340 7f224af68700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017443 client protocol 0
 -04-26 04:53:09.737449 7f224eec0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6804/15010 osd protocol 0
 -04-26 04:53:10.092880 7f22026e2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6801/8813 osd protocol 0
 -04-26 04:53:10.316111 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6804/8931 osd protocol 0
 -04-26 04:53:10.788678 7f2202ae6700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6807/9109 osd protocol 0
 -04-26 04:53:11.069000 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6813/9355 osd protocol 0
 -04-26 04:53:11.264174 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6816/9474 osd protocol 0
 -04-26 04:53:11.351481 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016175 client protocol 0
 -04-26 04:53:11.520008 7f2202ce8700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017187 client protocol 0
 -04-26 04:53:14.927691 7f2202ce8700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:53:15.738135 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6804/15010 osd protocol 0
 -04-26 04:53:16.094150 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6801/8813 osd protocol 0
 -04-26 04:53:16.279088 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6801/14901 osd protocol 0
 -04-26 04:53:16.493892 7f2202ae6700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6807/15124 osd protocol 0
 -04-26 04:53:18.089326 7f2202ce8700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:53:18.103118 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6800/8669 mds protocol 0
 -04-26 04:53:18.227506 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6801/17890 osd protocol 0
 -04-26 04:53:18.444604 7f22026e2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6804/17898 osd protocol 0
 -04-26 04:53:19.247645 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:53:19.316835 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6804/8931 osd protocol 0
 -04-26 04:53:19.563395 7f2202ae6700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016297 client protocol 0
 -04-26 04:53:19.726567 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/2016297 client protocol 0
 -04-26 04:53:19.789916 7f224eec0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6807/9109 osd protocol 0
 -04-26 04:53:20.070451 7f224af68700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6813/9355 osd protocol 0
 -04-26 04:53:20.265343 7f22022de700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6816/9474 osd protocol 0
 -04-26 04:53:20.742637 7f22024e0700  0 -- 10.227.227.103:6789/0 >> 10.227.227.103:0/576935661 pipe(0x8ec9900 sd=36 :6789 s=0 pgs=0 cs=0 l=0).accept peer addr is really 10.227.227.103:0/576935661 (socket is 10.227.227.103:43948/0)
 -04-26 04:53:20.742667 7f22024e0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/576935661 client protocol 0
 -04-26 04:53:21.292039 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017443 client protocol 0
 -04-26 04:53:21.738761 7f22026e2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6804/15010 osd protocol 0
 -04-26 04:53:22.279823 7f2202ce8700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6801/14901 osd protocol 0
 -04-26 04:53:22.494298 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6807/15124 osd protocol 0
 -04-26 04:53:23.352851 7f22022de700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016175 client protocol 0
 -04-26 04:53:23.519625 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017187 client protocol 0
 -04-26 04:53:24.228123 7f224af68700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6801/17890 osd protocol 0
 -04-26 04:53:24.445017 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6804/17898 osd protocol 0
 -04-26 04:53:25.095137 7f22026e2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6801/8813 osd protocol 0
 -04-26 04:53:25.553638 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:53:26.925795 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:53:27.739303 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6804/15010 osd protocol 0
 -04-26 04:53:28.103333 7f22026e2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6800/8669 mds protocol 0
 -04-26 04:53:28.427924 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:53:28.564384 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016297 client protocol 0
 -04-26 04:53:28.727642 7f224af68700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/2016297 client protocol 0
 -04-26 04:53:29.926569 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:53:30.229105 7f22022de700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6801/17890 osd protocol 0
 -04-26 04:53:30.293404 7f2202ce8700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017443 client protocol 0
 -04-26 04:53:30.445707 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6804/17898 osd protocol 0
 -04-26 04:53:30.853265 7f22024e0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6810/9229 osd protocol 0
 -04-26 04:53:32.353929 7f224af68700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016175 client protocol 0
 -04-26 04:53:32.520398 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017187 client protocol 0
 -04-26 04:53:33.089845 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:53:34.247630 7f22024e0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:53:34.565360 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016297 client protocol 0
 -04-26 04:53:34.645480 7f2202ce8700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6801/17890 osd protocol 0
 -04-26 04:53:34.728299 7f22022de700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/2016297 client protocol 0
 -04-26 04:53:34.810704 7f22026e2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6804/17898 osd protocol 0
 -04-26 04:53:36.293399 7f2202ce8700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017443 client protocol 0
 -04-26 04:53:36.300149 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6807/15124 osd protocol 0
 -04-26 04:53:36.741492 7f22026e2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6804/15010 osd protocol 0
 -04-26 04:53:36.854068 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6810/9229 osd protocol 0
 -04-26 04:53:37.109445 7f224af68700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6801/14901 osd protocol 0
 -04-26 04:53:37.676352 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6807/17905 osd protocol 0
 -04-26 04:53:38.089563 7f22022de700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:53:38.103515 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6800/8669 mds protocol 0
 -04-26 04:53:38.354521 7f22026e2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016175 client protocol 0
 -04-26 04:53:38.520701 7f224af68700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017187 client protocol 0
 -04-26 04:53:39.741578 7f2202ce8700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6804/15010 osd protocol 0
 -04-26 04:53:40.319222 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6804/8931 osd protocol 0
 -04-26 04:53:40.792722 7f22024e0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6807/9109 osd protocol 0
 -04-26 04:53:41.073221 7f22022de700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6813/9355 osd protocol 0
 -04-26 04:53:41.267632 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6816/9474 osd protocol 0
 -04-26 04:53:42.854838 7f2202ce8700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6810/9229 osd protocol 0
 -04-26 04:53:43.427569 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:53:43.566630 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016297 client protocol 0
 -04-26 04:53:43.729093 7f224af68700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/2016297 client protocol 0
 -04-26 04:53:44.927642 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:53:45.230623 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6801/17890 osd protocol 0
 -04-26 04:53:45.293939 7f22022de700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017443 client protocol 0
 -04-26 04:53:45.447769 7f22024e0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6804/17898 osd protocol 0
 -04-26 04:53:46.097623 7f2202ce8700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6801/8813 osd protocol 0
 -04-26 04:53:46.282396 7f22026e2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6801/14901 osd protocol 0
 -04-26 04:53:46.497277 7f224eec0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6807/15124 osd protocol 0
 -04-26 04:53:47.355475 7f224af68700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016175 client protocol 0
 -04-26 04:53:47.521550 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017187 client protocol 0
 -04-26 04:53:48.855534 7f22024e0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6810/9229 osd protocol 0
 -04-26 04:53:49.320424 7f22026e2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6804/8931 osd protocol 0
 -04-26 04:53:49.793850 7f224eec0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6807/9109 osd protocol 0
 -04-26 04:53:50.074349 7f2202ce8700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6813/9355 osd protocol 0
 -04-26 04:53:50.268571 7f22022de700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6816/9474 osd protocol 0
 -04-26 04:53:50.802624 7f22031ec700  0 -- 10.227.227.103:6789/0 >> 10.227.227.103:0/576935661 pipe(0x8f7b680 sd=29 :6789 s=0 pgs=0 cs=0 l=0).accept peer addr is really 10.227.227.103:0/576935661 (socket is 10.227.227.103:44053/0)
 -04-26 04:53:50.802653 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/576935661 client protocol 0
 -04-26 04:53:50.928282 7f224af68700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:53:51.231580 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6801/17890 osd protocol 0
 -04-26 04:53:51.448131 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6804/17898 osd protocol 0
 -04-26 04:53:52.567619 7f22026e2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016297 client protocol 0
 -04-26 04:53:52.730131 7f22024e0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/2016297 client protocol 0
 -04-26 04:53:53.103524 7f224af68700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6800/8669 mds protocol 0
 -04-26 04:53:54.247930 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:53:54.295451 7f22022de700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017443 client protocol 0
 -04-26 04:53:54.743096 7f224f1c3700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6804/15010 osd protocol 0
 -04-26 04:53:54.856359 7f2202ce8700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6810/9229 osd protocol 0
 -04-26 04:53:55.098747 7f224eec0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6801/8813 osd protocol 0
 -04-26 04:53:55.284127 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6801/14901 osd protocol 0
 -04-26 04:53:55.321142 7f2202ae6700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6804/8931 osd protocol 0
 -04-26 04:53:55.498647 7f22020dc700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6807/15124 osd protocol 0
 -04-26 04:53:55.794555 7f22024e0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6807/9109 osd protocol 0
 -04-26 04:53:56.075078 7f22026e2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6813/9355 osd protocol 0
 -04-26 04:53:56.269322 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6816/9474 osd protocol 0
 -04-26 04:53:56.356470 7f2201eda700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016175 client protocol 0
 -04-26 04:53:56.522710 7f2201cd8700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017187 client protocol 0
 -04-26 04:53:56.929536 7f2201ad6700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:53:57.232248 7f22018d4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6801/17890 osd protocol 0
 -04-26 04:53:57.449221 7f22022de700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6804/17898 osd protocol 0
 -04-26 04:53:58.568355 7f22020dc700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016297 client protocol 0
 -04-26 04:53:58.730683 7f2202ae6700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/2016297 client protocol 0
 -04-26 04:53:59.247934 7f22026e2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:54:00.074814 7f22026e2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:54:00.295596 7f22018d4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017443 client protocol 0
 -04-26 04:54:01.099540 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6801/8813 osd protocol 0
 -04-26 04:54:01.321826 7f22022de700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6804/8931 osd protocol 0
 -04-26 04:54:01.795255 7f2202ae6700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6807/9109 osd protocol 0
 -04-26 04:54:02.075772 7f22020dc700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6813/9355 osd protocol 0
 -04-26 04:54:02.270128 7f2201cd8700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6816/9474 osd protocol 0
 -04-26 04:54:02.357353 7f2201eda700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016175 client protocol 0
 -04-26 04:54:02.522793 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017187 client protocol 0
 -04-26 04:54:02.929513 7f2202ae6700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:54:03.103942 7f2202ae6700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6800/8669 mds protocol 0
 -04-26 04:54:04.099935 7f22018d4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6801/8813 osd protocol 0
 -04-26 04:54:04.569119 7f22022de700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016297 client protocol 0
 -04-26 04:54:04.731184 7f22026e2700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/2016297 client protocol 0
 -04-26 04:54:04.795521 7f22031ec700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6807/9109 osd protocol 0
 -04-26 04:54:05.013873 7f22020dc700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6804/17898 osd protocol 0
 -04-26 04:54:05.076103 7f22024e0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6813/9355 osd protocol 0
 -04-26 04:54:05.121154 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6801/17890 osd protocol 0
 -04-26 04:54:06.296274 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017443 client protocol 0
 -04-26 04:54:06.470014 7f22020dc700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6816/9474 osd protocol 0
 -04-26 04:54:06.497996 7f2202eea700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6804/8931 osd protocol 0
 -04-26 04:54:06.744523 7f2201eda700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6804/15010 osd protocol 0
 -04-26 04:54:07.285304 7f22018d4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6801/14901 osd protocol 0
 -04-26 04:54:07.499627 7f2201eda700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6807/15124 osd protocol 0
 -04-26 04:54:08.089947 7f22024e0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:54:08.358072 7f22020dc700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016175 client protocol 0
 -04-26 04:54:08.524547 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017187 client protocol 0
 -04-26 04:54:09.234166 7f22024e0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6801/17890 osd protocol 0
 -04-26 04:54:09.450062 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6804/17898 osd protocol 0
 -04-26 04:54:10.100688 7f2202ae6700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6801/8813 osd protocol 0
 -04-26 04:54:12.745440 7f224b069700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6804/15010 osd protocol 0
 -04-26 04:54:13.286050 7f2202ae6700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6801/14901 osd protocol 0
 -04-26 04:54:13.500317 7f22024e0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6807/15124 osd protocol 0
 -04-26 04:54:13.570383 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016297 client protocol 0
 -04-26 04:54:13.732071 7f22020dc700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/2016297 client protocol 0
 -04-26 04:54:14.930717 7f2201eda700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:54:15.296642 7f22018d4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017443 client protocol 0
 -04-26 04:54:17.358961 7f22020dc700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016175 client protocol 0
 -04-26 04:54:17.524322 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:0/1017187 client protocol 0
 -04-26 04:54:17.673778 7f22024e0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6807/17905 osd protocol 0
 -04-26 04:54:18.089691 7f2201eda700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6800/14732 mds protocol 0
 -04-26 04:54:18.104270 7f2202ae6700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6800/8669 mds protocol 0
 -04-26 04:54:18.859557 7f22018d4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6810/9229 osd protocol 0
 -04-26 04:54:21.235171 7f2201eda700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6801/17890 osd protocol 0
 -04-26 04:54:21.451492 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6804/17898 osd protocol 0
 -04-26 04:54:22.287220 7f22024e0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6801/14901 osd protocol 0
 -04-26 04:54:22.501330 7f22018d4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.104:6807/15124 osd protocol 0
 -04-26 04:54:24.247937 7f2201eda700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:54:24.860299 7f224c8e4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:6810/9229 osd protocol 0
 -04-26 04:54:25.553466 7f2201eda700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.101:6800/17876 mds protocol 0
 -04-26 04:54:25.571870 7f22018d4700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/1016297 client protocol 0
 -04-26 04:54:25.733156 7f22024e0700 10 mon.3@1(peon) e1 ms_verify_authorizer 10.227.227.103:0/2016297 client protocol 0

« Previous
1
2
3
Next »

(3-3/3)

Project

General

Profile

Ceph

Bug #4811 » ceph-mon.3.log