2013-08-14 10:51:29.106382 7f4e87fe9780  0 ceph version 0.61.7 (8f010aff684e820ecc837c25ac77c7a05d7191ff), process ceph-mon, pid 1130
2013-08-14 10:51:29.232802 7f4e87fe9780 -1 failed to create new leveldb store
2013-08-14 11:02:02.794525 7facf897a780  0 ceph version 0.61.7 (8f010aff684e820ecc837c25ac77c7a05d7191ff), process ceph-mon, pid 1120
2013-08-14 11:02:02.797409 7facf897a780 -1 failed to create new leveldb store
2013-08-14 11:07:05.396113 7f112ec9e780  0 ceph version 0.61.7 (8f010aff684e820ecc837c25ac77c7a05d7191ff), process ceph-mon, pid 5926
2013-08-14 11:07:36.959381 7f42183a8780  0 ceph version 0.61.7 (8f010aff684e820ecc837c25ac77c7a05d7191ff), process ceph-mon, pid 6706
2013-08-14 11:07:36.967234 7f42183a8780  1 mon.b@-1(probing) e0 preinit fsid d5ebc320-db52-4b88-9ddc-0242a477fc8f
2013-08-14 11:07:37.044088 7f42183a8780  0 mon.b@-1(probing) e0  my rank is now 2 (was -1)
2013-08-14 11:07:37.045487 7f4211443700  0 -- 10.202.1.54:6789/0 >> 10.202.1.53:6789/0 pipe(0x15e0c80 sd=22 :0 s=1 pgs=0 cs=0 l=0).fault
2013-08-14 11:07:37.047716 7f4211342700  0 -- 10.202.1.54:6789/0 >> 10.202.1.51:6789/0 pipe(0x1607000 sd=24 :6789 s=0 pgs=0 cs=0 l=0).accept connect_seq 0 vs existing 0 state wait
2013-08-14 11:07:37.060307 7f4212445700  0 log [INF] : mon.b calling new monitor election
2013-08-14 11:07:37.060432 7f4212445700  1 mon.b@2(electing).elector(1) init, last seen epoch 1
2013-08-14 11:07:42.433313 7f4212445700  1 mon.b@2(peon).osd e1 e1: 0 osds: 0 up, 0 in
2013-08-14 11:07:51.521158 7f4212445700  0 mon.b@2(peon) e1 handle_command mon_command(auth get-or-create client.admin mon allow * osd allow * mds allow v 0) v1
2013-08-14 11:07:54.513939 7f4212445700  0 mon.b@2(peon) e1 handle_command mon_command(auth get-or-create client.admin mon allow * osd allow * mds allow v 0) v1
2013-08-14 11:07:54.910064 7f4212445700  0 mon.b@2(peon) e1 handle_command mon_command(auth get-or-create client.bootstrap-mds mon allow command auth get-or-create * osd allow\ * mds allow mon allow\ rwx; allow command mon getmap v 0) v1
2013-08-14 11:07:54.913508 7f4212445700  0 mon.b@2(peon) e1 handle_command mon_command(auth get-or-create client.bootstrap-mds mon allow command auth get-or-create * osd allow\ * mds allow mon allow\ rwx; allow command mon getmap v 0) v1
2013-08-14 11:07:58.083271 7f4211241700  0 -- 10.202.1.54:6789/0 >> 10.202.1.53:6789/0 pipe(0x1607c80 sd=23 :6789 s=0 pgs=0 cs=0 l=0).accept connect_seq 0 vs existing 0 state connecting
2013-08-14 11:07:58.346251 7f4212445700  1 mon.b@2(peon sync( provider state none )) e1 sync_provider_cleanup no longer a sync provider
2013-08-14 11:07:58.833078 7f4212445700  0 log [INF] : mon.b calling new monitor election
2013-08-14 11:07:58.833142 7f4212445700  1 mon.b@2(electing).elector(4) init, last seen epoch 4
2013-08-14 11:08:02.092764 7f4212445700  0 mon.b@2(peon) e1 handle_command mon_command(auth get-or-create client.admin mon allow * osd allow * mds allow v 0) v1
2013-08-14 11:08:03.196220 7f4212445700  1 mon.b@2(peon).osd e2 e2: 1 osds: 1 up, 1 in
2013-08-14 11:08:05.306645 7f4212445700  1 mon.b@2(peon).osd e3 e3: 1 osds: 1 up, 1 in
2013-08-14 11:08:07.165518 7f4212445700  1 mon.b@2(peon).osd e4 e4: 2 osds: 2 up, 2 in
2013-08-14 11:08:08.974878 7f4212445700  1 mon.b@2(peon).osd e5 e5: 3 osds: 3 up, 3 in
2013-08-14 11:08:10.883766 7f4212445700  1 mon.b@2(peon).osd e6 e6: 4 osds: 4 up, 4 in
2013-08-14 11:08:16.244903 7f4212445700  1 mon.b@2(peon).osd e7 e7: 5 osds: 5 up, 5 in
2013-08-14 11:08:18.816496 7f4212445700  0 mon.b@2(peon) e1 handle_command mon_command(osd crush create-or-move 5 1.77 root=default host=sn3 v 0) v1
2013-08-14 11:08:20.630232 7f4212445700  1 mon.b@2(peon).osd e8 e8: 6 osds: 6 up, 6 in
2013-08-14 11:08:33.430852 7f4212445700  0 mon.b@2(peon) e1 handle_command mon_command(status v 0) v1
2013-08-14 11:08:33.436040 7f4212445700  1 mon.b@2(peon).log v16 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 16)
2013-08-14 11:08:37.043431 7f4212c46700  0 mon.b@2(peon).data_health(6) update_stats avail 92% total 75933720 used 1729380 avail 70347092
2013-08-14 11:09:26.435422 7f4212445700  1 mon.b@2(peon).log v17 check_sub sending message to client.? 10.202.1.51:0/13766 with 7 entries (version 17)
2013-08-14 11:09:29.008542 7f4212445700  1 mon.b@2(peon).osd e9 e9: 6 osds: 6 up, 6 in
2013-08-14 11:09:30.277897 7f4212445700  1 mon.b@2(peon).log v18 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 18)
2013-08-14 11:09:32.087561 7f4212445700  1 mon.b@2(peon).osd e10 e10: 6 osds: 6 up, 6 in
2013-08-14 11:09:38.533661 7f4212445700  1 mon.b@2(peon).log v19 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 19)
2013-08-14 11:09:38.533798 7f4212c46700  0 mon.b@2(peon).data_health(6) update_stats avail 92% total 75933720 used 2069016 avail 70007456
2013-08-14 11:09:38.533911 7f4212445700 -1 mon.b@2(peon).paxos(paxos updating c 1..53) lease_expire from mon.0 10.202.1.51:6789/0 is 0.000396 seconds in the past; mons are probably laggy (or possibly clocks are too skewed)
2013-08-14 11:09:40.263303 7f4212445700  1 mon.b@2(peon).log v20 check_sub sending message to client.? 10.202.1.51:0/13766 with 8 entries (version 20)
2013-08-14 11:09:41.960367 7f4212445700  1 mon.b@2(peon).log v21 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 21)
2013-08-14 11:09:44.314446 7f4212445700  1 mon.b@2(peon).log v22 check_sub sending message to client.? 10.202.1.51:0/13766 with 5 entries (version 22)
2013-08-14 11:09:47.497596 7f4212445700  1 mon.b@2(peon).log v23 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 23)
2013-08-14 11:09:49.375344 7f4212445700  1 mon.b@2(peon).log v24 check_sub sending message to client.? 10.202.1.51:0/13766 with 3 entries (version 24)
2013-08-14 11:09:50.761086 7f4212445700  1 mon.b@2(peon).log v25 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 25)
2013-08-14 11:09:53.812518 7f4212445700  1 mon.b@2(peon).log v26 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 26)
2013-08-14 11:09:56.176748 7f4212445700  1 mon.b@2(peon).log v27 check_sub sending message to client.? 10.202.1.51:0/13766 with 5 entries (version 27)
2013-08-14 11:09:57.962557 7f4212445700  1 mon.b@2(peon).osd e11 e11: 6 osds: 5 up, 6 in
2013-08-14 11:09:59.289019 7f4212445700  1 mon.b@2(peon).log v28 check_sub sending message to client.? 10.202.1.51:0/13766 with 7 entries (version 28)
2013-08-14 11:10:01.138396 7f4212445700  1 mon.b@2(peon).log v29 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 29)
2013-08-14 11:10:02.743979 7f4212445700  1 mon.b@2(peon).osd e12 e12: 6 osds: 5 up, 6 in
2013-08-14 11:10:04.866106 7f4212445700  1 mon.b@2(peon).log v30 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 30)
2013-08-14 11:10:07.086017 7f4212445700  1 mon.b@2(peon).osd e13 e13: 6 osds: 5 up, 6 in
2013-08-14 11:10:08.240753 7f4212445700  1 mon.b@2(peon).log v31 check_sub sending message to client.? 10.202.1.51:0/13766 with 5 entries (version 31)
2013-08-14 11:10:09.733372 7f4212445700  1 mon.b@2(peon).osd e14 e14: 6 osds: 5 up, 6 in
2013-08-14 11:10:10.842158 7f4212445700  1 mon.b@2(peon).log v32 check_sub sending message to client.? 10.202.1.51:0/13766 with 5 entries (version 32)
2013-08-14 11:10:12.837729 7f4212445700  1 mon.b@2(peon).log v33 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 33)
2013-08-14 11:10:15.202672 7f4212445700  1 mon.b@2(peon).log v34 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 34)
2013-08-14 11:10:20.223746 7f4212445700  1 mon.b@2(peon).log v35 check_sub sending message to client.? 10.202.1.51:0/13766 with 4 entries (version 35)
2013-08-14 11:10:22.345140 7f4212445700  1 mon.b@2(peon).log v36 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 36)
2013-08-14 11:10:24.637133 7f4212445700  1 mon.b@2(peon).log v37 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 37)
2013-08-14 11:10:27.012564 7f4212445700  1 mon.b@2(peon).log v38 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 38)
2013-08-14 11:10:30.124407 7f4212445700  1 mon.b@2(peon).log v39 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 39)
2013-08-14 11:10:33.671879 7f4212445700  1 mon.b@2(peon).log v40 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 40)
2013-08-14 11:10:35.600347 7f4212445700  1 mon.b@2(peon).log v41 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 41)
2013-08-14 11:10:37.580796 7f4212445700  1 mon.b@2(peon).log v42 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 42)
2013-08-14 11:10:38.533914 7f4212c46700  0 mon.b@2(peon).data_health(6) update_stats avail 92% total 75933720 used 2076836 avail 69999636
2013-08-14 11:10:40.425980 7f4212445700  1 mon.b@2(peon).log v43 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 43)
2013-08-14 11:10:44.046676 7f4212445700  1 mon.b@2(peon).log v44 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 44)
2013-08-14 11:10:46.723777 7f4212445700  1 mon.b@2(peon).log v45 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 45)
2013-08-14 11:10:50.317453 7f4212445700  1 mon.b@2(peon).osd e15 e15: 6 osds: 5 up, 6 in
2013-08-14 11:10:51.195392 7f4212445700  1 mon.b@2(peon).log v46 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 46)
2013-08-14 11:10:54.431011 7f4212445700  1 mon.b@2(peon).osd e16 e16: 6 osds: 5 up, 6 in
2013-08-14 11:10:55.988460 7f4212445700  1 mon.b@2(peon).log v47 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 47)
2013-08-14 11:10:57.103768 7f4212445700  1 mon.b@2(peon).osd e17 e17: 6 osds: 5 up, 6 in
2013-08-14 11:10:59.773546 7f4212445700  1 mon.b@2(peon).log v48 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 48)
2013-08-14 11:11:00.329902 7f4212445700  1 mon.b@2(peon).osd e18 e18: 6 osds: 5 up, 6 in
2013-08-14 11:11:01.274060 7f4212445700  1 mon.b@2(peon).log v49 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 49)
2013-08-14 11:11:04.524899 7f4212445700  1 mon.b@2(peon).osd e19 e19: 6 osds: 5 up, 6 in
2013-08-14 11:11:05.409602 7f4212445700  1 mon.b@2(peon).log v50 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 50)
2013-08-14 11:11:07.010153 7f4212445700  1 mon.b@2(peon).osd e20 e20: 6 osds: 5 up, 6 in
2013-08-14 11:11:07.851417 7f4212445700  1 mon.b@2(peon).log v51 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 51)
2013-08-14 11:11:09.486210 7f4212445700  1 mon.b@2(peon).osd e21 e21: 6 osds: 5 up, 6 in
2013-08-14 11:11:10.397933 7f4212445700  1 mon.b@2(peon).log v52 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 52)
2013-08-14 11:11:10.830753 7f4212445700  1 mon.b@2(peon).osd e22 e22: 6 osds: 5 up, 6 in
2013-08-14 11:11:13.063403 7f4212445700  1 mon.b@2(peon).log v53 check_sub sending message to client.? 10.202.1.51:0/13766 with 3 entries (version 53)
2013-08-14 11:11:14.095120 7f4212445700  1 mon.b@2(peon).osd e23 e23: 6 osds: 5 up, 6 in
2013-08-14 11:11:16.552637 7f4212445700  1 mon.b@2(peon).log v54 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 54)
2013-08-14 11:11:18.914304 7f4212445700  1 mon.b@2(peon).osd e24 e24: 6 osds: 5 up, 6 in
2013-08-14 11:11:20.215923 7f4212445700  1 mon.b@2(peon).log v55 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 55)
2013-08-14 11:11:20.895307 7f4212445700  1 mon.b@2(peon).osd e25 e25: 6 osds: 5 up, 6 in
2013-08-14 11:11:21.777123 7f4212445700  1 mon.b@2(peon).log v56 check_sub sending message to client.? 10.202.1.51:0/13766 with 3 entries (version 56)
2013-08-14 11:11:25.858993 7f4212445700  1 mon.b@2(peon).log v57 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 57)
2013-08-14 11:11:27.190539 7f4212445700  1 mon.b@2(peon).osd e26 e26: 6 osds: 5 up, 6 in
2013-08-14 11:11:29.520878 7f4212445700  1 mon.b@2(peon).log v58 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 58)
2013-08-14 11:11:30.312144 7f4212445700  1 mon.b@2(peon).osd e27 e27: 6 osds: 5 up, 6 in
2013-08-14 11:11:31.325399 7f4212445700  1 mon.b@2(peon).log v59 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 59)
2013-08-14 11:11:34.889520 7f4212445700  1 mon.b@2(peon).log v60 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 60)
2013-08-14 11:11:36.049013 7f4212445700  1 mon.b@2(peon).log v61 check_sub sending message to client.? 10.202.1.51:0/13766 with 7 entries (version 61)
2013-08-14 11:11:37.382831 7f4212445700  1 mon.b@2(peon).log v62 check_sub sending message to client.? 10.202.1.51:0/13766 with 3 entries (version 62)
2013-08-14 11:11:38.534046 7f4212c46700  0 mon.b@2(peon).data_health(6) update_stats avail 92% total 75933720 used 2089244 avail 69987228
2013-08-14 11:11:39.379674 7f4212445700  1 mon.b@2(peon).log v63 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 63)
2013-08-14 11:11:40.774135 7f4212445700  1 mon.b@2(peon).log v64 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 64)
2013-08-14 11:11:42.229110 7f4212445700  1 mon.b@2(peon).log v65 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 65)
2013-08-14 11:11:43.339085 7f4212445700  1 mon.b@2(peon).log v66 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 66)
2013-08-14 11:11:44.763776 7f4212445700  1 mon.b@2(peon).log v67 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 67)
2013-08-14 11:11:47.503935 7f4212445700  1 mon.b@2(peon).log v68 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 68)
2013-08-14 11:11:52.624452 7f4212445700  1 mon.b@2(peon).log v69 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 69)
2013-08-14 11:11:56.826985 7f4212445700  1 mon.b@2(peon).osd e28 e28: 6 osds: 5 up, 6 in
2013-08-14 11:11:57.905799 7f4212445700  1 mon.b@2(peon).log v70 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 70)
2013-08-14 11:11:58.112341 7f4212445700  1 mon.b@2(peon).osd e29 e29: 6 osds: 5 up, 6 in
2013-08-14 11:11:59.429861 7f4212445700  1 mon.b@2(peon).osd e30 e30: 6 osds: 5 up, 6 in
2013-08-14 11:12:00.066471 7f4212445700  1 mon.b@2(peon).log v71 check_sub sending message to client.? 10.202.1.51:0/13766 with 4 entries (version 71)
2013-08-14 11:12:01.112446 7f4212445700  1 mon.b@2(peon).log v72 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 72)
2013-08-14 11:12:04.749575 7f4212445700  1 mon.b@2(peon).log v73 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 73)
2013-08-14 11:12:05.795606 7f4212445700  1 mon.b@2(peon).log v74 check_sub sending message to client.? 10.202.1.51:0/13766 with 7 entries (version 74)
2013-08-14 11:12:06.866499 7f4212445700  1 mon.b@2(peon).log v75 check_sub sending message to client.? 10.202.1.51:0/13766 with 4 entries (version 75)
2013-08-14 11:12:08.116585 7f4212445700  1 mon.b@2(peon).log v76 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 76)
2013-08-14 11:12:09.180342 7f4212445700  1 mon.b@2(peon).log v77 check_sub sending message to client.? 10.202.1.51:0/13766 with 9 entries (version 77)
2013-08-14 11:12:10.483693 7f4212445700  1 mon.b@2(peon).log v78 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 78)
2013-08-14 11:12:12.679063 7f4212445700  1 mon.b@2(peon).log v79 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 79)
2013-08-14 11:12:13.921247 7f4212445700  1 mon.b@2(peon).log v80 check_sub sending message to client.? 10.202.1.51:0/13766 with 9 entries (version 80)
2013-08-14 11:12:15.152443 7f4212445700  1 mon.b@2(peon).log v81 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 81)
2013-08-14 11:12:16.476186 7f4212445700  1 mon.b@2(peon).log v82 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 82)
2013-08-14 11:12:17.525690 7f4212445700  1 mon.b@2(peon).log v83 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 83)
2013-08-14 11:12:19.667767 7f4212445700  1 mon.b@2(peon).log v84 check_sub sending message to client.? 10.202.1.51:0/13766 with 7 entries (version 84)
2013-08-14 11:12:21.819305 7f4212445700  1 mon.b@2(peon).log v85 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 85)
2013-08-14 11:12:23.001660 7f4212445700  1 mon.b@2(peon).log v86 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 86)
2013-08-14 11:12:24.184050 7f4212445700  1 mon.b@2(peon).log v87 check_sub sending message to client.? 10.202.1.51:0/13766 with 7 entries (version 87)
2013-08-14 11:12:26.508550 7f4212445700  1 mon.b@2(peon).log v88 check_sub sending message to client.? 10.202.1.51:0/13766 with 4 entries (version 88)
2013-08-14 11:12:27.700852 7f4212445700  1 mon.b@2(peon).log v89 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 89)
2013-08-14 11:12:29.044021 7f4212445700  1 mon.b@2(peon).log v90 check_sub sending message to client.? 10.202.1.51:0/13766 with 3 entries (version 90)
2013-08-14 11:12:31.540338 7f4212445700  1 mon.b@2(peon).log v91 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 91)
2013-08-14 11:12:33.187212 7f4212445700  1 mon.b@2(peon).log v92 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 92)
2013-08-14 11:12:34.339706 7f4212445700  1 mon.b@2(peon).log v93 check_sub sending message to client.? 10.202.1.51:0/13766 with 11 entries (version 93)
2013-08-14 11:12:35.652922 7f4212445700  1 mon.b@2(peon).log v94 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 94)
2013-08-14 11:12:36.806084 7f4212445700  1 mon.b@2(peon).log v95 check_sub sending message to client.? 10.202.1.51:0/13766 with 3 entries (version 95)
2013-08-14 11:12:37.981759 7f4212445700  1 mon.b@2(peon).log v96 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 96)
2013-08-14 11:12:38.534175 7f4212c46700  0 mon.b@2(peon).data_health(6) update_stats avail 92% total 75933720 used 2096372 avail 69980100
2013-08-14 11:12:39.040588 7f4212445700  1 mon.b@2(peon).log v97 check_sub sending message to client.? 10.202.1.51:0/13766 with 7 entries (version 97)
2013-08-14 11:12:40.231220 7f4212445700  1 mon.b@2(peon).log v98 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 98)
2013-08-14 11:12:42.494321 7f4212445700  1 mon.b@2(peon).log v99 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 99)
2013-08-14 11:12:43.697047 7f4212445700  1 mon.b@2(peon).log v100 check_sub sending message to client.? 10.202.1.51:0/13766 with 8 entries (version 100)
2013-08-14 11:12:44.889046 7f4212445700  1 mon.b@2(peon).log v101 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 101)
2013-08-14 11:12:47.768491 7f4212445700  1 mon.b@2(peon).log v102 check_sub sending message to client.? 10.202.1.51:0/13766 with 4 entries (version 102)
2013-08-14 11:12:49.496381 7f4212445700  1 mon.b@2(peon).log v103 check_sub sending message to client.? 10.202.1.51:0/13766 with 4 entries (version 103)
2013-08-14 11:12:52.001852 7f4212445700  1 mon.b@2(peon).log v104 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 104)
2013-08-14 11:12:54.204714 7f4212445700  1 mon.b@2(peon).log v105 check_sub sending message to client.? 10.202.1.51:0/13766 with 8 entries (version 105)
2013-08-14 11:12:55.386581 7f4212445700  1 mon.b@2(peon).log v106 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 106)
2013-08-14 11:12:56.599515 7f4212445700  1 mon.b@2(peon).log v107 check_sub sending message to client.? 10.202.1.51:0/13766 with 8 entries (version 107)
2013-08-14 11:12:57.761364 7f4212445700  1 mon.b@2(peon).log v108 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 108)
2013-08-14 11:12:59.135855 7f4212445700  1 mon.b@2(peon).log v109 check_sub sending message to client.? 10.202.1.51:0/13766 with 6 entries (version 109)
2013-08-14 11:13:02.136172 7f4212445700  1 mon.b@2(peon).log v110 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 110)
2013-08-14 11:13:03.500362 7f4212445700  1 mon.b@2(peon).log v111 check_sub sending message to client.? 10.202.1.51:0/13766 with 6 entries (version 111)
2013-08-14 11:13:04.712715 7f4212445700  1 mon.b@2(peon).log v112 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 112)
2013-08-14 11:13:07.255909 7f4212445700  1 mon.b@2(peon).log v113 check_sub sending message to client.? 10.202.1.51:0/13766 with 5 entries (version 113)
2013-08-14 11:13:09.442770 7f4212445700  1 mon.b@2(peon).log v114 check_sub sending message to client.? 10.202.1.51:0/13766 with 14 entries (version 114)
2013-08-14 11:13:11.664776 7f4212445700  1 mon.b@2(peon).log v115 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 115)
2013-08-14 11:13:13.776584 7f4212445700  1 mon.b@2(peon).log v116 check_sub sending message to client.? 10.202.1.51:0/13766 with 9 entries (version 116)
2013-08-14 11:13:16.756606 7f4212445700  1 mon.b@2(peon).log v117 check_sub sending message to client.? 10.202.1.51:0/13766 with 3 entries (version 117)
2013-08-14 11:13:19.060319 7f4212445700  1 mon.b@2(peon).log v118 check_sub sending message to client.? 10.202.1.51:0/13766 with 6 entries (version 118)
2013-08-14 11:13:21.606257 7f4212445700  1 mon.b@2(peon).log v119 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 119)
2013-08-14 11:13:23.748445 7f4212445700  1 mon.b@2(peon).log v120 check_sub sending message to client.? 10.202.1.51:0/13766 with 10 entries (version 120)
2013-08-14 11:13:24.940323 7f4212445700  1 mon.b@2(peon).log v121 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 121)
2013-08-14 11:13:27.183273 7f4212445700  1 mon.b@2(peon).log v122 check_sub sending message to client.? 10.202.1.51:0/13766 with 5 entries (version 122)
2013-08-14 11:13:28.648509 7f4212445700  1 mon.b@2(peon).log v123 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 123)
2013-08-14 11:13:29.689537 7f4212445700  1 mon.b@2(peon).log v124 check_sub sending message to client.? 10.202.1.51:0/13766 with 7 entries (version 124)
2013-08-14 11:13:31.834887 7f4212445700  1 mon.b@2(peon).log v125 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 125)
2013-08-14 11:13:33.265985 7f4212445700  1 mon.b@2(peon).log v126 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 126)
2013-08-14 11:13:34.650357 7f4212445700  1 mon.b@2(peon).log v127 check_sub sending message to client.? 10.202.1.51:0/13766 with 10 entries (version 127)
2013-08-14 11:13:36.895112 7f4212445700  1 mon.b@2(peon).log v128 check_sub sending message to client.? 10.202.1.51:0/13766 with 3 entries (version 128)
2013-08-14 11:13:38.534295 7f4212c46700  0 mon.b@2(peon).data_health(6) update_stats avail 92% total 75933720 used 2099268 avail 69977204
2013-08-14 11:13:39.147293 7f4212445700  1 mon.b@2(peon).log v129 check_sub sending message to client.? 10.202.1.51:0/13766 with 8 entries (version 129)
2013-08-14 11:13:40.591937 7f4212445700  1 mon.b@2(peon).log v130 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 130)
2013-08-14 11:13:42.784220 7f4212445700  1 mon.b@2(peon).log v131 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 131)
2013-08-14 11:13:44.613743 7f4212445700  1 mon.b@2(peon).log v132 check_sub sending message to client.? 10.202.1.51:0/13766 with 10 entries (version 132)
2013-08-14 11:13:46.563039 7f4212445700  1 mon.b@2(peon).log v133 check_sub sending message to client.? 10.202.1.51:0/13766 with 5 entries (version 133)
2013-08-14 11:13:47.947508 7f4212445700  1 mon.b@2(peon).log v134 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 134)
2013-08-14 11:13:49.029296 7f4212445700  1 mon.b@2(peon).log v135 check_sub sending message to client.? 10.202.1.51:0/13766 with 12 entries (version 135)
2013-08-14 11:13:50.221327 7f4212445700  1 mon.b@2(peon).log v136 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 136)
2013-08-14 11:13:52.413248 7f4212445700  1 mon.b@2(peon).log v137 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 137)
2013-08-14 11:13:53.727507 7f4212445700  1 mon.b@2(peon).log v138 check_sub sending message to client.? 10.202.1.51:0/13766 with 8 entries (version 138)
2013-08-14 11:13:56.525739 7f4212445700  1 mon.b@2(peon).log v139 check_sub sending message to client.? 10.202.1.51:0/13766 with 3 entries (version 139)
2013-08-14 11:13:58.678404 7f4212445700  1 mon.b@2(peon).log v140 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 140)
2013-08-14 11:13:59.809434 7f4212445700  1 mon.b@2(peon).log v141 check_sub sending message to client.? 10.202.1.51:0/13766 with 11 entries (version 141)
2013-08-14 11:14:02.082302 7f4212445700  1 mon.b@2(peon).log v142 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 142)
2013-08-14 11:14:03.576453 7f4212445700  1 mon.b@2(peon).log v143 check_sub sending message to client.? 10.202.1.51:0/13766 with 3 entries (version 143)
2013-08-14 11:14:04.658872 7f4212445700  1 mon.b@2(peon).log v144 check_sub sending message to client.? 10.202.1.51:0/13766 with 4 entries (version 144)
2013-08-14 11:14:06.821939 7f4212445700  1 mon.b@2(peon).log v145 check_sub sending message to client.? 10.202.1.51:0/13766 with 4 entries (version 145)
2013-08-14 11:14:08.207570 7f4212445700  1 mon.b@2(peon).log v146 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 146)
2013-08-14 11:14:09.378867 7f4212445700  1 mon.b@2(peon).log v147 check_sub sending message to client.? 10.202.1.51:0/13766 with 8 entries (version 147)
2013-08-14 11:14:10.732399 7f4212445700  1 mon.b@2(peon).log v148 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 148)
2013-08-14 11:14:13.004622 7f4212445700  1 mon.b@2(peon).log v149 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 149)
2013-08-14 11:14:14.065559 7f4212445700  1 mon.b@2(peon).log v150 check_sub sending message to client.? 10.202.1.51:0/13766 with 7 entries (version 150)
2013-08-14 11:14:15.298167 7f4212445700  1 mon.b@2(peon).log v151 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 151)
2013-08-14 11:14:16.380476 7f4212445700  1 mon.b@2(peon).log v152 check_sub sending message to client.? 10.202.1.51:0/13766 with 5 entries (version 152)
2013-08-14 11:14:17.643284 7f4212445700  1 mon.b@2(peon).log v153 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 153)
2013-08-14 11:14:18.835679 7f4212445700  1 mon.b@2(peon).log v154 check_sub sending message to client.? 10.202.1.51:0/13766 with 3 entries (version 154)
2013-08-14 11:14:19.896792 7f4212445700  1 mon.b@2(peon).log v155 check_sub sending message to client.? 10.202.1.51:0/13766 with 3 entries (version 155)
2013-08-14 11:14:22.321574 7f4212445700  1 mon.b@2(peon).log v156 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 156)
2013-08-14 11:14:23.614726 7f4212445700  1 mon.b@2(peon).log v157 check_sub sending message to client.? 10.202.1.51:0/13766 with 3 entries (version 157)
2013-08-14 11:14:26.554665 7f4212445700  1 mon.b@2(peon).log v158 check_sub sending message to client.? 10.202.1.51:0/13766 with 6 entries (version 158)
2013-08-14 11:14:27.736619 7f4212445700  1 mon.b@2(peon).log v159 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 159)
2013-08-14 11:14:29.091216 7f4212445700  1 mon.b@2(peon).log v160 check_sub sending message to client.? 10.202.1.51:0/13766 with 6 entries (version 160)
2013-08-14 11:14:31.759165 7f4212445700  1 mon.b@2(peon).log v161 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 161)
2013-08-14 11:14:33.486862 7f4212445700  1 mon.b@2(peon).log v162 check_sub sending message to client.? 10.202.1.51:0/13766 with 7 entries (version 162)
2013-08-14 11:14:34.559681 7f4212445700  1 mon.b@2(peon).log v163 check_sub sending message to client.? 10.202.1.51:0/13766 with 5 entries (version 163)
2013-08-14 11:14:36.770333 7f4212445700  1 mon.b@2(peon).log v164 check_sub sending message to client.? 10.202.1.51:0/13766 with 4 entries (version 164)
2013-08-14 11:14:37.960649 7f4212445700  1 mon.b@2(peon).log v165 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 165)
2013-08-14 11:14:38.534421 7f4212c46700  0 mon.b@2(peon).data_health(6) update_stats avail 92% total 75933720 used 1770464 avail 70306008
2013-08-14 11:14:39.225930 7f4212445700  1 mon.b@2(peon).log v166 check_sub sending message to client.? 10.202.1.51:0/13766 with 3 entries (version 166)
2013-08-14 11:14:41.650538 7f4212445700  1 mon.b@2(peon).log v167 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 167)
2013-08-14 11:14:43.792658 7f4212445700  1 mon.b@2(peon).log v168 check_sub sending message to client.? 10.202.1.51:0/13766 with 9 entries (version 168)
2013-08-14 11:14:44.994676 7f4212445700  1 mon.b@2(peon).log v169 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 169)
2013-08-14 11:14:47.187348 7f4212445700  1 mon.b@2(peon).log v170 check_sub sending message to client.? 10.202.1.51:0/13766 with 6 entries (version 170)
2013-08-14 11:14:49.167610 7f4212445700  1 mon.b@2(peon).log v171 check_sub sending message to client.? 10.202.1.51:0/13766 with 7 entries (version 171)
2013-08-14 11:14:51.582023 7f4212445700  1 mon.b@2(peon).log v172 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 172)
2013-08-14 11:14:53.825095 7f4212445700  1 mon.b@2(peon).log v173 check_sub sending message to client.? 10.202.1.51:0/13766 with 8 entries (version 173)
2013-08-14 11:14:56.613163 7f4212445700  1 mon.b@2(peon).log v174 check_sub sending message to client.? 10.202.1.51:0/13766 with 3 entries (version 174)
2013-08-14 11:14:59.078584 7f4212445700  1 mon.b@2(peon).log v175 check_sub sending message to client.? 10.202.1.51:0/13766 with 6 entries (version 175)
2013-08-14 11:15:00.833863 7f4212445700  1 mon.b@2(peon).osd e31 e31: 6 osds: 5 up, 5 in
2013-08-14 11:15:01.636020 7f4212445700  1 mon.b@2(peon).log v176 check_sub sending message to client.? 10.202.1.51:0/13766 with 3 entries (version 176)
2013-08-14 11:15:01.867233 7f4212445700  1 mon.b@2(peon).osd e32 e32: 6 osds: 5 up, 5 in
2013-08-14 11:15:02.717742 7f4212445700  1 mon.b@2(peon).log v177 check_sub sending message to client.? 10.202.1.51:0/13766 with 3 entries (version 177)
2013-08-14 11:15:04.383156 7f4212445700  1 mon.b@2(peon).osd e33 e33: 6 osds: 5 up, 5 in
2013-08-14 11:15:05.415983 7f4212445700  1 mon.b@2(peon).log v178 check_sub sending message to client.? 10.202.1.51:0/13766 with 10 entries (version 178)
2013-08-14 11:15:05.727644 7f4212445700  1 mon.b@2(peon).osd e34 e34: 6 osds: 5 up, 5 in
2013-08-14 11:15:06.870866 7f4212445700  1 mon.b@2(peon).log v179 check_sub sending message to client.? 10.202.1.51:0/13766 with 4 entries (version 179)
2013-08-14 11:15:08.431330 7f4212445700  1 mon.b@2(peon).log v180 check_sub sending message to client.? 10.202.1.51:0/13766 with 2 entries (version 180)
2013-08-14 11:15:09.865484 7f4212445700  1 mon.b@2(peon).log v181 check_sub sending message to client.? 10.202.1.51:0/13766 with 6 entries (version 181)
2013-08-14 11:15:12.183582 7f4212445700  1 mon.b@2(peon).log v182 check_sub sending message to client.? 10.202.1.51:0/13766 with 1 entries (version 182)