2015-08-06 01:00:58.294782 7fd57c264700 10 mon-018@2(peon).osd e528892 check_sub 0x1c4b1280 next 528892 (onetime)
2015-08-06 01:00:58.294790 7fd57c264700 5 mon-018@2(peon).osd e528892 send_incremental [528892..528892] to client.81113180 10.202.48.22:0/1302109
2015-08-06 01:00:58.294815 7fd57c264700 10 mon-018@2(peon).osd e528892 build_incremental [528892..528892]
2015-08-06 01:00:58.335493 7fd57c264700 10 mon-018@2(peon).osd e528892 check_sub 0x72c20c0 next 528892 (onetime)
2015-08-06 01:00:58.335508 7fd57c264700 5 mon-018@2(peon).osd e528892 send_incremental [528892..528892] to client.81122956 10.202.48.29:0/1040905
2015-08-06 01:00:58.335512 7fd57c264700 10 mon-018@2(peon).osd e528892 build_incremental [528892..528892]
40678 ms from build_incremental()
to the next check_sub()
. in this case, a lease timeout followed.
2015-08-07 02:07:07.063950 7f475f98d700 10 mon-018@2(peon).osd e529993 check_sub 0x17c94340 next 529993 (onetime)
2015-08-07 02:07:07.063961 7f475f98d700 5 mon-018@2(peon).osd e529993 send_incremental [529993..529993] to client.84840059 10.202.48.34:0/2331792
2015-08-07 02:07:07.063974 7f475f98d700 10 mon-018@2(peon).osd e529993 build_incremental [529993..529993]
2015-08-07 02:07:07.064150 7f475f98d700 10 mon-018@2(peon).osd e529993 check_sub 0x1bf26a00 next 529993 (onetime)
2015-08-07 02:07:07.064159 7f475f98d700 5 mon-018@2(peon).osd e529993 send_incremental [529993..529993] to client.80986206 10.202.48.26:0/1364503
2015-08-07 02:07:07.064167 7f475f98d700 10 mon-018@2(peon).osd e529993 build_incremental [529993..529993]
2015-08-07 02:07:07.064268 7f475f98d700 10 mon-018@2(peon).osd e529993 check_sub 0x1baae100 next 529993 (onetime)
176 ms from build_incremental()
to the next check_sub()
.
ubuntu@teuthology $ grep '29993..529993' mon.18.log | grep send_incremental | head -n1
2015-08-07 02:07:07.063961 7f475f98d700 5 mon-018@2(peon).osd e529993 send_incremental [529993..529993] to client.84840059 10.202.48.34:0/2331792
ubuntu@teuthology $ grep '29993..529993' mon.18.log | grep send_incremental | tail -n1
2015-08-07 02:07:07.270799 7f475f98d700 5 mon-018@2(peon).osd e529993 send_incremental [529993..529993] to osd.411 10.202.49.16:6821/29473
ubuntu@teuthology$ grep '29993..529993' mon.18.log | grep send_incremental | awk '{print $10}' |less | cut -d'.' -f1|grep client | wc -l
729
and it replied 728 osdmap subscriptions in 206838 ms, i.e. 0.2 s.
$ grep '29993..529993' mon.18.log | grep send_incremental | awk '{print $11}' | cut -d':' -f1 | sort | uniq | wc -l
79
they comes from 79 ip addresses. so the monitor performed well with the same load.