cmccabe@flab:~/src/ceph/src$ ./test/test_unfound.sh run ++ dirname ./test/test_unfound.sh + source ./test/test_common.sh ++ init ++ setup_tempdir +++ mktemp -d ++ TEMPDIR=/tmp/tmp.hlGXRd9a0V ++ '[' -z ']' ++ trap cleanup INT TERM EXIT +++ dirname ./test/test_unfound.sh ++ cd ./test/.. + run + setup + ./stop.sh cmon: no process found cmds: no process found cosd: no process found + CEPH_NUM_OSD=2 + ./vstart.sh -d -n -o 'osd recovery delay start = 10000' ** going verbose ** cmon: no process found cmds: no process found cosd: no process found hostname flab ip 10.3.14.10 ./osdmaptool: osdmap file '.ceph_osdmap' ./osdmaptool: writing epoch 1 to .ceph_osdmap ./monmaptool --create --clobber --add a 10.3.14.10:6789 --add b 10.3.14.10:6790 --add c 10.3.14.10:6791 --print .ceph_monmap ./monmaptool: monmap file .ceph_monmap ./monmaptool: generated fsid 22f08e12-d7e2-5a19-44be-6a101002962d epoch 1 fsid 22f08e12-d7e2-5a19-44be-6a101002962d last_changed 2010-11-09 14:49:14.196720 created 2010-11-09 14:49:14.196720 0: 10.3.14.10:6789/0 mon.a 1: 10.3.14.10:6790/0 mon.b 2: 10.3.14.10:6791/0 mon.c ./monmaptool: writing epoch 1 to .ceph_monmap (3 monitors) ./cmon --mkfs -c ceph.conf -i a --monmap=.ceph_monmap --osdmap=.ceph_osdmap ** WARNING: Ceph is still under heavy development, and is only suitable for ** ** testing and review. Do not trust it with important data. ** can't open ~/.ceph/keyring.bin, /etc/ceph/keyring.bin, .ceph_keyring: Not a directory can't open ~/.ceph/keyring.bin, /etc/ceph/keyring.bin, .ceph_keyring: Not a directory can't open ~/.ceph/keyring.bin, /etc/ceph/keyring.bin, .ceph_keyring: Not a directory ./cmon: created monfs at dev/mon.a for mon.a ./cmon --mkfs -c ceph.conf -i b --monmap=.ceph_monmap --osdmap=.ceph_osdmap ** WARNING: Ceph is still under heavy development, and is only suitable for ** ** testing and review. Do not trust it with important data. ** can't open ~/.ceph/keyring.bin, /etc/ceph/keyring.bin, .ceph_keyring: Not a directory can't open ~/.ceph/keyring.bin, /etc/ceph/keyring.bin, .ceph_keyring: Not a directory can't open ~/.ceph/keyring.bin, /etc/ceph/keyring.bin, .ceph_keyring: Not a directory ./cmon: created monfs at dev/mon.b for mon.b ./cmon --mkfs -c ceph.conf -i c --monmap=.ceph_monmap --osdmap=.ceph_osdmap ** WARNING: Ceph is still under heavy development, and is only suitable for ** ** testing and review. Do not trust it with important data. ** can't open ~/.ceph/keyring.bin, /etc/ceph/keyring.bin, .ceph_keyring: Not a directory can't open ~/.ceph/keyring.bin, /etc/ceph/keyring.bin, .ceph_keyring: Not a directory can't open ~/.ceph/keyring.bin, /etc/ceph/keyring.bin, .ceph_keyring: Not a directory ./cmon: created monfs at dev/mon.c for mon.c ./cmon -i a -c ceph.conf ** WARNING: Ceph is still under heavy development, and is only suitable for ** ** testing and review. Do not trust it with important data. ** starting mon.a rank 0 at 10.3.14.10:6789/0 mon_data dev/mon.a fsid 22f08e12-d7e2-5a19-44be-6a101002962d ./cmon -i b -c ceph.conf ** WARNING: Ceph is still under heavy development, and is only suitable for ** ** testing and review. Do not trust it with important data. ** starting mon.b rank 1 at 10.3.14.10:6790/0 mon_data dev/mon.b fsid 22f08e12-d7e2-5a19-44be-6a101002962d ./cmon -i c -c ceph.conf ** WARNING: Ceph is still under heavy development, and is only suitable for ** ** testing and review. Do not trust it with important data. ** starting mon.c rank 2 at 10.3.14.10:6791/0 mon_data dev/mon.c fsid 22f08e12-d7e2-5a19-44be-6a101002962d Loading class: .libs/libcls_rbd.so.1.0.0: rbd 1.2 x86-64 read 168698 bytes from .libs/libcls_rbd.so.1.0.0 2010-11-09 14:49:18.960427 mon <- [class,add,rbd,1.2,x86-64,changed] 2010-11-09 14:49:19.867822 mon0 -> 'updated' (0) mkfs osd0 ./cosd -i 0 -c ceph.conf --mkfs ** WARNING: Ceph is still under heavy development, and is only suitable for ** ** testing and review. Do not trust it with important data. ** created object store dev/osd0 journal dev/osd0/journal for osd0 fsid 22f08e12-d7e2-5a19-44be-6a101002962d start osd0 ./cosd -i 0 -c ceph.conf ** WARNING: Ceph is still under heavy development, and is only suitable for ** ** testing and review. Do not trust it with important data. ** starting osd0 at 0.0.0.0:6800/28570 osd_data dev/osd0 dev/osd0/journal mkfs osd1 ./cosd -i 1 -c ceph.conf --mkfs ** WARNING: Ceph is still under heavy development, and is only suitable for ** ** testing and review. Do not trust it with important data. ** created object store dev/osd1 journal dev/osd1/journal for osd1 fsid 22f08e12-d7e2-5a19-44be-6a101002962d start osd1 ./cosd -i 1 -c ceph.conf ** WARNING: Ceph is still under heavy development, and is only suitable for ** ** testing and review. Do not trust it with important data. ** starting osd1 at 0.0.0.0:6802/28616 osd_data dev/osd1 dev/osd1/journal creating dev/mds.a.keyring read 119 bytes from dev/mds.a.keyring 2010-11-09 14:49:22.864401 mon <- [auth,add,mds.a] 2010-11-09 14:49:23.657627 mon0 -> 'added key for mds.a' (0) ./cmds -i a -c ceph.conf ** WARNING: Ceph is still under heavy development, and is only suitable for ** ** testing and review. Do not trust it with important data. ** starting mds.a at 0.0.0.0:6804/28648 creating dev/mds.b.keyring read 119 bytes from dev/mds.b.keyring 2010-11-09 14:49:24.663803 mon <- [auth,add,mds.b] 2010-11-09 14:49:25.998384 mon1 -> 'added key for mds.b' (0) ./cmds -i b -c ceph.conf ** WARNING: Ceph is still under heavy development, and is only suitable for ** ** testing and review. Do not trust it with important data. ** starting mds.b at 0.0.0.0:6805/28677 creating dev/mds.c.keyring read 119 bytes from dev/mds.c.keyring 2010-11-09 14:49:28.641581 mon <- [auth,add,mds.c] 2010-11-09 14:49:30.478241 mon1 -> 'added key for mds.c' (0) ./cmds -i c -c ceph.conf ** WARNING: Ceph is still under heavy development, and is only suitable for ** ** testing and review. Do not trust it with important data. ** starting mds.c at 0.0.0.0:6806/28708 ./ceph -c ceph.conf --debug-ms 20 --log-file /tmp/foo mds set_max_mds 3 2010-11-09 14:49:31.624212 mon <- [mds,set_max_mds,3] 2010-11-09 14:49:38.309047 mon1 -> 'max_mds = 3' (0) started. stop.sh to stop. see out/* (e.g. 'tail -f out/????') for debug output. + do_test + my_write_objects 1 2 + write_objects 1 2 10 1000000 + start_ver=1 + stop_ver=2 + num_objs=10 + obj_size=1000000 + '[' -d /tmp/tmp.hlGXRd9a0V ']' ++ seq 1 2 + for v in '`seq $start_ver $stop_ver`' ++ perl -e 'print chr(48+1)' + chr=1 + head -c 1000000 /dev/zero + tr '\0' 1 ++ seq -w 1 10 + for i in '`seq -w 1 $num_objs`' + ./rados -p data put obj01 /tmp/tmp.hlGXRd9a0V/ver1 --debug_objecter 20 --debug-ms 1 2010-11-09 14:49:38.350265 7f324f4cc720 -- :/28739 messenger.start 2010-11-09 14:49:38.350649 7f324f4cc720 -- :/28739 --> mon1 10.3.14.10:6790/0 -- auth(proto 0 30 bytes) v1 -- ?+0 0x181ad30 2010-11-09 14:49:38.351201 7f324f4cb710 -- 10.3.14.10:0/28739 learned my addr 10.3.14.10:0/28739 2010-11-09 14:49:41.350673 7f324cdd7710 -- 10.3.14.10:0/28739 mark_down 10.3.14.10:6790/0 -- 0x1817560 2010-11-09 14:49:41.350849 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- auth(proto 0 30 bytes) v1 -- ?+0 0x181ad30 2010-11-09 14:49:41.352594 7f324d5d8710 -- 10.3.14.10:0/28739 <== mon0 10.3.14.10:6789/0 1 ==== auth_reply(proto 1 0 Success) v1 ==== 24+0+0 (3938551213 0 0) 0x181ad30 2010-11-09 14:49:41.352665 7f324d5d8710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=0+}) v1 -- ?+0 0x181c3d0 2010-11-09 14:49:41.352799 7f324f4cc720 client4101.objecter maybe_request_map subscribing (onetime) to next osd map 2010-11-09 14:49:41.352848 7f324f4cc720 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=0+,osdmap=0}) v1 -- ?+0 0x181cad0 2010-11-09 14:49:41.352902 7f324f4cc720 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=0+,osdmap=0}) v1 -- ?+0 0x181cd00 2010-11-09 14:49:41.353758 7f324d5d8710 -- 10.3.14.10:0/28739 <== mon0 10.3.14.10:6789/0 2 ==== mon_map v1 ==== 469+0+0 (4143121982 0 0) 0x181cad0 2010-11-09 14:49:41.354135 7f324d5d8710 -- 10.3.14.10:0/28739 <== mon0 10.3.14.10:6789/0 3 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (1505718997 0 0) 0x181c3d0 2010-11-09 14:49:41.354430 7f324d5d8710 -- 10.3.14.10:0/28739 <== mon0 10.3.14.10:6789/0 4 ==== mon_map v1 ==== 469+0+0 (4143121982 0 0) 0x181cad0 2010-11-09 14:49:41.354846 7f324d5d8710 -- 10.3.14.10:0/28739 <== mon0 10.3.14.10:6789/0 5 ==== osd_map(6,6) v1 ==== 1670+0+0 (3505548248 0 0) 0x1818000 2010-11-09 14:49:41.354898 7f324d5d8710 client4101.objecter handle_osd_map got epochs [6,6] > 0 2010-11-09 14:49:41.354943 7f324d5d8710 client4101.objecter handle_osd_map decoding full epoch 6 2010-11-09 14:49:41.355473 7f324d5d8710 client4101.objecter scan_pgs 2010-11-09 14:49:41.355766 7f324d5d8710 -- 10.3.14.10:0/28739 <== mon0 10.3.14.10:6789/0 6 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (1505718997 0 0) 0x181c3d0 2010-11-09 14:49:41.356109 7f324d5d8710 -- 10.3.14.10:0/28739 <== mon0 10.3.14.10:6789/0 7 ==== mon_map v1 ==== 469+0+0 (4143121982 0 0) 0x181cad0 2010-11-09 14:49:41.356152 7f324d5d8710 -- 10.3.14.10:0/28739 <== mon0 10.3.14.10:6789/0 8 ==== osd_map(6,6) v1 ==== 1670+0+0 (3505548248 0 0) 0x181ccf0 2010-11-09 14:49:41.356170 7f324d5d8710 client4101.objecter handle_osd_map ignoring epochs [6,6] <= 6 2010-11-09 14:49:41.356185 7f324d5d8710 -- 10.3.14.10:0/28739 <== mon0 10.3.14.10:6789/0 9 ==== mon_subscribe_ack(300s) v1 ==== 20+0+0 (1505718997 0 0) 0x181c3d0 2010-11-09 14:49:41.357187 7f324f4cc720 client4101.objecter get_pg 0.92bd is new, [0,1] 2010-11-09 14:49:41.357216 7f324f4cc720 client4101.objecter note: not requesting commit 2010-11-09 14:49:41.357274 7f324f4cc720 client4101.objecter op_submit oid obj01 @0 [writefull 0~1000000] tid 1 osd0 2010-11-09 14:49:41.357326 7f324f4cc720 -- 10.3.14.10:0/28739 --> osd0 10.3.14.10:6800/28570 -- osd_op(client4101.0:1 obj01 [writefull 0~1000000] 0.92bd) v1 -- ?+0 0x18192d0 2010-11-09 14:49:41.357426 7f324f4cc720 client4101.objecter 1 unacked, 0 uncommitted 2010-11-09 14:49:44.424899 7f324d5d8710 -- 10.3.14.10:0/28739 <== osd0 10.3.14.10:6800/28570 1 ==== osd_op_reply(1 obj01 [writefull 0~1000000] ack = 0) v1 ==== 91+0+0 (4261451454 0 0) 0x1818000 2010-11-09 14:49:44.424955 7f324d5d8710 client4101.objecter in handle_osd_op_reply 2010-11-09 14:49:44.424975 7f324d5d8710 client4101.objecter handle_osd_op_reply 1 ack v 0'0 in 0.92bd 2010-11-09 14:49:44.425014 7f324d5d8710 client4101.objecter get_pg 0.92bd is old, [0,1] 2010-11-09 14:49:44.425028 7f324d5d8710 client4101.objecter handle_osd_op_reply ack 2010-11-09 14:49:44.425077 7f324d5d8710 client4101.objecter handle_osd_op_reply completed tid 1, pg 0.92bd still has 2010-11-09 14:49:44.425136 7f324d5d8710 client4101.objecter 0 unacked, 0 uncommitted 2010-11-09 14:49:44.425144 7f324d5d8710 client4101.objecter Calling onack->finish with rc 0 2010-11-09 14:49:44.425156 7f324d5d8710 client4101.objecter Finished onack-finish --- 2010-11-09 14:52:14.352387 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1818000 2010-11-09 14:52:24.352691 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1818000 2010-11-09 14:52:34.352832 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x18192d0 2010-11-09 14:52:44.352938 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1817b20 2010-11-09 14:52:54.353046 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181ca10 2010-11-09 14:53:04.353184 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1817cd0 2010-11-09 14:53:14.353322 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181cc10 2010-11-09 14:53:24.353475 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181ce10 2010-11-09 14:53:34.353626 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1819a20 2010-11-09 14:53:44.353777 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1819c10 2010-11-09 14:53:54.353923 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1819e10 2010-11-09 14:54:04.354061 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181a190 2010-11-09 14:54:14.354194 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181a390 2010-11-09 14:54:24.354342 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181a590 2010-11-09 14:54:34.354499 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181a790 2010-11-09 14:54:44.354650 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181a990 2010-11-09 14:54:54.354780 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181d270 2010-11-09 14:55:04.354912 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181d400 2010-11-09 14:55:14.355064 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181d590 2010-11-09 14:55:24.355194 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181d720 2010-11-09 14:55:34.355338 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181da90 2010-11-09 14:55:44.355472 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181dc20 2010-11-09 14:55:54.355607 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181ddb0 2010-11-09 14:56:04.355740 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181e190 2010-11-09 14:56:14.355887 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181e320 2010-11-09 14:56:24.356019 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181e4b0 2010-11-09 14:56:34.356161 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181e660 2010-11-09 14:56:44.356315 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181e8a0 2010-11-09 14:56:54.356460 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181eae0 2010-11-09 14:57:04.356590 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181ed20 2010-11-09 14:57:14.356731 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181ef60 2010-11-09 14:57:24.356863 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181f1a0 2010-11-09 14:57:34.357002 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181f3e0 2010-11-09 14:57:44.357111 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181f620 2010-11-09 14:57:54.357252 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181f860 2010-11-09 14:58:04.357376 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181faa0 2010-11-09 14:58:14.357518 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181fce0 2010-11-09 14:58:24.357657 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x181ff20 2010-11-09 14:58:34.357794 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1820160 2010-11-09 14:58:44.357930 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x18203a0 2010-11-09 14:58:54.358070 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x18205e0 2010-11-09 14:59:04.358198 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1820820 2010-11-09 14:59:14.358327 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1820a60 2010-11-09 14:59:24.358470 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1820ca0 2010-11-09 14:59:34.358626 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1820ee0 2010-11-09 14:59:44.358782 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1821120 2010-11-09 14:59:54.358916 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1821360 2010-11-09 15:00:04.359061 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x18215a0 2010-11-09 15:00:14.359206 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x18217e0 2010-11-09 15:00:24.359339 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1821a20 2010-11-09 15:00:34.359486 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1821c60 2010-11-09 15:00:44.359634 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1821ea0 2010-11-09 15:00:54.359772 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x18220e0 2010-11-09 15:01:04.359910 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1822320 2010-11-09 15:01:14.360039 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1822560 2010-11-09 15:01:24.360185 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x18227a0 2010-11-09 15:01:34.360339 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x18229e0 2010-11-09 15:01:44.360497 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1822c20 2010-11-09 15:01:54.360641 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1822e60 2010-11-09 15:02:04.360777 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x18230a0 2010-11-09 15:02:14.360928 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x18232e0 2010-11-09 15:02:24.361077 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1823520 2010-11-09 15:02:34.361215 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1823760 2010-11-09 15:02:44.361346 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x18239a0 2010-11-09 15:02:54.361493 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1823be0 2010-11-09 15:03:04.361643 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1823e20 2010-11-09 15:03:14.361796 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1824020 2010-11-09 15:03:24.361940 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x18242b0 2010-11-09 15:03:34.362090 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x18244b0 2010-11-09 15:03:44.362221 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x18246e0 2010-11-09 15:03:54.362349 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1824910 2010-11-09 15:04:04.362500 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1824b40 2010-11-09 15:04:14.362633 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1824d70 2010-11-09 15:04:24.362786 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1824fa0 2010-11-09 15:04:34.362938 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x18251d0 2010-11-09 15:04:44.363090 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1817560 2010-11-09 15:04:54.363237 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x18253b0 2010-11-09 15:05:04.363402 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1825540 2010-11-09 15:05:14.363536 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x18256f0 2010-11-09 15:05:24.363673 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1825930 2010-11-09 15:05:34.363826 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1825b70 2010-11-09 15:05:44.363964 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1825db0 2010-11-09 15:05:54.364102 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1826000 2010-11-09 15:06:04.364300 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1826370 2010-11-09 15:06:14.364504 7f324cdd7710 -- 10.3.14.10:0/28739 --> mon0 10.3.14.10:6789/0 -- mon_subscribe({monmap=2+}) v1 -- ?+0 0x1826500