Project

General

Profile

Bug #39156 » ceph-osd.3.log

more verbose log from failing OSD - Guillaume Abrioux, 04/15/2019 02:26 PM

 
2019-04-15 12:14:25.659 7f76d9a85f00 0 set uid:gid to 64045:64045 (ceph:ceph)
2019-04-15 12:14:25.659 7f76d9a85f00 0 ceph version 14.2.0 (3a54b2b6d167d4a2a19e003a705696d4fe619afc) nautilus (stable), process ceph-osd, pid 123240
2019-04-15 12:14:25.659 7f76d9a85f00 20 Event(0x562fd28e0bc0 nevent=5000 time_id=2).wakeup
2019-04-15 12:14:25.659 7f76d9a85f00 20 Event(0x562fd28e1280 nevent=5000 time_id=1).wakeup
2019-04-15 12:14:25.659 7f76d9a85f00 20 Event(0x562fd28e14c0 nevent=5000 time_id=1).wakeup
2019-04-15 12:14:25.659 7f76d9a85f00 0 pidfile_write: ignore empty --pid-file
2019-04-15 12:14:25.663 7f76d9a85f00 10 bluestore(/var/lib/ceph/osd/ceph-3/) set_cache_shards 1
2019-04-15 12:14:25.663 7f76d9a85f00 1 bluestore(/var/lib/ceph/osd/ceph-3/) mkfs path /var/lib/ceph/osd/ceph-3/
2019-04-15 12:14:25.663 7f76d9a85f00 10 bluestore(/var/lib/ceph/osd/ceph-3//block) _read_bdev_label
2019-04-15 12:14:25.663 7f76d9a85f00 2 bluestore(/var/lib/ceph/osd/ceph-3//block) _read_bdev_label unable to decode label at offset 102: buffer::malformed_input: void bluestore_bdev_label_t::decode(ceph::buffer::v14_2_0::list::const_iterator&) decode past end of struct encoding
2019-04-15 12:14:25.663 7f76d9a85f00 10 bluestore(/var/lib/ceph/osd/ceph-3//block) _read_bdev_label
2019-04-15 12:14:25.663 7f76d9a85f00 2 bluestore(/var/lib/ceph/osd/ceph-3//block) _read_bdev_label unable to decode label at offset 102: buffer::malformed_input: void bluestore_bdev_label_t::decode(ceph::buffer::v14_2_0::list::const_iterator&) decode past end of struct encoding
2019-04-15 12:14:25.663 7f76d9a85f00 10 bluestore(/var/lib/ceph/osd/ceph-3//block) _read_bdev_label
2019-04-15 12:14:25.663 7f76d9a85f00 2 bluestore(/var/lib/ceph/osd/ceph-3//block) _read_bdev_label unable to decode label at offset 102: buffer::malformed_input: void bluestore_bdev_label_t::decode(ceph::buffer::v14_2_0::list::const_iterator&) decode past end of struct encoding
2019-04-15 12:14:25.663 7f76d9a85f00 -1 bluestore(/var/lib/ceph/osd/ceph-3/) _read_fsid unparsable uuid
2019-04-15 12:14:25.663 7f76d9a85f00 1 bluestore(/var/lib/ceph/osd/ceph-3/) mkfs using provided fsid 90385b3d-fe47-4c1d-92e0-0735a0ce5c14
2019-04-15 12:14:25.663 7f76d9a85f00 20 bluestore(/var/lib/ceph/osd/ceph-3/) _setup_block_symlink_or_file name block path size 10737418240 create=1
2019-04-15 12:14:25.663 7f76d9a85f00 20 bluestore(/var/lib/ceph/osd/ceph-3/) _setup_block_symlink_or_file name block.wal path size 100663296 create=0
2019-04-15 12:14:25.663 7f76d9a85f00 20 bluestore(/var/lib/ceph/osd/ceph-3/) _setup_block_symlink_or_file name block.db path /dev/journals/journal1 size 0 create=0
2019-04-15 12:14:25.663 7f76d9a85f00 1 bdev create path /var/lib/ceph/osd/ceph-3//block type kernel
2019-04-15 12:14:25.663 7f76d9a85f00 1 bdev(0x562fd3766700 /var/lib/ceph/osd/ceph-3//block) open path /var/lib/ceph/osd/ceph-3//block
2019-04-15 12:14:25.663 7f76d9a85f00 1 bdev(0x562fd3766700 /var/lib/ceph/osd/ceph-3//block) open size 13421772800 (0x320000000, 12 GiB) block_size 4096 (4 KiB) rotational discard supported
2019-04-15 12:14:25.663 7f76d9a85f00 10 bluestore(/var/lib/ceph/osd/ceph-3//block) _write_bdev_label path /var/lib/ceph/osd/ceph-3//block label bdev(osd_uuid 90385b3d-fe47-4c1d-92e0-0735a0ce5c14, size 0x320000000, btime 2019-04-15 12:14:25.669429, desc main, 0 meta)
2019-04-15 12:14:25.691 7f76d9a85f00 1 bluestore(/var/lib/ceph/osd/ceph-3/) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
2019-04-15 12:14:25.691 7f76d9a85f00 10 bluestore(/var/lib/ceph/osd/ceph-3/) _open_db kv_backend = rocksdb
2019-04-15 12:14:25.691 7f76d9a85f00 10 bluestore(/var/lib/ceph/osd/ceph-3/) _open_db do_bluefs = 1
2019-04-15 12:14:25.691 7f76d9a85f00 10 bluestore(/var/lib/ceph/osd/ceph-3/) _open_db initializing bluefs
2019-04-15 12:14:25.691 7f76d9a85f00 10 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-3//block.db
2019-04-15 12:14:25.691 7f76d9a85f00 1 bdev create path /var/lib/ceph/osd/ceph-3//block.db type kernel
2019-04-15 12:14:25.691 7f76d9a85f00 1 bdev(0x562fd3766a80 /var/lib/ceph/osd/ceph-3//block.db) open path /var/lib/ceph/osd/ceph-3//block.db
2019-04-15 12:14:25.691 7f76d9a85f00 1 bdev(0x562fd3766a80 /var/lib/ceph/osd/ceph-3//block.db) open size 26839351296 (0x63fc00000, 25 GiB) block_size 4096 (4 KiB) rotational discard supported
2019-04-15 12:14:25.691 7f76d9a85f00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-3//block.db size 25 GiB
2019-04-15 12:14:25.691 7f76d9a85f00 10 bluestore(/var/lib/ceph/osd/ceph-3//block.db) _write_bdev_label path /var/lib/ceph/osd/ceph-3//block.db label bdev(osd_uuid 90385b3d-fe47-4c1d-92e0-0735a0ce5c14, size 0x63fc00000, btime 2019-04-15 12:14:25.694534, desc bluefs db, 0 meta)
2019-04-15 12:14:25.707 7f76d9a85f00 1 bluefs _add_block_extent bdev 1 0x2000~63fbfe000
2019-04-15 12:14:25.707 7f76d9a85f00 10 bluefs _add_block_extent done
2019-04-15 12:14:25.707 7f76d9a85f00 10 bluefs _flush_and_sync_log want_seq 0 txn(seq 0 len 0x0 crc 0xffffffff) not dirty, dirty_files empty, no-op
2019-04-15 12:14:25.707 7f76d9a85f00 10 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-3//block
2019-04-15 12:14:25.707 7f76d9a85f00 1 bdev create path /var/lib/ceph/osd/ceph-3//block type kernel
2019-04-15 12:14:25.707 7f76d9a85f00 1 bdev(0x562fd3766e00 /var/lib/ceph/osd/ceph-3//block) open path /var/lib/ceph/osd/ceph-3//block
2019-04-15 12:14:25.707 7f76d9a85f00 1 bdev(0x562fd3766e00 /var/lib/ceph/osd/ceph-3//block) open size 13421772800 (0x320000000, 12 GiB) block_size 4096 (4 KiB) rotational discard supported
2019-04-15 12:14:25.707 7f76d9a85f00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-3//block size 12 GiB
2019-04-15 12:14:25.707 7f76d9a85f00 1 bluefs _add_block_extent bdev 2 0x170000000~40000000
2019-04-15 12:14:25.707 7f76d9a85f00 10 bluefs _add_block_extent done
2019-04-15 12:14:25.707 7f76d9a85f00 10 bluefs _flush_and_sync_log want_seq 0 txn(seq 0 len 0x0 crc 0xffffffff) not dirty, dirty_files empty, no-op
2019-04-15 12:14:25.707 7f76d9a85f00 1 bluefs mkfs osd_uuid 90385b3d-fe47-4c1d-92e0-0735a0ce5c14
2019-04-15 12:14:25.707 7f76d9a85f00 20 bluefs _init_alloc
2019-04-15 12:14:25.707 7f76d9a85f00 10 fbmap_alloc 0x562fd2958300 BitmapAllocator 0x63fc00000/100000
2019-04-15 12:14:25.707 7f76d9a85f00 10 fbmap_alloc 0x562fd2958300 init_add_free 0x2000~63fbfe000
2019-04-15 12:14:25.707 7f76d9a85f00 10 fbmap_alloc 0x562fd2958300 init_add_free done
2019-04-15 12:14:25.707 7f76d9a85f00 10 fbmap_alloc 0x562fd2958400 BitmapAllocator 0x320000000/100000
2019-04-15 12:14:25.711 7f76d9a85f00 10 fbmap_alloc 0x562fd2958400 init_add_free 0x170000000~40000000
2019-04-15 12:14:25.711 7f76d9a85f00 10 fbmap_alloc 0x562fd2958400 init_add_free done
2019-04-15 12:14:25.711 7f76d9a85f00 1 bluefs mkfs uuid 2ed85005-a3e1-413c-ab5f-0af4a2e126ad
2019-04-15 12:14:25.711 7f76d9a85f00 10 bluefs _allocate len 0x400000 from 0
2019-04-15 12:14:25.711 7f76d9a85f00 10 bluefs _allocate len 0x400000 from 1
2019-04-15 12:14:25.711 7f76d9a85f00 10 fbmap_alloc 0x562fd2958300 allocate 0x400000/100000,400000,0
2019-04-15 12:14:25.711 7f76d9a85f00 10 fbmap_alloc 0x562fd2958300 allocate 0x100000~400000/100000,400000,0
2019-04-15 12:14:25.711 7f76d9a85f00 20 bluefs mkfs op_alloc_add 1 0x2000~63fbfe000
2019-04-15 12:14:25.711 7f76d9a85f00 20 bluefs mkfs op_alloc_add 2 0x170000000~40000000
2019-04-15 12:14:25.711 7f76d9a85f00 10 bluefs _flush_and_sync_log txn(seq 1 len 0x25 crc 0x7f22e346)
2019-04-15 12:14:25.711 7f76d9a85f00 10 bluefs _flush 0x562fd2981680 0x0~1000 to file(ino 1 size 0x0 mtime 0.000000 bdev 0 allocated 400000 extents [1:0x100000~400000])
2019-04-15 12:14:25.711 7f76d9a85f00 10 bluefs _flush_range 0x562fd2981680 pos 0x0 0x0~1000 to file(ino 1 size 0x0 mtime 0.000000 bdev 0 allocated 400000 extents [1:0x100000~400000])
2019-04-15 12:14:25.711 7f76d9a85f00 20 bluefs _flush_range file now file(ino 1 size 0x1000 mtime 0.000000 bdev 0 allocated 400000 extents [1:0x100000~400000])
2019-04-15 12:14:25.711 7f76d9a85f00 20 bluefs _flush_range in 1:0x100000~400000 x_off 0x0
2019-04-15 12:14:25.711 7f76d9a85f00 20 bluefs _flush_range h 0x562fd2981680 pos now 0x1000
2019-04-15 12:14:25.711 7f76d9a85f00 10 bluefs _claim_completed_aios got 1 aios
2019-04-15 12:14:25.711 7f76d9a85f00 10 bluefs wait_for_aio 0x562fd2981680
2019-04-15 12:14:25.719 7f76d9a85f00 10 bluefs wait_for_aio 0x562fd2981680 done in 0.009824
2019-04-15 12:14:25.719 7f76d9a85f00 20 bluefs flush_bdev
2019-04-15 12:14:25.727 7f76d9a85f00 20 bluefs _flush_and_sync_log log_seq_stable 1
2019-04-15 12:14:25.727 7f76d9a85f00 10 bluefs _write_super super block length(encoded): 89
2019-04-15 12:14:25.727 7f76d9a85f00 10 bluefs _write_super superblock 1
2019-04-15 12:14:25.727 7f76d9a85f00 10 bluefs _write_super log_fnode file(ino 1 size 0x1000 mtime 0.000000 bdev 0 allocated 400000 extents [1:0x100000~400000])
2019-04-15 12:14:25.727 7f76d9a85f00 20 bluefs _write_super v 1 crc 0xde115834 offset 0x1000
2019-04-15 12:14:25.727 7f76d9a85f00 20 bluefs flush_bdev
2019-04-15 12:14:25.743 7f76d9a85f00 10 bluefs _close_writer 0x562fd2981680 type 0
2019-04-15 12:14:25.743 7f76d9a85f00 20 bluefs _stop_alloc
2019-04-15 12:14:25.743 7f76d9a85f00 1 fbmap_alloc 0x562fd2958300 shutdown
2019-04-15 12:14:25.743 7f76d9a85f00 1 fbmap_alloc 0x562fd2958400 shutdown
2019-04-15 12:14:25.743 7f76d9a85f00 10 bluefs mkfs success
2019-04-15 12:14:25.743 7f76d9a85f00 1 bluefs mount
2019-04-15 12:14:25.743 7f76d9a85f00 10 bluefs _open_super
2019-04-15 12:14:25.743 7f76d9a85f00 10 bluefs _open_super superblock 1
2019-04-15 12:14:25.743 7f76d9a85f00 10 bluefs _open_super log_fnode file(ino 1 size 0x1000 mtime 0.000000 bdev 0 allocated 400000 extents [1:0x100000~400000])
2019-04-15 12:14:25.743 7f76d9a85f00 20 bluefs _init_alloc
2019-04-15 12:14:25.743 7f76d9a85f00 10 fbmap_alloc 0x562fd2958400 BitmapAllocator 0x63fc00000/100000
2019-04-15 12:14:25.743 7f76d9a85f00 10 fbmap_alloc 0x562fd2958300 BitmapAllocator 0x320000000/100000
2019-04-15 12:14:25.743 7f76d9a85f00 10 bluefs _replay
2019-04-15 12:14:25.743 7f76d9a85f00 10 bluefs _replay log_fnode file(ino 1 size 0x1000 mtime 0.000000 bdev 0 allocated 400000 extents [1:0x100000~400000])
2019-04-15 12:14:25.743 7f76d9a85f00 10 bluefs _read h 0x562fd292c990 0x0~1000 from file(ino 1 size 0x1000 mtime 0.000000 bdev 0 allocated 400000 extents [1:0x100000~400000])
2019-04-15 12:14:25.743 7f76d9a85f00 20 bluefs _read fetching 0x0~100000 of 1:0x100000~400000
2019-04-15 12:14:25.747 7f76d9a85f00 20 bluefs _read left 0x100000 len 0x1000
2019-04-15 12:14:25.747 7f76d9a85f00 20 bluefs _read got 4096
2019-04-15 12:14:25.747 7f76d9a85f00 10 bluefs _replay 0x0: stop: uuid 00000000-0000-0000-0000-000000000000 != super.uuid 2ed85005-a3e1-413c-ab5f-0af4a2e126ad
2019-04-15 12:14:25.747 7f76d9a85f00 10 bluefs _replay log file size was 0x1000
2019-04-15 12:14:25.747 7f76d9a85f00 10 bluefs _replay done
2019-04-15 12:14:25.747 7f76d9a85f00 10 fbmap_alloc 0x562fd2958400 init_rm_free 0x100000~400000
2019-04-15 12:14:25.747 7f76d9a85f00 -1 /build/ceph-14.2.0/src/os/bluestore/fastbmap_allocator_impl.h: In function 'void AllocatorLevel02<T>::_mark_allocated(uint64_t, uint64_t) [with L1 = AllocatorLevel01Loose; uint64_t = long unsigned int]' thread 7f76d9a85f00 time 2019-04-15 12:14:25.749988
/build/ceph-14.2.0/src/os/bluestore/fastbmap_allocator_impl.h: 731: FAILED ceph_assert(available >= allocated)

ceph version 14.2.0 (3a54b2b6d167d4a2a19e003a705696d4fe619afc) nautilus (stable)
1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x562fc6fb67e0]
2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x562fc6fb69bb]
3: (BitmapAllocator::init_rm_free(unsigned long, unsigned long)+0x6fc) [0x562fc76b9b8c]
4: (BlueFS::mount()+0x2a0) [0x562fc7685630]
5: (BlueStore::_open_bluefs(bool)+0x8c) [0x562fc7560a0c]
6: (BlueStore::_open_db(bool, bool, bool)+0xa5c) [0x562fc7561d8c]
7: (BlueStore::mkfs()+0x11d1) [0x562fc75c7351]
8: (OSD::mkfs(CephContext*, ObjectStore*, uuid_d, int)+0xd5) [0x562fc70c4c35]
9: (main()+0x1979) [0x562fc6fbb849]
10: (__libc_start_main()+0xe7) [0x7f76d5f42b97]
11: (_start()+0x2a) [0x562fc70a312a]

2019-04-15 12:14:25.751 7f76d9a85f00 -1 *** Caught signal (Aborted) **
in thread 7f76d9a85f00 thread_name:ceph-osd

ceph version 14.2.0 (3a54b2b6d167d4a2a19e003a705696d4fe619afc) nautilus (stable)
1: (()+0x12890) [0x7f76d72ad890]
2: (gsignal()+0xc7) [0x7f76d5f5fe97]
3: (abort()+0x141) [0x7f76d5f61801]
4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x562fc6fb6831]
5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x562fc6fb69bb]
6: (BitmapAllocator::init_rm_free(unsigned long, unsigned long)+0x6fc) [0x562fc76b9b8c]
7: (BlueFS::mount()+0x2a0) [0x562fc7685630]
8: (BlueStore::_open_bluefs(bool)+0x8c) [0x562fc7560a0c]
9: (BlueStore::_open_db(bool, bool, bool)+0xa5c) [0x562fc7561d8c]
10: (BlueStore::mkfs()+0x11d1) [0x562fc75c7351]
11: (OSD::mkfs(CephContext*, ObjectStore*, uuid_d, int)+0xd5) [0x562fc70c4c35]
12: (main()+0x1979) [0x562fc6fbb849]
13: (__libc_start_main()+0xe7) [0x7f76d5f42b97]
14: (_start()+0x2a) [0x562fc70a312a]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- begin dump of recent events ---
-598> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command assert hook 0x562fd28de270
-597> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command abort hook 0x562fd28de270
-596> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command perfcounters_dump hook 0x562fd28de270
-595> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command 1 hook 0x562fd28de270
-594> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command perf dump hook 0x562fd28de270
-593> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command perfcounters_schema hook 0x562fd28de270
-592> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command perf histogram dump hook 0x562fd28de270
-591> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command 2 hook 0x562fd28de270
-590> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command perf schema hook 0x562fd28de270
-589> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command perf histogram schema hook 0x562fd28de270
-588> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command perf reset hook 0x562fd28de270
-587> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command config show hook 0x562fd28de270
-586> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command config help hook 0x562fd28de270
-585> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command config set hook 0x562fd28de270
-584> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command config unset hook 0x562fd28de270
-583> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command config get hook 0x562fd28de270
-582> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command config diff hook 0x562fd28de270
-581> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command config diff get hook 0x562fd28de270
-580> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command log flush hook 0x562fd28de270
-579> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command log dump hook 0x562fd28de270
-578> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command log reopen hook 0x562fd28de270
-577> 2019-04-15 12:14:25.647 7f76d9a85f00 5 asok(0x562fd2c78000) register_command dump_mempools hook 0x562fd376e068
-576> 2019-04-15 12:14:25.651 7f76d9a85f00 10 monclient: get_monmap_and_config
-575> 2019-04-15 12:14:25.651 7f76d9a85f00 10 monclient: build_initial_monmap
-574> 2019-04-15 12:14:25.651 7f76d9a85f00 10 monclient: monmap:
epoch 1
fsid 0df2e290-18dd-4eed-b03e-0524e4a907a0
last_changed 2019-04-15 12:07:39.353235
created 2019-04-15 12:07:39.353235
min_mon_release 14 (nautilus)
0: [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] mon.mon0
1: [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] mon.mon1
2: [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] mon.mon2

-573> 2019-04-15 12:14:25.651 7f76d9a85f00 5 AuthRegistry(0x562fd2cb8140) adding auth protocol: cephx
-572> 2019-04-15 12:14:25.651 7f76d9a85f00 5 AuthRegistry(0x562fd2cb8140) adding auth protocol: cephx
-571> 2019-04-15 12:14:25.651 7f76d9a85f00 5 AuthRegistry(0x562fd2cb8140) adding auth protocol: cephx
-570> 2019-04-15 12:14:25.651 7f76d9a85f00 5 AuthRegistry(0x562fd2cb8140) adding auth protocol: none
-569> 2019-04-15 12:14:25.651 7f76d9a85f00 5 AuthRegistry(0x562fd2cb8140) adding con mode: crc
-568> 2019-04-15 12:14:25.651 7f76d9a85f00 5 AuthRegistry(0x562fd2cb8140) adding con mode: crc
-567> 2019-04-15 12:14:25.651 7f76d9a85f00 5 AuthRegistry(0x562fd2cb8140) adding con mode: crc
-566> 2019-04-15 12:14:25.651 7f76d9a85f00 5 AuthRegistry(0x562fd2cb8140) adding con mode: crc
-565> 2019-04-15 12:14:25.651 7f76d9a85f00 5 AuthRegistry(0x562fd2cb8140) adding con mode: crc
-564> 2019-04-15 12:14:25.651 7f76d9a85f00 5 AuthRegistry(0x562fd2cb8140) adding con mode: crc
-563> 2019-04-15 12:14:25.651 7f76d9a85f00 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-3//keyring
-562> 2019-04-15 12:14:25.655 7f76d3c16700 2 Event(0x562fd28e0bc0 nevent=5000 time_id=1).set_owner idx=0 owner=140148335535872
-561> 2019-04-15 12:14:25.655 7f76d3c16700 20 Event(0x562fd28e0bc0 nevent=5000 time_id=1).create_file_event create event started fd=4 mask=1 original mask is 0
-560> 2019-04-15 12:14:25.655 7f76d3c16700 20 EpollDriver.add_event add event fd=4 cur_mask=0 add_mask=1 to 3
-559> 2019-04-15 12:14:25.655 7f76d3c16700 20 Event(0x562fd28e0bc0 nevent=5000 time_id=1).create_file_event create event end fd=4 mask=1 original mask is 1
-558> 2019-04-15 12:14:25.655 7f76d3c16700 10 stack operator() starting
-557> 2019-04-15 12:14:25.655 7f76d2c14700 2 Event(0x562fd28e14c0 nevent=5000 time_id=1).set_owner idx=2 owner=140148318750464
-556> 2019-04-15 12:14:25.655 7f76d2c14700 20 Event(0x562fd28e14c0 nevent=5000 time_id=1).create_file_event create event started fd=10 mask=1 original mask is 0
-555> 2019-04-15 12:14:25.655 7f76d2c14700 20 EpollDriver.add_event add event fd=10 cur_mask=0 add_mask=1 to 9
-554> 2019-04-15 12:14:25.655 7f76d2c14700 20 Event(0x562fd28e14c0 nevent=5000 time_id=1).create_file_event create event end fd=10 mask=1 original mask is 1
-553> 2019-04-15 12:14:25.655 7f76d2c14700 10 stack operator() starting
-552> 2019-04-15 12:14:25.655 7f76d3415700 2 Event(0x562fd28e1280 nevent=5000 time_id=1).set_owner idx=1 owner=140148327143168
-551> 2019-04-15 12:14:25.655 7f76d3415700 20 Event(0x562fd28e1280 nevent=5000 time_id=1).create_file_event create event started fd=7 mask=1 original mask is 0
-550> 2019-04-15 12:14:25.655 7f76d3415700 20 EpollDriver.add_event add event fd=7 cur_mask=0 add_mask=1 to 6
-549> 2019-04-15 12:14:25.655 7f76d3415700 20 Event(0x562fd28e1280 nevent=5000 time_id=1).create_file_event create event end fd=7 mask=1 original mask is 1
-548> 2019-04-15 12:14:25.655 7f76d3415700 10 stack operator() starting
-547> 2019-04-15 12:14:25.655 7f76d9a85f00 10 -- ready
-546> 2019-04-15 12:14:25.655 7f76d9a85f00 1 Processor -- start
-545> 2019-04-15 12:14:25.655 7f76d9a85f00 20 Event(0x562fd28e0bc0 nevent=5000 time_id=1).wakeup
-544> 2019-04-15 12:14:25.655 7f76d9a85f00 1 -- start start
-543> 2019-04-15 12:14:25.655 7f76d9a85f00 10 monclient: init
-542> 2019-04-15 12:14:25.655 7f76d9a85f00 5 AuthRegistry(0x7fff7c0d3ba8) adding auth protocol: cephx
-541> 2019-04-15 12:14:25.655 7f76d9a85f00 5 AuthRegistry(0x7fff7c0d3ba8) adding auth protocol: cephx
-540> 2019-04-15 12:14:25.655 7f76d9a85f00 5 AuthRegistry(0x7fff7c0d3ba8) adding auth protocol: cephx
-539> 2019-04-15 12:14:25.655 7f76d9a85f00 5 AuthRegistry(0x7fff7c0d3ba8) adding auth protocol: none
-538> 2019-04-15 12:14:25.655 7f76d9a85f00 5 AuthRegistry(0x7fff7c0d3ba8) adding con mode: crc
-537> 2019-04-15 12:14:25.655 7f76d9a85f00 5 AuthRegistry(0x7fff7c0d3ba8) adding con mode: crc
-536> 2019-04-15 12:14:25.655 7f76d9a85f00 5 AuthRegistry(0x7fff7c0d3ba8) adding con mode: crc
-535> 2019-04-15 12:14:25.655 7f76d9a85f00 5 AuthRegistry(0x7fff7c0d3ba8) adding con mode: crc
-534> 2019-04-15 12:14:25.655 7f76d9a85f00 5 AuthRegistry(0x7fff7c0d3ba8) adding con mode: crc
-533> 2019-04-15 12:14:25.655 7f76d9a85f00 5 AuthRegistry(0x7fff7c0d3ba8) adding con mode: crc
-532> 2019-04-15 12:14:25.655 7f76d9a85f00 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-3//keyring
-531> 2019-04-15 12:14:25.655 7f76d9a85f00 2 auth: KeyRing::load: loaded key file /var/lib/ceph/osd/ceph-3//keyring
-530> 2019-04-15 12:14:25.655 7f76d9a85f00 10 monclient: _reopen_session rank -1
-529> 2019-04-15 12:14:25.655 7f76d9a85f00 10 -- create_connect [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0], creating connection and registering
-528> 2019-04-15 12:14:25.655 7f76d9a85f00 10 -- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_NONE l=0)._connect
-527> 2019-04-15 12:14:25.655 7f76d9a85f00 1 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect
-526> 2019-04-15 12:14:25.655 7f76d9a85f00 20 Event(0x562fd28e1280 nevent=5000 time_id=1).wakeup
-525> 2019-04-15 12:14:25.655 7f76d9a85f00 10 -- create_connect 0x562fd2b7da80 [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0]
-524> 2019-04-15 12:14:25.655 7f76d9a85f00 10 -- connect_to [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] new 0x562fd2b7da80
-523> 2019-04-15 12:14:25.655 7f76d9a85f00 10 monclient(hunting): picked mon.mon2 con 0x562fd2b7da80 addr [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0]
-522> 2019-04-15 12:14:25.655 7f76d9a85f00 10 -- create_connect [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0], creating connection and registering
-521> 2019-04-15 12:14:25.655 7f76d3415700 20 -- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CONNECTING l=0).process
-520> 2019-04-15 12:14:25.655 7f76d9a85f00 10 -- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 msgr2=0x562fd37a6b00 unknown :-1 s=STATE_NONE l=0)._connect
-519> 2019-04-15 12:14:25.655 7f76d9a85f00 1 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect
-518> 2019-04-15 12:14:25.655 7f76d9a85f00 20 Event(0x562fd28e14c0 nevent=5000 time_id=1).wakeup
-517> 2019-04-15 12:14:25.655 7f76d9a85f00 10 -- create_connect 0x562fd3856000 [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0]
-516> 2019-04-15 12:14:25.655 7f76d9a85f00 10 -- connect_to [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] new 0x562fd3856000
-515> 2019-04-15 12:14:25.655 7f76d9a85f00 10 monclient(hunting): picked mon.mon0 con 0x562fd3856000 addr [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0]
-514> 2019-04-15 12:14:25.655 7f76d9a85f00 10 -- create_connect [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0], creating connection and registering
-513> 2019-04-15 12:14:25.655 7f76d9a85f00 10 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_NONE l=0)._connect
-512> 2019-04-15 12:14:25.655 7f76d9a85f00 1 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect
-511> 2019-04-15 12:14:25.655 7f76d9a85f00 20 Event(0x562fd28e0bc0 nevent=5000 time_id=1).wakeup
-510> 2019-04-15 12:14:25.655 7f76d9a85f00 10 -- create_connect 0x562fd3856480 [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0]
-509> 2019-04-15 12:14:25.655 7f76d9a85f00 10 -- connect_to [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] new 0x562fd3856480
-508> 2019-04-15 12:14:25.655 7f76d9a85f00 10 monclient(hunting): picked mon.mon1 con 0x562fd3856480 addr [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0]
-507> 2019-04-15 12:14:25.655 7f76d9a85f00 10 monclient(hunting): start opening mon connection
-506> 2019-04-15 12:14:25.655 7f76d9a85f00 1 -- --> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd2984e00 con 0x562fd3856000
-505> 2019-04-15 12:14:25.655 7f76d9a85f00 5 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).send_message enqueueing message m=0x562fd2984e00 type=5 mon_getmap magic: 0 v1
-504> 2019-04-15 12:14:25.655 7f76d9a85f00 15 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).send_message inline write is denied, reschedule m=0x562fd2984e00
-503> 2019-04-15 12:14:25.655 7f76d9a85f00 10 monclient(hunting): start opening mon connection
-502> 2019-04-15 12:14:25.655 7f76d9a85f00 1 -- --> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd2984c40 con 0x562fd3856480
-501> 2019-04-15 12:14:25.655 7f76d9a85f00 5 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).send_message enqueueing message m=0x562fd2984c40 type=5 mon_getmap magic: 0 v1
-500> 2019-04-15 12:14:25.655 7f76d9a85f00 15 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).send_message inline write is denied, reschedule m=0x562fd2984c40
-499> 2019-04-15 12:14:25.655 7f76d9a85f00 10 monclient(hunting): start opening mon connection
-498> 2019-04-15 12:14:25.655 7f76d9a85f00 1 -- --> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] -- mon_getmap magic: 0 v1 -- 0x562fd2984700 con 0x562fd2b7da80
-497> 2019-04-15 12:14:25.655 7f76d9a85f00 5 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).send_message enqueueing message m=0x562fd2984700 type=5 mon_getmap magic: 0 v1
-496> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTING l=0).process
-495> 2019-04-15 12:14:25.655 7f76d9a85f00 15 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).send_message inline write is denied, reschedule m=0x562fd2984700
-494> 2019-04-15 12:14:25.655 7f76d9a85f00 10 monclient(hunting): _renew_subs
-493> 2019-04-15 12:14:25.655 7f76d9a85f00 10 monclient(hunting): authenticate will time out at 2019-04-15 12:19:25.658455
-492> 2019-04-15 12:14:25.655 7f76d2c14700 20 -- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 msgr2=0x562fd37a6b00 unknown :-1 s=STATE_CONNECTING l=0).process
-491> 2019-04-15 12:14:25.655 7f76d3c16700 20 Event(0x562fd28e0bc0 nevent=5000 time_id=1).create_file_event create event started fd=13 mask=1 original mask is 0
-490> 2019-04-15 12:14:25.655 7f76d3c16700 20 EpollDriver.add_event add event fd=13 cur_mask=0 add_mask=1 to 3
-489> 2019-04-15 12:14:25.655 7f76d3c16700 20 Event(0x562fd28e0bc0 nevent=5000 time_id=1).create_file_event create event end fd=13 mask=1 original mask is 1
-488> 2019-04-15 12:14:25.655 7f76d3c16700 10 NetHandler reconnect reconnect: Operation already in progress
-487> 2019-04-15 12:14:25.655 7f76d3c16700 10 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTING_RE l=0).process nonblock connect inprogress
-486> 2019-04-15 12:14:25.655 7f76d3c16700 20 Event(0x562fd28e0bc0 nevent=5000 time_id=1).create_file_event create event started fd=13 mask=2 original mask is 1
-485> 2019-04-15 12:14:25.655 7f76d3c16700 20 EpollDriver.add_event add event fd=13 cur_mask=1 add_mask=2 to 3
-484> 2019-04-15 12:14:25.655 7f76d3c16700 20 Event(0x562fd28e0bc0 nevent=5000 time_id=1).create_file_event create event end fd=13 mask=2 original mask is 3
-483> 2019-04-15 12:14:25.655 7f76d3415700 20 Event(0x562fd28e1280 nevent=5000 time_id=1).create_file_event create event started fd=12 mask=1 original mask is 0
-482> 2019-04-15 12:14:25.655 7f76d3415700 20 EpollDriver.add_event add event fd=12 cur_mask=0 add_mask=1 to 6
-481> 2019-04-15 12:14:25.655 7f76d3415700 20 Event(0x562fd28e1280 nevent=5000 time_id=1).create_file_event create event end fd=12 mask=1 original mask is 1
-480> 2019-04-15 12:14:25.655 7f76d3415700 20 EpollDriver.del_event del event fd=12 cur_mask=1 delmask=2 to 6
-479> 2019-04-15 12:14:25.655 7f76d2c14700 20 Event(0x562fd28e14c0 nevent=5000 time_id=1).create_file_event create event started fd=14 mask=1 original mask is 0
-478> 2019-04-15 12:14:25.655 7f76d3415700 10 -- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CONNECTING_RE l=0).process connect successfully, ready to send banner
-477> 2019-04-15 12:14:25.655 7f76d2c14700 20 EpollDriver.add_event add event fd=14 cur_mask=0 add_mask=1 to 9
-476> 2019-04-15 12:14:25.655 7f76d2c14700 20 Event(0x562fd28e14c0 nevent=5000 time_id=1).create_file_event create event end fd=14 mask=1 original mask is 1
-475> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).read_event
-474> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).start_client_banner_exchange
-473> 2019-04-15 12:14:25.655 7f76d2c14700 10 NetHandler reconnect reconnect: Operation already in progress
-472> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._banner_exchange
-471> 2019-04-15 12:14:25.655 7f76d2c14700 10 -- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 msgr2=0x562fd37a6b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process nonblock connect inprogress
-470> 2019-04-15 12:14:25.655 7f76d2c14700 20 Event(0x562fd28e14c0 nevent=5000 time_id=1).create_file_event create event started fd=14 mask=2 original mask is 1
-469> 2019-04-15 12:14:25.655 7f76d2c14700 20 EpollDriver.add_event add event fd=14 cur_mask=1 add_mask=2 to 9
-468> 2019-04-15 12:14:25.655 7f76d2c14700 20 Event(0x562fd28e14c0 nevent=5000 time_id=1).create_file_event create event end fd=14 mask=2 original mask is 3
-467> 2019-04-15 12:14:25.655 7f76d3415700 10 -- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send sent bytes 26 remaining bytes 0
-466> 2019-04-15 12:14:25.655 7f76d3415700 20 -- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=10
-465> 2019-04-15 12:14:25.655 7f76d2c14700 20 -- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 msgr2=0x562fd37a6b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process
-464> 2019-04-15 12:14:25.655 7f76d2c14700 20 EpollDriver.del_event del event fd=14 cur_mask=3 delmask=2 to 9
-463> 2019-04-15 12:14:25.655 7f76d2c14700 10 -- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 msgr2=0x562fd37a6b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process connect successfully, ready to send banner
-462> 2019-04-15 12:14:25.655 7f76d2c14700 20 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).read_event
-461> 2019-04-15 12:14:25.655 7f76d2c14700 20 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).start_client_banner_exchange
-460> 2019-04-15 12:14:25.655 7f76d2c14700 20 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._banner_exchange
-459> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTING_RE l=0).process
-458> 2019-04-15 12:14:25.655 7f76d3c16700 20 EpollDriver.del_event del event fd=13 cur_mask=3 delmask=2 to 3
-457> 2019-04-15 12:14:25.655 7f76d3c16700 10 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTING_RE l=0).process connect successfully, ready to send banner
-456> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).read_event
-455> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).start_client_banner_exchange
-454> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._banner_exchange
-453> 2019-04-15 12:14:25.655 7f76d2c14700 10 -- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 msgr2=0x562fd37a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send sent bytes 26 remaining bytes 0
-452> 2019-04-15 12:14:25.655 7f76d2c14700 20 -- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 msgr2=0x562fd37a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=10
-451> 2019-04-15 12:14:25.655 7f76d3c16700 10 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send sent bytes 26 remaining bytes 0
-450> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=10
-449> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).process
-448> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read continue len=10
-447> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner r=0
-446> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=16
-445> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload r=0
-444> 2019-04-15 12:14:25.655 7f76d3c16700 1 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0
-443> 2019-04-15 12:14:25.655 7f76d3c16700 10 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send sent bytes 85 remaining bytes 0
-442> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).read_frame
-441> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=32
-440> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main r=0
-439> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main got new segment: len=36 align=8
-438> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).read_frame_segment
-437> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=36
-436> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_segment r=0
-435> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=17
-434> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_epilogue_main r=0
-433> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_epilogue_main message integrity check success: expected_crc=108261226 calculated_crc=108261226
-432> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_dispatch tag=1
-431> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello payload.length()=36
-430> 2019-04-15 12:14:25.655 7f76d3c16700 5 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello received hello: peer_type=1 peer_addr_for_me=v2:192.168.1.101:46882/0
-429> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).post_client_banner_exchange
-428> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request peer_type 1 auth_client 0x7fff7c0d3b98
-427> 2019-04-15 12:14:25.655 7f76d3c16700 10 monclient(hunting): get_auth_request con 0x562fd3856480 auth_method 0
-426> 2019-04-15 12:14:25.655 7f76d3c16700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1]
-425> 2019-04-15 12:14:25.655 7f76d3c16700 10 monclient(hunting): _init_auth method 2
-424> 2019-04-15 12:14:25.655 7f76d3c16700 10 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send sent bytes 83 remaining bytes 0
-423> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).read_frame
-422> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=32
-421> 2019-04-15 12:14:25.655 7f76d3415700 20 -- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).process
-420> 2019-04-15 12:14:25.655 7f76d3415700 20 -- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read continue len=10
-419> 2019-04-15 12:14:25.655 7f76d2c14700 20 -- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 msgr2=0x562fd37a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).process
-418> 2019-04-15 12:14:25.655 7f76d2c14700 20 -- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 msgr2=0x562fd37a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read continue len=10
-417> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner r=0
-416> 2019-04-15 12:14:25.655 7f76d3415700 20 -- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=16
-415> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload r=0
-414> 2019-04-15 12:14:25.655 7f76d3415700 1 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0
-413> 2019-04-15 12:14:25.655 7f76d2c14700 20 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner r=0
-412> 2019-04-15 12:14:25.655 7f76d2c14700 20 -- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 msgr2=0x562fd37a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=16
-411> 2019-04-15 12:14:25.655 7f76d2c14700 20 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload r=0
-410> 2019-04-15 12:14:25.655 7f76d2c14700 1 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0
-409> 2019-04-15 12:14:25.655 7f76d2c14700 10 -- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 msgr2=0x562fd37a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send sent bytes 85 remaining bytes 0
-408> 2019-04-15 12:14:25.655 7f76d2c14700 20 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).read_frame
-407> 2019-04-15 12:14:25.655 7f76d2c14700 20 -- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 msgr2=0x562fd37a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=32
-406> 2019-04-15 12:14:25.655 7f76d3415700 10 -- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send sent bytes 85 remaining bytes 0
-405> 2019-04-15 12:14:25.655 7f76d2c14700 20 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main r=0
-404> 2019-04-15 12:14:25.655 7f76d2c14700 10 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main got new segment: len=36 align=8
-403> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).read_frame
-402> 2019-04-15 12:14:25.655 7f76d2c14700 20 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).read_frame_segment
-401> 2019-04-15 12:14:25.655 7f76d3415700 20 -- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=32
-400> 2019-04-15 12:14:25.655 7f76d2c14700 20 -- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 msgr2=0x562fd37a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=36
-399> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main r=0
-398> 2019-04-15 12:14:25.655 7f76d2c14700 20 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_segment r=0
-397> 2019-04-15 12:14:25.655 7f76d3415700 10 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main got new segment: len=36 align=8
-396> 2019-04-15 12:14:25.655 7f76d2c14700 20 -- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 msgr2=0x562fd37a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=17
-395> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).read_frame_segment
-394> 2019-04-15 12:14:25.655 7f76d2c14700 20 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_epilogue_main r=0
-393> 2019-04-15 12:14:25.655 7f76d3415700 20 -- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=36
-392> 2019-04-15 12:14:25.655 7f76d2c14700 20 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_epilogue_main message integrity check success: expected_crc=2315318673 calculated_crc=2315318673
-391> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_segment r=0
-390> 2019-04-15 12:14:25.655 7f76d2c14700 10 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_dispatch tag=1
-389> 2019-04-15 12:14:25.655 7f76d3415700 20 -- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=17
-388> 2019-04-15 12:14:25.655 7f76d2c14700 20 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello payload.length()=36
-387> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_epilogue_main r=0
-386> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_epilogue_main message integrity check success: expected_crc=1721450388 calculated_crc=1721450388
-385> 2019-04-15 12:14:25.655 7f76d3415700 10 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_dispatch tag=1
-384> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello payload.length()=36
-383> 2019-04-15 12:14:25.655 7f76d3415700 5 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello received hello: peer_type=1 peer_addr_for_me=v2:192.168.1.101:60986/0
-382> 2019-04-15 12:14:25.655 7f76d2c14700 5 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello received hello: peer_type=1 peer_addr_for_me=v2:192.168.1.101:38544/0
-381> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).post_client_banner_exchange
-380> 2019-04-15 12:14:25.655 7f76d2c14700 20 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).post_client_banner_exchange
-379> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request peer_type 1 auth_client 0x7fff7c0d3b98
-378> 2019-04-15 12:14:25.655 7f76d2c14700 20 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request peer_type 1 auth_client 0x7fff7c0d3b98
-377> 2019-04-15 12:14:25.655 7f76d3415700 10 monclient(hunting): get_auth_request con 0x562fd2b7da80 auth_method 0
-376> 2019-04-15 12:14:25.655 7f76d3415700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1]
-375> 2019-04-15 12:14:25.655 7f76d3415700 10 monclient(hunting): _init_auth method 2
-374> 2019-04-15 12:14:25.655 7f76d2c14700 10 monclient(hunting): get_auth_request con 0x562fd3856000 auth_method 0
-373> 2019-04-15 12:14:25.655 7f76d2c14700 10 monclient(hunting): get_auth_request method 2 preferred_modes [1]
-372> 2019-04-15 12:14:25.655 7f76d2c14700 10 monclient(hunting): _init_auth method 2
-371> 2019-04-15 12:14:25.655 7f76d2c14700 10 -- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 msgr2=0x562fd37a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send sent bytes 83 remaining bytes 0
-370> 2019-04-15 12:14:25.655 7f76d2c14700 20 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).read_frame
-369> 2019-04-15 12:14:25.655 7f76d3415700 10 -- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send sent bytes 83 remaining bytes 0
-368> 2019-04-15 12:14:25.655 7f76d2c14700 20 -- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 msgr2=0x562fd37a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=32
-367> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).read_frame
-366> 2019-04-15 12:14:25.655 7f76d3415700 20 -- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=32
-365> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).process
-364> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read continue len=32
-363> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main r=0
-362> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main got new segment: len=13 align=8
-361> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).read_frame_segment
-360> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=13
-359> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_segment r=0
-358> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=17
-357> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_epilogue_main r=0
-356> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_epilogue_main message integrity check success: expected_crc=2125822184 calculated_crc=2125822184
-355> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_dispatch tag=4
-354> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more payload.length()=13
-353> 2019-04-15 12:14:25.655 7f76d3c16700 5 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more auth reply more len=9
-352> 2019-04-15 12:14:25.655 7f76d3c16700 10 monclient(hunting): handle_auth_reply_more payload 9
-351> 2019-04-15 12:14:25.655 7f76d3c16700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-350> 2019-04-15 12:14:25.655 7f76d3c16700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-349> 2019-04-15 12:14:25.655 7f76d3c16700 10 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send sent bytes 89 remaining bytes 0
-348> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).read_frame
-347> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=32
-346> 2019-04-15 12:14:25.655 7f76d3415700 20 -- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).process
-345> 2019-04-15 12:14:25.655 7f76d3415700 20 -- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read continue len=32
-344> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main r=0
-343> 2019-04-15 12:14:25.655 7f76d3415700 10 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main got new segment: len=13 align=8
-342> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).read_frame_segment
-341> 2019-04-15 12:14:25.655 7f76d3415700 20 -- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=13
-340> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_segment r=0
-339> 2019-04-15 12:14:25.655 7f76d3415700 20 -- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=17
-338> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_epilogue_main r=0
-337> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_epilogue_main message integrity check success: expected_crc=1818223086 calculated_crc=1818223086
-336> 2019-04-15 12:14:25.655 7f76d3415700 10 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_dispatch tag=4
-335> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more payload.length()=13
-334> 2019-04-15 12:14:25.655 7f76d3415700 5 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more auth reply more len=9
-333> 2019-04-15 12:14:25.655 7f76d3415700 10 monclient(hunting): handle_auth_reply_more payload 9
-332> 2019-04-15 12:14:25.655 7f76d3415700 10 monclient(hunting): handle_auth_reply_more payload_len 9
-331> 2019-04-15 12:14:25.655 7f76d3415700 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes
-330> 2019-04-15 12:14:25.655 7f76d3415700 10 -- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send sent bytes 89 remaining bytes 0
-329> 2019-04-15 12:14:25.655 7f76d3415700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).read_frame
-328> 2019-04-15 12:14:25.655 7f76d3415700 20 -- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=32
-327> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).process
-326> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read continue len=32
-325> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main r=0
-324> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main got new segment: len=402 align=8
-323> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).read_frame_segment
-322> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=402
-321> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_segment r=0
-320> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=17
-319> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_epilogue_main r=0
-318> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_epilogue_main message integrity check success: expected_crc=3773825728 calculated_crc=3773825728
-317> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_dispatch tag=6
-316> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done payload.length()=402
-315> 2019-04-15 12:14:25.655 7f76d3c16700 10 monclient(hunting): handle_auth_done global_id 4336 payload 386
-314> 2019-04-15 12:14:25.655 7f76d3c16700 1 -- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
-313> 2019-04-15 12:14:25.655 7f76d3c16700 1 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop
-312> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).discard_out_queue started
-311> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).discard_out_queue discard mon_getmap magic: 0 v1
-310> 2019-04-15 12:14:25.655 7f76d3c16700 20 Event(0x562fd28e1280 nevent=5000 time_id=1).wakeup
-309> 2019-04-15 12:14:25.655 7f76d3c16700 1 -- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 msgr2=0x562fd37a6b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down
-308> 2019-04-15 12:14:25.655 7f76d3c16700 1 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop
-307> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).discard_out_queue started
-306> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).discard_out_queue discard mon_getmap magic: 0 v1
-305> 2019-04-15 12:14:25.655 7f76d3c16700 20 Event(0x562fd28e14c0 nevent=5000 time_id=1).wakeup
-304> 2019-04-15 12:14:25.655 7f76d3c16700 10 monclient: _finish_hunting 0
-303> 2019-04-15 12:14:25.655 7f76d3c16700 1 monclient: found mon.mon1
-302> 2019-04-15 12:14:25.655 7f76d3c16700 10 monclient: _send_mon_message to mon.mon1 at v2:192.168.1.11:3300/0
-301> 2019-04-15 12:14:25.655 7f76d3c16700 1 -- --> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] -- mon_subscribe({config=0+,monmap=2+}) v3 -- 0x562fd2902600 con 0x562fd3856480
-300> 2019-04-15 12:14:25.655 7f76d3c16700 5 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_message enqueueing message m=0x562fd2902600 type=15 mon_subscribe({config=0+,monmap=2+}) v3
-299> 2019-04-15 12:14:25.655 7f76d2c14700 20 EpollDriver.del_event del event fd=14 cur_mask=1 delmask=3 to 9
-298> 2019-04-15 12:14:25.655 7f76d3c16700 15 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_message inline write is denied, reschedule m=0x562fd2902600
-297> 2019-04-15 12:14:25.655 7f76d3c16700 10 monclient: _finish_auth 0
-296> 2019-04-15 12:14:25.655 7f76d3c16700 10 monclient: _check_auth_rotating renewing rotating keys (they expired before 2019-04-15 12:13:55.660217)
-295> 2019-04-15 12:14:25.655 7f76d3c16700 10 monclient: _send_mon_message to mon.mon1 at v2:192.168.1.11:3300/0
-294> 2019-04-15 12:14:25.655 7f76d3c16700 1 -- --> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] -- auth(proto 2 2 bytes epoch 0) v1 -- 0x562fd28e1b00 con 0x562fd3856480
-293> 2019-04-15 12:14:25.655 7f76d3c16700 5 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_message enqueueing message m=0x562fd28e1b00 type=17 auth(proto 2 2 bytes epoch 0) v1
-292> 2019-04-15 12:14:25.655 7f76d3c16700 15 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_message inline write is denied, reschedule m=0x562fd28e1b00
-291> 2019-04-15 12:14:25.655 7f76d9a85f00 5 monclient: authenticate success, global_id 4336
-290> 2019-04-15 12:14:25.655 7f76d3c16700 10 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send sent bytes 81 remaining bytes 0
-289> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0 tx=0).read_frame
-288> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=32
-287> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main r=0
-286> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main got new segment: len=32 align=8
-285> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0 tx=0).read_frame_segment
-284> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=32
-283> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_segment r=0
-282> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=17
-281> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_epilogue_main r=0
-280> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_epilogue_main message integrity check success: expected_crc=1554190114 calculated_crc=1554190114
-279> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_dispatch tag=7
-278> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_signature payload.length()=32
-277> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_signature pre-auth signature success sig_frame.signature()=18ce06ec4d27e5a301548a4c8383954cf5318e970df3dd36796a9ac2964ee6a6
-276> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_client_ident
-275> 2019-04-15 12:14:25.655 7f76d3c16700 1 --2- >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_client_ident getsockname reveals I am 192.168.1.101:46882 when talking to v2:192.168.1.11:3300/0
-274> 2019-04-15 12:14:25.655 7f76d3c16700 10 -- 192.168.1.101:0/1442708312 learned_addr had no addrs
-273> 2019-04-15 12:14:25.655 7f76d3c16700 1 -- 192.168.1.101:0/1442708312 learned_addr learned my addr 192.168.1.101:0/1442708312 (peer_addr_for_me v2:192.168.1.101:0/0)
-272> 2019-04-15 12:14:25.655 7f76d3c16700 5 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_client_ident sending identification: addrs=192.168.1.101:0/1442708312 target=v2:192.168.1.11:3300/0 gid=-1 global_seq=3 features_supported=3ffddff8ffacffff features_required=800000000000000 flags=0 cookie=20859292c09dfa81
-271> 2019-04-15 12:14:25.655 7f76d3c16700 10 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send sent bytes 172 remaining bytes 0
-270> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).read_frame
-269> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=32
-268> 2019-04-15 12:14:25.655 7f76d3415700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CLOSED l=0).process
-267> 2019-04-15 12:14:25.655 7f76d3415700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 msgr2=0x562fd37a6580 unknown :-1 s=STATE_CLOSED l=0).process socket closed
-266> 2019-04-15 12:14:25.655 7f76d3415700 20 EpollDriver.del_event del event fd=12 cur_mask=1 delmask=3 to 6
-265> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).process
-264> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read continue len=32
-263> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main r=0
-262> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main got new segment: len=123 align=8
-261> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).read_frame_segment
-260> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=123
-259> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_segment r=0
-258> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read start len=17
-257> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_epilogue_main r=0
-256> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_epilogue_main message integrity check success: expected_crc=2121502830 calculated_crc=2121502830
-255> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_dispatch tag=9
-254> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_server_ident payload.length()=123
-253> 2019-04-15 12:14:25.655 7f76d3c16700 5 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_server_ident received server identification: addrs=[v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] gid=1 global_seq=88 features_supported=3ffddff8ffacffff features_required=c01020002040000 flags=1 cookie=0
-252> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=SESSION_CONNECTING pgs=88 cs=0 l=1 rx=0 tx=0).handle_server_ident connect success 0, lossy = 1, features 4611087854031667199
-251> 2019-04-15 12:14:25.655 7f76d3c16700 1 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).ready entity=mon.1 client_cookie=20859292c09dfa81 server_cookie=0 in_seq=0 out_seq=0
-250> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).read_frame
-249> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32
-248> 2019-04-15 12:14:25.655 7f76d3c16700 10 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).handle_write
-247> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).write_event
-246> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).prepare_send_message m=mon_getmap magic: 0 v1
-245> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).prepare_send_message encoding features 4611087854031667199 0x562fd2984c40 mon_getmap magic: 0 v1
-244> 2019-04-15 12:14:25.655 7f76d3c16700 5 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).write_message sending message m=0x562fd2984c40 seq=1 mon_getmap magic: 0 v1
-243> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).write_message sending m=0x562fd2984c40 seq=1 src=client.? off=0
-242> 2019-04-15 12:14:25.655 7f76d3c16700 10 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 90 remaining bytes 0
-241> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).write_message sending 0x562fd2984c40 done.
-240> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).prepare_send_message m=mon_subscribe({config=0+,monmap=2+}) v3
-239> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).prepare_send_message encoding features 4611087854031667199 0x562fd2902600 mon_subscribe({config=0+,monmap=2+}) v3
-238> 2019-04-15 12:14:25.655 7f76d3c16700 5 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).write_message sending message m=0x562fd2902600 seq=2 mon_subscribe({config=0+,monmap=2+}) v3
-237> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).write_message sending m=0x562fd2902600 seq=2 src=client.? off=0
-236> 2019-04-15 12:14:25.655 7f76d3c16700 10 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 140 remaining bytes 0
-235> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).write_message sending 0x562fd2902600 done.
-234> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).prepare_send_message m=auth(proto 2 2 bytes epoch 0) v1
-233> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).prepare_send_message encoding features 4611087854031667199 0x562fd28e1b00 auth(proto 2 2 bytes epoch 0) v1
-232> 2019-04-15 12:14:25.655 7f76d3c16700 5 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).write_message sending message m=0x562fd28e1b00 seq=3 auth(proto 2 2 bytes epoch 0) v1
-231> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).write_message sending m=0x562fd28e1b00 seq=3 src=client.? off=0
-230> 2019-04-15 12:14:25.655 7f76d3c16700 10 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 122 remaining bytes 0
-229> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).write_message sending 0x562fd28e1b00 done.
-228> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process
-227> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=32
-226> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main r=0
-225> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main got new segment: len=41 align=8
-224> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main got new segment: len=404 align=8
-223> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_MESSAGE pgs=88 cs=0 l=1 rx=0 tx=0).throttle_message
-222> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_BYTES pgs=88 cs=0 l=1 rx=0 tx=0).throttle_bytes
-221> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DISPATCH_QUEUE pgs=88 cs=0 l=1 rx=0 tx=0).throttle_dispatch_queue
-220> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).read_frame_segment
-219> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=41
-218> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_segment r=0
-217> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).read_frame_segment
-216> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=404
-215> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_segment r=0
-214> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=17
-213> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_epilogue_main r=0
-212> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_epilogue_main message integrity check success: expected_crc=3804004365 calculated_crc=3804004365
-211> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_epilogue_main message integrity check success: expected_crc=137258709 calculated_crc=137258709
-210> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_dispatch tag=17
-209> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_message
-208> 2019-04-15 12:14:25.655 7f76d3c16700 5 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_message got 404 + 0 + 0 byte message. envelope type=4 src mon.1 off 0
-207> 2019-04-15 12:14:25.655 7f76d3c16700 5 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READ_MESSAGE_COMPLETE pgs=88 cs=0 l=1 rx=0 tx=0).handle_message received message m=0x562fd2902600 seq=1 from=mon.1 type=4 mon_map magic: 0 v1
-206> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 queue 0x562fd2902600 prio 196
-205> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).read_frame
-204> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32
-203> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main r=0
-202> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main got new segment: len=41 align=8
-201> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main got new segment: len=4 align=8
-200> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_MESSAGE pgs=88 cs=0 l=1 rx=0 tx=0).throttle_message
-199> 2019-04-15 12:14:25.655 7f76d2413700 1 -- 192.168.1.101:0/1442708312 <== mon.1 v2:192.168.1.11:3300/0 1 ==== mon_map magic: 0 v1 ==== 404+0+0 (crc 0 0 0) 0x562fd2902600 con 0x562fd3856480
-198> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_BYTES pgs=88 cs=0 l=1 rx=0 tx=0).throttle_bytes
-197> 2019-04-15 12:14:25.655 7f76d2413700 10 monclient: handle_monmap mon_map magic: 0 v1
-196> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DISPATCH_QUEUE pgs=88 cs=0 l=1 rx=0 tx=0).throttle_dispatch_queue
-195> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).read_frame_segment
-194> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=41
-193> 2019-04-15 12:14:25.655 7f76d2413700 10 monclient: got monmap 1 from mon.mon1 (according to old e1)
-192> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_segment r=0
-191> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).read_frame_segment
-190> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=4
-189> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_segment r=0
-188> 2019-04-15 12:14:25.655 7f76d2413700 10 monclient: dump:
epoch 1
fsid 0df2e290-18dd-4eed-b03e-0524e4a907a0
last_changed 2019-04-15 12:07:39.353235
created 2019-04-15 12:07:39.353235
min_mon_release 14 (nautilus)
0: [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] mon.mon0
1: [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] mon.mon1
2: [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] mon.mon2

-187> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=17
-186> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_epilogue_main r=0
-185> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_epilogue_main message integrity check success: expected_crc=958001000 calculated_crc=958001000
-184> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_epilogue_main message integrity check success: expected_crc=3080238136 calculated_crc=3080238136
-183> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_dispatch tag=17
-182> 2019-04-15 12:14:25.655 7f76d2413700 10 -- 192.168.1.101:0/1442708312 dispatch_throttle_release 404 to dispatch throttler 408/104857600
-181> 2019-04-15 12:14:25.655 7f76d2413700 20 -- 192.168.1.101:0/1442708312 done calling dispatch on 0x562fd2902600
-180> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_message
-179> 2019-04-15 12:14:25.655 7f76d3c16700 5 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_message got 4 + 0 + 0 byte message. envelope type=62 src mon.1 off 0
-178> 2019-04-15 12:14:25.655 7f76d3c16700 5 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READ_MESSAGE_COMPLETE pgs=88 cs=0 l=1 rx=0 tx=0).handle_message received message m=0x562fd29501e0 seq=2 from=mon.1 type=62 config(0 keys) v1
-177> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 queue 0x562fd29501e0 prio 196
-176> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).read_frame
-175> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32
-174> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main r=0
-173> 2019-04-15 12:14:25.655 7f76d2413700 1 -- 192.168.1.101:0/1442708312 <== mon.1 v2:192.168.1.11:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (crc 0 0 0) 0x562fd29501e0 con 0x562fd3856480
-172> 2019-04-15 12:14:25.655 7f76d2413700 10 monclient: handle_config config(0 keys) v1
-171> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main got new segment: len=41 align=8
-170> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main got new segment: len=194 align=8
-169> 2019-04-15 12:14:25.655 7f76d9a85f00 10 monclient: get_monmap_and_config success
-168> 2019-04-15 12:14:25.655 7f76d9a85f00 10 monclient: shutdown
-167> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_MESSAGE pgs=88 cs=0 l=1 rx=0 tx=0).throttle_message
-166> 2019-04-15 12:14:25.655 7f76d9a85f00 1 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down
-165> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_BYTES pgs=88 cs=0 l=1 rx=0 tx=0).throttle_bytes
-164> 2019-04-15 12:14:25.655 7f76d2413700 10 -- 192.168.1.101:0/1442708312 dispatch_throttle_release 4 to dispatch throttler 4/104857600
-163> 2019-04-15 12:14:25.655 7f76d2413700 20 -- 192.168.1.101:0/1442708312 done calling dispatch on 0x562fd29501e0
-162> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DISPATCH_QUEUE pgs=88 cs=0 l=1 rx=0 tx=0).throttle_dispatch_queue
-161> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).read_frame_segment
-160> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=41
-159> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_segment r=0
-158> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).read_frame_segment
-157> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=194
-156> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_segment r=0
-155> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=17
-154> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_epilogue_main r=0
-153> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_epilogue_main message integrity check success: expected_crc=2561527904 calculated_crc=2561527904
-152> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_epilogue_main message integrity check success: expected_crc=4142997112 calculated_crc=4142997112
-151> 2019-04-15 12:14:25.655 7f76d3c16700 10 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_read_frame_dispatch tag=17
-150> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_message
-149> 2019-04-15 12:14:25.655 7f76d3c16700 5 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0 tx=0).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.1 off 0
-148> 2019-04-15 12:14:25.655 7f76d3c16700 5 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READ_MESSAGE_COMPLETE pgs=88 cs=0 l=1 rx=0 tx=0).handle_message received message m=0x562fd28e1b00 seq=3 from=mon.1 type=18 auth_reply(proto 2 0 (0) Success) v1
-147> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 queue 0x562fd28e1b00 prio 196
-146> 2019-04-15 12:14:25.655 7f76d3c16700 20 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).read_frame
-145> 2019-04-15 12:14:25.655 7f76d3c16700 20 -- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 msgr2=0x562fd37a7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32
-144> 2019-04-15 12:14:25.655 7f76d9a85f00 1 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).stop
-143> 2019-04-15 12:14:25.655 7f76d9a85f00 10 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).discard_out_queue started
-142> 2019-04-15 12:14:25.655 7f76d9a85f00 20 Event(0x562fd28e0bc0 nevent=5000 time_id=2).wakeup
-141> 2019-04-15 12:14:25.655 7f76d2413700 1 -- 192.168.1.101:0/1442708312 <== mon.1 v2:192.168.1.11:3300/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (unknown 0 0 0) 0x562fd28e1b00 con 0x562fd3856480
-140> 2019-04-15 12:14:25.655 7f76d2413700 10 monclient: discarding stray monitor message auth_reply(proto 2 0 (0) Success) v1
-139> 2019-04-15 12:14:25.655 7f76d2413700 10 -- 192.168.1.101:0/1442708312 dispatch_throttle_release 194 to dispatch throttler 194/104857600
-138> 2019-04-15 12:14:25.655 7f76d2413700 20 -- 192.168.1.101:0/1442708312 done calling dispatch on 0x562fd28e1b00
-137> 2019-04-15 12:14:25.655 7f76d3c16700 20 EpollDriver.del_event del event fd=13 cur_mask=1 delmask=3 to 3
-136> 2019-04-15 12:14:25.655 7f76d0c10700 4 set_mon_vals no callback set
-135> 2019-04-15 12:14:25.659 7f76d9a85f00 10 -- 192.168.1.101:0/1442708312 shutdown 192.168.1.101:0/1442708312
-134> 2019-04-15 12:14:25.659 7f76d9a85f00 10 Processor -- stop
-133> 2019-04-15 12:14:25.659 7f76d9a85f00 20 Event(0x562fd28e0bc0 nevent=5000 time_id=2).wakeup
-132> 2019-04-15 12:14:25.659 7f76d9a85f00 1 -- 192.168.1.101:0/1442708312 shutdown_connections
-131> 2019-04-15 12:14:25.659 7f76d9a85f00 5 -- 192.168.1.101:0/1442708312 shutdown_connections mark down [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] 0x562fd2b7da80
-130> 2019-04-15 12:14:25.659 7f76d9a85f00 1 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.12:3300/0,v1:192.168.1.12:6789/0] conn(0x562fd2b7da80 0x562fd37a6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop
-129> 2019-04-15 12:14:25.659 7f76d9a85f00 5 -- 192.168.1.101:0/1442708312 shutdown_connections mark down [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] 0x562fd3856480
-128> 2019-04-15 12:14:25.659 7f76d9a85f00 1 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.11:3300/0,v1:192.168.1.11:6789/0] conn(0x562fd3856480 0x562fd37a7080 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop
-127> 2019-04-15 12:14:25.659 7f76d9a85f00 5 -- 192.168.1.101:0/1442708312 shutdown_connections mark down [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] 0x562fd3856000
-126> 2019-04-15 12:14:25.659 7f76d9a85f00 1 --2- 192.168.1.101:0/1442708312 >> [v2:192.168.1.10:3300/0,v1:192.168.1.10:6789/0] conn(0x562fd3856000 0x562fd37a6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop
-125> 2019-04-15 12:14:25.659 7f76d9a85f00 5 -- 192.168.1.101:0/1442708312 shutdown_connections delete 0x562fd2b7da80
-124> 2019-04-15 12:14:25.659 7f76d9a85f00 5 -- 192.168.1.101:0/1442708312 shutdown_connections delete 0x562fd3856000
-123> 2019-04-15 12:14:25.659 7f76d9a85f00 5 -- 192.168.1.101:0/1442708312 shutdown_connections delete 0x562fd3856480
-122> 2019-04-15 12:14:25.659 7f76d9a85f00 20 Event(0x562fd28e0bc0 nevent=5000 time_id=2).wakeup
-121> 2019-04-15 12:14:25.659 7f76d9a85f00 20 Event(0x562fd28e1280 nevent=5000 time_id=1).wakeup
-120> 2019-04-15 12:14:25.659 7f76d9a85f00 20 Event(0x562fd28e14c0 nevent=5000 time_id=1).wakeup
-119> 2019-04-15 12:14:25.659 7f76d9a85f00 10 -- 192.168.1.101:0/1442708312 wait: waiting for dispatch queue
-118> 2019-04-15 12:14:25.659 7f76d9a85f00 10 -- 192.168.1.101:0/1442708312 wait: dispatch queue is stopped
-117> 2019-04-15 12:14:25.659 7f76d9a85f00 1 -- 192.168.1.101:0/1442708312 shutdown_connections
-116> 2019-04-15 12:14:25.659 7f76d9a85f00 20 Event(0x562fd28e0bc0 nevent=5000 time_id=2).wakeup
-115> 2019-04-15 12:14:25.659 7f76d9a85f00 20 Event(0x562fd28e1280 nevent=5000 time_id=1).wakeup
-114> 2019-04-15 12:14:25.659 7f76d9a85f00 20 Event(0x562fd28e14c0 nevent=5000 time_id=1).wakeup
-113> 2019-04-15 12:14:25.659 7f76d9a85f00 10 -- 192.168.1.101:0/1442708312 wait: done.
-112> 2019-04-15 12:14:25.659 7f76d9a85f00 1 -- 192.168.1.101:0/1442708312 wait complete.
-111> 2019-04-15 12:14:25.659 7f76d9a85f00 1 -- 192.168.1.101:0/1442708312 >> 192.168.1.101:0/1442708312 conn(0x562fd2b7d600 msgr2=0x562fd37b0000 unknown :-1 s=STATE_NONE l=0).mark_down
-110> 2019-04-15 12:14:25.659 7f76d9a85f00 20 --1- 192.168.1.101:0/1442708312 >> 192.168.1.101:0/1442708312 conn(0x562fd2b7d600 0x562fd37b0000 :-1 s=NONE pgs=0 cs=0 l=0).stop
-109> 2019-04-15 12:14:25.659 7f76d9a85f00 2 --1- 192.168.1.101:0/1442708312 >> 192.168.1.101:0/1442708312 conn(0x562fd2b7d600 0x562fd37b0000 :-1 s=NONE pgs=0 cs=0 l=0).stop
-108> 2019-04-15 12:14:25.659 7f76d9a85f00 10 --1- 192.168.1.101:0/1442708312 >> 192.168.1.101:0/1442708312 conn(0x562fd2b7d600 0x562fd37b0000 :-1 s=NONE pgs=0 cs=0 l=0).discard_out_queue started
-107> 2019-04-15 12:14:25.659 7f76d9a85f00 20 Event(0x562fd28e0bc0 nevent=5000 time_id=2).wakeup
-106> 2019-04-15 12:14:25.659 7f76d9a85f00 0 set uid:gid to 64045:64045 (ceph:ceph)
-105> 2019-04-15 12:14:25.659 7f76d9a85f00 0 ceph version 14.2.0 (3a54b2b6d167d4a2a19e003a705696d4fe619afc) nautilus (stable), process ceph-osd, pid 123240
-104> 2019-04-15 12:14:25.659 7f76d9a85f00 20 Event(0x562fd28e0bc0 nevent=5000 time_id=2).wakeup
-103> 2019-04-15 12:14:25.659 7f76d9a85f00 20 Event(0x562fd28e1280 nevent=5000 time_id=1).wakeup
-102> 2019-04-15 12:14:25.659 7f76d9a85f00 20 Event(0x562fd28e14c0 nevent=5000 time_id=1).wakeup
-101> 2019-04-15 12:14:25.659 7f76d9a85f00 0 pidfile_write: ignore empty --pid-file
-100> 2019-04-15 12:14:25.663 7f76d9a85f00 5 asok(0x562fd2c78000) init /var/run/ceph/ceph-osd.3.asok
-99> 2019-04-15 12:14:25.663 7f76d9a85f00 5 asok(0x562fd2c78000) bind_and_listen /var/run/ceph/ceph-osd.3.asok
-98> 2019-04-15 12:14:25.663 7f76d9a85f00 5 asok(0x562fd2c78000) register_command 0 hook 0x562fd28dd418
-97> 2019-04-15 12:14:25.663 7f76d9a85f00 5 asok(0x562fd2c78000) register_command version hook 0x562fd28dd418
-96> 2019-04-15 12:14:25.663 7f76d9a85f00 5 asok(0x562fd2c78000) register_command git_version hook 0x562fd28dd418
-95> 2019-04-15 12:14:25.663 7f76d9a85f00 5 asok(0x562fd2c78000) register_command help hook 0x562fd28de4f0
-94> 2019-04-15 12:14:25.663 7f76d9a85f00 5 asok(0x562fd2c78000) register_command get_command_descriptions hook 0x562fd28de500
-93> 2019-04-15 12:14:25.663 7f76d3415700 5 asok(0x562fd2c78000) entry start
-92> 2019-04-15 12:14:25.663 7f76d9a85f00 10 bluestore(/var/lib/ceph/osd/ceph-3/) set_cache_shards 1
-91> 2019-04-15 12:14:25.663 7f76d9a85f00 1 bluestore(/var/lib/ceph/osd/ceph-3/) mkfs path /var/lib/ceph/osd/ceph-3/
-90> 2019-04-15 12:14:25.663 7f76d9a85f00 10 bluestore(/var/lib/ceph/osd/ceph-3//block) _read_bdev_label
-89> 2019-04-15 12:14:25.663 7f76d9a85f00 2 bluestore(/var/lib/ceph/osd/ceph-3//block) _read_bdev_label unable to decode label at offset 102: buffer::malformed_input: void bluestore_bdev_label_t::decode(ceph::buffer::v14_2_0::list::const_iterator&) decode past end of struct encoding
-88> 2019-04-15 12:14:25.663 7f76d9a85f00 10 bluestore(/var/lib/ceph/osd/ceph-3//block) _read_bdev_label
-87> 2019-04-15 12:14:25.663 7f76d9a85f00 2 bluestore(/var/lib/ceph/osd/ceph-3//block) _read_bdev_label unable to decode label at offset 102: buffer::malformed_input: void bluestore_bdev_label_t::decode(ceph::buffer::v14_2_0::list::const_iterator&) decode past end of struct encoding
-86> 2019-04-15 12:14:25.663 7f76d9a85f00 10 bluestore(/var/lib/ceph/osd/ceph-3//block) _read_bdev_label
-85> 2019-04-15 12:14:25.663 7f76d9a85f00 2 bluestore(/var/lib/ceph/osd/ceph-3//block) _read_bdev_label unable to decode label at offset 102: buffer::malformed_input: void bluestore_bdev_label_t::decode(ceph::buffer::v14_2_0::list::const_iterator&) decode past end of struct encoding
-84> 2019-04-15 12:14:25.663 7f76d9a85f00 -1 bluestore(/var/lib/ceph/osd/ceph-3/) _read_fsid unparsable uuid
-83> 2019-04-15 12:14:25.663 7f76d9a85f00 1 bluestore(/var/lib/ceph/osd/ceph-3/) mkfs using provided fsid 90385b3d-fe47-4c1d-92e0-0735a0ce5c14
-82> 2019-04-15 12:14:25.663 7f76d9a85f00 20 bluestore(/var/lib/ceph/osd/ceph-3/) _setup_block_symlink_or_file name block path size 10737418240 create=1
-81> 2019-04-15 12:14:25.663 7f76d9a85f00 20 bluestore(/var/lib/ceph/osd/ceph-3/) _setup_block_symlink_or_file name block.wal path size 100663296 create=0
-80> 2019-04-15 12:14:25.663 7f76d9a85f00 20 bluestore(/var/lib/ceph/osd/ceph-3/) _setup_block_symlink_or_file name block.db path /dev/journals/journal1 size 0 create=0
-79> 2019-04-15 12:14:25.663 7f76d9a85f00 1 bdev create path /var/lib/ceph/osd/ceph-3//block type kernel
-78> 2019-04-15 12:14:25.663 7f76d9a85f00 1 bdev(0x562fd3766700 /var/lib/ceph/osd/ceph-3//block) open path /var/lib/ceph/osd/ceph-3//block
-77> 2019-04-15 12:14:25.663 7f76d9a85f00 1 bdev(0x562fd3766700 /var/lib/ceph/osd/ceph-3//block) open size 13421772800 (0x320000000, 12 GiB) block_size 4096 (4 KiB) rotational discard supported
-76> 2019-04-15 12:14:25.663 7f76d9a85f00 10 bluestore(/var/lib/ceph/osd/ceph-3//block) _write_bdev_label path /var/lib/ceph/osd/ceph-3//block label bdev(osd_uuid 90385b3d-fe47-4c1d-92e0-0735a0ce5c14, size 0x320000000, btime 2019-04-15 12:14:25.669429, desc main, 0 meta)
-75> 2019-04-15 12:14:25.691 7f76d9a85f00 1 bluestore(/var/lib/ceph/osd/ceph-3/) _set_cache_sizes cache_size 1073741824 meta 0.4 kv 0.4 data 0.2
-74> 2019-04-15 12:14:25.691 7f76d9a85f00 10 bluestore(/var/lib/ceph/osd/ceph-3/) _open_db kv_backend = rocksdb
-73> 2019-04-15 12:14:25.691 7f76d9a85f00 10 bluestore(/var/lib/ceph/osd/ceph-3/) _open_db do_bluefs = 1
-72> 2019-04-15 12:14:25.691 7f76d9a85f00 10 bluestore(/var/lib/ceph/osd/ceph-3/) _open_db initializing bluefs
-71> 2019-04-15 12:14:25.691 7f76d9a85f00 10 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-3//block.db
-70> 2019-04-15 12:14:25.691 7f76d9a85f00 1 bdev create path /var/lib/ceph/osd/ceph-3//block.db type kernel
-69> 2019-04-15 12:14:25.691 7f76d9a85f00 1 bdev(0x562fd3766a80 /var/lib/ceph/osd/ceph-3//block.db) open path /var/lib/ceph/osd/ceph-3//block.db
-68> 2019-04-15 12:14:25.691 7f76d9a85f00 1 bdev(0x562fd3766a80 /var/lib/ceph/osd/ceph-3//block.db) open size 26839351296 (0x63fc00000, 25 GiB) block_size 4096 (4 KiB) rotational discard supported
-67> 2019-04-15 12:14:25.691 7f76d9a85f00 1 bluefs add_block_device bdev 1 path /var/lib/ceph/osd/ceph-3//block.db size 25 GiB
-66> 2019-04-15 12:14:25.691 7f76d9a85f00 10 bluestore(/var/lib/ceph/osd/ceph-3//block.db) _write_bdev_label path /var/lib/ceph/osd/ceph-3//block.db label bdev(osd_uuid 90385b3d-fe47-4c1d-92e0-0735a0ce5c14, size 0x63fc00000, btime 2019-04-15 12:14:25.694534, desc bluefs db, 0 meta)
-65> 2019-04-15 12:14:25.707 7f76d9a85f00 1 bluefs _add_block_extent bdev 1 0x2000~63fbfe000
-64> 2019-04-15 12:14:25.707 7f76d9a85f00 10 bluefs _add_block_extent done
-63> 2019-04-15 12:14:25.707 7f76d9a85f00 10 bluefs _flush_and_sync_log want_seq 0 txn(seq 0 len 0x0 crc 0xffffffff) not dirty, dirty_files empty, no-op
-62> 2019-04-15 12:14:25.707 7f76d9a85f00 10 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-3//block
-61> 2019-04-15 12:14:25.707 7f76d9a85f00 1 bdev create path /var/lib/ceph/osd/ceph-3//block type kernel
-60> 2019-04-15 12:14:25.707 7f76d9a85f00 1 bdev(0x562fd3766e00 /var/lib/ceph/osd/ceph-3//block) open path /var/lib/ceph/osd/ceph-3//block
-59> 2019-04-15 12:14:25.707 7f76d9a85f00 1 bdev(0x562fd3766e00 /var/lib/ceph/osd/ceph-3//block) open size 13421772800 (0x320000000, 12 GiB) block_size 4096 (4 KiB) rotational discard supported
-58> 2019-04-15 12:14:25.707 7f76d9a85f00 1 bluefs add_block_device bdev 2 path /var/lib/ceph/osd/ceph-3//block size 12 GiB
-57> 2019-04-15 12:14:25.707 7f76d9a85f00 1 bluefs _add_block_extent bdev 2 0x170000000~40000000
-56> 2019-04-15 12:14:25.707 7f76d9a85f00 10 bluefs _add_block_extent done
-55> 2019-04-15 12:14:25.707 7f76d9a85f00 10 bluefs _flush_and_sync_log want_seq 0 txn(seq 0 len 0x0 crc 0xffffffff) not dirty, dirty_files empty, no-op
-54> 2019-04-15 12:14:25.707 7f76d9a85f00 1 bluefs mkfs osd_uuid 90385b3d-fe47-4c1d-92e0-0735a0ce5c14
-53> 2019-04-15 12:14:25.707 7f76d9a85f00 20 bluefs _init_alloc
-52> 2019-04-15 12:14:25.707 7f76d9a85f00 10 fbmap_alloc 0x562fd2958300 BitmapAllocator 0x63fc00000/100000
-51> 2019-04-15 12:14:25.707 7f76d9a85f00 10 fbmap_alloc 0x562fd2958300 init_add_free 0x2000~63fbfe000
-50> 2019-04-15 12:14:25.707 7f76d9a85f00 10 fbmap_alloc 0x562fd2958300 init_add_free done
-49> 2019-04-15 12:14:25.707 7f76d9a85f00 10 fbmap_alloc 0x562fd2958400 BitmapAllocator 0x320000000/100000
-48> 2019-04-15 12:14:25.711 7f76d9a85f00 10 fbmap_alloc 0x562fd2958400 init_add_free 0x170000000~40000000
-47> 2019-04-15 12:14:25.711 7f76d9a85f00 10 fbmap_alloc 0x562fd2958400 init_add_free done
-46> 2019-04-15 12:14:25.711 7f76d9a85f00 1 bluefs mkfs uuid 2ed85005-a3e1-413c-ab5f-0af4a2e126ad
-45> 2019-04-15 12:14:25.711 7f76d9a85f00 10 bluefs _allocate len 0x400000 from 0
-44> 2019-04-15 12:14:25.711 7f76d9a85f00 10 bluefs _allocate len 0x400000 from 1
-43> 2019-04-15 12:14:25.711 7f76d9a85f00 10 fbmap_alloc 0x562fd2958300 allocate 0x400000/100000,400000,0
-42> 2019-04-15 12:14:25.711 7f76d9a85f00 10 fbmap_alloc 0x562fd2958300 allocate 0x100000~400000/100000,400000,0
-41> 2019-04-15 12:14:25.711 7f76d9a85f00 20 bluefs mkfs op_alloc_add 1 0x2000~63fbfe000
-40> 2019-04-15 12:14:25.711 7f76d9a85f00 20 bluefs mkfs op_alloc_add 2 0x170000000~40000000
-39> 2019-04-15 12:14:25.711 7f76d9a85f00 10 bluefs _flush_and_sync_log txn(seq 1 len 0x25 crc 0x7f22e346)
-38> 2019-04-15 12:14:25.711 7f76d9a85f00 10 bluefs _flush 0x562fd2981680 0x0~1000 to file(ino 1 size 0x0 mtime 0.000000 bdev 0 allocated 400000 extents [1:0x100000~400000])
-37> 2019-04-15 12:14:25.711 7f76d9a85f00 10 bluefs _flush_range 0x562fd2981680 pos 0x0 0x0~1000 to file(ino 1 size 0x0 mtime 0.000000 bdev 0 allocated 400000 extents [1:0x100000~400000])
-36> 2019-04-15 12:14:25.711 7f76d9a85f00 20 bluefs _flush_range file now file(ino 1 size 0x1000 mtime 0.000000 bdev 0 allocated 400000 extents [1:0x100000~400000])
-35> 2019-04-15 12:14:25.711 7f76d9a85f00 20 bluefs _flush_range in 1:0x100000~400000 x_off 0x0
-34> 2019-04-15 12:14:25.711 7f76d9a85f00 20 bluefs _flush_range h 0x562fd2981680 pos now 0x1000
-33> 2019-04-15 12:14:25.711 7f76d9a85f00 10 bluefs _claim_completed_aios got 1 aios
-32> 2019-04-15 12:14:25.711 7f76d9a85f00 10 bluefs wait_for_aio 0x562fd2981680
-31> 2019-04-15 12:14:25.719 7f76d9a85f00 10 bluefs wait_for_aio 0x562fd2981680 done in 0.009824
-30> 2019-04-15 12:14:25.719 7f76d9a85f00 20 bluefs flush_bdev
-29> 2019-04-15 12:14:25.727 7f76d9a85f00 20 bluefs _flush_and_sync_log log_seq_stable 1
-28> 2019-04-15 12:14:25.727 7f76d9a85f00 10 bluefs _write_super super block length(encoded): 89
-27> 2019-04-15 12:14:25.727 7f76d9a85f00 10 bluefs _write_super superblock 1
-26> 2019-04-15 12:14:25.727 7f76d9a85f00 10 bluefs _write_super log_fnode file(ino 1 size 0x1000 mtime 0.000000 bdev 0 allocated 400000 extents [1:0x100000~400000])
-25> 2019-04-15 12:14:25.727 7f76d9a85f00 20 bluefs _write_super v 1 crc 0xde115834 offset 0x1000
-24> 2019-04-15 12:14:25.727 7f76d9a85f00 20 bluefs flush_bdev
-23> 2019-04-15 12:14:25.743 7f76d9a85f00 10 bluefs _close_writer 0x562fd2981680 type 0
-22> 2019-04-15 12:14:25.743 7f76d9a85f00 20 bluefs _stop_alloc
-21> 2019-04-15 12:14:25.743 7f76d9a85f00 1 fbmap_alloc 0x562fd2958300 shutdown
-20> 2019-04-15 12:14:25.743 7f76d9a85f00 1 fbmap_alloc 0x562fd2958400 shutdown
-19> 2019-04-15 12:14:25.743 7f76d9a85f00 10 bluefs mkfs success
-18> 2019-04-15 12:14:25.743 7f76d9a85f00 1 bluefs mount
-17> 2019-04-15 12:14:25.743 7f76d9a85f00 10 bluefs _open_super
-16> 2019-04-15 12:14:25.743 7f76d9a85f00 10 bluefs _open_super superblock 1
-15> 2019-04-15 12:14:25.743 7f76d9a85f00 10 bluefs _open_super log_fnode file(ino 1 size 0x1000 mtime 0.000000 bdev 0 allocated 400000 extents [1:0x100000~400000])
-14> 2019-04-15 12:14:25.743 7f76d9a85f00 20 bluefs _init_alloc
-13> 2019-04-15 12:14:25.743 7f76d9a85f00 10 fbmap_alloc 0x562fd2958400 BitmapAllocator 0x63fc00000/100000
-12> 2019-04-15 12:14:25.743 7f76d9a85f00 10 fbmap_alloc 0x562fd2958300 BitmapAllocator 0x320000000/100000
-11> 2019-04-15 12:14:25.743 7f76d9a85f00 10 bluefs _replay
-10> 2019-04-15 12:14:25.743 7f76d9a85f00 10 bluefs _replay log_fnode file(ino 1 size 0x1000 mtime 0.000000 bdev 0 allocated 400000 extents [1:0x100000~400000])
-9> 2019-04-15 12:14:25.743 7f76d9a85f00 10 bluefs _read h 0x562fd292c990 0x0~1000 from file(ino 1 size 0x1000 mtime 0.000000 bdev 0 allocated 400000 extents [1:0x100000~400000])
-8> 2019-04-15 12:14:25.743 7f76d9a85f00 20 bluefs _read fetching 0x0~100000 of 1:0x100000~400000
-7> 2019-04-15 12:14:25.747 7f76d9a85f00 20 bluefs _read left 0x100000 len 0x1000
-6> 2019-04-15 12:14:25.747 7f76d9a85f00 20 bluefs _read got 4096
-5> 2019-04-15 12:14:25.747 7f76d9a85f00 10 bluefs _replay 0x0: stop: uuid 00000000-0000-0000-0000-000000000000 != super.uuid 2ed85005-a3e1-413c-ab5f-0af4a2e126ad
-4> 2019-04-15 12:14:25.747 7f76d9a85f00 10 bluefs _replay log file size was 0x1000
-3> 2019-04-15 12:14:25.747 7f76d9a85f00 10 bluefs _replay done
-2> 2019-04-15 12:14:25.747 7f76d9a85f00 10 fbmap_alloc 0x562fd2958400 init_rm_free 0x100000~400000
-1> 2019-04-15 12:14:25.747 7f76d9a85f00 -1 /build/ceph-14.2.0/src/os/bluestore/fastbmap_allocator_impl.h: In function 'void AllocatorLevel02<T>::_mark_allocated(uint64_t, uint64_t) [with L1 = AllocatorLevel01Loose; uint64_t = long unsigned int]' thread 7f76d9a85f00 time 2019-04-15 12:14:25.749988
/build/ceph-14.2.0/src/os/bluestore/fastbmap_allocator_impl.h: 731: FAILED ceph_assert(available >= allocated)

ceph version 14.2.0 (3a54b2b6d167d4a2a19e003a705696d4fe619afc) nautilus (stable)
1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x562fc6fb67e0]
2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x562fc6fb69bb]
3: (BitmapAllocator::init_rm_free(unsigned long, unsigned long)+0x6fc) [0x562fc76b9b8c]
4: (BlueFS::mount()+0x2a0) [0x562fc7685630]
5: (BlueStore::_open_bluefs(bool)+0x8c) [0x562fc7560a0c]
6: (BlueStore::_open_db(bool, bool, bool)+0xa5c) [0x562fc7561d8c]
7: (BlueStore::mkfs()+0x11d1) [0x562fc75c7351]
8: (OSD::mkfs(CephContext*, ObjectStore*, uuid_d, int)+0xd5) [0x562fc70c4c35]
9: (main()+0x1979) [0x562fc6fbb849]
10: (__libc_start_main()+0xe7) [0x7f76d5f42b97]
11: (_start()+0x2a) [0x562fc70a312a]

0> 2019-04-15 12:14:25.751 7f76d9a85f00 -1 *** Caught signal (Aborted) **
in thread 7f76d9a85f00 thread_name:ceph-osd

ceph version 14.2.0 (3a54b2b6d167d4a2a19e003a705696d4fe619afc) nautilus (stable)
1: (()+0x12890) [0x7f76d72ad890]
2: (gsignal()+0xc7) [0x7f76d5f5fe97]
3: (abort()+0x141) [0x7f76d5f61801]
4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x562fc6fb6831]
5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x562fc6fb69bb]
6: (BitmapAllocator::init_rm_free(unsigned long, unsigned long)+0x6fc) [0x562fc76b9b8c]
7: (BlueFS::mount()+0x2a0) [0x562fc7685630]
8: (BlueStore::_open_bluefs(bool)+0x8c) [0x562fc7560a0c]
9: (BlueStore::_open_db(bool, bool, bool)+0xa5c) [0x562fc7561d8c]
10: (BlueStore::mkfs()+0x11d1) [0x562fc75c7351]
11: (OSD::mkfs(CephContext*, ObjectStore*, uuid_d, int)+0xd5) [0x562fc70c4c35]
12: (main()+0x1979) [0x562fc6fbb849]
13: (__libc_start_main()+0xe7) [0x7f76d5f42b97]
14: (_start()+0x2a) [0x562fc70a312a]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

--- logging levels ---
0/ 5 none
0/ 1 lockdep
0/ 1 context
1/ 1 crush
1/ 5 mds
1/ 5 mds_balancer
1/ 5 mds_locker
1/ 5 mds_log
1/ 5 mds_log_expire
1/ 5 mds_migrator
0/ 1 buffer
0/ 1 timer
0/ 1 filer
0/ 1 striper
0/ 1 objecter
0/ 5 rados
0/ 5 rbd
0/ 5 rbd_mirror
0/ 5 rbd_replay
0/ 5 journaler
0/ 5 objectcacher
0/ 5 client
1/ 5 osd
0/ 5 optracker
0/ 5 objclass
1/ 3 filestore
1/ 3 journal
20/20 ms
1/ 5 mon
0/10 monc
1/ 5 paxos
0/ 5 tp
1/ 5 auth
1/ 5 crypto
1/ 1 finisher
1/ 1 reserver
1/ 5 heartbeatmap
1/ 5 perfcounter
1/ 5 rgw
1/ 5 rgw_sync
1/10 civetweb
1/ 5 javaclient
1/ 5 asok
1/ 1 throttle
0/ 0 refs
1/ 5 xio
1/ 5 compressor
20/20 bluestore
20/20 bluefs
1/ 3 bdev
1/ 5 kstore
4/ 5 rocksdb
4/ 5 leveldb
4/ 5 memdb
1/ 5 kinetic
1/ 5 fuse
1/ 5 mgr
1/ 5 mgrc
1/ 5 dpdk
1/ 5 eventtrace
-2/-2 (syslog threshold)
-1/-1 (stderr threshold)
max_recent 10000
max_new 1000
log_file /var/log/ceph/ceph-osd.3.log
--- end dump of recent events ---
(2-2/2)