cephadmin@cc3:~$ ceph -s 2017-05-17 10:21:08.045841 7f99605200 10 -- :/0 ready :/0 2017-05-17 10:21:08.049206 7f99605200 1 -- :/0 messenger.start 2017-05-17 10:21:08.051223 7f91fff200 10 -- :/593602058 reaper_entry start 2017-05-17 10:21:08.051253 7f91fff200 10 -- :/593602058 reaper 2017-05-17 10:21:08.051262 7f91fff200 10 -- :/593602058 reaper done 2017-05-17 10:21:08.055154 7f99605200 10 -- :/593602058 connect_rank to 172.12.55.160:6789/0, creating pipe and registering 2017-05-17 10:21:08.055352 7f99605200 10 -- :/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=-1 :0 s=1 pgs=0 cs=0 l=1 c=0x7f94063910).register_pipe 2017-05-17 10:21:08.055415 7f99605200 10 -- :/593602058 get_connection mon.0 172.12.55.160:6789/0 new 0x7f9405e780 2017-05-17 10:21:08.055512 7f99605200 1 -- :/593602058 --> 172.12.55.160:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- ?+0 0x7f94064010 con 0x7f94063910 2017-05-17 10:21:08.055843 7f98481200 10 -- :/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=-1 :0 s=1 pgs=0 cs=0 l=1 c=0x7f94063910).writer: state = connecting policy.server=0 2017-05-17 10:21:08.055903 7f98481200 10 -- :/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=-1 :0 s=1 pgs=0 cs=0 l=1 c=0x7f94063910).connect 0 2017-05-17 10:21:08.056001 7f98481200 10 -- :/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :0 s=1 pgs=0 cs=0 l=1 c=0x7f94063910).connecting to 172.12.55.160:6789/0 2017-05-17 10:21:08.058893 7f98481200 1 -- 172.12.55.159:0/593602058 learned my addr 172.12.55.159:0/593602058 2017-05-17 10:21:08.059216 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=1 pgs=0 cs=0 l=1 c=0x7f94063910).connect sent my addr 172.12.55.159:0/593602058 2017-05-17 10:21:08.059297 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=1 pgs=0 cs=0 l=1 c=0x7f94063910).connect sending gseq=1 cseq=0 proto=15 2017-05-17 10:21:08.061029 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).connect success 1, lossy = 1, features 576460752032874495 2017-05-17 10:21:08.061342 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.061417 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).write_keepalive2 14 2017-05-17 10:21:08.061415 2017-05-17 10:21:08.061842 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.064440 7f98381200 2 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).reader got KEEPALIVE_ACK 2017-05-17 10:21:08.066832 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).reader wants 193 from dispatch throttler 0/104857600 2017-05-17 10:21:08.067031 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).aborted = 0 2017-05-17 10:21:08.067389 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).No session security set 2017-05-17 10:21:08.067497 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).reader got message 1 0x7f88000ed0 mon_map magic: 0 v1 2017-05-17 10:21:08.068013 7f92fff200 1 -- 172.12.55.159:0/593602058 <== mon.0 172.12.55.160:6789/0 1 ==== mon_map magic: 0 v1 ==== 193+0+0 (0 0 0) 0x7f88000ed0 con 0x7f94063910 2017-05-17 10:21:08.068351 7f92fff200 10 -- 172.12.55.159:0/593602058 dispatch_throttle_release 193 to dispatch throttler 193/104857600 2017-05-17 10:21:08.068484 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.068522 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).reader wants 33 from dispatch throttler 0/104857600 2017-05-17 10:21:08.068596 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).aborted = 0 2017-05-17 10:21:08.068717 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).No session security set 2017-05-17 10:21:08.068774 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).write_ack 1 2017-05-17 10:21:08.068866 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.069113 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).reader got message 2 0x7f88001770 auth_reply(proto 2 0 (0) Success) v1 2017-05-17 10:21:08.069383 7f92fff200 1 -- 172.12.55.159:0/593602058 <== mon.0 172.12.55.160:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (0 0 0) 0x7f88001770 con 0x7f94063910 2017-05-17 10:21:08.070028 7f92fff200 1 -- 172.12.55.159:0/593602058 --> 172.12.55.160:6789/0 -- auth(proto 2 32 bytes epoch 0) v1 -- ?+0 0x7f7c001530 con 0x7f94063910 2017-05-17 10:21:08.070370 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.070487 7f92fff200 10 -- 172.12.55.159:0/593602058 dispatch_throttle_release 33 to dispatch throttler 33/104857600 2017-05-17 10:21:08.070553 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).write_ack 2 2017-05-17 10:21:08.070762 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.072723 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).reader wants 206 from dispatch throttler 0/104857600 2017-05-17 10:21:08.072831 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).aborted = 0 2017-05-17 10:21:08.072981 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).No session security set 2017-05-17 10:21:08.073048 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).reader got message 3 0x7f88001f10 auth_reply(proto 2 0 (0) Success) v1 2017-05-17 10:21:08.073361 7f92fff200 1 -- 172.12.55.159:0/593602058 <== mon.0 172.12.55.160:6789/0 3 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 206+0+0 (0 0 0) 0x7f88001f10 con 0x7f94063910 2017-05-17 10:21:08.074271 7f92fff200 1 -- 172.12.55.159:0/593602058 --> 172.12.55.160:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- ?+0 0x7f7c001940 con 0x7f94063910 2017-05-17 10:21:08.074453 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.074543 7f92fff200 10 -- 172.12.55.159:0/593602058 dispatch_throttle_release 206 to dispatch throttler 206/104857600 2017-05-17 10:21:08.074603 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).write_ack 3 2017-05-17 10:21:08.074885 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.077853 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).reader wants 393 from dispatch throttler 0/104857600 2017-05-17 10:21:08.077984 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).aborted = 0 2017-05-17 10:21:08.078066 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).No session security set 2017-05-17 10:21:08.078216 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).reader got message 4 0x7f88002580 auth_reply(proto 2 0 (0) Success) v1 2017-05-17 10:21:08.078462 7f92fff200 1 -- 172.12.55.159:0/593602058 <== mon.0 172.12.55.160:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 393+0+0 (0 0 0) 0x7f88002580 con 0x7f94063910 2017-05-17 10:21:08.079515 7f92fff200 1 -- 172.12.55.159:0/593602058 --> 172.12.55.160:6789/0 -- mon_subscribe({monmap=0+}) v2 -- ?+0 0x7f94067e30 con 0x7f94063910 2017-05-17 10:21:08.079662 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.080186 7f99605200 1 -- 172.12.55.159:0/593602058 --> 172.12.55.160:6789/0 -- mon_subscribe({osdmap=0}) v2 -- ?+0 0x7f94066f20 con 0x7f94063910 2017-05-17 10:21:08.080679 7f92fff200 10 -- 172.12.55.159:0/593602058 dispatch_throttle_release 393 to dispatch throttler 393/104857600 2017-05-17 10:21:08.081205 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).write_ack 4 2017-05-17 10:21:08.081731 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.082109 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.083957 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).reader wants 193 from dispatch throttler 0/104857600 2017-05-17 10:21:08.084345 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).aborted = 0 2017-05-17 10:21:08.084556 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).No session security set 2017-05-17 10:21:08.084784 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).reader got message 5 0x7f88002bf0 mon_map magic: 0 v1 2017-05-17 10:21:08.085057 7f92fff200 1 -- 172.12.55.159:0/593602058 <== mon.0 172.12.55.160:6789/0 5 ==== mon_map magic: 0 v1 ==== 193+0+0 (0 0 0) 0x7f88002bf0 con 0x7f94063910 2017-05-17 10:21:08.085302 7f92fff200 10 -- 172.12.55.159:0/593602058 dispatch_throttle_release 193 to dispatch throttler 193/104857600 2017-05-17 10:21:08.085548 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.085776 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).write_ack 5 2017-05-17 10:21:08.085844 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.086054 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).reader wants 2905 from dispatch throttler 0/104857600 2017-05-17 10:21:08.086175 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).aborted = 0 2017-05-17 10:21:08.086327 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).No session security set 2017-05-17 10:21:08.086441 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).reader got message 6 0x7f88003cc0 osd_map(14..14 src has 1..14) v3 2017-05-17 10:21:08.086595 7f92fff200 1 -- 172.12.55.159:0/593602058 <== mon.0 172.12.55.160:6789/0 6 ==== osd_map(14..14 src has 1..14) v3 ==== 2905+0+0 (0 0 0) 0x7f88003cc0 con 0x7f94063910 2017-05-17 10:21:08.086926 7f92fff200 10 -- 172.12.55.159:0/593602058 dispatch_throttle_release 2905 to dispatch throttler 2905/104857600 2017-05-17 10:21:08.087129 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.087175 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).write_ack 6 2017-05-17 10:21:08.087215 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.112188 7f99605200 1 -- 172.12.55.159:0/593602058 --> 172.12.55.160:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- ?+0 0x7f940510e0 con 0x7f94063910 2017-05-17 10:21:08.112260 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.112722 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.129794 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).reader wants 41629 from dispatch throttler 0/104857600 2017-05-17 10:21:08.131084 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).aborted = 0 2017-05-17 10:21:08.131333 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).No session security set 2017-05-17 10:21:08.132013 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).reader got message 7 0x7f88003890 mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 2017-05-17 10:21:08.132506 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.132677 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).write_ack 7 2017-05-17 10:21:08.132821 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.132802 7f92fff200 1 -- 172.12.55.159:0/593602058 <== mon.0 172.12.55.160:6789/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+41557 (0 0 0) 0x7f88003890 con 0x7f94063910 2017-05-17 10:21:08.133072 7f92fff200 10 -- 172.12.55.159:0/593602058 dispatch_throttle_release 41629 to dispatch throttler 41629/104857600 2017-05-17 10:21:08.767580 7f99605200 1 -- 172.12.55.159:0/593602058 --> 172.12.55.160:6789/0 -- mon_command({"prefix": "status"} v 0) v1 -- ?+0 0x7f94067880 con 0x7f94063910 2017-05-17 10:21:08.767667 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.768117 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.775900 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).reader wants 447 from dispatch throttler 0/104857600 2017-05-17 10:21:08.776014 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).aborted = 0 2017-05-17 10:21:08.776313 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).No session security set 2017-05-17 10:21:08.776399 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).reader got message 8 0x7f88004320 mon_command_ack([{"prefix": "status"}]=0 v0) v1 2017-05-17 10:21:08.776673 7f92fff200 1 -- 172.12.55.159:0/593602058 <== mon.0 172.12.55.160:6789/0 8 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+393 (0 0 0) 0x7f88004320 con 0x7f94063910 2017-05-17 10:21:08.776990 7f92fff200 10 -- 172.12.55.159:0/593602058 dispatch_throttle_release 447 to dispatch throttler 447/104857600 2017-05-17 10:21:08.777062 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 2017-05-17 10:21:08.777096 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).write_ack 8 2017-05-17 10:21:08.777152 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).writer: state = open policy.server=0 cluster aa74a643-7b86-4585-b31c-f2e715533b53 health HEALTH_OK monmap e1: 1 mons at {cc1=172.12.55.160:6789/0} election epoch 3, quorum 0 cc1 osdmap e14: 3 osds: 3 up, 3 in flags sortbitwise,require_jewel_osds pgmap v35: 64 pgs, 1 pools, 0 bytes data, 0 objects 100 MB used, 5571 GB / 5571 GB avail 64 active+clean 2017-05-17 10:21:08.795057 7f99605200 1 -- 172.12.55.159:0/593602058 mark_down 0x7f94063910 -- 0x7f9405e780 2017-05-17 10:21:08.795117 7f99605200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).unregister_pipe 2017-05-17 10:21:08.795175 7f99605200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=2 pgs=130 cs=1 l=1 c=0x7f94063910).stop 2017-05-17 10:21:08.795823 7f98381200 2 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=4 pgs=130 cs=1 l=1 c=0x7f94063910).reader couldn't read tag, (0) Success 2017-05-17 10:21:08.796010 7f98381200 2 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=4 pgs=130 cs=1 l=1 c=0x7f94063910).fault (0) Success 2017-05-17 10:21:08.796082 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=4 pgs=130 cs=1 l=1 c=0x7f94063910).fault already closed|closing 2017-05-17 10:21:08.796138 7f98381200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=4 pgs=130 cs=1 l=1 c=0x7f94063910).reader done 2017-05-17 10:21:08.796630 7f98481200 10 -- 172.12.55.159:0/593602058 queue_reap 0x7f9405e780 2017-05-17 10:21:08.796710 7f98481200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=4 pgs=130 cs=1 l=1 c=0x7f94063910).writer done 2017-05-17 10:21:08.796958 7f91fff200 10 -- 172.12.55.159:0/593602058 reaper 2017-05-17 10:21:08.796996 7f91fff200 10 -- 172.12.55.159:0/593602058 reaper reaping pipe 0x7f9405e780 172.12.55.160:6789/0 2017-05-17 10:21:08.797030 7f91fff200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=4 pgs=130 cs=1 l=1 c=0x7f94063910).discard_queue 2017-05-17 10:21:08.797150 7f91fff200 10 -- 172.12.55.159:0/593602058 >> 172.12.55.160:6789/0 pipe(0x7f9405e780 sd=3 :54026 s=4 pgs=130 cs=1 l=1 c=0x7f94063910).unregister_pipe - not registered 2017-05-17 10:21:08.797331 7f91fff200 10 -- 172.12.55.159:0/593602058 reaper reaped pipe 0x7f9405e780 172.12.55.160:6789/0 2017-05-17 10:21:08.797390 7f91fff200 10 -- 172.12.55.159:0/593602058 reaper deleted pipe 0x7f9405e780 2017-05-17 10:21:08.797422 7f91fff200 10 -- 172.12.55.159:0/593602058 reaper done 2017-05-17 10:21:08.799889 7f99605200 10 -- 172.12.55.159:0/593602058 shutdown 172.12.55.159:0/593602058 2017-05-17 10:21:08.799991 7f99605200 1 -- 172.12.55.159:0/593602058 mark_down_all 2017-05-17 10:21:08.801798 7f99605200 10 -- 172.12.55.159:0/593602058 wait: waiting for dispatch queue 2017-05-17 10:21:08.803188 7f99605200 10 -- 172.12.55.159:0/593602058 wait: dispatch queue is stopped 2017-05-17 10:21:08.803359 7f91fff200 10 -- 172.12.55.159:0/593602058 reaper_entry done 2017-05-17 10:21:08.805003 7f99605200 10 -- 172.12.55.159:0/593602058 wait: closing pipes 2017-05-17 10:21:08.805097 7f99605200 10 -- 172.12.55.159:0/593602058 reaper 2017-05-17 10:21:08.805120 7f99605200 10 -- 172.12.55.159:0/593602058 reaper done 2017-05-17 10:21:08.805139 7f99605200 10 -- 172.12.55.159:0/593602058 wait: waiting for pipes to close 2017-05-17 10:21:08.805159 7f99605200 10 -- 172.12.55.159:0/593602058 wait: done. 2017-05-17 10:21:08.805175 7f99605200 1 -- 172.12.55.159:0/593602058 shutdown complete. cephadmin@cc3:~$