2017-12-16 18:41:03.882311 mon.node1 unknown.0 - 0 : [INF] mkfs d754e98d-5b4b-4539-9ef1-e5610d03ebf5 2017-12-16 18:40:53.746261 mon.node1 mon.0 10.193.56.230:6789/0 1 : cluster [INF] mon.node1 calling new monitor election 2017-12-16 18:40:50.810065 mon.node4 mon.1 10.193.56.233:6789/0 5 : cluster [INF] mon.node4 calling new monitor election 2017-12-16 18:40:52.168311 mon.node5 mon.2 10.193.56.234:6789/0 5 : cluster [INF] mon.node5 calling new monitor election 2017-12-16 18:40:53.730948 mon.node4 mon.2 10.193.56.233:6789/0 6 : cluster [INF] mon.node4 calling new monitor election 2017-12-16 18:40:54.749219 mon.node1 mon.0 10.193.56.230:6789/0 6 : cluster [INF] mon.node1 calling new monitor election 2017-12-16 18:40:54.808221 mon.node2 mon.1 10.193.56.231:6789/0 1 : cluster [INF] mon.node2 calling new monitor election 2017-12-16 18:40:55.089266 mon.node5 mon.3 10.193.56.234:6789/0 6 : cluster [INF] mon.node5 calling new monitor election 2017-12-16 18:40:56.638515 mon.node4 mon.3 10.193.56.233:6789/0 7 : cluster [INF] mon.node4 calling new monitor election 2017-12-16 18:40:57.718119 mon.node3 mon.1 10.193.56.232:6789/0 1 : cluster [INF] mon.node3 calling new monitor election 2017-12-16 18:40:57.812497 mon.node2 mon.1 10.193.56.231:6789/0 6 : cluster [INF] mon.node2 calling new monitor election 2017-12-16 18:40:57.866989 mon.node4 mon.3 10.193.56.233:6789/0 8 : cluster [INF] mon.node4 calling new monitor election 2017-12-16 18:40:57.996500 mon.node5 mon.4 10.193.56.234:6789/0 7 : cluster [INF] mon.node5 calling new monitor election 2017-12-16 18:40:58.716220 mon.node3 mon.2 10.193.56.232:6789/0 2 : cluster [INF] mon.node3 calling new monitor election 2017-12-16 18:40:58.752521 mon.node1 mon.0 10.193.56.230:6789/0 7 : cluster [INF] mon.node1 calling new monitor election 2017-12-16 18:40:58.763575 mon.node1 mon.0 10.193.56.230:6789/0 8 : cluster [INF] mon.node1@0 won leader election with quorum 0,1,2,3,4 2017-12-16 18:40:58.766684 mon.node3 mon.2 10.193.56.232:6789/0 3 : cluster [INF] mon.node3 calling new monitor election 2017-12-16 18:40:58.803791 mon.node1 mon.0 10.193.56.230:6789/0 9 : cluster [INF] mon.node1 calling new monitor election 2017-12-16 18:40:58.865324 mon.node2 mon.1 10.193.56.231:6789/0 7 : cluster [INF] mon.node2 calling new monitor election 2017-12-16 18:40:59.225435 mon.node5 mon.4 10.193.56.234:6789/0 8 : cluster [INF] mon.node5 calling new monitor election 2017-12-16 18:41:03.813536 mon.node1 mon.0 10.193.56.230:6789/0 10 : cluster [INF] mon.node1@0 won leader election with quorum 0,2,3,4 2017-12-16 18:41:03.819235 mon.node1 mon.0 10.193.56.230:6789/0 11 : cluster [INF] HEALTH_ERR; no osds; 1 mons down, quorum 0,2,3,4 node1,node3,node4,node5 2017-12-16 18:41:03.825496 mon.node1 mon.0 10.193.56.230:6789/0 12 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 18:41:03.826696 mon.node1 mon.0 10.193.56.230:6789/0 13 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 18:41:03.829480 mon.node1 mon.0 10.193.56.230:6789/0 14 : cluster [INF] monmap e1: 5 mons at {node1=10.193.56.230:6789/0,node2=10.193.56.231:6789/0,node3=10.193.56.232:6789/0,node4=10.193.56.233:6789/0,node5=10.193.56.234:6789/0} 2017-12-16 18:41:03.834329 mon.node1 mon.0 10.193.56.230:6789/0 15 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 18:41:03.838945 mon.node1 mon.0 10.193.56.230:6789/0 16 : cluster [INF] mon.node1 calling new monitor election 2017-12-16 18:41:03.856249 mon.node1 mon.0 10.193.56.230:6789/0 17 : cluster [INF] mon.node1@0 won leader election with quorum 0,1,2,3,4 2017-12-16 18:41:03.859037 mon.node1 mon.0 10.193.56.230:6789/0 18 : cluster [INF] HEALTH_ERR; no osds 2017-12-16 18:41:03.866262 mon.node1 mon.0 10.193.56.230:6789/0 19 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 18:41:03.866299 mon.node1 mon.0 10.193.56.230:6789/0 20 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 18:41:03.866441 mon.node1 mon.0 10.193.56.230:6789/0 21 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 18:41:03.870026 mon.node1 mon.0 10.193.56.230:6789/0 22 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 18:41:03.872296 mon.node2 mon.1 10.193.56.231:6789/0 8 : cluster [INF] mon.node2 calling new monitor election 2017-12-16 18:41:03.877695 mon.node1 mon.0 10.193.56.230:6789/0 23 : cluster [INF] monmap e1: 5 mons at {node1=10.193.56.230:6789/0,node2=10.193.56.231:6789/0,node3=10.193.56.232:6789/0,node4=10.193.56.233:6789/0,node5=10.193.56.234:6789/0} 2017-12-16 18:41:03.877726 mon.node1 mon.0 10.193.56.230:6789/0 24 : cluster [INF] pgmap 0 pgs: ; 0 bytes data, 0 kB used, 0 kB / 0 kB avail 2017-12-16 18:41:11.975637 mon.node1 mon.0 10.193.56.230:6789/0 42 : cluster [INF] Activating manager daemon node1 2017-12-16 18:41:12.185761 mon.node1 mon.0 10.193.56.230:6789/0 44 : cluster [INF] Manager daemon node1 is now available 2017-12-16 18:41:16.247479 mon.node1 mon.0 10.193.56.230:6789/0 63 : cluster [WRN] Health check failed: noscrub flag(s) set (OSDMAP_FLAGS) 2017-12-16 18:41:21.746724 mon.node1 mon.0 10.193.56.230:6789/0 70 : cluster [WRN] Health check update: noscrub,nodeep-scrub flag(s) set (OSDMAP_FLAGS) 2017-12-16 18:41:55.158658 mon.node1 mon.0 10.193.56.230:6789/0 108 : cluster [INF] osd.3 10.193.56.232:6800/4434 boot 2017-12-16 18:41:55.158712 mon.node1 mon.0 10.193.56.230:6789/0 109 : cluster [INF] osd.0 10.193.56.233:6800/11031 boot 2017-12-16 18:41:55.158747 mon.node1 mon.0 10.193.56.230:6789/0 110 : cluster [INF] osd.2 10.193.56.234:6800/21851 boot 2017-12-16 18:41:55.158833 mon.node1 mon.0 10.193.56.230:6789/0 112 : cluster [INF] osd.1 10.193.56.231:6800/4885 boot 2017-12-16 18:41:56.197397 mon.node1 mon.0 10.193.56.230:6789/0 121 : cluster [INF] osd.4 10.193.56.230:6801/18252 boot 2017-12-16 18:42:03.859122 mon.node1 mon.0 10.193.56.230:6789/0 129 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set 2017-12-16 18:42:22.675908 mon.node1 mon.0 10.193.56.230:6789/0 163 : cluster [INF] osd.5 10.193.56.233:6804/19567 boot 2017-12-16 18:42:23.733405 mon.node1 mon.0 10.193.56.230:6789/0 177 : cluster [INF] osd.7 10.193.56.232:6804/11090 boot 2017-12-16 18:42:23.733494 mon.node1 mon.0 10.193.56.230:6789/0 178 : cluster [INF] osd.9 10.193.56.231:6804/11827 boot 2017-12-16 18:42:23.733566 mon.node1 mon.0 10.193.56.230:6789/0 179 : cluster [INF] osd.6 10.193.56.230:6805/30229 boot 2017-12-16 18:42:23.733628 mon.node1 mon.0 10.193.56.230:6789/0 180 : cluster [INF] osd.8 10.193.56.234:6804/29635 boot 2017-12-16 18:42:51.168387 mon.node1 mon.0 10.193.56.230:6789/0 228 : cluster [INF] osd.10 10.193.56.230:6809/11074 boot 2017-12-16 18:42:51.168462 mon.node1 mon.0 10.193.56.230:6789/0 229 : cluster [INF] osd.13 10.193.56.234:6808/5525 boot 2017-12-16 18:42:51.168516 mon.node1 mon.0 10.193.56.230:6789/0 230 : cluster [INF] osd.11 10.193.56.233:6808/29503 boot 2017-12-16 18:42:51.168604 mon.node1 mon.0 10.193.56.230:6789/0 231 : cluster [INF] osd.12 10.193.56.232:6808/18269 boot 2017-12-16 18:42:51.168678 mon.node1 mon.0 10.193.56.230:6789/0 232 : cluster [INF] osd.14 10.193.56.231:6808/18093 boot 2017-12-16 18:43:18.314192 mon.node1 mon.0 10.193.56.230:6789/0 272 : cluster [INF] osd.16 10.193.56.233:6812/5522 boot 2017-12-16 18:43:18.314282 mon.node1 mon.0 10.193.56.230:6789/0 273 : cluster [INF] osd.15 10.193.56.230:6813/22179 boot 2017-12-16 18:43:19.344643 mon.node1 mon.0 10.193.56.230:6789/0 282 : cluster [INF] osd.19 10.193.56.234:6812/13646 boot 2017-12-16 18:43:19.344712 mon.node1 mon.0 10.193.56.230:6789/0 283 : cluster [INF] osd.17 10.193.56.232:6812/24242 boot 2017-12-16 18:43:19.344783 mon.node1 mon.0 10.193.56.230:6789/0 284 : cluster [INF] osd.18 10.193.56.231:6812/24620 boot 2017-12-16 18:43:44.903433 mon.node1 mon.0 10.193.56.230:6789/0 316 : cluster [INF] osd.20 10.193.56.230:6817/2415 boot 2017-12-16 18:43:46.965342 mon.node1 mon.0 10.193.56.230:6789/0 329 : cluster [INF] osd.21 10.193.56.233:6816/12786 boot 2017-12-16 18:43:48.026759 mon.node1 mon.0 10.193.56.230:6789/0 339 : cluster [INF] osd.22 10.193.56.232:6816/30850 boot 2017-12-16 18:43:48.026846 mon.node1 mon.0 10.193.56.230:6789/0 340 : cluster [INF] osd.23 10.193.56.234:6816/21593 boot 2017-12-16 18:43:48.026897 mon.node1 mon.0 10.193.56.230:6789/0 341 : cluster [INF] osd.24 10.193.56.231:6816/31424 boot 2017-12-16 18:44:12.926609 mon.node1 mon.0 10.193.56.230:6789/0 373 : cluster [INF] osd.25 10.193.56.230:6821/13468 boot 2017-12-16 18:44:14.999296 mon.node1 mon.0 10.193.56.230:6789/0 390 : cluster [INF] osd.26 10.193.56.233:6820/20112 boot 2017-12-16 18:44:14.999353 mon.node1 mon.0 10.193.56.230:6789/0 391 : cluster [INF] osd.27 10.193.56.232:6820/5320 boot 2017-12-16 18:44:16.018499 mon.node1 mon.0 10.193.56.230:6789/0 399 : cluster [INF] osd.29 10.193.56.231:6820/6003 boot 2017-12-16 18:44:16.018632 mon.node1 mon.0 10.193.56.230:6789/0 400 : cluster [INF] osd.28 10.193.56.234:6820/29482 boot 2017-12-16 18:44:40.873295 mon.node1 mon.0 10.193.56.230:6789/0 432 : cluster [INF] osd.30 10.193.56.230:6825/27010 boot 2017-12-16 18:44:41.907748 mon.node1 mon.0 10.193.56.230:6789/0 438 : cluster [INF] osd.31 10.193.56.233:6824/27546 boot 2017-12-16 18:44:43.968557 mon.node1 mon.0 10.193.56.230:6789/0 454 : cluster [INF] osd.33 10.193.56.234:6824/3623 boot 2017-12-16 18:44:43.968605 mon.node1 mon.0 10.193.56.230:6789/0 455 : cluster [INF] osd.34 10.193.56.231:6824/13450 boot 2017-12-16 18:44:43.968729 mon.node1 mon.0 10.193.56.230:6789/0 456 : cluster [INF] osd.32 10.193.56.232:6824/12642 boot 2017-12-16 18:45:09.146572 mon.node1 mon.0 10.193.56.230:6789/0 485 : cluster [INF] osd.35 10.193.56.230:6829/7316 boot 2017-12-16 18:45:11.205066 mon.node1 mon.0 10.193.56.230:6789/0 497 : cluster [INF] osd.36 10.193.56.232:6828/19379 boot 2017-12-16 18:45:12.243412 mon.node1 mon.0 10.193.56.230:6789/0 505 : cluster [INF] osd.38 10.193.56.231:6828/19981 boot 2017-12-16 18:45:12.243472 mon.node1 mon.0 10.193.56.230:6789/0 506 : cluster [INF] osd.37 10.193.56.234:6828/10714 boot 2017-12-16 18:45:15.338239 mon.node1 mon.0 10.193.56.230:6789/0 518 : cluster [INF] osd.39 10.193.56.233:6828/4592 boot 2017-12-16 18:45:37.251605 mon.node1 mon.0 10.193.56.230:6789/0 543 : cluster [INF] osd.40 10.193.56.230:6833/17477 boot 2017-12-16 18:45:39.331193 mon.node1 mon.0 10.193.56.230:6789/0 554 : cluster [INF] osd.41 10.193.56.232:6832/26089 boot 2017-12-16 18:45:40.390660 mon.node1 mon.0 10.193.56.230:6789/0 563 : cluster [INF] osd.42 10.193.56.234:6832/17598 boot 2017-12-16 18:45:41.430895 mon.node1 mon.0 10.193.56.230:6789/0 567 : cluster [INF] osd.43 10.193.56.231:6832/26930 boot 2017-12-16 18:45:44.550012 mon.node1 mon.0 10.193.56.230:6789/0 578 : cluster [INF] osd.44 10.193.56.233:6832/12444 boot 2017-12-16 18:46:03.859424 mon.node1 mon.0 10.193.56.230:6789/0 603 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 18:46:03.859490 mon.node1 mon.0 10.193.56.230:6789/0 604 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 18:46:03.859546 mon.node1 mon.0 10.193.56.230:6789/0 605 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 18:46:03.859567 mon.node1 mon.0 10.193.56.230:6789/0 606 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 18:46:05.881235 mon.node1 mon.0 10.193.56.230:6789/0 613 : cluster [INF] osd.45 10.193.56.230:6837/32169 boot 2017-12-16 18:46:07.942209 mon.node1 mon.0 10.193.56.230:6789/0 624 : cluster [INF] osd.47 10.193.56.234:6836/24823 boot 2017-12-16 18:46:07.942272 mon.node1 mon.0 10.193.56.230:6789/0 625 : cluster [INF] osd.46 10.193.56.232:6836/32535 boot 2017-12-16 18:46:08.977231 mon.node1 mon.0 10.193.56.230:6789/0 631 : cluster [INF] osd.48 10.193.56.231:6836/32682 boot 2017-12-16 18:46:12.075103 mon.node1 mon.0 10.193.56.230:6789/0 643 : cluster [INF] osd.49 10.193.56.233:6836/20188 boot 2017-12-16 18:46:32.772596 mon.node1 mon.0 10.193.56.230:6789/0 670 : cluster [INF] osd.50 10.193.56.230:6841/11351 boot 2017-12-16 18:46:36.903578 mon.node1 mon.0 10.193.56.230:6789/0 683 : cluster [INF] osd.51 10.193.56.234:6840/31884 boot 2017-12-16 18:46:36.903668 mon.node1 mon.0 10.193.56.230:6789/0 684 : cluster [INF] osd.52 10.193.56.232:6840/7376 boot 2017-12-16 18:46:37.928426 mon.node1 mon.0 10.193.56.230:6789/0 690 : cluster [INF] osd.53 10.193.56.231:6840/7545 boot 2017-12-16 18:46:41.036101 mon.node1 mon.0 10.193.56.230:6789/0 704 : cluster [INF] osd.54 10.193.56.233:6840/27866 boot 2017-12-16 18:47:01.650924 mon.node1 mon.0 10.193.56.230:6789/0 732 : cluster [INF] osd.55 10.193.56.230:6845/21610 boot 2017-12-16 18:47:04.750930 mon.node1 mon.0 10.193.56.230:6789/0 746 : cluster [INF] osd.56 10.193.56.234:6844/6833 boot 2017-12-16 18:47:04.750994 mon.node1 mon.0 10.193.56.230:6789/0 747 : cluster [INF] osd.57 10.193.56.232:6844/14310 boot 2017-12-16 18:47:06.807042 mon.node1 mon.0 10.193.56.230:6789/0 753 : cluster [INF] osd.58 10.193.56.231:6844/15008 boot 2017-12-16 18:47:08.883898 mon.node1 mon.0 10.193.56.230:6789/0 763 : cluster [INF] osd.59 10.193.56.233:6844/4233 boot 2017-12-16 18:47:28.655826 mon.node1 mon.0 10.193.56.230:6789/0 788 : cluster [INF] osd.60 10.193.56.230:6849/5794 boot 2017-12-16 18:47:32.800544 mon.node1 mon.0 10.193.56.230:6789/0 800 : cluster [INF] osd.61 10.193.56.234:6848/14678 boot 2017-12-16 18:47:33.818175 mon.node1 mon.0 10.193.56.230:6789/0 804 : cluster [INF] osd.62 10.193.56.232:6848/21939 boot 2017-12-16 18:47:35.891340 mon.node1 mon.0 10.193.56.230:6789/0 814 : cluster [INF] osd.63 10.193.56.231:6848/22951 boot 2017-12-16 18:47:37.971410 mon.node1 mon.0 10.193.56.230:6789/0 821 : cluster [INF] osd.64 10.193.56.233:6848/12612 boot 2017-12-16 18:47:57.211922 mon.node1 mon.0 10.193.56.230:6789/0 847 : cluster [INF] osd.65 10.193.56.230:6853/16583 boot 2017-12-16 18:48:00.318774 mon.node1 mon.0 10.193.56.230:6789/0 856 : cluster [INF] osd.66 10.193.56.234:6852/20111 boot 2017-12-16 18:48:01.357586 mon.node1 mon.0 10.193.56.230:6789/0 862 : cluster [INF] osd.67 10.193.56.232:6852/28568 boot 2017-12-16 18:48:03.408215 mon.node1 mon.0 10.193.56.230:6789/0 871 : cluster [INF] osd.68 10.193.56.231:6852/29146 boot 2017-12-16 18:48:05.481177 mon.node1 mon.0 10.193.56.230:6789/0 879 : cluster [INF] osd.69 10.193.56.233:6852/19469 boot 2017-12-16 18:48:25.203094 mon.node1 mon.0 10.193.56.230:6789/0 907 : cluster [INF] osd.70 10.193.56.230:6857/28032 boot 2017-12-16 18:48:29.430363 mon.node1 mon.0 10.193.56.230:6789/0 918 : cluster [INF] osd.71 10.193.56.234:6856/26986 boot 2017-12-16 18:48:30.455176 mon.node1 mon.0 10.193.56.230:6789/0 924 : cluster [INF] osd.72 10.193.56.232:6856/2937 boot 2017-12-16 18:48:32.539285 mon.node1 mon.0 10.193.56.230:6789/0 931 : cluster [INF] osd.73 10.193.56.231:6856/4077 boot 2017-12-16 18:48:34.626103 mon.node1 mon.0 10.193.56.230:6789/0 939 : cluster [INF] osd.74 10.193.56.233:6856/26950 boot 2017-12-16 18:48:54.018545 mon.node1 mon.0 10.193.56.230:6789/0 967 : cluster [INF] osd.75 10.193.56.230:6861/12175 boot 2017-12-16 18:48:58.152889 mon.node1 mon.0 10.193.56.230:6789/0 978 : cluster [INF] osd.77 10.193.56.234:6860/3085 boot 2017-12-16 18:48:58.152953 mon.node1 mon.0 10.193.56.230:6789/0 979 : cluster [INF] osd.76 10.193.56.232:6860/11476 boot 2017-12-16 18:49:02.290461 mon.node1 mon.0 10.193.56.230:6789/0 992 : cluster [INF] osd.78 10.193.56.231:6860/12358 boot 2017-12-16 18:49:02.290499 mon.node1 mon.0 10.193.56.230:6789/0 993 : cluster [INF] osd.79 10.193.56.233:6860/4156 boot 2017-12-16 18:49:23.220073 mon.node1 mon.0 10.193.56.230:6789/0 1020 : cluster [INF] osd.80 10.193.56.230:6865/22806 boot 2017-12-16 18:49:27.454250 mon.node1 mon.0 10.193.56.230:6789/0 1028 : cluster [INF] osd.81 10.193.56.234:6864/10076 boot 2017-12-16 18:49:30.552068 mon.node1 mon.0 10.193.56.230:6789/0 1041 : cluster [INF] osd.82 10.193.56.231:6864/18345 boot 2017-12-16 18:49:31.586244 mon.node1 mon.0 10.193.56.230:6789/0 1045 : cluster [INF] osd.83 10.193.56.233:6864/11325 boot 2017-12-16 18:49:51.979943 mon.node1 mon.0 10.193.56.230:6789/0 1070 : cluster [INF] osd.84 10.193.56.230:6869/5076 boot 2017-12-16 18:49:56.211982 mon.node1 mon.0 10.193.56.230:6789/0 1078 : cluster [INF] osd.85 10.193.56.234:6868/17854 boot 2017-12-16 18:49:59.307551 mon.node1 mon.0 10.193.56.230:6789/0 1089 : cluster [INF] osd.86 10.193.56.233:6868/20364 boot 2017-12-16 18:49:59.307605 mon.node1 mon.0 10.193.56.230:6789/0 1090 : cluster [INF] osd.87 10.193.56.231:6868/26019 boot 2017-12-16 18:50:20.389680 mon.node1 mon.0 10.193.56.230:6789/0 1115 : cluster [INF] osd.88 10.193.56.230:6873/16829 boot 2017-12-16 18:50:24.500578 mon.node1 mon.0 10.193.56.230:6789/0 1128 : cluster [INF] osd.89 10.193.56.232:6864/28400 boot 2017-12-16 18:50:25.519332 mon.node1 mon.0 10.193.56.230:6789/0 1133 : cluster [INF] osd.90 10.193.56.234:6872/25219 boot 2017-12-16 18:50:28.635477 mon.node1 mon.0 10.193.56.230:6789/0 1146 : cluster [INF] osd.92 10.193.56.231:6872/670 boot 2017-12-16 18:50:28.635519 mon.node1 mon.0 10.193.56.230:6789/0 1147 : cluster [INF] osd.91 10.193.56.233:6872/28094 boot 2017-12-16 18:50:49.260526 mon.node1 mon.0 10.193.56.230:6789/0 1177 : cluster [INF] osd.93 10.193.56.230:6877/29944 boot 2017-12-16 18:50:52.363221 mon.node1 mon.0 10.193.56.230:6789/0 1187 : cluster [INF] osd.94 10.193.56.232:6868/4163 boot 2017-12-16 18:50:53.405172 mon.node1 mon.0 10.193.56.230:6789/0 1192 : cluster [INF] osd.95 10.193.56.234:6876/1024 boot 2017-12-16 18:50:56.475843 mon.node1 mon.0 10.193.56.230:6789/0 1202 : cluster [INF] osd.96 10.193.56.233:6876/4723 boot 2017-12-16 18:50:57.516898 mon.node1 mon.0 10.193.56.230:6789/0 1208 : cluster [INF] osd.97 10.193.56.231:6876/8966 boot 2017-12-16 18:51:03.859661 mon.node1 mon.0 10.193.56.230:6789/0 1218 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 18:51:03.859697 mon.node1 mon.0 10.193.56.230:6789/0 1219 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 18:51:03.859724 mon.node1 mon.0 10.193.56.230:6789/0 1220 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 18:51:03.859752 mon.node1 mon.0 10.193.56.230:6789/0 1221 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 18:51:18.153986 mon.node1 mon.0 10.193.56.230:6789/0 1244 : cluster [INF] osd.98 10.193.56.230:6881/11692 boot 2017-12-16 18:51:21.265164 mon.node1 mon.0 10.193.56.230:6789/0 1253 : cluster [INF] osd.99 10.193.56.232:6872/11674 boot 2017-12-16 18:51:22.303209 mon.node1 mon.0 10.193.56.230:6789/0 1258 : cluster [INF] osd.100 10.193.56.234:6880/8221 boot 2017-12-16 18:51:25.392173 mon.node1 mon.0 10.193.56.230:6789/0 1267 : cluster [INF] osd.101 10.193.56.233:6880/13374 boot 2017-12-16 18:51:26.435569 mon.node1 mon.0 10.193.56.230:6789/0 1272 : cluster [INF] osd.102 10.193.56.231:6880/16849 boot 2017-12-16 18:51:47.218939 mon.node1 mon.0 10.193.56.230:6789/0 1303 : cluster [INF] osd.103 10.193.56.230:6885/26385 boot 2017-12-16 18:51:50.305467 mon.node1 mon.0 10.193.56.230:6789/0 1311 : cluster [INF] osd.104 10.193.56.232:6876/19105 boot 2017-12-16 18:51:51.377310 mon.node1 mon.0 10.193.56.230:6789/0 1317 : cluster [INF] osd.105 10.193.56.234:6884/15308 boot 2017-12-16 18:51:54.483886 mon.node1 mon.0 10.193.56.230:6789/0 1328 : cluster [INF] osd.106 10.193.56.233:6884/21027 boot 2017-12-16 18:51:55.527280 mon.node1 mon.0 10.193.56.230:6789/0 1334 : cluster [INF] osd.107 10.193.56.231:6884/24910 boot 2017-12-16 18:52:16.724312 mon.node1 mon.0 10.193.56.230:6789/0 1363 : cluster [INF] osd.108 10.193.56.230:6889/10681 boot 2017-12-16 18:52:19.819589 mon.node1 mon.0 10.193.56.230:6789/0 1372 : cluster [INF] osd.109 10.193.56.232:6880/28513 boot 2017-12-16 18:52:20.859255 mon.node1 mon.0 10.193.56.230:6789/0 1377 : cluster [INF] osd.110 10.193.56.234:6888/23619 boot 2017-12-16 18:52:23.952651 mon.node1 mon.0 10.193.56.230:6789/0 1390 : cluster [INF] osd.111 10.193.56.233:6888/30260 boot 2017-12-16 18:52:24.993040 mon.node1 mon.0 10.193.56.230:6789/0 1394 : cluster [INF] osd.112 10.193.56.231:6888/32526 boot 2017-12-16 18:52:46.243700 mon.node1 mon.0 10.193.56.230:6789/0 1425 : cluster [INF] osd.113 10.193.56.230:6893/24995 boot 2017-12-16 18:52:48.315662 mon.node1 mon.0 10.193.56.230:6789/0 1432 : cluster [INF] osd.114 10.193.56.232:6884/4497 boot 2017-12-16 18:52:50.393880 mon.node1 mon.0 10.193.56.230:6789/0 1440 : cluster [INF] osd.115 10.193.56.234:6892/31646 boot 2017-12-16 18:52:54.534995 mon.node1 mon.0 10.193.56.230:6789/0 1452 : cluster [INF] osd.116 10.193.56.233:6892/7322 boot 2017-12-16 18:52:54.535062 mon.node1 mon.0 10.193.56.230:6789/0 1453 : cluster [INF] osd.117 10.193.56.231:6892/8476 boot 2017-12-16 18:53:18.219141 mon.node1 mon.0 10.193.56.230:6789/0 1468 : cluster [INF] osd.118 10.193.56.232:6888/11770 boot 2017-12-16 18:56:03.859692 mon.node1 mon.0 10.193.56.230:6789/0 1509 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 18:56:03.859727 mon.node1 mon.0 10.193.56.230:6789/0 1510 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 18:56:03.859777 mon.node1 mon.0 10.193.56.230:6789/0 1511 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 18:56:03.859827 mon.node1 mon.0 10.193.56.230:6789/0 1512 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 19:00:00.000099 mon.node1 mon.0 10.193.56.230:6789/0 1576 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set 2017-12-16 19:01:03.862095 mon.node1 mon.0 10.193.56.230:6789/0 1670 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 19:01:03.863401 mon.node1 mon.0 10.193.56.230:6789/0 1671 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 19:01:03.864711 mon.node1 mon.0 10.193.56.230:6789/0 1672 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 19:01:03.864940 mon.node1 mon.0 10.193.56.230:6789/0 1673 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 19:01:35.052505 mon.node1 mon.0 10.193.56.230:6789/0 1781 : cluster [WRN] Health check failed: too few PGs per OSD (11 < min 30) (TOO_FEW_PGS) 2017-12-16 19:01:36.319249 mon.node1 mon.0 10.193.56.230:6789/0 1785 : cluster [INF] Health check cleared: TOO_FEW_PGS (was: too few PGs per OSD (11 < min 30)) 2017-12-16 19:06:03.860047 mon.node1 mon.0 10.193.56.230:6789/0 2202 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 19:06:03.860076 mon.node1 mon.0 10.193.56.230:6789/0 2203 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 19:06:03.860105 mon.node1 mon.0 10.193.56.230:6789/0 2204 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 19:06:03.860153 mon.node1 mon.0 10.193.56.230:6789/0 2205 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 19:07:45.358091 mon.node1 mon.0 10.193.56.230:6789/0 2401 : cluster [WRN] Health check failed: too many PGs per OSD (330 > max 300) (TOO_MANY_PGS) 2017-12-16 19:07:52.034393 mon.node1 mon.0 10.193.56.230:6789/0 2404 : cluster [WRN] Health check update: too many PGs per OSD (344 > max 300) (TOO_MANY_PGS) 2017-12-16 19:08:03.861304 mon.node1 mon.0 10.193.56.230:6789/0 2407 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; too many PGs per OSD (344 > max 300) 2017-12-16 19:11:03.864309 mon.node1 mon.0 10.193.56.230:6789/0 2449 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 19:11:03.867985 mon.node1 mon.0 10.193.56.230:6789/0 2450 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 19:11:03.868040 mon.node1 mon.0 10.193.56.230:6789/0 2451 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 19:11:03.870213 mon.node1 mon.0 10.193.56.230:6789/0 2452 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 19:13:21.220040 mon.node1 mon.0 10.193.56.230:6789/0 2484 : cluster [INF] Health check cleared: TOO_MANY_PGS (was: too many PGs per OSD (344 > max 300)) 2017-12-16 19:14:03.861881 mon.node1 mon.0 10.193.56.230:6789/0 2606 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set 2017-12-16 19:16:03.860246 mon.node1 mon.0 10.193.56.230:6789/0 2664 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 19:16:03.860281 mon.node1 mon.0 10.193.56.230:6789/0 2665 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 19:16:03.860318 mon.node1 mon.0 10.193.56.230:6789/0 2666 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 19:16:03.860373 mon.node1 mon.0 10.193.56.230:6789/0 2667 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 19:21:03.860398 mon.node1 mon.0 10.193.56.230:6789/0 2746 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 19:21:03.860427 mon.node1 mon.0 10.193.56.230:6789/0 2747 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 19:21:03.860486 mon.node1 mon.0 10.193.56.230:6789/0 2748 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 19:21:03.860509 mon.node1 mon.0 10.193.56.230:6789/0 2749 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 19:26:03.860497 mon.node1 mon.0 10.193.56.230:6789/0 2900 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 19:26:03.860542 mon.node1 mon.0 10.193.56.230:6789/0 2901 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 19:26:03.860578 mon.node1 mon.0 10.193.56.230:6789/0 2902 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 19:26:03.860609 mon.node1 mon.0 10.193.56.230:6789/0 2903 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 19:26:39.533346 mon.node1 mon.0 10.193.56.230:6789/0 3027 : cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED) 2017-12-16 19:26:39.533372 mon.node1 mon.0 10.193.56.230:6789/0 3028 : cluster [WRN] Health check failed: too many PGs per OSD (323 > max 300) (TOO_MANY_PGS) 2017-12-16 19:26:46.197504 mon.node1 mon.0 10.193.56.230:6789/0 3034 : cluster [WRN] Health check update: too many PGs per OSD (344 > max 300) (TOO_MANY_PGS) 2017-12-16 19:27:03.863092 mon.node1 mon.0 10.193.56.230:6789/0 3036 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 1 pg degraded; too many PGs per OSD (344 > max 300) 2017-12-16 19:27:35.509285 mon.node1 mon.0 10.193.56.230:6789/0 3043 : cluster [WRN] Health check update: Degraded data redundancy: 1 pg unclean, 1 pg degraded (PG_DEGRADED) 2017-12-16 19:27:42.216061 mon.node1 mon.0 10.193.56.230:6789/0 3046 : cluster [WRN] Health check update: Degraded data redundancy: 1 pg unclean, 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2017-12-16 19:28:03.863225 mon.node1 mon.0 10.193.56.230:6789/0 3050 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 1 pg unclean, 1 pg degraded, 1 pg undersized; too many PGs per OSD (344 > max 300) 2017-12-16 19:31:03.860659 mon.node1 mon.0 10.193.56.230:6789/0 3096 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 19:31:03.860714 mon.node1 mon.0 10.193.56.230:6789/0 3097 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 19:31:03.860743 mon.node1 mon.0 10.193.56.230:6789/0 3098 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 19:31:03.860768 mon.node1 mon.0 10.193.56.230:6789/0 3099 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 19:31:44.956586 mon.node1 mon.0 10.193.56.230:6789/0 3112 : cluster [INF] Health check cleared: TOO_MANY_PGS (was: too many PGs per OSD (344 > max 300)) 2017-12-16 19:32:03.863551 mon.node1 mon.0 10.193.56.230:6789/0 3175 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 1 pg unclean, 1 pg degraded, 1 pg undersized 2017-12-16 19:35:11.688830 mon.node1 mon.0 10.193.56.230:6789/0 3528 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1 pg unclean, 1 pg degraded, 1 pg undersized) 2017-12-16 19:36:03.860792 mon.node1 mon.0 10.193.56.230:6789/0 3663 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 19:36:03.860836 mon.node1 mon.0 10.193.56.230:6789/0 3664 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 19:36:03.860892 mon.node1 mon.0 10.193.56.230:6789/0 3665 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 19:36:03.860940 mon.node1 mon.0 10.193.56.230:6789/0 3666 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 19:36:03.863899 mon.node1 mon.0 10.193.56.230:6789/0 3667 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set 2017-12-16 19:41:03.860954 mon.node1 mon.0 10.193.56.230:6789/0 3932 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 19:41:03.861087 mon.node1 mon.0 10.193.56.230:6789/0 3933 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 19:41:03.861157 mon.node1 mon.0 10.193.56.230:6789/0 3934 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 19:41:03.861187 mon.node1 mon.0 10.193.56.230:6789/0 3935 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 19:44:18.470713 mon.node1 mon.0 10.193.56.230:6789/0 4262 : cluster [WRN] Health check failed: too few PGs per OSD (4 < min 30) (TOO_FEW_PGS) 2017-12-16 19:44:21.839914 mon.node1 mon.0 10.193.56.230:6789/0 4269 : cluster [INF] Health check cleared: TOO_FEW_PGS (was: too few PGs per OSD (27 < min 30)) 2017-12-16 19:46:03.861173 mon.node1 mon.0 10.193.56.230:6789/0 4466 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 19:46:03.861209 mon.node1 mon.0 10.193.56.230:6789/0 4467 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 19:46:03.861229 mon.node1 mon.0 10.193.56.230:6789/0 4468 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 19:46:03.861257 mon.node1 mon.0 10.193.56.230:6789/0 4469 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 19:48:10.661274 mon.node1 mon.0 10.193.56.230:6789/0 4722 : cluster [WRN] Health check failed: application not enabled on 1 pool(s) (POOL_APP_NOT_ENABLED) 2017-12-16 19:48:16.499282 mon.node1 mon.0 10.193.56.230:6789/0 4742 : cluster [WRN] Health check update: application not enabled on 2 pool(s) (POOL_APP_NOT_ENABLED) 2017-12-16 19:49:03.864970 mon.node1 mon.0 10.193.56.230:6789/0 4897 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 2 pool(s) 2017-12-16 19:51:03.861333 mon.node1 mon.0 10.193.56.230:6789/0 4925 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 19:51:03.861432 mon.node1 mon.0 10.193.56.230:6789/0 4926 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 19:51:03.861452 mon.node1 mon.0 10.193.56.230:6789/0 4927 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 19:51:03.861476 mon.node1 mon.0 10.193.56.230:6789/0 4928 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 19:56:03.861446 mon.node1 mon.0 10.193.56.230:6789/0 5121 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 19:56:03.861488 mon.node1 mon.0 10.193.56.230:6789/0 5122 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 19:56:03.861510 mon.node1 mon.0 10.193.56.230:6789/0 5123 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 19:56:03.861531 mon.node1 mon.0 10.193.56.230:6789/0 5124 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 20:00:00.000081 mon.node1 mon.0 10.193.56.230:6789/0 5375 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 2 pool(s) 2017-12-16 20:01:03.861548 mon.node1 mon.0 10.193.56.230:6789/0 5389 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 20:01:03.861585 mon.node1 mon.0 10.193.56.230:6789/0 5390 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 20:01:03.861613 mon.node1 mon.0 10.193.56.230:6789/0 5391 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 20:01:03.861662 mon.node1 mon.0 10.193.56.230:6789/0 5392 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 20:06:03.861703 mon.node1 mon.0 10.193.56.230:6789/0 5767 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 20:06:03.861759 mon.node1 mon.0 10.193.56.230:6789/0 5768 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 20:06:03.861785 mon.node1 mon.0 10.193.56.230:6789/0 5769 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 20:06:03.861804 mon.node1 mon.0 10.193.56.230:6789/0 5770 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 20:11:03.861830 mon.node1 mon.0 10.193.56.230:6789/0 5847 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 20:11:03.861868 mon.node1 mon.0 10.193.56.230:6789/0 5848 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 20:11:03.861890 mon.node1 mon.0 10.193.56.230:6789/0 5849 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 20:11:03.861911 mon.node1 mon.0 10.193.56.230:6789/0 5850 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 20:12:17.573965 mon.node1 mon.0 10.193.56.230:6789/0 6058 : cluster [WRN] Health check failed: Degraded data redundancy: 1 pg degraded (PG_DEGRADED) 2017-12-16 20:13:03.867077 mon.node1 mon.0 10.193.56.230:6789/0 6075 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 1 pg degraded; application not enabled on 2 pool(s) 2017-12-16 20:13:14.146288 mon.node1 mon.0 10.193.56.230:6789/0 6077 : cluster [WRN] Health check update: Degraded data redundancy: 1 pg unclean, 1 pg degraded (PG_DEGRADED) 2017-12-16 20:13:20.790637 mon.node1 mon.0 10.193.56.230:6789/0 6080 : cluster [WRN] Health check update: Degraded data redundancy: 1 pg unclean, 1 pg degraded, 1 pg undersized (PG_DEGRADED) 2017-12-16 20:14:03.867200 mon.node1 mon.0 10.193.56.230:6789/0 6093 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 1 pg unclean, 1 pg degraded, 1 pg undersized; application not enabled on 2 pool(s) 2017-12-16 20:16:03.861998 mon.node1 mon.0 10.193.56.230:6789/0 6123 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 20:16:03.862033 mon.node1 mon.0 10.193.56.230:6789/0 6124 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 20:16:03.862055 mon.node1 mon.0 10.193.56.230:6789/0 6125 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 20:16:03.862128 mon.node1 mon.0 10.193.56.230:6789/0 6126 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 20:18:13.522643 mon.node1 mon.0 10.193.56.230:6789/0 6160 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1 pg unclean, 1 pg degraded, 1 pg undersized) 2017-12-16 20:19:03.867623 mon.node1 mon.0 10.193.56.230:6789/0 6301 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 2 pool(s) 2017-12-16 20:21:03.862196 mon.node1 mon.0 10.193.56.230:6789/0 6351 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 20:21:03.862226 mon.node1 mon.0 10.193.56.230:6789/0 6352 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 20:21:03.862246 mon.node1 mon.0 10.193.56.230:6789/0 6353 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 20:21:03.862264 mon.node1 mon.0 10.193.56.230:6789/0 6354 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 20:26:03.862338 mon.node1 mon.0 10.193.56.230:6789/0 6625 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 20:26:03.862371 mon.node1 mon.0 10.193.56.230:6789/0 6626 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 20:26:03.862765 mon.node1 mon.0 10.193.56.230:6789/0 6627 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 20:26:03.863624 mon.node1 mon.0 10.193.56.230:6789/0 6628 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 20:26:04.938852 mon.node1 mon.0 10.193.56.230:6789/0 6630 : cluster [WRN] Health check update: application not enabled on 4 pool(s) (POOL_APP_NOT_ENABLED) 2017-12-16 20:26:33.193777 mon.node1 mon.0 10.193.56.230:6789/0 6654 : cluster [WRN] Health check update: application not enabled on 5 pool(s) (POOL_APP_NOT_ENABLED) 2017-12-16 20:26:38.957594 mon.node1 mon.0 10.193.56.230:6789/0 6659 : cluster [WRN] Health check update: application not enabled on 6 pool(s) (POOL_APP_NOT_ENABLED) 2017-12-16 20:27:03.868360 mon.node1 mon.0 10.193.56.230:6789/0 6682 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 6 pool(s) 2017-12-16 20:27:04.920632 mon.node1 mon.0 10.193.56.230:6789/0 6684 : cluster [WRN] Health check update: application not enabled on 7 pool(s) (POOL_APP_NOT_ENABLED) 2017-12-16 20:27:10.966852 mon.node1 mon.0 10.193.56.230:6789/0 6686 : cluster [WRN] Health check update: application not enabled on 8 pool(s) (POOL_APP_NOT_ENABLED) 2017-12-16 20:27:27.168356 mon.node1 mon.0 10.193.56.230:6789/0 6704 : cluster [WRN] Health check update: application not enabled on 9 pool(s) (POOL_APP_NOT_ENABLED) 2017-12-16 20:27:32.968911 mon.node1 mon.0 10.193.56.230:6789/0 6706 : cluster [WRN] Health check update: application not enabled on 10 pool(s) (POOL_APP_NOT_ENABLED) 2017-12-16 20:28:03.868493 mon.node1 mon.0 10.193.56.230:6789/0 6710 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-16 20:31:03.862277 mon.node1 mon.0 10.193.56.230:6789/0 6742 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 20:31:03.864143 mon.node1 mon.0 10.193.56.230:6789/0 6743 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 20:31:03.865230 mon.node1 mon.0 10.193.56.230:6789/0 6744 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 20:31:03.866219 mon.node1 mon.0 10.193.56.230:6789/0 6745 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 20:36:03.862455 mon.node1 mon.0 10.193.56.230:6789/0 6800 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 20:36:03.862499 mon.node1 mon.0 10.193.56.230:6789/0 6801 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 20:36:03.862524 mon.node1 mon.0 10.193.56.230:6789/0 6802 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 20:36:03.862543 mon.node1 mon.0 10.193.56.230:6789/0 6803 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 20:36:25.805814 mon.node1 mon.0 10.193.56.230:6789/0 6807 : cluster [WRN] Health check failed: 1 pools have many more objects per pg than average (MANY_OBJECTS_PER_PG) 2017-12-16 20:36:41.374855 mon.node1 mon.0 10.193.56.230:6789/0 6810 : cluster [INF] Health check cleared: MANY_OBJECTS_PER_PG (was: 1 pools have many more objects per pg than average) 2017-12-16 20:41:03.862486 mon.node1 mon.0 10.193.56.230:6789/0 6868 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 20:41:03.862520 mon.node1 mon.0 10.193.56.230:6789/0 6869 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 20:41:03.862540 mon.node1 mon.0 10.193.56.230:6789/0 6870 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 20:41:03.862564 mon.node1 mon.0 10.193.56.230:6789/0 6871 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 20:46:03.862702 mon.node1 mon.0 10.193.56.230:6789/0 6925 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 20:46:03.862750 mon.node1 mon.0 10.193.56.230:6789/0 6926 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 20:46:03.862799 mon.node1 mon.0 10.193.56.230:6789/0 6927 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 20:46:03.862843 mon.node1 mon.0 10.193.56.230:6789/0 6928 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 20:51:03.862871 mon.node1 mon.0 10.193.56.230:6789/0 6998 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 20:51:03.862917 mon.node1 mon.0 10.193.56.230:6789/0 6999 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 20:51:03.862947 mon.node1 mon.0 10.193.56.230:6789/0 7000 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 20:51:03.862973 mon.node1 mon.0 10.193.56.230:6789/0 7001 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 20:56:03.862975 mon.node1 mon.0 10.193.56.230:6789/0 7068 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 20:56:03.863586 mon.node1 mon.0 10.193.56.230:6789/0 7069 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 20:56:03.863623 mon.node1 mon.0 10.193.56.230:6789/0 7070 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 20:56:03.864238 mon.node1 mon.0 10.193.56.230:6789/0 7071 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 21:00:00.000084 mon.node1 mon.0 10.193.56.230:6789/0 7126 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-16 21:01:03.866630 mon.node1 mon.0 10.193.56.230:6789/0 7141 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 21:01:03.867182 mon.node1 mon.0 10.193.56.230:6789/0 7142 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 21:01:03.868210 mon.node1 mon.0 10.193.56.230:6789/0 7143 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 21:01:03.868539 mon.node1 mon.0 10.193.56.230:6789/0 7144 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 21:06:03.863206 mon.node1 mon.0 10.193.56.230:6789/0 7207 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 21:06:03.863240 mon.node1 mon.0 10.193.56.230:6789/0 7208 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 21:06:03.863277 mon.node1 mon.0 10.193.56.230:6789/0 7209 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 21:06:03.863407 mon.node1 mon.0 10.193.56.230:6789/0 7210 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 21:11:03.863514 mon.node1 mon.0 10.193.56.230:6789/0 7277 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 21:11:03.864156 mon.node1 mon.0 10.193.56.230:6789/0 7278 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 21:11:03.864950 mon.node1 mon.0 10.193.56.230:6789/0 7279 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 21:11:03.868917 mon.node1 mon.0 10.193.56.230:6789/0 7280 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 21:16:03.864598 mon.node1 mon.0 10.193.56.230:6789/0 7333 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 21:16:03.864774 mon.node1 mon.0 10.193.56.230:6789/0 7334 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 21:16:03.864821 mon.node1 mon.0 10.193.56.230:6789/0 7335 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 21:16:03.865001 mon.node1 mon.0 10.193.56.230:6789/0 7336 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 21:21:03.863647 mon.node1 mon.0 10.193.56.230:6789/0 7398 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 21:21:03.864982 mon.node1 mon.0 10.193.56.230:6789/0 7399 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 21:21:03.866810 mon.node1 mon.0 10.193.56.230:6789/0 7400 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 21:21:03.867884 mon.node1 mon.0 10.193.56.230:6789/0 7401 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 21:26:03.863959 mon.node1 mon.0 10.193.56.230:6789/0 7465 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 21:26:03.864589 mon.node1 mon.0 10.193.56.230:6789/0 7466 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 21:26:03.865207 mon.node1 mon.0 10.193.56.230:6789/0 7467 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 21:26:03.866952 mon.node1 mon.0 10.193.56.230:6789/0 7468 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 21:31:03.863799 mon.node1 mon.0 10.193.56.230:6789/0 7522 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 21:31:03.863832 mon.node1 mon.0 10.193.56.230:6789/0 7523 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 21:31:03.865812 mon.node1 mon.0 10.193.56.230:6789/0 7524 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 21:31:03.867561 mon.node1 mon.0 10.193.56.230:6789/0 7525 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 21:35:26.123936 mon.node1 mon.0 10.193.56.230:6789/0 7574 : cluster [WRN] Health check failed: 3 slow requests are blocked > 32 sec (REQUEST_SLOW) 2017-12-16 21:35:36.184532 mon.node1 mon.0 10.193.56.230:6789/0 7579 : cluster [WRN] Health check update: 4 slow requests are blocked > 32 sec (REQUEST_SLOW) 2017-12-16 21:35:40.313553 mon.node1 mon.0 10.193.56.230:6789/0 7582 : cluster [INF] Health check cleared: REQUEST_SLOW (was: 4 slow requests are blocked > 32 sec) 2017-12-16 21:36:03.863951 mon.node1 mon.0 10.193.56.230:6789/0 7586 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 21:36:03.863993 mon.node1 mon.0 10.193.56.230:6789/0 7587 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 21:36:03.864023 mon.node1 mon.0 10.193.56.230:6789/0 7588 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 21:36:03.864082 mon.node1 mon.0 10.193.56.230:6789/0 7589 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 21:41:03.864070 mon.node1 mon.0 10.193.56.230:6789/0 7645 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 21:41:03.864550 mon.node1 mon.0 10.193.56.230:6789/0 7646 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 21:41:03.867365 mon.node1 mon.0 10.193.56.230:6789/0 7647 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 21:41:03.868098 mon.node1 mon.0 10.193.56.230:6789/0 7648 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 21:46:03.864686 mon.node1 mon.0 10.193.56.230:6789/0 7707 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 21:46:03.864769 mon.node1 mon.0 10.193.56.230:6789/0 7708 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 21:46:03.865349 mon.node1 mon.0 10.193.56.230:6789/0 7709 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 21:46:03.865526 mon.node1 mon.0 10.193.56.230:6789/0 7710 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 21:51:03.864427 mon.node1 mon.0 10.193.56.230:6789/0 7775 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 21:51:03.865199 mon.node1 mon.0 10.193.56.230:6789/0 7776 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 21:51:03.868676 mon.node1 mon.0 10.193.56.230:6789/0 7777 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 21:51:03.869844 mon.node1 mon.0 10.193.56.230:6789/0 7778 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 21:56:03.866045 mon.node1 mon.0 10.193.56.230:6789/0 7838 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 21:56:03.867285 mon.node1 mon.0 10.193.56.230:6789/0 7839 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 21:56:03.868640 mon.node1 mon.0 10.193.56.230:6789/0 7840 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 21:56:03.868886 mon.node1 mon.0 10.193.56.230:6789/0 7841 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 22:00:00.000094 mon.node1 mon.0 10.193.56.230:6789/0 7886 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-16 22:01:03.864703 mon.node1 mon.0 10.193.56.230:6789/0 7901 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 22:01:03.864744 mon.node1 mon.0 10.193.56.230:6789/0 7902 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 22:01:03.864773 mon.node1 mon.0 10.193.56.230:6789/0 7903 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 22:01:03.864804 mon.node1 mon.0 10.193.56.230:6789/0 7904 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 22:06:03.864791 mon.node1 mon.0 10.193.56.230:6789/0 7966 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 22:06:03.864839 mon.node1 mon.0 10.193.56.230:6789/0 7967 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 22:06:03.864886 mon.node1 mon.0 10.193.56.230:6789/0 7968 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 22:06:03.866313 mon.node1 mon.0 10.193.56.230:6789/0 7969 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 22:11:03.865156 mon.node1 mon.0 10.193.56.230:6789/0 8036 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 22:11:03.865266 mon.node1 mon.0 10.193.56.230:6789/0 8037 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 22:11:03.866591 mon.node1 mon.0 10.193.56.230:6789/0 8038 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 22:11:03.868068 mon.node1 mon.0 10.193.56.230:6789/0 8039 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 22:16:03.865137 mon.node1 mon.0 10.193.56.230:6789/0 8094 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 22:16:03.865176 mon.node1 mon.0 10.193.56.230:6789/0 8095 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 22:16:03.865260 mon.node1 mon.0 10.193.56.230:6789/0 8096 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 22:16:03.865452 mon.node1 mon.0 10.193.56.230:6789/0 8097 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 22:21:03.865357 mon.node1 mon.0 10.193.56.230:6789/0 8169 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 22:21:03.866269 mon.node1 mon.0 10.193.56.230:6789/0 8170 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 22:21:03.867569 mon.node1 mon.0 10.193.56.230:6789/0 8171 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 22:21:03.869074 mon.node1 mon.0 10.193.56.230:6789/0 8172 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 22:26:03.865429 mon.node1 mon.0 10.193.56.230:6789/0 8219 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 22:26:03.866295 mon.node1 mon.0 10.193.56.230:6789/0 8220 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 22:26:03.867552 mon.node1 mon.0 10.193.56.230:6789/0 8221 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 22:26:03.867663 mon.node1 mon.0 10.193.56.230:6789/0 8222 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 22:31:03.865570 mon.node1 mon.0 10.193.56.230:6789/0 8278 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 22:31:03.865607 mon.node1 mon.0 10.193.56.230:6789/0 8279 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 22:31:03.865635 mon.node1 mon.0 10.193.56.230:6789/0 8280 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 22:31:03.865663 mon.node1 mon.0 10.193.56.230:6789/0 8281 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 22:36:03.865753 mon.node1 mon.0 10.193.56.230:6789/0 8341 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 22:36:03.866049 mon.node1 mon.0 10.193.56.230:6789/0 8342 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 22:36:03.868128 mon.node1 mon.0 10.193.56.230:6789/0 8343 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 22:36:03.876625 mon.node1 mon.0 10.193.56.230:6789/0 8344 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 22:41:03.872550 mon.node1 mon.0 10.193.56.230:6789/0 8404 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 22:41:03.872592 mon.node1 mon.0 10.193.56.230:6789/0 8405 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 22:41:03.872619 mon.node1 mon.0 10.193.56.230:6789/0 8406 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 22:41:03.872667 mon.node1 mon.0 10.193.56.230:6789/0 8407 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 22:41:14.200141 mon.node1 mon.0 10.193.56.230:6789/0 8409 : cluster [WRN] Health check failed: 1 slow requests are blocked > 32 sec (REQUEST_SLOW) 2017-12-16 22:41:20.219333 mon.node1 mon.0 10.193.56.230:6789/0 8410 : cluster [WRN] Health check update: 9 slow requests are blocked > 32 sec (REQUEST_SLOW) 2017-12-16 22:41:23.769841 osd.58 osd.58 10.193.56.231:6844/15008 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.953672 secs 2017-12-16 22:41:23.769851 osd.58 osd.58 10.193.56.231:6844/15008 2 : cluster [WRN] slow request 30.953672 seconds old, received at 2017-12-16 22:40:52.816043: osd_op(client.25649.0:245390 9.165s0 9:a6e47a68:::rbd_data.17.5dfd74b0dc51.00000000001c0fec:head [write 0~1310720] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-16 22:41:26.219919 mon.node1 mon.0 10.193.56.230:6789/0 8412 : cluster [WRN] Health check update: 18 slow requests are blocked > 32 sec (REQUEST_SLOW) 2017-12-16 22:41:22.979568 osd.42 osd.42 10.193.56.234:6832/17598 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 30.156930 secs 2017-12-16 22:41:22.979572 osd.42 osd.42 10.193.56.234:6832/17598 2 : cluster [WRN] slow request 30.156930 seconds old, received at 2017-12-16 22:40:52.822562: osd_op(client.25649.0:245382 9.16as0 9:56d57696:::rbd_data.17.5dfd74b0dc51.0000000000100ff7:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~1310720] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-16 22:41:24.979830 osd.42 osd.42 10.193.56.234:6832/17598 3 : cluster [WRN] 3 slow requests, 2 included below; oldest blocked for > 32.157226 secs 2017-12-16 22:41:24.979833 osd.42 osd.42 10.193.56.234:6832/17598 4 : cluster [WRN] slow request 30.812592 seconds old, received at 2017-12-16 22:40:54.167195: osd_op(client.25649.0:245494 9.86s0 9:6144628a:::rbd_data.17.5dfd74b0dc51.00000000001a0ff5:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2097152~524288] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-16 22:41:24.979835 osd.42 osd.42 10.193.56.234:6832/17598 5 : cluster [WRN] slow request 30.804740 seconds old, received at 2017-12-16 22:40:54.175048: osd_op(client.25649.0:245495 9.86s0 9:6144628a:::rbd_data.17.5dfd74b0dc51.00000000001a0ff5:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~2097152] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-16 22:41:26.980093 osd.42 osd.42 10.193.56.234:6832/17598 6 : cluster [WRN] 6 slow requests, 3 included below; oldest blocked for > 34.157481 secs 2017-12-16 22:41:26.980097 osd.42 osd.42 10.193.56.234:6832/17598 7 : cluster [WRN] slow request 30.113390 seconds old, received at 2017-12-16 22:40:56.866653: osd_op(client.25649.0:245717 9.3fs0 9:fc15b95c:::rbd_data.17.5dfd74b0dc51.0000000000140ff4:head [write 3145728~1048576] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-16 22:41:26.980105 osd.42 osd.42 10.193.56.234:6832/17598 8 : cluster [WRN] slow request 30.811935 seconds old, received at 2017-12-16 22:40:56.168108: osd_op(client.25649.0:245659 9.86s0 9:613125eb:::rbd_data.17.5dfd74b0dc51.000000000008100e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2097152~2097152] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-16 22:41:26.980109 osd.42 osd.42 10.193.56.234:6832/17598 9 : cluster [WRN] slow request 30.753517 seconds old, received at 2017-12-16 22:40:56.226525: osd_op(client.25649.0:245660 9.86s0 9:613125eb:::rbd_data.17.5dfd74b0dc51.000000000008100e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~2097152] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-16 22:41:32.220526 mon.node1 mon.0 10.193.56.230:6789/0 8415 : cluster [WRN] Health check update: 21 slow requests are blocked > 32 sec (REQUEST_SLOW) 2017-12-16 22:41:25.770067 osd.58 osd.58 10.193.56.231:6844/15008 3 : cluster [WRN] 3 slow requests, 2 included below; oldest blocked for > 32.953979 secs 2017-12-16 22:41:25.770096 osd.58 osd.58 10.193.56.231:6844/15008 4 : cluster [WRN] slow request 30.821691 seconds old, received at 2017-12-16 22:40:54.948331: osd_op(client.25649.0:245548 9.124s0 9:24b83523:::rbd_data.17.5dfd74b0dc51.0000000000240ff9:head [set-alloc-hint object_size 4194304 write_size 4194304,write 2097152~2097152] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-16 22:41:25.770101 osd.58 osd.58 10.193.56.231:6844/15008 5 : cluster [WRN] slow request 30.780381 seconds old, received at 2017-12-16 22:40:54.989641: osd_op(client.25649.0:245549 9.124s0 9:24b83523:::rbd_data.17.5dfd74b0dc51.0000000000240ff9:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~2097152] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-16 22:41:27.770252 osd.58 osd.58 10.193.56.231:6844/15008 6 : cluster [WRN] 6 slow requests, 3 included below; oldest blocked for > 34.954155 secs 2017-12-16 22:41:27.770255 osd.58 osd.58 10.193.56.231:6844/15008 7 : cluster [WRN] slow request 30.413573 seconds old, received at 2017-12-16 22:40:57.356624: osd_op(client.25649.0:245756 9.1a4s0 9:25852af1:::rbd_data.17.5dfd74b0dc51.00000000000e1014:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~4128768] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-16 22:41:27.770256 osd.58 osd.58 10.193.56.231:6844/15008 8 : cluster [WRN] slow request 30.377480 seconds old, received at 2017-12-16 22:40:57.392718: osd_op(client.25649.0:245757 9.1a4s0 9:25852af1:::rbd_data.17.5dfd74b0dc51.00000000000e1014:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4128768~65536] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-16 22:41:27.770258 osd.58 osd.58 10.193.56.231:6844/15008 9 : cluster [WRN] slow request 30.530564 seconds old, received at 2017-12-16 22:40:57.239634: osd_op(client.25649.0:245744 9.cfs0 9:f34b0463:::rbd_data.17.5dfd74b0dc51.0000000000140ff8:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~2621440] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-16 22:41:33.770863 osd.58 osd.58 10.193.56.231:6844/15008 10 : cluster [WRN] 7 slow requests, 1 included below; oldest blocked for > 40.954779 secs 2017-12-16 22:41:33.770866 osd.58 osd.58 10.193.56.231:6844/15008 11 : cluster [WRN] slow request 30.755135 seconds old, received at 2017-12-16 22:41:03.015687: osd_op(client.25649.0:246015 9.192s0 9:49fb64d2:::rbd_data.17.5dfd74b0dc51.0000000000041015:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~1507328] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-16 22:41:28.980340 osd.42 osd.42 10.193.56.234:6832/17598 10 : cluster [WRN] 8 slow requests, 2 included below; oldest blocked for > 36.157721 secs 2017-12-16 22:41:28.980345 osd.42 osd.42 10.193.56.234:6832/17598 11 : cluster [WRN] slow request 30.045045 seconds old, received at 2017-12-16 22:40:58.935238: osd_op(client.25649.0:245876 9.3fs0 9:fc1c7e5f:::rbd_data.17.5dfd74b0dc51.00000000001c0ff4:head [write 0~4128768] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-16 22:41:28.980349 osd.42 osd.42 10.193.56.234:6832/17598 12 : cluster [WRN] slow request 30.123780 seconds old, received at 2017-12-16 22:40:58.856503: osd_op(client.25649.0:245872 9.3fs0 9:fc1c7e5f:::rbd_data.17.5dfd74b0dc51.00000000001c0ff4:head [set-alloc-hint object_size 4194304 write_size 4194304,write 4128768~65536] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-16 22:41:29.980487 osd.42 osd.42 10.193.56.234:6832/17598 13 : cluster [WRN] 10 slow requests, 2 included below; oldest blocked for > 37.157861 secs 2017-12-16 22:41:29.980491 osd.42 osd.42 10.193.56.234:6832/17598 14 : cluster [WRN] slow request 30.991872 seconds old, received at 2017-12-16 22:40:58.988552: osd_op(client.25649.0:245882 9.195s0 9:a9f67b9d:::rbd_data.17.5dfd74b0dc51.00000000001c0ffb:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~1048576] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-16 22:41:29.980493 osd.42 osd.42 10.193.56.234:6832/17598 15 : cluster [WRN] slow request 30.982156 seconds old, received at 2017-12-16 22:40:58.998267: osd_op(client.25649.0:245884 9.195s0 9:a9f67b9d:::rbd_data.17.5dfd74b0dc51.00000000001c0ffb:head [write 1048576~3145728] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-16 22:41:30.980651 osd.42 osd.42 10.193.56.234:6832/17598 16 : cluster [WRN] 12 slow requests, 2 included below; oldest blocked for > 38.158044 secs 2017-12-16 22:41:30.980655 osd.42 osd.42 10.193.56.234:6832/17598 17 : cluster [WRN] slow request 30.868866 seconds old, received at 2017-12-16 22:41:00.111740: osd_op(client.25649.0:245940 9.c2s0 9:437e264b:::rbd_data.17.5dfd74b0dc51.000000000024100c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 524288~589824] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-16 22:41:30.980659 osd.42 osd.42 10.193.56.234:6832/17598 18 : cluster [WRN] slow request 30.856701 seconds old, received at 2017-12-16 22:41:00.123906: osd_op(client.25649.0:245942 9.c2s0 9:437e264b:::rbd_data.17.5dfd74b0dc51.000000000024100c:head [write 0~524288] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-16 22:41:36.771163 osd.58 osd.58 10.193.56.231:6844/15008 12 : cluster [WRN] 9 slow requests, 2 included below; oldest blocked for > 43.955071 secs 2017-12-16 22:41:36.771166 osd.58 osd.58 10.193.56.231:6844/15008 13 : cluster [WRN] slow request 30.580422 seconds old, received at 2017-12-16 22:41:06.190692: osd_op(client.25649.0:246017 9.192s0 9:49fb64d2:::rbd_data.17.5dfd74b0dc51.0000000000041015:head [write 1507328~2686976] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-16 22:41:36.771168 osd.58 osd.58 10.193.56.231:6844/15008 14 : cluster [WRN] slow request 30.555321 seconds old, received at 2017-12-16 22:41:06.215793: osd_op(client.25649.0:246019 9.66s0 9:662eaba1:::rbd_data.17.5dfd74b0dc51.0000000000041016:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~1507328] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-16 22:41:52.071687 mon.node1 mon.0 10.193.56.230:6789/0 8419 : cluster [INF] Health check cleared: REQUEST_SLOW (was: 21 slow requests are blocked > 32 sec) 2017-12-16 22:46:03.865928 mon.node1 mon.0 10.193.56.230:6789/0 8467 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 22:46:03.866047 mon.node1 mon.0 10.193.56.230:6789/0 8468 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 22:46:03.866181 mon.node1 mon.0 10.193.56.230:6789/0 8469 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 22:46:03.866489 mon.node1 mon.0 10.193.56.230:6789/0 8470 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 22:51:03.866223 mon.node1 mon.0 10.193.56.230:6789/0 8543 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 22:51:03.866261 mon.node1 mon.0 10.193.56.230:6789/0 8544 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 22:51:03.871704 mon.node1 mon.0 10.193.56.230:6789/0 8545 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 22:51:03.874242 mon.node1 mon.0 10.193.56.230:6789/0 8546 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 22:56:03.866265 mon.node1 mon.0 10.193.56.230:6789/0 8595 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 22:56:03.866302 mon.node1 mon.0 10.193.56.230:6789/0 8596 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 22:56:03.867582 mon.node1 mon.0 10.193.56.230:6789/0 8597 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 22:56:04.187572 mon.node1 mon.0 10.193.56.230:6789/0 8598 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 23:00:00.000075 mon.node1 mon.0 10.193.56.230:6789/0 8636 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-16 23:01:03.866350 mon.node1 mon.0 10.193.56.230:6789/0 8654 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 23:01:03.866441 mon.node1 mon.0 10.193.56.230:6789/0 8655 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 23:01:03.866620 mon.node1 mon.0 10.193.56.230:6789/0 8656 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 23:01:03.871957 mon.node1 mon.0 10.193.56.230:6789/0 8657 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 23:06:03.866480 mon.node1 mon.0 10.193.56.230:6789/0 8710 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 23:06:03.866531 mon.node1 mon.0 10.193.56.230:6789/0 8711 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 23:06:03.866569 mon.node1 mon.0 10.193.56.230:6789/0 8712 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 23:06:03.867419 mon.node1 mon.0 10.193.56.230:6789/0 8713 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 23:11:03.866648 mon.node1 mon.0 10.193.56.230:6789/0 8780 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 23:11:03.866700 mon.node1 mon.0 10.193.56.230:6789/0 8781 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 23:11:03.866726 mon.node1 mon.0 10.193.56.230:6789/0 8782 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 23:11:03.866749 mon.node1 mon.0 10.193.56.230:6789/0 8783 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 23:16:03.866744 mon.node1 mon.0 10.193.56.230:6789/0 8851 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 23:16:03.866934 mon.node1 mon.0 10.193.56.230:6789/0 8852 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 23:16:03.866988 mon.node1 mon.0 10.193.56.230:6789/0 8853 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 23:16:03.869442 mon.node1 mon.0 10.193.56.230:6789/0 8854 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 23:21:03.866839 mon.node1 mon.0 10.193.56.230:6789/0 8915 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 23:21:03.866941 mon.node1 mon.0 10.193.56.230:6789/0 8916 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 23:21:03.867763 mon.node1 mon.0 10.193.56.230:6789/0 8917 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 23:21:03.872009 mon.node1 mon.0 10.193.56.230:6789/0 8918 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 23:26:03.867544 mon.node1 mon.0 10.193.56.230:6789/0 8981 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 23:26:03.867659 mon.node1 mon.0 10.193.56.230:6789/0 8982 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 23:26:03.868020 mon.node1 mon.0 10.193.56.230:6789/0 8983 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 23:26:03.868141 mon.node1 mon.0 10.193.56.230:6789/0 8984 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 23:31:03.867424 mon.node1 mon.0 10.193.56.230:6789/0 9052 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 23:31:03.867567 mon.node1 mon.0 10.193.56.230:6789/0 9053 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 23:31:03.868113 mon.node1 mon.0 10.193.56.230:6789/0 9054 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 23:31:03.868928 mon.node1 mon.0 10.193.56.230:6789/0 9055 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 23:36:03.867278 mon.node1 mon.0 10.193.56.230:6789/0 9118 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 23:36:03.867374 mon.node1 mon.0 10.193.56.230:6789/0 9119 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 23:36:03.867657 mon.node1 mon.0 10.193.56.230:6789/0 9120 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 23:36:03.868798 mon.node1 mon.0 10.193.56.230:6789/0 9121 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 23:41:03.867390 mon.node1 mon.0 10.193.56.230:6789/0 9192 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 23:41:03.867430 mon.node1 mon.0 10.193.56.230:6789/0 9193 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 23:41:03.867554 mon.node1 mon.0 10.193.56.230:6789/0 9194 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 23:41:03.867864 mon.node1 mon.0 10.193.56.230:6789/0 9195 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 23:46:03.867489 mon.node1 mon.0 10.193.56.230:6789/0 9258 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 23:46:03.867534 mon.node1 mon.0 10.193.56.230:6789/0 9259 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 23:46:03.867677 mon.node1 mon.0 10.193.56.230:6789/0 9260 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 23:46:03.867908 mon.node1 mon.0 10.193.56.230:6789/0 9261 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 23:51:03.867688 mon.node1 mon.0 10.193.56.230:6789/0 9332 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 23:51:03.867725 mon.node1 mon.0 10.193.56.230:6789/0 9333 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 23:51:03.867746 mon.node1 mon.0 10.193.56.230:6789/0 9334 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 23:51:03.867822 mon.node1 mon.0 10.193.56.230:6789/0 9335 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-16 23:56:03.868177 mon.node1 mon.0 10.193.56.230:6789/0 9389 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-16 23:56:03.868631 mon.node1 mon.0 10.193.56.230:6789/0 9390 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-16 23:56:03.870239 mon.node1 mon.0 10.193.56.230:6789/0 9391 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-16 23:56:03.871701 mon.node1 mon.0 10.193.56.230:6789/0 9392 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 00:00:00.000111 mon.node1 mon.0 10.193.56.230:6789/0 9433 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 00:01:03.867941 mon.node1 mon.0 10.193.56.230:6789/0 9447 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 00:01:03.867988 mon.node1 mon.0 10.193.56.230:6789/0 9448 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 00:01:03.868022 mon.node1 mon.0 10.193.56.230:6789/0 9449 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 00:01:03.869807 mon.node1 mon.0 10.193.56.230:6789/0 9450 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 00:06:03.868065 mon.node1 mon.0 10.193.56.230:6789/0 9511 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 00:06:03.868371 mon.node1 mon.0 10.193.56.230:6789/0 9512 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 00:06:03.869418 mon.node1 mon.0 10.193.56.230:6789/0 9513 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 00:06:03.870290 mon.node1 mon.0 10.193.56.230:6789/0 9514 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 00:11:03.868323 mon.node1 mon.0 10.193.56.230:6789/0 9579 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 00:11:03.868499 mon.node1 mon.0 10.193.56.230:6789/0 9580 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 00:11:03.868758 mon.node1 mon.0 10.193.56.230:6789/0 9581 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 00:11:03.871304 mon.node1 mon.0 10.193.56.230:6789/0 9582 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 00:16:03.868375 mon.node1 mon.0 10.193.56.230:6789/0 9640 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 00:16:03.869381 mon.node1 mon.0 10.193.56.230:6789/0 9641 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 00:16:03.872365 mon.node1 mon.0 10.193.56.230:6789/0 9642 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 00:16:03.875494 mon.node1 mon.0 10.193.56.230:6789/0 9643 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 00:21:03.868427 mon.node1 mon.0 10.193.56.230:6789/0 9710 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 00:21:03.868497 mon.node1 mon.0 10.193.56.230:6789/0 9711 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 00:21:03.869264 mon.node1 mon.0 10.193.56.230:6789/0 9712 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 00:21:03.873161 mon.node1 mon.0 10.193.56.230:6789/0 9713 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 00:26:03.868635 mon.node1 mon.0 10.193.56.230:6789/0 9773 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 00:26:03.868686 mon.node1 mon.0 10.193.56.230:6789/0 9774 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 00:26:03.868738 mon.node1 mon.0 10.193.56.230:6789/0 9775 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 00:26:03.869118 mon.node1 mon.0 10.193.56.230:6789/0 9776 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 00:31:03.869088 mon.node1 mon.0 10.193.56.230:6789/0 9851 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 00:31:03.869497 mon.node1 mon.0 10.193.56.230:6789/0 9852 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 00:31:03.869802 mon.node1 mon.0 10.193.56.230:6789/0 9853 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 00:31:03.869846 mon.node1 mon.0 10.193.56.230:6789/0 9854 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 00:36:03.868823 mon.node1 mon.0 10.193.56.230:6789/0 9923 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 00:36:03.868856 mon.node1 mon.0 10.193.56.230:6789/0 9924 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 00:36:03.868877 mon.node1 mon.0 10.193.56.230:6789/0 9925 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 00:36:03.868904 mon.node1 mon.0 10.193.56.230:6789/0 9926 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 00:41:03.869300 mon.node1 mon.0 10.193.56.230:6789/0 9980 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 00:41:03.869371 mon.node1 mon.0 10.193.56.230:6789/0 9981 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 00:41:03.869463 mon.node1 mon.0 10.193.56.230:6789/0 9982 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 00:41:03.870007 mon.node1 mon.0 10.193.56.230:6789/0 9983 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 00:46:03.869089 mon.node1 mon.0 10.193.56.230:6789/0 10037 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 00:46:03.869124 mon.node1 mon.0 10.193.56.230:6789/0 10038 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 00:46:03.869145 mon.node1 mon.0 10.193.56.230:6789/0 10039 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 00:46:03.869198 mon.node1 mon.0 10.193.56.230:6789/0 10040 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 00:51:03.869323 mon.node1 mon.0 10.193.56.230:6789/0 10106 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 00:51:03.869421 mon.node1 mon.0 10.193.56.230:6789/0 10107 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 00:51:03.870559 mon.node1 mon.0 10.193.56.230:6789/0 10108 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 00:51:03.879497 mon.node1 mon.0 10.193.56.230:6789/0 10109 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 00:56:03.869332 mon.node1 mon.0 10.193.56.230:6789/0 10164 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 00:56:03.869367 mon.node1 mon.0 10.193.56.230:6789/0 10165 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 00:56:03.869391 mon.node1 mon.0 10.193.56.230:6789/0 10166 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 00:56:03.872776 mon.node1 mon.0 10.193.56.230:6789/0 10167 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 01:00:00.000094 mon.node1 mon.0 10.193.56.230:6789/0 10208 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 01:01:03.869647 mon.node1 mon.0 10.193.56.230:6789/0 10226 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 01:01:03.869872 mon.node1 mon.0 10.193.56.230:6789/0 10227 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 01:01:03.871108 mon.node1 mon.0 10.193.56.230:6789/0 10228 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 01:01:03.871163 mon.node1 mon.0 10.193.56.230:6789/0 10229 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 01:06:03.869969 mon.node1 mon.0 10.193.56.230:6789/0 10288 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 01:06:03.870209 mon.node1 mon.0 10.193.56.230:6789/0 10289 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 01:06:03.870946 mon.node1 mon.0 10.193.56.230:6789/0 10290 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 01:06:03.870985 mon.node1 mon.0 10.193.56.230:6789/0 10291 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 01:11:03.869691 mon.node1 mon.0 10.193.56.230:6789/0 10351 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 01:11:03.869766 mon.node1 mon.0 10.193.56.230:6789/0 10352 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 01:11:03.869795 mon.node1 mon.0 10.193.56.230:6789/0 10353 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 01:11:03.870462 mon.node1 mon.0 10.193.56.230:6789/0 10354 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 01:16:03.870291 mon.node1 mon.0 10.193.56.230:6789/0 10412 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 01:16:03.871424 mon.node1 mon.0 10.193.56.230:6789/0 10413 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 01:16:03.872170 mon.node1 mon.0 10.193.56.230:6789/0 10414 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 01:16:03.873564 mon.node1 mon.0 10.193.56.230:6789/0 10415 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 01:21:03.870021 mon.node1 mon.0 10.193.56.230:6789/0 10465 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 01:21:03.870058 mon.node1 mon.0 10.193.56.230:6789/0 10466 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 01:21:03.870128 mon.node1 mon.0 10.193.56.230:6789/0 10467 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 01:21:03.870153 mon.node1 mon.0 10.193.56.230:6789/0 10468 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 01:26:03.870603 mon.node1 mon.0 10.193.56.230:6789/0 10530 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 01:26:03.870640 mon.node1 mon.0 10.193.56.230:6789/0 10531 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 01:26:03.871094 mon.node1 mon.0 10.193.56.230:6789/0 10532 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 01:26:03.871847 mon.node1 mon.0 10.193.56.230:6789/0 10533 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 01:31:03.870292 mon.node1 mon.0 10.193.56.230:6789/0 10592 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 01:31:03.870338 mon.node1 mon.0 10.193.56.230:6789/0 10593 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 01:31:03.870414 mon.node1 mon.0 10.193.56.230:6789/0 10594 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 01:31:03.870444 mon.node1 mon.0 10.193.56.230:6789/0 10595 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 01:36:03.870439 mon.node1 mon.0 10.193.56.230:6789/0 10633 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 01:36:03.870479 mon.node1 mon.0 10.193.56.230:6789/0 10634 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 01:36:03.870503 mon.node1 mon.0 10.193.56.230:6789/0 10635 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 01:36:03.870566 mon.node1 mon.0 10.193.56.230:6789/0 10636 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 01:41:03.870692 mon.node1 mon.0 10.193.56.230:6789/0 10710 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 01:41:03.870980 mon.node1 mon.0 10.193.56.230:6789/0 10711 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 01:41:03.871300 mon.node1 mon.0 10.193.56.230:6789/0 10712 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 01:41:03.871329 mon.node1 mon.0 10.193.56.230:6789/0 10713 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 01:46:03.870681 mon.node1 mon.0 10.193.56.230:6789/0 10773 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 01:46:03.872002 mon.node1 mon.0 10.193.56.230:6789/0 10774 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 01:46:03.872035 mon.node1 mon.0 10.193.56.230:6789/0 10775 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 01:46:03.872058 mon.node1 mon.0 10.193.56.230:6789/0 10776 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 01:51:03.871296 mon.node1 mon.0 10.193.56.230:6789/0 10837 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 01:51:03.871356 mon.node1 mon.0 10.193.56.230:6789/0 10838 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 01:51:03.871428 mon.node1 mon.0 10.193.56.230:6789/0 10839 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 01:51:03.876109 mon.node1 mon.0 10.193.56.230:6789/0 10840 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 01:56:03.870959 mon.node1 mon.0 10.193.56.230:6789/0 10900 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 01:56:03.870996 mon.node1 mon.0 10.193.56.230:6789/0 10901 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 01:56:03.871186 mon.node1 mon.0 10.193.56.230:6789/0 10902 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 01:56:03.871631 mon.node1 mon.0 10.193.56.230:6789/0 10903 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 02:00:00.000094 mon.node1 mon.0 10.193.56.230:6789/0 10954 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 02:01:03.871585 mon.node1 mon.0 10.193.56.230:6789/0 10968 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 02:01:03.871859 mon.node1 mon.0 10.193.56.230:6789/0 10969 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 02:01:03.871894 mon.node1 mon.0 10.193.56.230:6789/0 10970 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 02:01:03.873473 mon.node1 mon.0 10.193.56.230:6789/0 10971 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 02:06:03.871566 mon.node1 mon.0 10.193.56.230:6789/0 11026 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 02:06:03.874821 mon.node1 mon.0 10.193.56.230:6789/0 11027 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 02:06:03.875698 mon.node1 mon.0 10.193.56.230:6789/0 11028 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 02:06:03.878764 mon.node1 mon.0 10.193.56.230:6789/0 11029 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 02:11:03.871578 mon.node1 mon.0 10.193.56.230:6789/0 11103 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 02:11:03.872216 mon.node1 mon.0 10.193.56.230:6789/0 11104 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 02:11:03.872508 mon.node1 mon.0 10.193.56.230:6789/0 11105 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 02:11:03.872558 mon.node1 mon.0 10.193.56.230:6789/0 11106 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 02:16:03.871501 mon.node1 mon.0 10.193.56.230:6789/0 11156 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 02:16:03.871551 mon.node1 mon.0 10.193.56.230:6789/0 11157 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 02:16:03.871616 mon.node1 mon.0 10.193.56.230:6789/0 11158 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 02:16:03.871646 mon.node1 mon.0 10.193.56.230:6789/0 11159 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 02:21:03.871636 mon.node1 mon.0 10.193.56.230:6789/0 11220 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 02:21:03.872188 mon.node1 mon.0 10.193.56.230:6789/0 11221 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 02:21:03.872640 mon.node1 mon.0 10.193.56.230:6789/0 11222 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 02:21:03.872857 mon.node1 mon.0 10.193.56.230:6789/0 11223 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 02:26:03.871933 mon.node1 mon.0 10.193.56.230:6789/0 11280 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 02:26:03.872044 mon.node1 mon.0 10.193.56.230:6789/0 11281 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 02:26:03.872096 mon.node1 mon.0 10.193.56.230:6789/0 11282 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 02:26:03.872153 mon.node1 mon.0 10.193.56.230:6789/0 11283 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 02:31:03.871866 mon.node1 mon.0 10.193.56.230:6789/0 11355 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 02:31:03.872713 mon.node1 mon.0 10.193.56.230:6789/0 11356 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 02:31:03.874273 mon.node1 mon.0 10.193.56.230:6789/0 11357 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 02:31:03.879426 mon.node1 mon.0 10.193.56.230:6789/0 11358 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 02:36:03.872123 mon.node1 mon.0 10.193.56.230:6789/0 11416 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 02:36:03.872200 mon.node1 mon.0 10.193.56.230:6789/0 11417 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 02:36:03.872790 mon.node1 mon.0 10.193.56.230:6789/0 11418 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 02:36:03.873243 mon.node1 mon.0 10.193.56.230:6789/0 11419 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 02:41:03.872248 mon.node1 mon.0 10.193.56.230:6789/0 11487 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 02:41:03.872299 mon.node1 mon.0 10.193.56.230:6789/0 11488 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 02:41:03.874546 mon.node1 mon.0 10.193.56.230:6789/0 11489 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 02:41:03.874796 mon.node1 mon.0 10.193.56.230:6789/0 11490 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 02:46:03.873043 mon.node1 mon.0 10.193.56.230:6789/0 11548 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 02:46:03.873685 mon.node1 mon.0 10.193.56.230:6789/0 11549 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 02:46:03.874194 mon.node1 mon.0 10.193.56.230:6789/0 11550 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 02:46:03.874300 mon.node1 mon.0 10.193.56.230:6789/0 11551 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 02:51:03.872649 mon.node1 mon.0 10.193.56.230:6789/0 11605 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 02:51:03.872985 mon.node1 mon.0 10.193.56.230:6789/0 11606 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 02:51:03.873025 mon.node1 mon.0 10.193.56.230:6789/0 11607 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 02:51:03.874390 mon.node1 mon.0 10.193.56.230:6789/0 11608 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 02:56:03.873182 mon.node1 mon.0 10.193.56.230:6789/0 11668 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 02:56:03.873471 mon.node1 mon.0 10.193.56.230:6789/0 11669 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 02:56:03.873905 mon.node1 mon.0 10.193.56.230:6789/0 11670 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 02:56:03.875410 mon.node1 mon.0 10.193.56.230:6789/0 11671 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 03:00:00.000104 mon.node1 mon.0 10.193.56.230:6789/0 11724 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 03:01:03.872941 mon.node1 mon.0 10.193.56.230:6789/0 11739 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 03:01:03.873306 mon.node1 mon.0 10.193.56.230:6789/0 11740 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 03:01:03.873530 mon.node1 mon.0 10.193.56.230:6789/0 11741 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 03:01:03.877553 mon.node1 mon.0 10.193.56.230:6789/0 11742 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 03:06:03.872933 mon.node1 mon.0 10.193.56.230:6789/0 11802 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 03:06:03.872996 mon.node1 mon.0 10.193.56.230:6789/0 11803 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 03:06:03.873080 mon.node1 mon.0 10.193.56.230:6789/0 11804 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 03:06:03.873120 mon.node1 mon.0 10.193.56.230:6789/0 11805 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 03:11:03.873012 mon.node1 mon.0 10.193.56.230:6789/0 11868 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 03:11:03.873045 mon.node1 mon.0 10.193.56.230:6789/0 11869 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 03:11:03.876151 mon.node1 mon.0 10.193.56.230:6789/0 11870 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 03:11:03.878848 mon.node1 mon.0 10.193.56.230:6789/0 11871 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 03:16:03.873197 mon.node1 mon.0 10.193.56.230:6789/0 11924 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 03:16:03.873231 mon.node1 mon.0 10.193.56.230:6789/0 11925 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 03:16:03.873626 mon.node1 mon.0 10.193.56.230:6789/0 11926 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 03:16:03.877215 mon.node1 mon.0 10.193.56.230:6789/0 11927 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 03:21:03.873276 mon.node1 mon.0 10.193.56.230:6789/0 11985 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 03:21:03.873329 mon.node1 mon.0 10.193.56.230:6789/0 11986 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 03:21:03.873380 mon.node1 mon.0 10.193.56.230:6789/0 11987 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 03:21:03.873407 mon.node1 mon.0 10.193.56.230:6789/0 11988 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 03:26:03.873534 mon.node1 mon.0 10.193.56.230:6789/0 12049 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 03:26:03.874040 mon.node1 mon.0 10.193.56.230:6789/0 12050 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 03:26:03.874701 mon.node1 mon.0 10.193.56.230:6789/0 12051 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 03:26:03.875849 mon.node1 mon.0 10.193.56.230:6789/0 12052 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 03:31:03.874143 mon.node1 mon.0 10.193.56.230:6789/0 12105 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 03:31:03.874264 mon.node1 mon.0 10.193.56.230:6789/0 12106 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 03:31:03.875342 mon.node1 mon.0 10.193.56.230:6789/0 12107 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 03:31:03.876003 mon.node1 mon.0 10.193.56.230:6789/0 12108 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 03:36:03.873867 mon.node1 mon.0 10.193.56.230:6789/0 12168 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 03:36:03.875620 mon.node1 mon.0 10.193.56.230:6789/0 12169 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 03:36:03.875753 mon.node1 mon.0 10.193.56.230:6789/0 12170 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 03:36:03.880190 mon.node1 mon.0 10.193.56.230:6789/0 12171 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 03:41:03.873851 mon.node1 mon.0 10.193.56.230:6789/0 12241 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 03:41:03.874094 mon.node1 mon.0 10.193.56.230:6789/0 12242 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 03:41:03.875603 mon.node1 mon.0 10.193.56.230:6789/0 12243 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 03:41:03.876762 mon.node1 mon.0 10.193.56.230:6789/0 12244 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 03:44:38.288778 mon.node1 mon.0 10.193.56.230:6789/0 12286 : cluster [WRN] Health check failed: 6 slow requests are blocked > 32 sec (REQUEST_SLOW) 2017-12-17 03:44:43.751864 mon.node1 mon.0 10.193.56.230:6789/0 12289 : cluster [WRN] Health check update: 14 slow requests are blocked > 32 sec (REQUEST_SLOW) 2017-12-17 03:44:49.752520 mon.node1 mon.0 10.193.56.230:6789/0 12290 : cluster [WRN] Health check update: 11 slow requests are blocked > 32 sec (REQUEST_SLOW) 2017-12-17 03:44:50.511701 mon.node1 mon.0 10.193.56.230:6789/0 12291 : cluster [INF] Health check cleared: REQUEST_SLOW (was: 11 slow requests are blocked > 32 sec) 2017-12-17 03:46:03.873954 mon.node1 mon.0 10.193.56.230:6789/0 12308 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 03:46:03.874016 mon.node1 mon.0 10.193.56.230:6789/0 12309 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 03:46:03.874118 mon.node1 mon.0 10.193.56.230:6789/0 12310 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 03:46:03.874183 mon.node1 mon.0 10.193.56.230:6789/0 12311 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 03:51:03.874133 mon.node1 mon.0 10.193.56.230:6789/0 12365 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 03:51:03.874201 mon.node1 mon.0 10.193.56.230:6789/0 12366 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 03:51:03.875938 mon.node1 mon.0 10.193.56.230:6789/0 12367 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 03:51:03.876430 mon.node1 mon.0 10.193.56.230:6789/0 12368 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 03:56:03.874187 mon.node1 mon.0 10.193.56.230:6789/0 12425 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 03:56:03.874229 mon.node1 mon.0 10.193.56.230:6789/0 12426 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 03:56:03.874473 mon.node1 mon.0 10.193.56.230:6789/0 12427 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 03:56:03.874914 mon.node1 mon.0 10.193.56.230:6789/0 12428 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 04:00:00.000098 mon.node1 mon.0 10.193.56.230:6789/0 12481 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 04:01:03.874432 mon.node1 mon.0 10.193.56.230:6789/0 12495 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 04:01:03.874584 mon.node1 mon.0 10.193.56.230:6789/0 12496 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 04:01:03.874618 mon.node1 mon.0 10.193.56.230:6789/0 12497 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 04:01:03.878572 mon.node1 mon.0 10.193.56.230:6789/0 12498 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 04:06:03.874425 mon.node1 mon.0 10.193.56.230:6789/0 12554 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 04:06:03.874478 mon.node1 mon.0 10.193.56.230:6789/0 12555 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 04:06:03.874568 mon.node1 mon.0 10.193.56.230:6789/0 12556 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 04:06:03.878875 mon.node1 mon.0 10.193.56.230:6789/0 12557 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 04:11:03.874649 mon.node1 mon.0 10.193.56.230:6789/0 12617 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 04:11:03.874802 mon.node1 mon.0 10.193.56.230:6789/0 12618 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 04:11:03.876079 mon.node1 mon.0 10.193.56.230:6789/0 12619 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 04:11:03.876170 mon.node1 mon.0 10.193.56.230:6789/0 12620 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 04:16:03.875178 mon.node1 mon.0 10.193.56.230:6789/0 12673 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 04:16:03.875315 mon.node1 mon.0 10.193.56.230:6789/0 12674 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 04:16:03.875615 mon.node1 mon.0 10.193.56.230:6789/0 12675 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 04:16:03.875981 mon.node1 mon.0 10.193.56.230:6789/0 12676 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 04:21:03.874879 mon.node1 mon.0 10.193.56.230:6789/0 12741 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 04:21:03.875016 mon.node1 mon.0 10.193.56.230:6789/0 12742 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 04:21:03.875068 mon.node1 mon.0 10.193.56.230:6789/0 12743 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 04:21:03.877398 mon.node1 mon.0 10.193.56.230:6789/0 12744 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 04:26:03.876259 mon.node1 mon.0 10.193.56.230:6789/0 12806 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 04:26:03.876809 mon.node1 mon.0 10.193.56.230:6789/0 12807 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 04:26:03.877334 mon.node1 mon.0 10.193.56.230:6789/0 12808 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 04:26:03.879265 mon.node1 mon.0 10.193.56.230:6789/0 12809 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 04:31:03.875122 mon.node1 mon.0 10.193.56.230:6789/0 12866 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 04:31:03.875210 mon.node1 mon.0 10.193.56.230:6789/0 12867 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 04:31:03.875240 mon.node1 mon.0 10.193.56.230:6789/0 12868 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 04:31:03.875260 mon.node1 mon.0 10.193.56.230:6789/0 12869 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 04:36:03.875396 mon.node1 mon.0 10.193.56.230:6789/0 12927 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 04:36:03.875682 mon.node1 mon.0 10.193.56.230:6789/0 12928 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 04:36:03.878752 mon.node1 mon.0 10.193.56.230:6789/0 12929 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 04:36:03.880646 mon.node1 mon.0 10.193.56.230:6789/0 12930 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 04:41:03.875390 mon.node1 mon.0 10.193.56.230:6789/0 12989 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 04:41:03.875430 mon.node1 mon.0 10.193.56.230:6789/0 12990 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 04:41:03.875464 mon.node1 mon.0 10.193.56.230:6789/0 12991 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 04:41:03.875525 mon.node1 mon.0 10.193.56.230:6789/0 12992 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 04:46:03.875501 mon.node1 mon.0 10.193.56.230:6789/0 13060 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 04:46:03.875533 mon.node1 mon.0 10.193.56.230:6789/0 13061 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 04:46:03.878614 mon.node1 mon.0 10.193.56.230:6789/0 13062 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 04:46:03.879259 mon.node1 mon.0 10.193.56.230:6789/0 13063 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 04:51:03.876872 mon.node1 mon.0 10.193.56.230:6789/0 13136 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 04:51:03.879669 mon.node1 mon.0 10.193.56.230:6789/0 13137 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 04:51:03.880051 mon.node1 mon.0 10.193.56.230:6789/0 13138 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 04:51:03.882088 mon.node1 mon.0 10.193.56.230:6789/0 13139 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 04:56:03.875967 mon.node1 mon.0 10.193.56.230:6789/0 13196 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 04:56:03.876209 mon.node1 mon.0 10.193.56.230:6789/0 13197 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 04:56:03.876239 mon.node1 mon.0 10.193.56.230:6789/0 13198 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 04:56:03.877537 mon.node1 mon.0 10.193.56.230:6789/0 13199 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 05:00:00.000090 mon.node1 mon.0 10.193.56.230:6789/0 13241 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 05:01:03.876891 mon.node1 mon.0 10.193.56.230:6789/0 13258 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 05:01:03.879923 mon.node1 mon.0 10.193.56.230:6789/0 13259 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 05:01:03.880367 mon.node1 mon.0 10.193.56.230:6789/0 13260 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 05:01:03.884334 mon.node1 mon.0 10.193.56.230:6789/0 13261 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 05:06:03.876244 mon.node1 mon.0 10.193.56.230:6789/0 13314 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 05:06:03.876279 mon.node1 mon.0 10.193.56.230:6789/0 13315 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 05:06:03.876473 mon.node1 mon.0 10.193.56.230:6789/0 13316 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 05:06:03.882141 mon.node1 mon.0 10.193.56.230:6789/0 13317 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 05:11:03.876259 mon.node1 mon.0 10.193.56.230:6789/0 13380 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 05:11:03.876290 mon.node1 mon.0 10.193.56.230:6789/0 13381 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 05:11:03.876310 mon.node1 mon.0 10.193.56.230:6789/0 13382 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 05:11:03.876331 mon.node1 mon.0 10.193.56.230:6789/0 13383 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 05:16:03.876378 mon.node1 mon.0 10.193.56.230:6789/0 13442 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 05:16:03.876428 mon.node1 mon.0 10.193.56.230:6789/0 13443 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 05:16:03.876656 mon.node1 mon.0 10.193.56.230:6789/0 13444 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 05:16:03.877146 mon.node1 mon.0 10.193.56.230:6789/0 13445 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 05:21:03.876438 mon.node1 mon.0 10.193.56.230:6789/0 13507 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 05:21:03.876602 mon.node1 mon.0 10.193.56.230:6789/0 13508 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 05:21:03.878430 mon.node1 mon.0 10.193.56.230:6789/0 13509 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 05:21:03.879237 mon.node1 mon.0 10.193.56.230:6789/0 13510 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 05:26:03.876716 mon.node1 mon.0 10.193.56.230:6789/0 13572 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 05:26:03.876760 mon.node1 mon.0 10.193.56.230:6789/0 13573 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 05:26:03.877132 mon.node1 mon.0 10.193.56.230:6789/0 13574 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 05:26:03.883247 mon.node1 mon.0 10.193.56.230:6789/0 13575 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 05:31:03.876742 mon.node1 mon.0 10.193.56.230:6789/0 13628 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 05:31:03.876775 mon.node1 mon.0 10.193.56.230:6789/0 13629 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 05:31:03.876833 mon.node1 mon.0 10.193.56.230:6789/0 13630 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 05:31:03.879386 mon.node1 mon.0 10.193.56.230:6789/0 13631 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 05:36:03.876871 mon.node1 mon.0 10.193.56.230:6789/0 13688 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 05:36:03.876909 mon.node1 mon.0 10.193.56.230:6789/0 13689 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 05:36:03.876932 mon.node1 mon.0 10.193.56.230:6789/0 13690 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 05:36:03.876952 mon.node1 mon.0 10.193.56.230:6789/0 13691 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 05:41:03.877049 mon.node1 mon.0 10.193.56.230:6789/0 13759 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 05:41:03.877087 mon.node1 mon.0 10.193.56.230:6789/0 13760 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 05:41:03.877109 mon.node1 mon.0 10.193.56.230:6789/0 13761 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 05:41:03.877233 mon.node1 mon.0 10.193.56.230:6789/0 13762 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 05:46:03.877071 mon.node1 mon.0 10.193.56.230:6789/0 13828 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 05:46:03.877191 mon.node1 mon.0 10.193.56.230:6789/0 13829 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 05:46:03.877747 mon.node1 mon.0 10.193.56.230:6789/0 13830 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 05:46:03.877894 mon.node1 mon.0 10.193.56.230:6789/0 13831 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 05:51:03.877246 mon.node1 mon.0 10.193.56.230:6789/0 13901 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 05:51:03.877284 mon.node1 mon.0 10.193.56.230:6789/0 13902 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 05:51:03.877339 mon.node1 mon.0 10.193.56.230:6789/0 13903 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 05:51:03.877947 mon.node1 mon.0 10.193.56.230:6789/0 13904 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 05:56:03.877499 mon.node1 mon.0 10.193.56.230:6789/0 13953 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 05:56:03.877549 mon.node1 mon.0 10.193.56.230:6789/0 13954 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 05:56:03.877861 mon.node1 mon.0 10.193.56.230:6789/0 13955 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 05:56:03.879971 mon.node1 mon.0 10.193.56.230:6789/0 13956 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 06:00:00.000072 mon.node1 mon.0 10.193.56.230:6789/0 14009 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 06:01:03.877565 mon.node1 mon.0 10.193.56.230:6789/0 14022 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 06:01:03.877610 mon.node1 mon.0 10.193.56.230:6789/0 14023 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 06:01:03.877635 mon.node1 mon.0 10.193.56.230:6789/0 14024 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 06:01:03.877659 mon.node1 mon.0 10.193.56.230:6789/0 14025 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 06:06:03.877587 mon.node1 mon.0 10.193.56.230:6789/0 14091 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 06:06:03.877662 mon.node1 mon.0 10.193.56.230:6789/0 14092 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 06:06:03.878013 mon.node1 mon.0 10.193.56.230:6789/0 14093 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 06:06:03.884495 mon.node1 mon.0 10.193.56.230:6789/0 14094 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 06:11:03.878125 mon.node1 mon.0 10.193.56.230:6789/0 14161 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 06:11:03.878165 mon.node1 mon.0 10.193.56.230:6789/0 14162 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 06:11:03.878261 mon.node1 mon.0 10.193.56.230:6789/0 14163 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 06:11:03.878425 mon.node1 mon.0 10.193.56.230:6789/0 14164 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 06:16:03.877914 mon.node1 mon.0 10.193.56.230:6789/0 14230 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 06:16:03.877946 mon.node1 mon.0 10.193.56.230:6789/0 14231 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 06:16:03.877969 mon.node1 mon.0 10.193.56.230:6789/0 14232 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 06:16:03.879312 mon.node1 mon.0 10.193.56.230:6789/0 14233 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 06:21:03.878263 mon.node1 mon.0 10.193.56.230:6789/0 14289 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 06:21:03.879901 mon.node1 mon.0 10.193.56.230:6789/0 14290 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 06:21:03.881440 mon.node1 mon.0 10.193.56.230:6789/0 14291 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 06:21:03.883445 mon.node1 mon.0 10.193.56.230:6789/0 14292 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 06:26:03.878084 mon.node1 mon.0 10.193.56.230:6789/0 14343 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 06:26:03.878129 mon.node1 mon.0 10.193.56.230:6789/0 14344 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 06:26:03.878336 mon.node1 mon.0 10.193.56.230:6789/0 14345 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 06:26:03.879316 mon.node1 mon.0 10.193.56.230:6789/0 14346 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 06:31:03.878415 mon.node1 mon.0 10.193.56.230:6789/0 14407 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 06:31:03.878510 mon.node1 mon.0 10.193.56.230:6789/0 14408 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 06:31:03.878690 mon.node1 mon.0 10.193.56.230:6789/0 14409 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 06:31:03.880242 mon.node1 mon.0 10.193.56.230:6789/0 14410 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 06:36:03.880850 mon.node1 mon.0 10.193.56.230:6789/0 14472 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 06:36:03.881422 mon.node1 mon.0 10.193.56.230:6789/0 14473 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 06:36:03.884137 mon.node1 mon.0 10.193.56.230:6789/0 14474 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 06:36:03.884652 mon.node1 mon.0 10.193.56.230:6789/0 14475 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 06:41:03.878511 mon.node1 mon.0 10.193.56.230:6789/0 14553 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 06:41:03.878571 mon.node1 mon.0 10.193.56.230:6789/0 14554 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 06:41:03.878596 mon.node1 mon.0 10.193.56.230:6789/0 14555 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 06:41:03.878664 mon.node1 mon.0 10.193.56.230:6789/0 14556 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 06:46:03.878648 mon.node1 mon.0 10.193.56.230:6789/0 14623 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 06:46:03.878685 mon.node1 mon.0 10.193.56.230:6789/0 14624 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 06:46:03.878765 mon.node1 mon.0 10.193.56.230:6789/0 14625 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 06:46:03.883238 mon.node1 mon.0 10.193.56.230:6789/0 14626 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 06:51:03.878862 mon.node1 mon.0 10.193.56.230:6789/0 14697 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 06:51:03.879004 mon.node1 mon.0 10.193.56.230:6789/0 14698 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 06:51:03.879146 mon.node1 mon.0 10.193.56.230:6789/0 14699 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 06:51:03.880959 mon.node1 mon.0 10.193.56.230:6789/0 14700 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 06:56:03.879332 mon.node1 mon.0 10.193.56.230:6789/0 14750 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 06:56:03.879382 mon.node1 mon.0 10.193.56.230:6789/0 14751 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 06:56:03.879492 mon.node1 mon.0 10.193.56.230:6789/0 14752 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 06:56:03.880587 mon.node1 mon.0 10.193.56.230:6789/0 14753 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 07:00:00.000090 mon.node1 mon.0 10.193.56.230:6789/0 14796 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 07:01:03.879368 mon.node1 mon.0 10.193.56.230:6789/0 14812 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 07:01:03.881991 mon.node1 mon.0 10.193.56.230:6789/0 14813 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 07:01:03.882173 mon.node1 mon.0 10.193.56.230:6789/0 14814 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 07:01:03.883187 mon.node1 mon.0 10.193.56.230:6789/0 14815 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 07:06:03.879293 mon.node1 mon.0 10.193.56.230:6789/0 14872 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 07:06:03.879324 mon.node1 mon.0 10.193.56.230:6789/0 14873 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 07:06:03.879376 mon.node1 mon.0 10.193.56.230:6789/0 14874 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 07:06:04.873423 mon.node1 mon.0 10.193.56.230:6789/0 14875 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 07:11:03.879472 mon.node1 mon.0 10.193.56.230:6789/0 14930 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 07:11:03.879523 mon.node1 mon.0 10.193.56.230:6789/0 14931 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 07:11:03.879560 mon.node1 mon.0 10.193.56.230:6789/0 14932 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 07:11:03.879595 mon.node1 mon.0 10.193.56.230:6789/0 14933 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 07:16:03.879939 mon.node1 mon.0 10.193.56.230:6789/0 14993 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 07:16:03.879987 mon.node1 mon.0 10.193.56.230:6789/0 14994 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 07:16:03.882043 mon.node1 mon.0 10.193.56.230:6789/0 14995 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 07:16:03.884130 mon.node1 mon.0 10.193.56.230:6789/0 14996 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 07:21:03.879680 mon.node1 mon.0 10.193.56.230:6789/0 15052 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 07:21:03.879711 mon.node1 mon.0 10.193.56.230:6789/0 15053 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 07:21:03.881244 mon.node1 mon.0 10.193.56.230:6789/0 15054 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 07:21:03.882611 mon.node1 mon.0 10.193.56.230:6789/0 15055 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 07:26:03.880102 mon.node1 mon.0 10.193.56.230:6789/0 15116 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 07:26:03.880429 mon.node1 mon.0 10.193.56.230:6789/0 15117 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 07:26:03.880712 mon.node1 mon.0 10.193.56.230:6789/0 15118 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 07:26:03.884560 mon.node1 mon.0 10.193.56.230:6789/0 15119 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 07:31:03.879959 mon.node1 mon.0 10.193.56.230:6789/0 15174 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 07:31:03.880007 mon.node1 mon.0 10.193.56.230:6789/0 15175 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 07:31:03.880040 mon.node1 mon.0 10.193.56.230:6789/0 15176 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 07:31:03.880739 mon.node1 mon.0 10.193.56.230:6789/0 15177 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 07:36:03.881149 mon.node1 mon.0 10.193.56.230:6789/0 15231 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 07:36:03.881253 mon.node1 mon.0 10.193.56.230:6789/0 15232 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 07:36:03.881926 mon.node1 mon.0 10.193.56.230:6789/0 15233 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 07:36:03.882867 mon.node1 mon.0 10.193.56.230:6789/0 15234 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 07:41:03.880276 mon.node1 mon.0 10.193.56.230:6789/0 15285 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 07:41:03.880314 mon.node1 mon.0 10.193.56.230:6789/0 15286 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 07:41:03.880666 mon.node1 mon.0 10.193.56.230:6789/0 15287 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 07:41:03.881542 mon.node1 mon.0 10.193.56.230:6789/0 15288 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 07:46:03.880404 mon.node1 mon.0 10.193.56.230:6789/0 15362 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 07:46:03.880491 mon.node1 mon.0 10.193.56.230:6789/0 15363 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 07:46:03.881992 mon.node1 mon.0 10.193.56.230:6789/0 15364 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 07:46:03.882550 mon.node1 mon.0 10.193.56.230:6789/0 15365 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 07:51:03.880470 mon.node1 mon.0 10.193.56.230:6789/0 15421 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 07:51:03.880586 mon.node1 mon.0 10.193.56.230:6789/0 15422 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 07:51:03.880868 mon.node1 mon.0 10.193.56.230:6789/0 15423 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 07:51:03.881803 mon.node1 mon.0 10.193.56.230:6789/0 15424 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 07:56:03.880956 mon.node1 mon.0 10.193.56.230:6789/0 15484 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 07:56:03.882251 mon.node1 mon.0 10.193.56.230:6789/0 15485 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 07:56:03.882375 mon.node1 mon.0 10.193.56.230:6789/0 15486 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 07:56:03.884661 mon.node1 mon.0 10.193.56.230:6789/0 15487 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 08:00:00.000089 mon.node1 mon.0 10.193.56.230:6789/0 15537 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 08:01:03.880876 mon.node1 mon.0 10.193.56.230:6789/0 15558 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 08:01:03.880913 mon.node1 mon.0 10.193.56.230:6789/0 15559 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 08:01:03.880952 mon.node1 mon.0 10.193.56.230:6789/0 15560 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 08:01:03.881004 mon.node1 mon.0 10.193.56.230:6789/0 15561 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 08:06:03.882243 mon.node1 mon.0 10.193.56.230:6789/0 15626 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 08:06:03.882877 mon.node1 mon.0 10.193.56.230:6789/0 15627 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 08:06:03.883022 mon.node1 mon.0 10.193.56.230:6789/0 15628 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 08:06:03.884067 mon.node1 mon.0 10.193.56.230:6789/0 15629 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 08:11:03.881160 mon.node1 mon.0 10.193.56.230:6789/0 15685 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 08:11:03.881214 mon.node1 mon.0 10.193.56.230:6789/0 15686 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 08:11:03.881250 mon.node1 mon.0 10.193.56.230:6789/0 15687 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 08:11:03.881272 mon.node1 mon.0 10.193.56.230:6789/0 15688 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 08:16:03.881365 mon.node1 mon.0 10.193.56.230:6789/0 15741 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 08:16:03.881450 mon.node1 mon.0 10.193.56.230:6789/0 15742 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 08:16:03.881531 mon.node1 mon.0 10.193.56.230:6789/0 15743 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 08:16:03.881786 mon.node1 mon.0 10.193.56.230:6789/0 15744 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 08:21:03.881399 mon.node1 mon.0 10.193.56.230:6789/0 15810 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 08:21:03.881436 mon.node1 mon.0 10.193.56.230:6789/0 15811 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 08:21:03.881774 mon.node1 mon.0 10.193.56.230:6789/0 15812 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 08:21:03.886172 mon.node1 mon.0 10.193.56.230:6789/0 15813 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 08:26:03.881521 mon.node1 mon.0 10.193.56.230:6789/0 15880 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 08:26:03.881560 mon.node1 mon.0 10.193.56.230:6789/0 15881 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 08:26:03.881585 mon.node1 mon.0 10.193.56.230:6789/0 15882 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 08:26:03.881650 mon.node1 mon.0 10.193.56.230:6789/0 15883 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 08:31:03.881686 mon.node1 mon.0 10.193.56.230:6789/0 15946 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 08:31:03.881717 mon.node1 mon.0 10.193.56.230:6789/0 15947 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 08:31:03.881740 mon.node1 mon.0 10.193.56.230:6789/0 15948 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 08:31:03.884651 mon.node1 mon.0 10.193.56.230:6789/0 15949 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 08:36:03.881788 mon.node1 mon.0 10.193.56.230:6789/0 16004 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 08:36:03.882055 mon.node1 mon.0 10.193.56.230:6789/0 16005 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 08:36:03.882308 mon.node1 mon.0 10.193.56.230:6789/0 16006 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 08:36:03.887937 mon.node1 mon.0 10.193.56.230:6789/0 16007 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 08:41:03.881895 mon.node1 mon.0 10.193.56.230:6789/0 16075 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 08:41:03.881933 mon.node1 mon.0 10.193.56.230:6789/0 16076 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 08:41:03.881960 mon.node1 mon.0 10.193.56.230:6789/0 16077 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 08:41:03.884483 mon.node1 mon.0 10.193.56.230:6789/0 16078 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 08:46:03.882653 mon.node1 mon.0 10.193.56.230:6789/0 16137 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 08:46:03.882734 mon.node1 mon.0 10.193.56.230:6789/0 16138 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 08:46:03.883054 mon.node1 mon.0 10.193.56.230:6789/0 16139 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 08:46:03.884719 mon.node1 mon.0 10.193.56.230:6789/0 16140 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 08:51:03.882178 mon.node1 mon.0 10.193.56.230:6789/0 16208 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 08:51:03.882245 mon.node1 mon.0 10.193.56.230:6789/0 16209 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 08:51:03.882273 mon.node1 mon.0 10.193.56.230:6789/0 16210 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 08:51:03.882320 mon.node1 mon.0 10.193.56.230:6789/0 16211 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 08:56:03.884224 mon.node1 mon.0 10.193.56.230:6789/0 16275 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 08:56:03.885126 mon.node1 mon.0 10.193.56.230:6789/0 16276 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 08:56:03.887934 mon.node1 mon.0 10.193.56.230:6789/0 16277 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 08:56:03.888850 mon.node1 mon.0 10.193.56.230:6789/0 16278 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 09:00:00.000090 mon.node1 mon.0 10.193.56.230:6789/0 16314 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 09:01:03.882950 mon.node1 mon.0 10.193.56.230:6789/0 16330 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 09:01:03.883001 mon.node1 mon.0 10.193.56.230:6789/0 16331 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 09:01:03.883651 mon.node1 mon.0 10.193.56.230:6789/0 16332 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 09:01:03.887937 mon.node1 mon.0 10.193.56.230:6789/0 16333 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 09:06:03.882657 mon.node1 mon.0 10.193.56.230:6789/0 16394 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 09:06:03.882700 mon.node1 mon.0 10.193.56.230:6789/0 16395 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 09:06:03.882774 mon.node1 mon.0 10.193.56.230:6789/0 16396 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 09:06:03.885059 mon.node1 mon.0 10.193.56.230:6789/0 16397 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 09:11:03.882699 mon.node1 mon.0 10.193.56.230:6789/0 16454 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 09:11:03.882740 mon.node1 mon.0 10.193.56.230:6789/0 16455 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 09:11:03.882801 mon.node1 mon.0 10.193.56.230:6789/0 16456 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 09:11:03.882831 mon.node1 mon.0 10.193.56.230:6789/0 16457 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 09:16:03.882839 mon.node1 mon.0 10.193.56.230:6789/0 16512 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 09:16:03.882896 mon.node1 mon.0 10.193.56.230:6789/0 16513 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 09:16:03.882947 mon.node1 mon.0 10.193.56.230:6789/0 16514 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 09:16:03.883046 mon.node1 mon.0 10.193.56.230:6789/0 16515 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 09:21:03.883016 mon.node1 mon.0 10.193.56.230:6789/0 16572 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 09:21:03.883054 mon.node1 mon.0 10.193.56.230:6789/0 16573 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 09:21:03.883076 mon.node1 mon.0 10.193.56.230:6789/0 16574 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 09:21:03.883389 mon.node1 mon.0 10.193.56.230:6789/0 16575 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 09:22:12.005511 mon.node1 mon.0 10.193.56.230:6789/0 16591 : cluster [WRN] Health check failed: 2 slow requests are blocked > 32 sec (REQUEST_SLOW) 2017-12-17 09:22:22.152124 mon.node1 mon.0 10.193.56.230:6789/0 16594 : cluster [INF] Health check cleared: REQUEST_SLOW (was: 2 slow requests are blocked > 32 sec) 2017-12-17 09:26:03.883436 mon.node1 mon.0 10.193.56.230:6789/0 16633 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 09:26:03.883484 mon.node1 mon.0 10.193.56.230:6789/0 16634 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 09:26:03.884807 mon.node1 mon.0 10.193.56.230:6789/0 16635 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 09:26:03.888640 mon.node1 mon.0 10.193.56.230:6789/0 16636 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 09:31:03.883291 mon.node1 mon.0 10.193.56.230:6789/0 16698 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 09:31:03.883332 mon.node1 mon.0 10.193.56.230:6789/0 16699 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 09:31:03.883395 mon.node1 mon.0 10.193.56.230:6789/0 16700 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 09:31:03.883785 mon.node1 mon.0 10.193.56.230:6789/0 16701 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 09:36:03.883509 mon.node1 mon.0 10.193.56.230:6789/0 16758 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 09:36:03.883608 mon.node1 mon.0 10.193.56.230:6789/0 16759 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 09:36:03.883733 mon.node1 mon.0 10.193.56.230:6789/0 16760 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 09:36:03.884420 mon.node1 mon.0 10.193.56.230:6789/0 16761 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 09:41:03.883751 mon.node1 mon.0 10.193.56.230:6789/0 16834 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 09:41:03.883788 mon.node1 mon.0 10.193.56.230:6789/0 16835 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 09:41:03.886206 mon.node1 mon.0 10.193.56.230:6789/0 16836 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 09:41:03.888760 mon.node1 mon.0 10.193.56.230:6789/0 16837 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 09:46:03.883626 mon.node1 mon.0 10.193.56.230:6789/0 16887 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 09:46:03.883664 mon.node1 mon.0 10.193.56.230:6789/0 16888 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 09:46:03.883726 mon.node1 mon.0 10.193.56.230:6789/0 16889 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 09:46:03.884169 mon.node1 mon.0 10.193.56.230:6789/0 16890 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 09:51:03.883832 mon.node1 mon.0 10.193.56.230:6789/0 16949 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 09:51:03.885282 mon.node1 mon.0 10.193.56.230:6789/0 16950 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 09:51:03.889267 mon.node1 mon.0 10.193.56.230:6789/0 16951 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 09:51:03.890524 mon.node1 mon.0 10.193.56.230:6789/0 16952 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 09:56:03.886276 mon.node1 mon.0 10.193.56.230:6789/0 17014 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 09:56:03.888607 mon.node1 mon.0 10.193.56.230:6789/0 17015 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 09:56:03.889323 mon.node1 mon.0 10.193.56.230:6789/0 17016 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 09:56:03.889570 mon.node1 mon.0 10.193.56.230:6789/0 17017 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 10:00:00.000096 mon.node1 mon.0 10.193.56.230:6789/0 17079 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 10:01:03.884043 mon.node1 mon.0 10.193.56.230:6789/0 17099 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 10:01:03.884102 mon.node1 mon.0 10.193.56.230:6789/0 17100 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 10:01:03.884125 mon.node1 mon.0 10.193.56.230:6789/0 17101 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 10:01:03.884177 mon.node1 mon.0 10.193.56.230:6789/0 17102 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 10:06:03.884640 mon.node1 mon.0 10.193.56.230:6789/0 17159 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 10:06:03.884804 mon.node1 mon.0 10.193.56.230:6789/0 17160 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 10:06:03.884898 mon.node1 mon.0 10.193.56.230:6789/0 17161 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 10:06:03.884974 mon.node1 mon.0 10.193.56.230:6789/0 17162 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 10:11:03.884346 mon.node1 mon.0 10.193.56.230:6789/0 17225 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 10:11:03.884394 mon.node1 mon.0 10.193.56.230:6789/0 17226 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 10:11:03.884446 mon.node1 mon.0 10.193.56.230:6789/0 17227 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 10:11:03.884474 mon.node1 mon.0 10.193.56.230:6789/0 17228 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 10:16:03.894620 mon.node1 mon.0 10.193.56.230:6789/0 17287 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 10:16:03.896495 mon.node1 mon.0 10.193.56.230:6789/0 17288 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 10:16:03.896850 mon.node1 mon.0 10.193.56.230:6789/0 17289 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 10:16:03.900937 mon.node1 mon.0 10.193.56.230:6789/0 17290 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 10:21:03.890498 mon.node1 mon.0 10.193.56.230:6789/0 17352 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 10:21:03.890540 mon.node1 mon.0 10.193.56.230:6789/0 17353 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 10:21:03.891640 mon.node1 mon.0 10.193.56.230:6789/0 17354 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 10:21:03.892356 mon.node1 mon.0 10.193.56.230:6789/0 17355 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 10:26:03.890134 mon.node1 mon.0 10.193.56.230:6789/0 17425 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 10:26:03.890254 mon.node1 mon.0 10.193.56.230:6789/0 17426 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 10:26:03.890538 mon.node1 mon.0 10.193.56.230:6789/0 17427 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 10:26:03.891671 mon.node1 mon.0 10.193.56.230:6789/0 17428 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 10:31:03.890198 mon.node1 mon.0 10.193.56.230:6789/0 17484 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 10:31:03.890383 mon.node1 mon.0 10.193.56.230:6789/0 17485 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 10:31:03.893202 mon.node1 mon.0 10.193.56.230:6789/0 17486 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 10:31:03.895629 mon.node1 mon.0 10.193.56.230:6789/0 17487 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 10:36:03.891667 mon.node1 mon.0 10.193.56.230:6789/0 17540 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 10:36:03.895688 mon.node1 mon.0 10.193.56.230:6789/0 17541 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 10:36:03.896794 mon.node1 mon.0 10.193.56.230:6789/0 17542 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 10:36:03.897429 mon.node1 mon.0 10.193.56.230:6789/0 17543 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 10:41:03.890518 mon.node1 mon.0 10.193.56.230:6789/0 17608 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 10:41:03.890558 mon.node1 mon.0 10.193.56.230:6789/0 17609 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 10:41:03.890610 mon.node1 mon.0 10.193.56.230:6789/0 17610 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 10:41:03.896265 mon.node1 mon.0 10.193.56.230:6789/0 17611 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 10:46:03.890763 mon.node1 mon.0 10.193.56.230:6789/0 17667 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 10:46:03.892542 mon.node1 mon.0 10.193.56.230:6789/0 17668 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 10:46:03.893705 mon.node1 mon.0 10.193.56.230:6789/0 17669 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 10:46:03.894254 mon.node1 mon.0 10.193.56.230:6789/0 17670 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 10:51:03.890775 mon.node1 mon.0 10.193.56.230:6789/0 17736 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 10:51:03.890814 mon.node1 mon.0 10.193.56.230:6789/0 17737 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 10:51:03.890900 mon.node1 mon.0 10.193.56.230:6789/0 17738 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 10:51:03.891799 mon.node1 mon.0 10.193.56.230:6789/0 17739 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 10:56:03.891011 mon.node1 mon.0 10.193.56.230:6789/0 17800 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 10:56:03.891161 mon.node1 mon.0 10.193.56.230:6789/0 17801 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 10:56:03.891303 mon.node1 mon.0 10.193.56.230:6789/0 17802 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 10:56:03.891857 mon.node1 mon.0 10.193.56.230:6789/0 17803 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 11:00:00.000096 mon.node1 mon.0 10.193.56.230:6789/0 17856 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 11:01:03.891166 mon.node1 mon.0 10.193.56.230:6789/0 17874 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 11:01:03.891411 mon.node1 mon.0 10.193.56.230:6789/0 17875 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 11:01:03.891441 mon.node1 mon.0 10.193.56.230:6789/0 17876 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 11:01:03.892321 mon.node1 mon.0 10.193.56.230:6789/0 17877 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 11:02:53.751549 mon.node1 mon.0 10.193.56.230:6789/0 17904 : cluster [WRN] Health check failed: 7 slow requests are blocked > 32 sec (REQUEST_SLOW) 2017-12-17 11:02:59.309232 mon.node1 mon.0 10.193.56.230:6789/0 17907 : cluster [WRN] Health check update: 13 slow requests are blocked > 32 sec (REQUEST_SLOW) 2017-12-17 11:03:04.836578 mon.node1 mon.0 10.193.56.230:6789/0 17911 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s); 20 slow requests are blocked > 32 sec 2017-12-17 11:03:05.309779 mon.node1 mon.0 10.193.56.230:6789/0 17912 : cluster [WRN] Health check update: 20 slow requests are blocked > 32 sec (REQUEST_SLOW) 2017-12-17 11:03:03.511066 osd.15 osd.15 10.193.56.230:6813/22179 1 : cluster [WRN] 3 slow requests, 3 included below; oldest blocked for > 30.512397 secs 2017-12-17 11:03:03.511070 osd.15 osd.15 10.193.56.230:6813/22179 2 : cluster [WRN] slow request 30.217265 seconds old, received at 2017-12-17 11:02:33.293739: osd_op(client.18209.0:1907235 7.1bfs0 7:fdbccc30:::rbd_data.10.44be2ae8944a.00000000000e811e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~3997696] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-17 11:03:03.511072 osd.15 osd.15 10.193.56.230:6813/22179 3 : cluster [WRN] slow request 30.215157 seconds old, received at 2017-12-17 11:02:33.295847: osd_op(client.18209.0:1907236 7.1bfs0 7:fdbccc30:::rbd_data.10.44be2ae8944a.00000000000e811e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3997696~196608] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-17 11:03:03.511074 osd.15 osd.15 10.193.56.230:6813/22179 4 : cluster [WRN] slow request 30.512397 seconds old, received at 2017-12-17 11:02:32.998607: osd_op(client.18209.0:1907216 7.22s0 7:4436c9a6:::rbd_data.10.44be2ae8944a.00000000000c814e:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~3997696] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-17 11:03:04.511217 osd.15 osd.15 10.193.56.230:6813/22179 5 : cluster [WRN] 5 slow requests, 2 included below; oldest blocked for > 31.512565 secs 2017-12-17 11:03:04.511220 osd.15 osd.15 10.193.56.230:6813/22179 6 : cluster [WRN] slow request 30.949163 seconds old, received at 2017-12-17 11:02:33.562009: osd_op(client.18209.0:1907250 7.d6s0 7:6b5ba4b9:::rbd_data.10.44be2ae8944a.00000000000e8144:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~3342336] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-17 11:03:04.511222 osd.15 osd.15 10.193.56.230:6813/22179 7 : cluster [WRN] slow request 30.488900 seconds old, received at 2017-12-17 11:02:34.022273: osd_op(client.18209.0:1907274 7.17as0 7:5eab73e8:::rbd_data.10.44be2ae8944a.000000000014813f:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~3342336] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-17 11:03:05.511346 osd.15 osd.15 10.193.56.230:6813/22179 8 : cluster [WRN] 6 slow requests, 1 included below; oldest blocked for > 32.512699 secs 2017-12-17 11:03:05.511350 osd.15 osd.15 10.193.56.230:6813/22179 9 : cluster [WRN] slow request 30.395071 seconds old, received at 2017-12-17 11:02:35.116235: osd_op(client.18209.0:1907348 7.d3s0 7:cb6fa6dc:::rbd_data.10.44be2ae8944a.00000000001e8147:head [write 3932160~262144] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-17 11:03:04.211773 osd.18 osd.18 10.193.56.231:6812/24620 1 : cluster [WRN] 2 slow requests, 2 included below; oldest blocked for > 30.949338 secs 2017-12-17 11:03:04.211776 osd.18 osd.18 10.193.56.231:6812/24620 2 : cluster [WRN] slow request 30.949338 seconds old, received at 2017-12-17 11:02:33.262373: osd_op(client.18209.0:1907233 7.1fbs0 7:dfd55524:::rbd_data.10.44be2ae8944a.00000000000e8118:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~3932160] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-17 11:03:04.211778 osd.18 osd.18 10.193.56.231:6812/24620 3 : cluster [WRN] slow request 30.571216 seconds old, received at 2017-12-17 11:02:33.640495: osd_op(client.18209.0:1907234 7.1fbs0 7:dfd55524:::rbd_data.10.44be2ae8944a.00000000000e8118:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3932160~262144] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-17 11:03:06.211954 osd.18 osd.18 10.193.56.231:6812/24620 4 : cluster [WRN] 3 slow requests, 1 included below; oldest blocked for > 32.949544 secs 2017-12-17 11:03:06.211958 osd.18 osd.18 10.193.56.231:6812/24620 5 : cluster [WRN] slow request 30.122504 seconds old, received at 2017-12-17 11:02:36.089412: osd_op(client.18209.0:1907409 7.b3s0 7:cd1cf6e0:::rbd_data.10.44be2ae8944a.000000000020835c:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~3342336] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-17 11:03:07.511538 osd.15 osd.15 10.193.56.230:6813/22179 10 : cluster [WRN] 7 slow requests, 1 included below; oldest blocked for > 34.512878 secs 2017-12-17 11:03:07.511543 osd.15 osd.15 10.193.56.230:6813/22179 11 : cluster [WRN] slow request 30.092679 seconds old, received at 2017-12-17 11:02:37.418806: osd_op(client.18209.0:1907502 7.22s0 7:44579eef:::rbd_data.10.44be2ae8944a.0000000000008112:head [write 262144~3932160] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-17 11:03:09.511764 osd.15 osd.15 10.193.56.230:6813/22179 12 : cluster [WRN] 11 slow requests, 4 included below; oldest blocked for > 36.513093 secs 2017-12-17 11:03:09.511770 osd.15 osd.15 10.193.56.230:6813/22179 13 : cluster [WRN] slow request 30.762016 seconds old, received at 2017-12-17 11:02:38.749684: osd_op(client.18209.0:1907577 7.d6s0 7:6b2542e9:::rbd_data.10.44be2ae8944a.0000000000068155:head [write 1507328~2686976] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-17 11:03:09.511772 osd.15 osd.15 10.193.56.230:6813/22179 14 : cluster [WRN] slow request 30.911756 seconds old, received at 2017-12-17 11:02:38.599944: osd_op(client.18209.0:1907567 7.18es0 7:71859f03:::rbd_data.10.44be2ae8944a.0000000000048129:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~3997696] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-17 11:03:09.511774 osd.15 osd.15 10.193.56.230:6813/22179 15 : cluster [WRN] slow request 30.909377 seconds old, received at 2017-12-17 11:02:38.602323: osd_op(client.18209.0:1907568 7.18es0 7:71859f03:::rbd_data.10.44be2ae8944a.0000000000048129:head [set-alloc-hint object_size 4194304 write_size 4194304,write 3997696~196608] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-17 11:03:09.511776 osd.15 osd.15 10.193.56.230:6813/22179 16 : cluster [WRN] slow request 30.067953 seconds old, received at 2017-12-17 11:02:39.443747: osd_op(client.18209.0:1907620 7.d3s0 7:cb261ea2:::rbd_data.10.44be2ae8944a.00000000000281c8:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~196608] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-17 11:03:10.511914 osd.15 osd.15 10.193.56.230:6813/22179 17 : cluster [WRN] 13 slow requests, 2 included below; oldest blocked for > 37.513240 secs 2017-12-17 11:03:10.511918 osd.15 osd.15 10.193.56.230:6813/22179 18 : cluster [WRN] slow request 30.140431 seconds old, received at 2017-12-17 11:02:40.371416: osd_op(client.18209.0:1907657 7.17as0 7:5ebc8248:::rbd_data.10.44be2ae8944a.00000000000a814b:head [write 1507328~2686976] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-17 11:03:10.511921 osd.15 osd.15 10.193.56.230:6813/22179 19 : cluster [WRN] slow request 30.358704 seconds old, received at 2017-12-17 11:02:40.153143: osd_op(client.18209.0:1907656 7.17as0 7:5ebc8248:::rbd_data.10.44be2ae8944a.00000000000a814b:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~1507328] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-17 11:03:09.212241 osd.18 osd.18 10.193.56.231:6812/24620 6 : cluster [WRN] 4 slow requests, 1 included below; oldest blocked for > 35.949828 secs 2017-12-17 11:03:09.212243 osd.18 osd.18 10.193.56.231:6812/24620 7 : cluster [WRN] slow request 30.442379 seconds old, received at 2017-12-17 11:02:38.769822: osd_op(client.18209.0:1907581 7.1cas0 7:53a1eece:::rbd_data.10.44be2ae8944a.000000000004814f:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~3342336] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-17 11:03:10.212368 osd.18 osd.18 10.193.56.231:6812/24620 8 : cluster [WRN] 5 slow requests, 1 included below; oldest blocked for > 36.949966 secs 2017-12-17 11:03:10.212372 osd.18 osd.18 10.193.56.231:6812/24620 9 : cluster [WRN] slow request 30.143621 seconds old, received at 2017-12-17 11:02:40.068718: osd_op(client.18209.0:1907649 7.1fbs0 7:dff1e425:::rbd_data.10.44be2ae8944a.00000000000a8149:head [write 1507328~2686976] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-17 11:03:11.212486 osd.18 osd.18 10.193.56.231:6812/24620 10 : cluster [WRN] 7 slow requests, 2 included below; oldest blocked for > 37.950066 secs 2017-12-17 11:03:11.212489 osd.18 osd.18 10.193.56.231:6812/24620 11 : cluster [WRN] slow request 30.104367 seconds old, received at 2017-12-17 11:02:41.108072: osd_op(client.18209.0:1907675 7.1es0 7:7811c36d:::rbd_data.10.44be2ae8944a.00000000000c8157:head [write 262144~3932160] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-17 11:03:11.212491 osd.18 osd.18 10.193.56.231:6812/24620 12 : cluster [WRN] slow request 30.271834 seconds old, received at 2017-12-17 11:02:40.940605: osd_op(client.18209.0:1907672 7.1es0 7:7811c36d:::rbd_data.10.44be2ae8944a.00000000000c8157:head [set-alloc-hint object_size 4194304 write_size 4194304,write 0~262144] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-17 11:03:33.833365 mon.node1 mon.0 10.193.56.230:6789/0 17918 : cluster [INF] Health check cleared: REQUEST_SLOW (was: 20 slow requests are blocked > 32 sec) 2017-12-17 11:04:04.836704 mon.node1 mon.0 10.193.56.230:6789/0 17926 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 11:06:03.891147 mon.node1 mon.0 10.193.56.230:6789/0 17952 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 11:06:03.891185 mon.node1 mon.0 10.193.56.230:6789/0 17953 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 11:06:03.891212 mon.node1 mon.0 10.193.56.230:6789/0 17954 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 11:06:03.891272 mon.node1 mon.0 10.193.56.230:6789/0 17955 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 11:11:03.891360 mon.node1 mon.0 10.193.56.230:6789/0 18016 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 11:11:03.892036 mon.node1 mon.0 10.193.56.230:6789/0 18017 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 11:11:03.892894 mon.node1 mon.0 10.193.56.230:6789/0 18018 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 11:11:03.895261 mon.node1 mon.0 10.193.56.230:6789/0 18019 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 11:16:03.892045 mon.node1 mon.0 10.193.56.230:6789/0 18075 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 11:16:03.893022 mon.node1 mon.0 10.193.56.230:6789/0 18076 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 11:16:03.896386 mon.node1 mon.0 10.193.56.230:6789/0 18077 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 11:16:03.897027 mon.node1 mon.0 10.193.56.230:6789/0 18078 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 11:21:03.891570 mon.node1 mon.0 10.193.56.230:6789/0 18134 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 11:21:03.891627 mon.node1 mon.0 10.193.56.230:6789/0 18135 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 11:21:03.891699 mon.node1 mon.0 10.193.56.230:6789/0 18136 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 11:21:03.891738 mon.node1 mon.0 10.193.56.230:6789/0 18137 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 11:26:03.891743 mon.node1 mon.0 10.193.56.230:6789/0 18204 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 11:26:03.891876 mon.node1 mon.0 10.193.56.230:6789/0 18205 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 11:26:03.893788 mon.node1 mon.0 10.193.56.230:6789/0 18206 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 11:26:03.894334 mon.node1 mon.0 10.193.56.230:6789/0 18207 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 11:31:03.892104 mon.node1 mon.0 10.193.56.230:6789/0 18262 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 11:31:03.892239 mon.node1 mon.0 10.193.56.230:6789/0 18263 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 11:31:03.892272 mon.node1 mon.0 10.193.56.230:6789/0 18264 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 11:31:03.895757 mon.node1 mon.0 10.193.56.230:6789/0 18265 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 11:34:28.097347 osd.114 osd.114 10.193.56.232:6884/4497 1 : cluster [WRN] 1 slow requests, 1 included below; oldest blocked for > 335.478392 secs 2017-12-17 11:34:28.097368 osd.114 osd.114 10.193.56.232:6884/4497 2 : cluster [WRN] slow request 335.478392 seconds old, received at 2017-12-17 11:28:52.618904: osd_op(client.25433.0:1924810 15.287s0 15:e16aa92f:::rbd_data.19.5eab74b0dc51.00000000002681fd:head [write 0~3211264] snapc 0=[] ondisk+write+known_if_redirected e1360) currently sub_op_applied 2017-12-17 11:36:03.892027 mon.node1 mon.0 10.193.56.230:6789/0 18323 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 11:36:03.892061 mon.node1 mon.0 10.193.56.230:6789/0 18324 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 11:36:03.892115 mon.node1 mon.0 10.193.56.230:6789/0 18325 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 11:36:03.892137 mon.node1 mon.0 10.193.56.230:6789/0 18326 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 11:41:03.892171 mon.node1 mon.0 10.193.56.230:6789/0 18398 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 11:41:03.892214 mon.node1 mon.0 10.193.56.230:6789/0 18399 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 11:41:03.896336 mon.node1 mon.0 10.193.56.230:6789/0 18400 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 11:41:03.901773 mon.node1 mon.0 10.193.56.230:6789/0 18401 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 11:46:03.892229 mon.node1 mon.0 10.193.56.230:6789/0 18463 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 11:46:03.892263 mon.node1 mon.0 10.193.56.230:6789/0 18464 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 11:46:03.892447 mon.node1 mon.0 10.193.56.230:6789/0 18465 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 11:46:03.892603 mon.node1 mon.0 10.193.56.230:6789/0 18466 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 11:51:03.892452 mon.node1 mon.0 10.193.56.230:6789/0 18535 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 11:51:03.892504 mon.node1 mon.0 10.193.56.230:6789/0 18536 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 11:51:03.892601 mon.node1 mon.0 10.193.56.230:6789/0 18537 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 11:51:03.892661 mon.node1 mon.0 10.193.56.230:6789/0 18538 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 11:56:03.892504 mon.node1 mon.0 10.193.56.230:6789/0 18595 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 11:56:03.892545 mon.node1 mon.0 10.193.56.230:6789/0 18596 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 11:56:03.892572 mon.node1 mon.0 10.193.56.230:6789/0 18597 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 11:56:03.893207 mon.node1 mon.0 10.193.56.230:6789/0 18598 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 12:00:00.000089 mon.node1 mon.0 10.193.56.230:6789/0 18651 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 12:01:03.893053 mon.node1 mon.0 10.193.56.230:6789/0 18667 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 12:01:03.893145 mon.node1 mon.0 10.193.56.230:6789/0 18668 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 12:01:03.893638 mon.node1 mon.0 10.193.56.230:6789/0 18669 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 12:01:03.894354 mon.node1 mon.0 10.193.56.230:6789/0 18670 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 12:06:03.892730 mon.node1 mon.0 10.193.56.230:6789/0 18740 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 12:06:03.892771 mon.node1 mon.0 10.193.56.230:6789/0 18741 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 12:06:03.892807 mon.node1 mon.0 10.193.56.230:6789/0 18742 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 12:06:03.892864 mon.node1 mon.0 10.193.56.230:6789/0 18743 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 12:11:03.892902 mon.node1 mon.0 10.193.56.230:6789/0 18803 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 12:11:03.892938 mon.node1 mon.0 10.193.56.230:6789/0 18804 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 12:11:03.892991 mon.node1 mon.0 10.193.56.230:6789/0 18805 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 12:11:03.893016 mon.node1 mon.0 10.193.56.230:6789/0 18806 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 12:16:03.893019 mon.node1 mon.0 10.193.56.230:6789/0 18853 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 12:16:03.893059 mon.node1 mon.0 10.193.56.230:6789/0 18854 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 12:16:03.893085 mon.node1 mon.0 10.193.56.230:6789/0 18855 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 12:16:03.895212 mon.node1 mon.0 10.193.56.230:6789/0 18856 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 12:21:03.893124 mon.node1 mon.0 10.193.56.230:6789/0 18921 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 12:21:03.893191 mon.node1 mon.0 10.193.56.230:6789/0 18922 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 12:21:03.893285 mon.node1 mon.0 10.193.56.230:6789/0 18923 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 12:21:03.893321 mon.node1 mon.0 10.193.56.230:6789/0 18924 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 12:26:03.893389 mon.node1 mon.0 10.193.56.230:6789/0 18991 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 12:26:03.893424 mon.node1 mon.0 10.193.56.230:6789/0 18992 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 12:26:03.893521 mon.node1 mon.0 10.193.56.230:6789/0 18993 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 12:26:03.893551 mon.node1 mon.0 10.193.56.230:6789/0 18994 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 12:31:03.893460 mon.node1 mon.0 10.193.56.230:6789/0 19064 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 12:31:03.893526 mon.node1 mon.0 10.193.56.230:6789/0 19065 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 12:31:03.893587 mon.node1 mon.0 10.193.56.230:6789/0 19066 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 12:31:03.894073 mon.node1 mon.0 10.193.56.230:6789/0 19067 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 12:36:03.893653 mon.node1 mon.0 10.193.56.230:6789/0 19129 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 12:36:03.893730 mon.node1 mon.0 10.193.56.230:6789/0 19130 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 12:36:03.893760 mon.node1 mon.0 10.193.56.230:6789/0 19131 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 12:36:03.896069 mon.node1 mon.0 10.193.56.230:6789/0 19132 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 12:41:03.893865 mon.node1 mon.0 10.193.56.230:6789/0 19190 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 12:41:03.893993 mon.node1 mon.0 10.193.56.230:6789/0 19191 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 12:41:03.894035 mon.node1 mon.0 10.193.56.230:6789/0 19192 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 12:41:03.895439 mon.node1 mon.0 10.193.56.230:6789/0 19193 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 12:46:03.893988 mon.node1 mon.0 10.193.56.230:6789/0 19253 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 12:46:03.894071 mon.node1 mon.0 10.193.56.230:6789/0 19254 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 12:46:03.894133 mon.node1 mon.0 10.193.56.230:6789/0 19255 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 12:46:03.894522 mon.node1 mon.0 10.193.56.230:6789/0 19256 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 12:51:03.894109 mon.node1 mon.0 10.193.56.230:6789/0 19313 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 12:51:03.894153 mon.node1 mon.0 10.193.56.230:6789/0 19314 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 12:51:03.894173 mon.node1 mon.0 10.193.56.230:6789/0 19315 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 12:51:03.894221 mon.node1 mon.0 10.193.56.230:6789/0 19316 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 12:56:03.894160 mon.node1 mon.0 10.193.56.230:6789/0 19383 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 12:56:03.894188 mon.node1 mon.0 10.193.56.230:6789/0 19384 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 12:56:03.894215 mon.node1 mon.0 10.193.56.230:6789/0 19385 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 12:56:03.894237 mon.node1 mon.0 10.193.56.230:6789/0 19386 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 13:00:00.000097 mon.node1 mon.0 10.193.56.230:6789/0 19439 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 13:01:03.894284 mon.node1 mon.0 10.193.56.230:6789/0 19459 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 13:01:03.894344 mon.node1 mon.0 10.193.56.230:6789/0 19460 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 13:01:03.894410 mon.node1 mon.0 10.193.56.230:6789/0 19461 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 13:01:03.894507 mon.node1 mon.0 10.193.56.230:6789/0 19462 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 13:06:03.894530 mon.node1 mon.0 10.193.56.230:6789/0 19521 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 13:06:03.894846 mon.node1 mon.0 10.193.56.230:6789/0 19522 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 13:06:03.895870 mon.node1 mon.0 10.193.56.230:6789/0 19523 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 13:06:03.896033 mon.node1 mon.0 10.193.56.230:6789/0 19524 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 13:11:03.897555 mon.node1 mon.0 10.193.56.230:6789/0 19583 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 13:11:03.898042 mon.node1 mon.0 10.193.56.230:6789/0 19584 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 13:11:03.898358 mon.node1 mon.0 10.193.56.230:6789/0 19585 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 13:11:03.898914 mon.node1 mon.0 10.193.56.230:6789/0 19586 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 13:16:03.894882 mon.node1 mon.0 10.193.56.230:6789/0 19657 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 13:16:03.895746 mon.node1 mon.0 10.193.56.230:6789/0 19658 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 13:16:03.897041 mon.node1 mon.0 10.193.56.230:6789/0 19659 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 13:16:03.897412 mon.node1 mon.0 10.193.56.230:6789/0 19660 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 13:21:03.894849 mon.node1 mon.0 10.193.56.230:6789/0 19726 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 13:21:03.894879 mon.node1 mon.0 10.193.56.230:6789/0 19727 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 13:21:03.894901 mon.node1 mon.0 10.193.56.230:6789/0 19728 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 13:21:03.896605 mon.node1 mon.0 10.193.56.230:6789/0 19729 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 13:26:03.894915 mon.node1 mon.0 10.193.56.230:6789/0 19781 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 13:26:03.894949 mon.node1 mon.0 10.193.56.230:6789/0 19782 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 13:26:03.894979 mon.node1 mon.0 10.193.56.230:6789/0 19783 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 13:26:03.895029 mon.node1 mon.0 10.193.56.230:6789/0 19784 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 13:31:03.895645 mon.node1 mon.0 10.193.56.230:6789/0 19830 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 13:31:03.895690 mon.node1 mon.0 10.193.56.230:6789/0 19831 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 13:31:03.896356 mon.node1 mon.0 10.193.56.230:6789/0 19832 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 13:31:03.899556 mon.node1 mon.0 10.193.56.230:6789/0 19833 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 13:36:03.895161 mon.node1 mon.0 10.193.56.230:6789/0 19904 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 13:36:03.895214 mon.node1 mon.0 10.193.56.230:6789/0 19905 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 13:36:03.895277 mon.node1 mon.0 10.193.56.230:6789/0 19906 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 13:36:03.895300 mon.node1 mon.0 10.193.56.230:6789/0 19907 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 13:41:03.895754 mon.node1 mon.0 10.193.56.230:6789/0 19971 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 13:41:03.895805 mon.node1 mon.0 10.193.56.230:6789/0 19972 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 13:41:03.895945 mon.node1 mon.0 10.193.56.230:6789/0 19973 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 13:41:03.896217 mon.node1 mon.0 10.193.56.230:6789/0 19974 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 13:46:03.897852 mon.node1 mon.0 10.193.56.230:6789/0 20032 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 13:46:03.898693 mon.node1 mon.0 10.193.56.230:6789/0 20033 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 13:46:03.898726 mon.node1 mon.0 10.193.56.230:6789/0 20034 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 13:46:03.901832 mon.node1 mon.0 10.193.56.230:6789/0 20035 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 13:51:03.898675 mon.node1 mon.0 10.193.56.230:6789/0 20097 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 13:51:03.899126 mon.node1 mon.0 10.193.56.230:6789/0 20098 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 13:51:03.900458 mon.node1 mon.0 10.193.56.230:6789/0 20099 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 13:51:03.901870 mon.node1 mon.0 10.193.56.230:6789/0 20100 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 13:56:03.895832 mon.node1 mon.0 10.193.56.230:6789/0 20159 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 13:56:03.895872 mon.node1 mon.0 10.193.56.230:6789/0 20160 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 13:56:03.895893 mon.node1 mon.0 10.193.56.230:6789/0 20161 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 13:56:03.895918 mon.node1 mon.0 10.193.56.230:6789/0 20162 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 14:00:00.000078 mon.node1 mon.0 10.193.56.230:6789/0 20212 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 14:01:03.896052 mon.node1 mon.0 10.193.56.230:6789/0 20226 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 14:01:03.896093 mon.node1 mon.0 10.193.56.230:6789/0 20227 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 14:01:03.896266 mon.node1 mon.0 10.193.56.230:6789/0 20228 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 14:01:03.897324 mon.node1 mon.0 10.193.56.230:6789/0 20229 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 14:06:03.896052 mon.node1 mon.0 10.193.56.230:6789/0 20288 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 14:06:03.896092 mon.node1 mon.0 10.193.56.230:6789/0 20289 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 14:06:03.896149 mon.node1 mon.0 10.193.56.230:6789/0 20290 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 14:06:03.896319 mon.node1 mon.0 10.193.56.230:6789/0 20291 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 14:11:03.896212 mon.node1 mon.0 10.193.56.230:6789/0 20362 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 14:11:03.896281 mon.node1 mon.0 10.193.56.230:6789/0 20363 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 14:11:03.896328 mon.node1 mon.0 10.193.56.230:6789/0 20364 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 14:11:03.896368 mon.node1 mon.0 10.193.56.230:6789/0 20365 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 14:16:03.896352 mon.node1 mon.0 10.193.56.230:6789/0 20428 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 14:16:03.896398 mon.node1 mon.0 10.193.56.230:6789/0 20429 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 14:16:03.896453 mon.node1 mon.0 10.193.56.230:6789/0 20430 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 14:16:03.896485 mon.node1 mon.0 10.193.56.230:6789/0 20431 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 14:21:03.896593 mon.node1 mon.0 10.193.56.230:6789/0 20502 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 14:21:03.897163 mon.node1 mon.0 10.193.56.230:6789/0 20503 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 14:21:03.899998 mon.node1 mon.0 10.193.56.230:6789/0 20504 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 14:21:03.901528 mon.node1 mon.0 10.193.56.230:6789/0 20505 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 14:26:03.896648 mon.node1 mon.0 10.193.56.230:6789/0 20573 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 14:26:03.896684 mon.node1 mon.0 10.193.56.230:6789/0 20574 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 14:26:03.896955 mon.node1 mon.0 10.193.56.230:6789/0 20575 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 14:26:03.897390 mon.node1 mon.0 10.193.56.230:6789/0 20576 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 14:31:03.897131 mon.node1 mon.0 10.193.56.230:6789/0 20645 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 14:31:03.898386 mon.node1 mon.0 10.193.56.230:6789/0 20646 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 14:31:03.899656 mon.node1 mon.0 10.193.56.230:6789/0 20647 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 14:31:03.899985 mon.node1 mon.0 10.193.56.230:6789/0 20648 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 14:36:03.897039 mon.node1 mon.0 10.193.56.230:6789/0 20701 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 14:36:03.897099 mon.node1 mon.0 10.193.56.230:6789/0 20702 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 14:36:03.897796 mon.node1 mon.0 10.193.56.230:6789/0 20703 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 14:36:03.898158 mon.node1 mon.0 10.193.56.230:6789/0 20704 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 14:41:03.897121 mon.node1 mon.0 10.193.56.230:6789/0 20771 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 14:41:03.897290 mon.node1 mon.0 10.193.56.230:6789/0 20772 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 14:41:03.897328 mon.node1 mon.0 10.193.56.230:6789/0 20773 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 14:41:03.897594 mon.node1 mon.0 10.193.56.230:6789/0 20774 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 14:46:03.897176 mon.node1 mon.0 10.193.56.230:6789/0 20844 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 14:46:03.897213 mon.node1 mon.0 10.193.56.230:6789/0 20845 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 14:46:03.897233 mon.node1 mon.0 10.193.56.230:6789/0 20846 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 14:46:03.897277 mon.node1 mon.0 10.193.56.230:6789/0 20847 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 14:51:03.897374 mon.node1 mon.0 10.193.56.230:6789/0 20906 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 14:51:03.897658 mon.node1 mon.0 10.193.56.230:6789/0 20907 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 14:51:03.897702 mon.node1 mon.0 10.193.56.230:6789/0 20908 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 14:51:03.900540 mon.node1 mon.0 10.193.56.230:6789/0 20909 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 14:56:03.897401 mon.node1 mon.0 10.193.56.230:6789/0 20978 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 14:56:03.897443 mon.node1 mon.0 10.193.56.230:6789/0 20979 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 14:56:03.897482 mon.node1 mon.0 10.193.56.230:6789/0 20980 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 14:56:03.897550 mon.node1 mon.0 10.193.56.230:6789/0 20981 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 15:00:00.000076 mon.node1 mon.0 10.193.56.230:6789/0 21034 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 15:01:03.897531 mon.node1 mon.0 10.193.56.230:6789/0 21051 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 15:01:03.897563 mon.node1 mon.0 10.193.56.230:6789/0 21052 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 15:01:03.897618 mon.node1 mon.0 10.193.56.230:6789/0 21053 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 15:01:03.897787 mon.node1 mon.0 10.193.56.230:6789/0 21054 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 15:06:03.897651 mon.node1 mon.0 10.193.56.230:6789/0 21118 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 15:06:03.897747 mon.node1 mon.0 10.193.56.230:6789/0 21119 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 15:06:03.897776 mon.node1 mon.0 10.193.56.230:6789/0 21120 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 15:06:03.898858 mon.node1 mon.0 10.193.56.230:6789/0 21121 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 15:11:03.897879 mon.node1 mon.0 10.193.56.230:6789/0 21197 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 15:11:03.897909 mon.node1 mon.0 10.193.56.230:6789/0 21198 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 15:11:03.897929 mon.node1 mon.0 10.193.56.230:6789/0 21199 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 15:11:03.898049 mon.node1 mon.0 10.193.56.230:6789/0 21200 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 15:16:03.897851 mon.node1 mon.0 10.193.56.230:6789/0 21264 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 15:16:03.897894 mon.node1 mon.0 10.193.56.230:6789/0 21265 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 15:16:03.897974 mon.node1 mon.0 10.193.56.230:6789/0 21266 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 15:16:03.898888 mon.node1 mon.0 10.193.56.230:6789/0 21267 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 15:21:03.898037 mon.node1 mon.0 10.193.56.230:6789/0 21332 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 15:21:03.898086 mon.node1 mon.0 10.193.56.230:6789/0 21333 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 15:21:03.898111 mon.node1 mon.0 10.193.56.230:6789/0 21334 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 15:21:03.898133 mon.node1 mon.0 10.193.56.230:6789/0 21335 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 15:26:03.898221 mon.node1 mon.0 10.193.56.230:6789/0 21389 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 15:26:03.898256 mon.node1 mon.0 10.193.56.230:6789/0 21390 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 15:26:03.898490 mon.node1 mon.0 10.193.56.230:6789/0 21391 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 15:26:03.899332 mon.node1 mon.0 10.193.56.230:6789/0 21392 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 15:31:03.899001 mon.node1 mon.0 10.193.56.230:6789/0 21463 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 15:31:03.900351 mon.node1 mon.0 10.193.56.230:6789/0 21464 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 15:31:03.900417 mon.node1 mon.0 10.193.56.230:6789/0 21465 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 15:31:03.903215 mon.node1 mon.0 10.193.56.230:6789/0 21466 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 15:36:03.898391 mon.node1 mon.0 10.193.56.230:6789/0 21535 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 15:36:03.898429 mon.node1 mon.0 10.193.56.230:6789/0 21536 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 15:36:03.898489 mon.node1 mon.0 10.193.56.230:6789/0 21537 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 15:36:03.898525 mon.node1 mon.0 10.193.56.230:6789/0 21538 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 15:41:03.898520 mon.node1 mon.0 10.193.56.230:6789/0 21594 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 15:41:03.898554 mon.node1 mon.0 10.193.56.230:6789/0 21595 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 15:41:03.898604 mon.node1 mon.0 10.193.56.230:6789/0 21596 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 15:41:03.898678 mon.node1 mon.0 10.193.56.230:6789/0 21597 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 15:46:03.898750 mon.node1 mon.0 10.193.56.230:6789/0 21672 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 15:46:03.900774 mon.node1 mon.0 10.193.56.230:6789/0 21673 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 15:46:03.901067 mon.node1 mon.0 10.193.56.230:6789/0 21674 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 15:46:03.901128 mon.node1 mon.0 10.193.56.230:6789/0 21675 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 15:51:03.898819 mon.node1 mon.0 10.193.56.230:6789/0 21739 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 15:51:03.898861 mon.node1 mon.0 10.193.56.230:6789/0 21740 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 15:51:03.899572 mon.node1 mon.0 10.193.56.230:6789/0 21741 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 15:51:03.901874 mon.node1 mon.0 10.193.56.230:6789/0 21742 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 15:56:03.898946 mon.node1 mon.0 10.193.56.230:6789/0 21801 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 15:56:03.898987 mon.node1 mon.0 10.193.56.230:6789/0 21802 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 15:56:03.899059 mon.node1 mon.0 10.193.56.230:6789/0 21803 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 15:56:03.899107 mon.node1 mon.0 10.193.56.230:6789/0 21804 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 16:00:00.000090 mon.node1 mon.0 10.193.56.230:6789/0 21850 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 16:01:03.899082 mon.node1 mon.0 10.193.56.230:6789/0 21860 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 16:01:03.899124 mon.node1 mon.0 10.193.56.230:6789/0 21861 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 16:01:03.901712 mon.node1 mon.0 10.193.56.230:6789/0 21862 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 16:01:04.313278 mon.node1 mon.0 10.193.56.230:6789/0 21864 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 16:06:03.899372 mon.node1 mon.0 10.193.56.230:6789/0 21922 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 16:06:03.899438 mon.node1 mon.0 10.193.56.230:6789/0 21923 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 16:06:03.899482 mon.node1 mon.0 10.193.56.230:6789/0 21924 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 16:06:03.899820 mon.node1 mon.0 10.193.56.230:6789/0 21925 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 16:11:03.899683 mon.node1 mon.0 10.193.56.230:6789/0 21994 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 16:11:03.899938 mon.node1 mon.0 10.193.56.230:6789/0 21995 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 16:11:03.900592 mon.node1 mon.0 10.193.56.230:6789/0 21996 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 16:11:03.901260 mon.node1 mon.0 10.193.56.230:6789/0 21997 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 16:16:03.899529 mon.node1 mon.0 10.193.56.230:6789/0 22059 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 16:16:03.899718 mon.node1 mon.0 10.193.56.230:6789/0 22060 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 16:16:03.899747 mon.node1 mon.0 10.193.56.230:6789/0 22061 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 16:16:03.904529 mon.node1 mon.0 10.193.56.230:6789/0 22062 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 16:21:03.899594 mon.node1 mon.0 10.193.56.230:6789/0 22129 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 16:21:03.899625 mon.node1 mon.0 10.193.56.230:6789/0 22130 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 16:21:03.899697 mon.node1 mon.0 10.193.56.230:6789/0 22131 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 16:21:03.899750 mon.node1 mon.0 10.193.56.230:6789/0 22132 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 16:26:03.900001 mon.node1 mon.0 10.193.56.230:6789/0 22187 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 16:26:03.901314 mon.node1 mon.0 10.193.56.230:6789/0 22188 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 16:26:03.901927 mon.node1 mon.0 10.193.56.230:6789/0 22189 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 16:26:03.903195 mon.node1 mon.0 10.193.56.230:6789/0 22190 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 16:31:03.900245 mon.node1 mon.0 10.193.56.230:6789/0 22261 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 16:31:03.900301 mon.node1 mon.0 10.193.56.230:6789/0 22262 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 16:31:03.901848 mon.node1 mon.0 10.193.56.230:6789/0 22263 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 16:31:03.903640 mon.node1 mon.0 10.193.56.230:6789/0 22264 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 16:36:03.900118 mon.node1 mon.0 10.193.56.230:6789/0 22335 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 16:36:03.901770 mon.node1 mon.0 10.193.56.230:6789/0 22336 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 16:36:03.902492 mon.node1 mon.0 10.193.56.230:6789/0 22337 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 16:36:03.902980 mon.node1 mon.0 10.193.56.230:6789/0 22338 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 16:41:03.900128 mon.node1 mon.0 10.193.56.230:6789/0 22403 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 16:41:03.900164 mon.node1 mon.0 10.193.56.230:6789/0 22404 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 16:41:03.900214 mon.node1 mon.0 10.193.56.230:6789/0 22405 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 16:41:03.900236 mon.node1 mon.0 10.193.56.230:6789/0 22406 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 16:46:03.900633 mon.node1 mon.0 10.193.56.230:6789/0 22462 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 16:46:03.901104 mon.node1 mon.0 10.193.56.230:6789/0 22463 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 16:46:03.902353 mon.node1 mon.0 10.193.56.230:6789/0 22464 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 16:46:03.906517 mon.node1 mon.0 10.193.56.230:6789/0 22465 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 16:48:33.993502 mon.node1 mon.0 10.193.56.230:6789/0 22499 : cluster [WRN] Health check failed: 4 slow requests are blocked > 32 sec (REQUEST_SLOW) 2017-12-17 16:48:39.909915 mon.node1 mon.0 10.193.56.230:6789/0 22501 : cluster [WRN] Health check update: 16 slow requests are blocked > 32 sec (REQUEST_SLOW) 2017-12-17 16:48:45.923398 mon.node1 mon.0 10.193.56.230:6789/0 22506 : cluster [WRN] Health check update: 13 slow requests are blocked > 32 sec (REQUEST_SLOW) 2017-12-17 16:48:47.953758 mon.node1 mon.0 10.193.56.230:6789/0 22507 : cluster [INF] Health check cleared: REQUEST_SLOW (was: 13 slow requests are blocked > 32 sec) 2017-12-17 16:51:03.900404 mon.node1 mon.0 10.193.56.230:6789/0 22533 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 16:51:03.900446 mon.node1 mon.0 10.193.56.230:6789/0 22534 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 16:51:03.900476 mon.node1 mon.0 10.193.56.230:6789/0 22535 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 16:51:03.900545 mon.node1 mon.0 10.193.56.230:6789/0 22536 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 16:56:03.900493 mon.node1 mon.0 10.193.56.230:6789/0 22585 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 16:56:03.900521 mon.node1 mon.0 10.193.56.230:6789/0 22586 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 16:56:03.900579 mon.node1 mon.0 10.193.56.230:6789/0 22587 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 16:56:03.900600 mon.node1 mon.0 10.193.56.230:6789/0 22588 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 17:00:00.000089 mon.node1 mon.0 10.193.56.230:6789/0 22642 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 17:01:03.900688 mon.node1 mon.0 10.193.56.230:6789/0 22659 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 17:01:03.901179 mon.node1 mon.0 10.193.56.230:6789/0 22660 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 17:01:03.901859 mon.node1 mon.0 10.193.56.230:6789/0 22661 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 17:01:03.901976 mon.node1 mon.0 10.193.56.230:6789/0 22662 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 17:06:03.900780 mon.node1 mon.0 10.193.56.230:6789/0 22730 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 17:06:03.900823 mon.node1 mon.0 10.193.56.230:6789/0 22731 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 17:06:03.900850 mon.node1 mon.0 10.193.56.230:6789/0 22732 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 17:06:03.900978 mon.node1 mon.0 10.193.56.230:6789/0 22733 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 17:11:03.900906 mon.node1 mon.0 10.193.56.230:6789/0 22786 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 17:11:03.900943 mon.node1 mon.0 10.193.56.230:6789/0 22787 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 17:11:03.900963 mon.node1 mon.0 10.193.56.230:6789/0 22788 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 17:11:03.900983 mon.node1 mon.0 10.193.56.230:6789/0 22789 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 17:16:03.901172 mon.node1 mon.0 10.193.56.230:6789/0 22848 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 17:16:03.901204 mon.node1 mon.0 10.193.56.230:6789/0 22849 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 17:16:03.901234 mon.node1 mon.0 10.193.56.230:6789/0 22850 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 17:16:03.901299 mon.node1 mon.0 10.193.56.230:6789/0 22851 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 17:21:03.901129 mon.node1 mon.0 10.193.56.230:6789/0 22912 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 17:21:03.901163 mon.node1 mon.0 10.193.56.230:6789/0 22913 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 17:21:03.901188 mon.node1 mon.0 10.193.56.230:6789/0 22914 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 17:21:03.904432 mon.node1 mon.0 10.193.56.230:6789/0 22915 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 17:26:03.901493 mon.node1 mon.0 10.193.56.230:6789/0 22983 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 17:26:03.901534 mon.node1 mon.0 10.193.56.230:6789/0 22984 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 17:26:03.901637 mon.node1 mon.0 10.193.56.230:6789/0 22985 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 17:26:03.904679 mon.node1 mon.0 10.193.56.230:6789/0 22986 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 17:31:03.901441 mon.node1 mon.0 10.193.56.230:6789/0 23038 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 17:31:03.901496 mon.node1 mon.0 10.193.56.230:6789/0 23039 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 17:31:03.901568 mon.node1 mon.0 10.193.56.230:6789/0 23040 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 17:31:03.904148 mon.node1 mon.0 10.193.56.230:6789/0 23041 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 17:36:03.901568 mon.node1 mon.0 10.193.56.230:6789/0 23103 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 17:36:03.901605 mon.node1 mon.0 10.193.56.230:6789/0 23104 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 17:36:03.901635 mon.node1 mon.0 10.193.56.230:6789/0 23105 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 17:36:03.902820 mon.node1 mon.0 10.193.56.230:6789/0 23106 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 17:41:03.901714 mon.node1 mon.0 10.193.56.230:6789/0 23160 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 17:41:03.904219 mon.node1 mon.0 10.193.56.230:6789/0 23161 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 17:41:03.905686 mon.node1 mon.0 10.193.56.230:6789/0 23162 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 17:41:03.905856 mon.node1 mon.0 10.193.56.230:6789/0 23163 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 17:46:03.902030 mon.node1 mon.0 10.193.56.230:6789/0 23218 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 17:46:03.902839 mon.node1 mon.0 10.193.56.230:6789/0 23219 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 17:46:03.903403 mon.node1 mon.0 10.193.56.230:6789/0 23220 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 17:46:03.905706 mon.node1 mon.0 10.193.56.230:6789/0 23221 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 17:51:03.901901 mon.node1 mon.0 10.193.56.230:6789/0 23282 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 17:51:03.901954 mon.node1 mon.0 10.193.56.230:6789/0 23283 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 17:51:03.901985 mon.node1 mon.0 10.193.56.230:6789/0 23284 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 17:51:03.904867 mon.node1 mon.0 10.193.56.230:6789/0 23285 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 17:56:03.904743 mon.node1 mon.0 10.193.56.230:6789/0 23334 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 17:56:03.905110 mon.node1 mon.0 10.193.56.230:6789/0 23335 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 17:56:03.905586 mon.node1 mon.0 10.193.56.230:6789/0 23336 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 17:56:03.907134 mon.node1 mon.0 10.193.56.230:6789/0 23337 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 18:00:00.000084 mon.node1 mon.0 10.193.56.230:6789/0 23392 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 18:01:03.902232 mon.node1 mon.0 10.193.56.230:6789/0 23404 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 18:01:03.902320 mon.node1 mon.0 10.193.56.230:6789/0 23405 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 18:01:03.902356 mon.node1 mon.0 10.193.56.230:6789/0 23406 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 18:01:03.902403 mon.node1 mon.0 10.193.56.230:6789/0 23407 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 18:06:03.902716 mon.node1 mon.0 10.193.56.230:6789/0 23462 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 18:06:03.903426 mon.node1 mon.0 10.193.56.230:6789/0 23463 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 18:06:03.905222 mon.node1 mon.0 10.193.56.230:6789/0 23464 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 18:06:03.907671 mon.node1 mon.0 10.193.56.230:6789/0 23465 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 18:11:03.902669 mon.node1 mon.0 10.193.56.230:6789/0 23520 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 18:11:03.902713 mon.node1 mon.0 10.193.56.230:6789/0 23521 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 18:11:03.903474 mon.node1 mon.0 10.193.56.230:6789/0 23522 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 18:11:03.905418 mon.node1 mon.0 10.193.56.230:6789/0 23523 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 18:16:03.902714 mon.node1 mon.0 10.193.56.230:6789/0 23571 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 18:16:03.902955 mon.node1 mon.0 10.193.56.230:6789/0 23572 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 18:16:03.904382 mon.node1 mon.0 10.193.56.230:6789/0 23573 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 18:16:03.907664 mon.node1 mon.0 10.193.56.230:6789/0 23574 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 18:21:03.902848 mon.node1 mon.0 10.193.56.230:6789/0 23645 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 18:21:03.903460 mon.node1 mon.0 10.193.56.230:6789/0 23646 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 18:21:03.903707 mon.node1 mon.0 10.193.56.230:6789/0 23647 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 18:21:03.903870 mon.node1 mon.0 10.193.56.230:6789/0 23648 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 18:26:03.903058 mon.node1 mon.0 10.193.56.230:6789/0 23714 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 18:26:03.903098 mon.node1 mon.0 10.193.56.230:6789/0 23715 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 18:26:03.904474 mon.node1 mon.0 10.193.56.230:6789/0 23716 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 18:26:03.905058 mon.node1 mon.0 10.193.56.230:6789/0 23717 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 18:31:03.903128 mon.node1 mon.0 10.193.56.230:6789/0 23782 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 18:31:03.903173 mon.node1 mon.0 10.193.56.230:6789/0 23783 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 18:31:03.903222 mon.node1 mon.0 10.193.56.230:6789/0 23784 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 18:31:03.904857 mon.node1 mon.0 10.193.56.230:6789/0 23785 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 18:36:03.903422 mon.node1 mon.0 10.193.56.230:6789/0 23849 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 18:36:03.903482 mon.node1 mon.0 10.193.56.230:6789/0 23850 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 18:36:03.903520 mon.node1 mon.0 10.193.56.230:6789/0 23851 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 18:36:03.903585 mon.node1 mon.0 10.193.56.230:6789/0 23852 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 18:41:03.926600 mon.node1 mon.0 10.193.56.230:6789/0 23933 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 18:41:03.926644 mon.node1 mon.0 10.193.56.230:6789/0 23934 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 18:41:03.926673 mon.node1 mon.0 10.193.56.230:6789/0 23935 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 18:41:03.926716 mon.node1 mon.0 10.193.56.230:6789/0 23936 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 18:46:03.911438 mon.node1 mon.0 10.193.56.230:6789/0 24012 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 18:46:03.911477 mon.node1 mon.0 10.193.56.230:6789/0 24013 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 18:46:03.911547 mon.node1 mon.0 10.193.56.230:6789/0 24014 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 18:46:03.911833 mon.node1 mon.0 10.193.56.230:6789/0 24015 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 18:51:03.911626 mon.node1 mon.0 10.193.56.230:6789/0 24075 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 18:51:03.911662 mon.node1 mon.0 10.193.56.230:6789/0 24076 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 18:51:03.911784 mon.node1 mon.0 10.193.56.230:6789/0 24077 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 18:51:03.913537 mon.node1 mon.0 10.193.56.230:6789/0 24078 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 18:56:03.911680 mon.node1 mon.0 10.193.56.230:6789/0 24141 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 18:56:03.911715 mon.node1 mon.0 10.193.56.230:6789/0 24142 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 18:56:03.911738 mon.node1 mon.0 10.193.56.230:6789/0 24143 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 18:56:03.911761 mon.node1 mon.0 10.193.56.230:6789/0 24144 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 19:00:00.000091 mon.node1 mon.0 10.193.56.230:6789/0 24187 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 19:01:03.911870 mon.node1 mon.0 10.193.56.230:6789/0 24204 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 19:01:03.911902 mon.node1 mon.0 10.193.56.230:6789/0 24205 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 19:01:03.911951 mon.node1 mon.0 10.193.56.230:6789/0 24206 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 19:01:03.912187 mon.node1 mon.0 10.193.56.230:6789/0 24207 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 19:06:03.911937 mon.node1 mon.0 10.193.56.230:6789/0 24272 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 19:06:03.911970 mon.node1 mon.0 10.193.56.230:6789/0 24273 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 19:06:03.912086 mon.node1 mon.0 10.193.56.230:6789/0 24274 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 19:06:03.913613 mon.node1 mon.0 10.193.56.230:6789/0 24275 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 19:11:03.912027 mon.node1 mon.0 10.193.56.230:6789/0 24345 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 19:11:03.912060 mon.node1 mon.0 10.193.56.230:6789/0 24346 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 19:11:03.912082 mon.node1 mon.0 10.193.56.230:6789/0 24347 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 19:11:03.913094 mon.node1 mon.0 10.193.56.230:6789/0 24348 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 19:16:03.915074 mon.node1 mon.0 10.193.56.230:6789/0 24408 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 19:16:03.915347 mon.node1 mon.0 10.193.56.230:6789/0 24409 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 19:16:03.915661 mon.node1 mon.0 10.193.56.230:6789/0 24410 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 19:16:03.917321 mon.node1 mon.0 10.193.56.230:6789/0 24411 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 19:21:03.912740 mon.node1 mon.0 10.193.56.230:6789/0 24475 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 19:21:03.912776 mon.node1 mon.0 10.193.56.230:6789/0 24476 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 19:21:03.912888 mon.node1 mon.0 10.193.56.230:6789/0 24477 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 19:21:03.912918 mon.node1 mon.0 10.193.56.230:6789/0 24478 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 19:26:03.912813 mon.node1 mon.0 10.193.56.230:6789/0 24535 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 19:26:03.912856 mon.node1 mon.0 10.193.56.230:6789/0 24536 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 19:26:03.912900 mon.node1 mon.0 10.193.56.230:6789/0 24537 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 19:26:03.912928 mon.node1 mon.0 10.193.56.230:6789/0 24538 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 19:31:03.922021 mon.node1 mon.0 10.193.56.230:6789/0 24612 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 19:31:03.925256 mon.node1 mon.0 10.193.56.230:6789/0 24613 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 19:31:03.926078 mon.node1 mon.0 10.193.56.230:6789/0 24614 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 19:31:03.926419 mon.node1 mon.0 10.193.56.230:6789/0 24615 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 19:36:03.917271 mon.node1 mon.0 10.193.56.230:6789/0 24678 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 19:36:03.917327 mon.node1 mon.0 10.193.56.230:6789/0 24679 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 19:36:03.917350 mon.node1 mon.0 10.193.56.230:6789/0 24680 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 19:36:03.917404 mon.node1 mon.0 10.193.56.230:6789/0 24681 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 19:41:03.917521 mon.node1 mon.0 10.193.56.230:6789/0 24735 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 19:41:03.917566 mon.node1 mon.0 10.193.56.230:6789/0 24736 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 19:41:03.918406 mon.node1 mon.0 10.193.56.230:6789/0 24737 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 19:41:03.919150 mon.node1 mon.0 10.193.56.230:6789/0 24738 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 19:46:03.917539 mon.node1 mon.0 10.193.56.230:6789/0 24811 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 19:46:03.917587 mon.node1 mon.0 10.193.56.230:6789/0 24812 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 19:46:03.917648 mon.node1 mon.0 10.193.56.230:6789/0 24813 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 19:46:03.917709 mon.node1 mon.0 10.193.56.230:6789/0 24814 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 19:51:03.917656 mon.node1 mon.0 10.193.56.230:6789/0 24884 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 19:51:03.917698 mon.node1 mon.0 10.193.56.230:6789/0 24885 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 19:51:03.917719 mon.node1 mon.0 10.193.56.230:6789/0 24886 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 19:51:03.917747 mon.node1 mon.0 10.193.56.230:6789/0 24887 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 19:56:03.917774 mon.node1 mon.0 10.193.56.230:6789/0 24943 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 19:56:03.918001 mon.node1 mon.0 10.193.56.230:6789/0 24944 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 19:56:03.921612 mon.node1 mon.0 10.193.56.230:6789/0 24945 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 19:56:03.930037 mon.node1 mon.0 10.193.56.230:6789/0 24946 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 20:00:00.000091 mon.node1 mon.0 10.193.56.230:6789/0 24988 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 20:01:03.917901 mon.node1 mon.0 10.193.56.230:6789/0 24998 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 20:01:03.917953 mon.node1 mon.0 10.193.56.230:6789/0 24999 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 20:01:03.917984 mon.node1 mon.0 10.193.56.230:6789/0 25000 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 20:01:03.918078 mon.node1 mon.0 10.193.56.230:6789/0 25001 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 20:06:03.918053 mon.node1 mon.0 10.193.56.230:6789/0 25057 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 20:06:03.918083 mon.node1 mon.0 10.193.56.230:6789/0 25058 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 20:06:03.918260 mon.node1 mon.0 10.193.56.230:6789/0 25059 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 20:06:03.921392 mon.node1 mon.0 10.193.56.230:6789/0 25060 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 20:11:03.918207 mon.node1 mon.0 10.193.56.230:6789/0 25134 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 20:11:03.918248 mon.node1 mon.0 10.193.56.230:6789/0 25135 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 20:11:03.918307 mon.node1 mon.0 10.193.56.230:6789/0 25136 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 20:11:03.918661 mon.node1 mon.0 10.193.56.230:6789/0 25137 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 20:16:03.918259 mon.node1 mon.0 10.193.56.230:6789/0 25209 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 20:16:03.918345 mon.node1 mon.0 10.193.56.230:6789/0 25210 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 20:16:03.918370 mon.node1 mon.0 10.193.56.230:6789/0 25211 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 20:16:03.918630 mon.node1 mon.0 10.193.56.230:6789/0 25212 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 20:21:03.918439 mon.node1 mon.0 10.193.56.230:6789/0 25294 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 20:21:03.918482 mon.node1 mon.0 10.193.56.230:6789/0 25295 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 20:21:03.918514 mon.node1 mon.0 10.193.56.230:6789/0 25296 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 20:21:03.919540 mon.node1 mon.0 10.193.56.230:6789/0 25297 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 20:26:03.918661 mon.node1 mon.0 10.193.56.230:6789/0 25368 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 20:26:03.918777 mon.node1 mon.0 10.193.56.230:6789/0 25369 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 20:26:03.919122 mon.node1 mon.0 10.193.56.230:6789/0 25370 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 20:26:03.919274 mon.node1 mon.0 10.193.56.230:6789/0 25371 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 20:31:03.918665 mon.node1 mon.0 10.193.56.230:6789/0 25434 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 20:31:03.918705 mon.node1 mon.0 10.193.56.230:6789/0 25435 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 20:31:03.918766 mon.node1 mon.0 10.193.56.230:6789/0 25436 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 20:31:03.918796 mon.node1 mon.0 10.193.56.230:6789/0 25437 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 20:36:03.918757 mon.node1 mon.0 10.193.56.230:6789/0 25503 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 20:36:03.918833 mon.node1 mon.0 10.193.56.230:6789/0 25504 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 20:36:03.918855 mon.node1 mon.0 10.193.56.230:6789/0 25505 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 20:36:03.918933 mon.node1 mon.0 10.193.56.230:6789/0 25506 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 20:41:03.918976 mon.node1 mon.0 10.193.56.230:6789/0 25568 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 20:41:03.919019 mon.node1 mon.0 10.193.56.230:6789/0 25569 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 20:41:03.919090 mon.node1 mon.0 10.193.56.230:6789/0 25570 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 20:41:03.919124 mon.node1 mon.0 10.193.56.230:6789/0 25571 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 20:46:03.919109 mon.node1 mon.0 10.193.56.230:6789/0 25636 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 20:46:03.919149 mon.node1 mon.0 10.193.56.230:6789/0 25637 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 20:46:03.919199 mon.node1 mon.0 10.193.56.230:6789/0 25638 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 20:46:03.920336 mon.node1 mon.0 10.193.56.230:6789/0 25639 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 20:51:03.919588 mon.node1 mon.0 10.193.56.230:6789/0 25699 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 20:51:03.919661 mon.node1 mon.0 10.193.56.230:6789/0 25700 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 20:51:03.922326 mon.node1 mon.0 10.193.56.230:6789/0 25701 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 20:51:03.923277 mon.node1 mon.0 10.193.56.230:6789/0 25702 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 20:56:03.919450 mon.node1 mon.0 10.193.56.230:6789/0 25760 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 20:56:03.919492 mon.node1 mon.0 10.193.56.230:6789/0 25761 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 20:56:03.919683 mon.node1 mon.0 10.193.56.230:6789/0 25762 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 20:56:03.919816 mon.node1 mon.0 10.193.56.230:6789/0 25763 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 21:00:00.000094 mon.node1 mon.0 10.193.56.230:6789/0 25808 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 21:01:03.919539 mon.node1 mon.0 10.193.56.230:6789/0 25825 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 21:01:03.919733 mon.node1 mon.0 10.193.56.230:6789/0 25826 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 21:01:03.919830 mon.node1 mon.0 10.193.56.230:6789/0 25827 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 21:01:03.919883 mon.node1 mon.0 10.193.56.230:6789/0 25828 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 21:06:03.919943 mon.node1 mon.0 10.193.56.230:6789/0 25900 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 21:06:03.922312 mon.node1 mon.0 10.193.56.230:6789/0 25901 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 21:06:03.923649 mon.node1 mon.0 10.193.56.230:6789/0 25902 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 21:06:03.924396 mon.node1 mon.0 10.193.56.230:6789/0 25903 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 21:11:03.919760 mon.node1 mon.0 10.193.56.230:6789/0 25964 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 21:11:03.919796 mon.node1 mon.0 10.193.56.230:6789/0 25965 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 21:11:03.919843 mon.node1 mon.0 10.193.56.230:6789/0 25966 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 21:11:03.920087 mon.node1 mon.0 10.193.56.230:6789/0 25967 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 21:16:03.920113 mon.node1 mon.0 10.193.56.230:6789/0 26026 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 21:16:03.920703 mon.node1 mon.0 10.193.56.230:6789/0 26027 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 21:16:03.920777 mon.node1 mon.0 10.193.56.230:6789/0 26028 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 21:16:03.922958 mon.node1 mon.0 10.193.56.230:6789/0 26029 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 21:21:03.920484 mon.node1 mon.0 10.193.56.230:6789/0 26095 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 21:21:03.920526 mon.node1 mon.0 10.193.56.230:6789/0 26096 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 21:21:03.921360 mon.node1 mon.0 10.193.56.230:6789/0 26097 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 21:21:03.922409 mon.node1 mon.0 10.193.56.230:6789/0 26098 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 21:26:03.920185 mon.node1 mon.0 10.193.56.230:6789/0 26166 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 21:26:03.920223 mon.node1 mon.0 10.193.56.230:6789/0 26167 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 21:26:03.920351 mon.node1 mon.0 10.193.56.230:6789/0 26168 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 21:26:03.920377 mon.node1 mon.0 10.193.56.230:6789/0 26169 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 21:31:03.920247 mon.node1 mon.0 10.193.56.230:6789/0 26230 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 21:31:03.920344 mon.node1 mon.0 10.193.56.230:6789/0 26231 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 21:31:03.921670 mon.node1 mon.0 10.193.56.230:6789/0 26232 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 21:31:03.922481 mon.node1 mon.0 10.193.56.230:6789/0 26233 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 21:36:03.920399 mon.node1 mon.0 10.193.56.230:6789/0 26302 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 21:36:03.920450 mon.node1 mon.0 10.193.56.230:6789/0 26303 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 21:36:03.920493 mon.node1 mon.0 10.193.56.230:6789/0 26304 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 21:36:03.921077 mon.node1 mon.0 10.193.56.230:6789/0 26305 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 21:38:44.055320 mon.node1 mon.0 10.193.56.230:6789/0 26335 : cluster [WRN] Health check failed: 5 slow requests are blocked > 32 sec (REQUEST_SLOW) 2017-12-17 21:38:50.377238 mon.node1 mon.0 10.193.56.230:6789/0 26338 : cluster [WRN] Health check update: 18 slow requests are blocked > 32 sec (REQUEST_SLOW) 2017-12-17 21:38:53.937524 mon.node1 mon.0 10.193.56.230:6789/0 26339 : cluster [INF] Health check cleared: REQUEST_SLOW (was: 18 slow requests are blocked > 32 sec) 2017-12-17 21:41:03.920540 mon.node1 mon.0 10.193.56.230:6789/0 26369 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 21:41:03.920672 mon.node1 mon.0 10.193.56.230:6789/0 26370 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 21:41:03.920882 mon.node1 mon.0 10.193.56.230:6789/0 26371 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 21:41:03.921308 mon.node1 mon.0 10.193.56.230:6789/0 26372 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 21:46:03.920692 mon.node1 mon.0 10.193.56.230:6789/0 26434 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 21:46:03.920733 mon.node1 mon.0 10.193.56.230:6789/0 26435 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 21:46:03.920787 mon.node1 mon.0 10.193.56.230:6789/0 26436 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 21:46:03.920904 mon.node1 mon.0 10.193.56.230:6789/0 26437 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 21:51:03.920805 mon.node1 mon.0 10.193.56.230:6789/0 26503 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 21:51:03.920842 mon.node1 mon.0 10.193.56.230:6789/0 26504 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 21:51:03.920864 mon.node1 mon.0 10.193.56.230:6789/0 26505 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 21:51:03.920892 mon.node1 mon.0 10.193.56.230:6789/0 26506 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 21:56:03.921013 mon.node1 mon.0 10.193.56.230:6789/0 26570 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 21:56:03.921374 mon.node1 mon.0 10.193.56.230:6789/0 26571 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 21:56:03.921579 mon.node1 mon.0 10.193.56.230:6789/0 26572 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 21:56:03.926659 mon.node1 mon.0 10.193.56.230:6789/0 26573 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 22:00:00.000091 mon.node1 mon.0 10.193.56.230:6789/0 26613 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 22:01:03.932516 mon.node1 mon.0 10.193.56.230:6789/0 26629 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 22:01:03.935883 mon.node1 mon.0 10.193.56.230:6789/0 26630 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 22:01:03.937492 mon.node1 mon.0 10.193.56.230:6789/0 26631 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 22:01:03.938903 mon.node1 mon.0 10.193.56.230:6789/0 26632 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 22:06:03.927858 mon.node1 mon.0 10.193.56.230:6789/0 26700 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 22:06:03.927982 mon.node1 mon.0 10.193.56.230:6789/0 26701 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 22:06:03.928052 mon.node1 mon.0 10.193.56.230:6789/0 26702 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 22:06:03.929993 mon.node1 mon.0 10.193.56.230:6789/0 26703 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 22:11:03.928246 mon.node1 mon.0 10.193.56.230:6789/0 26750 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 22:11:03.928810 mon.node1 mon.0 10.193.56.230:6789/0 26751 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 22:11:03.930590 mon.node1 mon.0 10.193.56.230:6789/0 26752 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 22:11:03.931684 mon.node1 mon.0 10.193.56.230:6789/0 26753 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 22:16:03.928055 mon.node1 mon.0 10.193.56.230:6789/0 26813 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 22:16:03.928103 mon.node1 mon.0 10.193.56.230:6789/0 26814 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 22:16:03.928125 mon.node1 mon.0 10.193.56.230:6789/0 26815 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 22:16:03.928146 mon.node1 mon.0 10.193.56.230:6789/0 26816 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 22:21:03.928308 mon.node1 mon.0 10.193.56.230:6789/0 26876 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 22:21:03.928386 mon.node1 mon.0 10.193.56.230:6789/0 26877 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 22:21:03.928420 mon.node1 mon.0 10.193.56.230:6789/0 26878 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 22:21:03.930964 mon.node1 mon.0 10.193.56.230:6789/0 26879 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 22:26:03.928343 mon.node1 mon.0 10.193.56.230:6789/0 26937 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 22:26:03.928378 mon.node1 mon.0 10.193.56.230:6789/0 26938 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 22:26:03.928436 mon.node1 mon.0 10.193.56.230:6789/0 26939 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 22:26:03.929125 mon.node1 mon.0 10.193.56.230:6789/0 26940 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 22:31:03.928488 mon.node1 mon.0 10.193.56.230:6789/0 27015 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 22:31:03.928533 mon.node1 mon.0 10.193.56.230:6789/0 27016 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 22:31:03.928563 mon.node1 mon.0 10.193.56.230:6789/0 27017 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 22:31:03.928590 mon.node1 mon.0 10.193.56.230:6789/0 27018 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 22:36:03.928651 mon.node1 mon.0 10.193.56.230:6789/0 27079 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 22:36:03.928703 mon.node1 mon.0 10.193.56.230:6789/0 27080 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 22:36:03.928728 mon.node1 mon.0 10.193.56.230:6789/0 27081 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 22:36:03.929941 mon.node1 mon.0 10.193.56.230:6789/0 27082 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 22:41:03.928739 mon.node1 mon.0 10.193.56.230:6789/0 27155 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 22:41:03.928859 mon.node1 mon.0 10.193.56.230:6789/0 27156 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 22:41:03.928905 mon.node1 mon.0 10.193.56.230:6789/0 27157 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 22:41:03.928956 mon.node1 mon.0 10.193.56.230:6789/0 27158 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 22:46:03.929064 mon.node1 mon.0 10.193.56.230:6789/0 27215 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 22:46:03.929123 mon.node1 mon.0 10.193.56.230:6789/0 27216 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 22:46:03.929617 mon.node1 mon.0 10.193.56.230:6789/0 27217 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 22:46:03.931064 mon.node1 mon.0 10.193.56.230:6789/0 27218 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 22:51:03.929024 mon.node1 mon.0 10.193.56.230:6789/0 27287 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 22:51:03.929090 mon.node1 mon.0 10.193.56.230:6789/0 27288 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 22:51:03.929122 mon.node1 mon.0 10.193.56.230:6789/0 27289 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 22:51:03.929141 mon.node1 mon.0 10.193.56.230:6789/0 27290 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 22:56:03.929178 mon.node1 mon.0 10.193.56.230:6789/0 27341 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 22:56:03.929220 mon.node1 mon.0 10.193.56.230:6789/0 27342 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 22:56:03.929251 mon.node1 mon.0 10.193.56.230:6789/0 27343 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 22:56:03.929308 mon.node1 mon.0 10.193.56.230:6789/0 27344 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 23:00:00.000098 mon.node1 mon.0 10.193.56.230:6789/0 27385 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-17 23:01:03.929585 mon.node1 mon.0 10.193.56.230:6789/0 27398 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 23:01:03.930094 mon.node1 mon.0 10.193.56.230:6789/0 27399 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 23:01:03.930356 mon.node1 mon.0 10.193.56.230:6789/0 27400 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 23:01:03.931718 mon.node1 mon.0 10.193.56.230:6789/0 27401 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 23:06:03.929437 mon.node1 mon.0 10.193.56.230:6789/0 27464 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 23:06:03.929485 mon.node1 mon.0 10.193.56.230:6789/0 27465 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 23:06:03.929518 mon.node1 mon.0 10.193.56.230:6789/0 27466 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 23:06:03.930008 mon.node1 mon.0 10.193.56.230:6789/0 27467 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 23:11:03.929616 mon.node1 mon.0 10.193.56.230:6789/0 27534 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 23:11:03.929650 mon.node1 mon.0 10.193.56.230:6789/0 27535 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 23:11:03.929683 mon.node1 mon.0 10.193.56.230:6789/0 27536 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 23:11:03.929727 mon.node1 mon.0 10.193.56.230:6789/0 27537 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 23:16:03.930713 mon.node1 mon.0 10.193.56.230:6789/0 27592 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 23:16:03.932041 mon.node1 mon.0 10.193.56.230:6789/0 27593 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 23:16:03.932828 mon.node1 mon.0 10.193.56.230:6789/0 27594 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 23:16:03.933275 mon.node1 mon.0 10.193.56.230:6789/0 27595 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 23:21:03.929845 mon.node1 mon.0 10.193.56.230:6789/0 27666 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 23:21:03.929880 mon.node1 mon.0 10.193.56.230:6789/0 27667 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 23:21:03.929939 mon.node1 mon.0 10.193.56.230:6789/0 27668 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 23:21:03.929962 mon.node1 mon.0 10.193.56.230:6789/0 27669 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 23:26:03.929945 mon.node1 mon.0 10.193.56.230:6789/0 27729 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 23:26:03.930033 mon.node1 mon.0 10.193.56.230:6789/0 27730 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 23:26:03.930147 mon.node1 mon.0 10.193.56.230:6789/0 27731 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 23:26:03.931109 mon.node1 mon.0 10.193.56.230:6789/0 27732 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 23:31:03.930113 mon.node1 mon.0 10.193.56.230:6789/0 27797 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 23:31:03.930147 mon.node1 mon.0 10.193.56.230:6789/0 27798 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 23:31:03.930176 mon.node1 mon.0 10.193.56.230:6789/0 27799 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 23:31:03.930268 mon.node1 mon.0 10.193.56.230:6789/0 27800 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 23:36:03.930327 mon.node1 mon.0 10.193.56.230:6789/0 27860 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 23:36:03.930368 mon.node1 mon.0 10.193.56.230:6789/0 27861 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 23:36:03.930396 mon.node1 mon.0 10.193.56.230:6789/0 27862 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 23:36:03.930422 mon.node1 mon.0 10.193.56.230:6789/0 27863 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 23:41:03.930355 mon.node1 mon.0 10.193.56.230:6789/0 27923 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 23:41:03.930391 mon.node1 mon.0 10.193.56.230:6789/0 27924 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 23:41:03.930418 mon.node1 mon.0 10.193.56.230:6789/0 27925 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 23:41:03.930440 mon.node1 mon.0 10.193.56.230:6789/0 27926 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 23:46:03.930516 mon.node1 mon.0 10.193.56.230:6789/0 27976 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 23:46:03.930561 mon.node1 mon.0 10.193.56.230:6789/0 27977 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 23:46:03.930596 mon.node1 mon.0 10.193.56.230:6789/0 27978 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 23:46:03.930616 mon.node1 mon.0 10.193.56.230:6789/0 27979 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 23:51:03.930620 mon.node1 mon.0 10.193.56.230:6789/0 28038 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 23:51:03.930662 mon.node1 mon.0 10.193.56.230:6789/0 28039 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 23:51:03.932201 mon.node1 mon.0 10.193.56.230:6789/0 28040 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 23:51:03.935256 mon.node1 mon.0 10.193.56.230:6789/0 28041 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-17 23:56:03.931028 mon.node1 mon.0 10.193.56.230:6789/0 28107 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-17 23:56:03.931073 mon.node1 mon.0 10.193.56.230:6789/0 28108 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-17 23:56:03.931481 mon.node1 mon.0 10.193.56.230:6789/0 28109 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-17 23:56:03.931518 mon.node1 mon.0 10.193.56.230:6789/0 28110 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 00:00:00.000094 mon.node1 mon.0 10.193.56.230:6789/0 28161 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 00:01:03.930857 mon.node1 mon.0 10.193.56.230:6789/0 28172 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 00:01:03.930899 mon.node1 mon.0 10.193.56.230:6789/0 28173 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 00:01:03.930920 mon.node1 mon.0 10.193.56.230:6789/0 28174 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 00:01:03.930942 mon.node1 mon.0 10.193.56.230:6789/0 28175 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 00:06:03.930964 mon.node1 mon.0 10.193.56.230:6789/0 28239 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 00:06:03.931053 mon.node1 mon.0 10.193.56.230:6789/0 28240 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 00:06:03.931108 mon.node1 mon.0 10.193.56.230:6789/0 28241 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 00:06:03.932546 mon.node1 mon.0 10.193.56.230:6789/0 28242 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 00:11:03.931092 mon.node1 mon.0 10.193.56.230:6789/0 28319 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 00:11:03.931134 mon.node1 mon.0 10.193.56.230:6789/0 28320 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 00:11:03.931158 mon.node1 mon.0 10.193.56.230:6789/0 28321 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 00:11:03.931180 mon.node1 mon.0 10.193.56.230:6789/0 28322 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 00:16:03.931237 mon.node1 mon.0 10.193.56.230:6789/0 28378 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 00:16:03.931274 mon.node1 mon.0 10.193.56.230:6789/0 28379 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 00:16:03.931326 mon.node1 mon.0 10.193.56.230:6789/0 28380 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 00:16:03.932856 mon.node1 mon.0 10.193.56.230:6789/0 28381 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 00:21:03.931391 mon.node1 mon.0 10.193.56.230:6789/0 28449 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 00:21:03.931425 mon.node1 mon.0 10.193.56.230:6789/0 28450 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 00:21:03.931494 mon.node1 mon.0 10.193.56.230:6789/0 28451 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 00:21:03.931559 mon.node1 mon.0 10.193.56.230:6789/0 28452 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 00:26:03.931530 mon.node1 mon.0 10.193.56.230:6789/0 28509 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 00:26:03.931615 mon.node1 mon.0 10.193.56.230:6789/0 28510 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 00:26:03.933073 mon.node1 mon.0 10.193.56.230:6789/0 28511 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 00:26:03.933177 mon.node1 mon.0 10.193.56.230:6789/0 28512 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 00:31:03.931640 mon.node1 mon.0 10.193.56.230:6789/0 28575 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 00:31:03.931671 mon.node1 mon.0 10.193.56.230:6789/0 28576 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 00:31:03.931971 mon.node1 mon.0 10.193.56.230:6789/0 28577 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 00:31:03.933975 mon.node1 mon.0 10.193.56.230:6789/0 28578 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 00:36:03.931764 mon.node1 mon.0 10.193.56.230:6789/0 28632 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 00:36:03.931836 mon.node1 mon.0 10.193.56.230:6789/0 28633 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 00:36:03.931995 mon.node1 mon.0 10.193.56.230:6789/0 28634 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 00:36:03.932315 mon.node1 mon.0 10.193.56.230:6789/0 28635 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 00:41:03.931981 mon.node1 mon.0 10.193.56.230:6789/0 28701 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 00:41:03.932052 mon.node1 mon.0 10.193.56.230:6789/0 28702 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 00:41:03.933640 mon.node1 mon.0 10.193.56.230:6789/0 28703 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 00:41:03.935016 mon.node1 mon.0 10.193.56.230:6789/0 28704 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 00:46:03.932028 mon.node1 mon.0 10.193.56.230:6789/0 28750 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 00:46:03.932136 mon.node1 mon.0 10.193.56.230:6789/0 28751 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 00:46:03.934553 mon.node1 mon.0 10.193.56.230:6789/0 28752 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 00:46:03.935997 mon.node1 mon.0 10.193.56.230:6789/0 28753 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 00:51:03.932142 mon.node1 mon.0 10.193.56.230:6789/0 28826 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 00:51:03.932204 mon.node1 mon.0 10.193.56.230:6789/0 28827 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 00:51:03.932302 mon.node1 mon.0 10.193.56.230:6789/0 28828 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 00:51:03.932351 mon.node1 mon.0 10.193.56.230:6789/0 28829 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 00:56:03.932263 mon.node1 mon.0 10.193.56.230:6789/0 28900 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 00:56:03.932318 mon.node1 mon.0 10.193.56.230:6789/0 28901 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 00:56:03.932349 mon.node1 mon.0 10.193.56.230:6789/0 28902 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 00:56:03.932378 mon.node1 mon.0 10.193.56.230:6789/0 28903 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 01:00:00.000108 mon.node1 mon.0 10.193.56.230:6789/0 28959 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 01:01:03.932840 mon.node1 mon.0 10.193.56.230:6789/0 28977 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 01:01:03.933429 mon.node1 mon.0 10.193.56.230:6789/0 28978 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 01:01:03.933486 mon.node1 mon.0 10.193.56.230:6789/0 28979 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 01:01:03.933512 mon.node1 mon.0 10.193.56.230:6789/0 28980 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 01:06:03.932985 mon.node1 mon.0 10.193.56.230:6789/0 29045 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 01:06:03.933111 mon.node1 mon.0 10.193.56.230:6789/0 29046 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 01:06:03.933460 mon.node1 mon.0 10.193.56.230:6789/0 29047 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 01:06:03.937214 mon.node1 mon.0 10.193.56.230:6789/0 29048 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 01:11:03.933448 mon.node1 mon.0 10.193.56.230:6789/0 29099 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 01:11:03.934095 mon.node1 mon.0 10.193.56.230:6789/0 29100 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 01:11:03.935366 mon.node1 mon.0 10.193.56.230:6789/0 29101 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 01:11:03.935470 mon.node1 mon.0 10.193.56.230:6789/0 29102 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 01:16:03.933045 mon.node1 mon.0 10.193.56.230:6789/0 29166 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 01:16:03.933230 mon.node1 mon.0 10.193.56.230:6789/0 29167 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 01:16:03.933831 mon.node1 mon.0 10.193.56.230:6789/0 29168 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 01:16:03.936542 mon.node1 mon.0 10.193.56.230:6789/0 29169 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 01:21:03.932901 mon.node1 mon.0 10.193.56.230:6789/0 29240 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 01:21:03.932959 mon.node1 mon.0 10.193.56.230:6789/0 29241 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 01:21:03.932986 mon.node1 mon.0 10.193.56.230:6789/0 29242 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 01:21:03.933033 mon.node1 mon.0 10.193.56.230:6789/0 29243 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 01:26:03.933016 mon.node1 mon.0 10.193.56.230:6789/0 29303 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 01:26:03.933047 mon.node1 mon.0 10.193.56.230:6789/0 29304 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 01:26:03.933132 mon.node1 mon.0 10.193.56.230:6789/0 29305 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 01:26:03.933520 mon.node1 mon.0 10.193.56.230:6789/0 29306 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 01:31:03.943937 mon.node1 mon.0 10.193.56.230:6789/0 29379 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 01:31:03.944041 mon.node1 mon.0 10.193.56.230:6789/0 29380 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 01:31:03.945186 mon.node1 mon.0 10.193.56.230:6789/0 29381 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 01:31:03.945743 mon.node1 mon.0 10.193.56.230:6789/0 29382 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 01:36:03.937315 mon.node1 mon.0 10.193.56.230:6789/0 29439 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 01:36:03.937346 mon.node1 mon.0 10.193.56.230:6789/0 29440 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 01:36:03.937367 mon.node1 mon.0 10.193.56.230:6789/0 29441 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 01:36:03.937423 mon.node1 mon.0 10.193.56.230:6789/0 29442 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 01:41:03.937426 mon.node1 mon.0 10.193.56.230:6789/0 29507 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 01:41:03.937837 mon.node1 mon.0 10.193.56.230:6789/0 29508 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 01:41:03.937872 mon.node1 mon.0 10.193.56.230:6789/0 29509 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 01:41:03.938693 mon.node1 mon.0 10.193.56.230:6789/0 29510 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 01:46:03.937547 mon.node1 mon.0 10.193.56.230:6789/0 29578 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 01:46:03.937593 mon.node1 mon.0 10.193.56.230:6789/0 29579 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 01:46:03.937615 mon.node1 mon.0 10.193.56.230:6789/0 29580 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 01:46:03.937639 mon.node1 mon.0 10.193.56.230:6789/0 29581 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 01:51:03.937622 mon.node1 mon.0 10.193.56.230:6789/0 29642 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 01:51:03.937701 mon.node1 mon.0 10.193.56.230:6789/0 29643 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 01:51:03.940856 mon.node1 mon.0 10.193.56.230:6789/0 29644 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 01:51:03.944326 mon.node1 mon.0 10.193.56.230:6789/0 29645 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 01:56:03.937756 mon.node1 mon.0 10.193.56.230:6789/0 29699 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 01:56:03.938192 mon.node1 mon.0 10.193.56.230:6789/0 29700 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 01:56:03.939925 mon.node1 mon.0 10.193.56.230:6789/0 29701 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 01:56:03.947409 mon.node1 mon.0 10.193.56.230:6789/0 29702 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 02:00:00.000089 mon.node1 mon.0 10.193.56.230:6789/0 29753 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 02:01:03.937922 mon.node1 mon.0 10.193.56.230:6789/0 29764 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 02:01:03.937976 mon.node1 mon.0 10.193.56.230:6789/0 29765 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 02:01:03.938076 mon.node1 mon.0 10.193.56.230:6789/0 29766 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 02:01:03.938108 mon.node1 mon.0 10.193.56.230:6789/0 29767 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 02:06:03.938357 mon.node1 mon.0 10.193.56.230:6789/0 29825 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 02:06:03.938683 mon.node1 mon.0 10.193.56.230:6789/0 29826 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 02:06:03.938763 mon.node1 mon.0 10.193.56.230:6789/0 29827 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 02:06:03.938798 mon.node1 mon.0 10.193.56.230:6789/0 29828 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 02:11:03.938147 mon.node1 mon.0 10.193.56.230:6789/0 29881 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 02:11:03.938309 mon.node1 mon.0 10.193.56.230:6789/0 29882 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 02:11:03.938347 mon.node1 mon.0 10.193.56.230:6789/0 29883 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 02:11:03.938410 mon.node1 mon.0 10.193.56.230:6789/0 29884 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 02:16:03.938339 mon.node1 mon.0 10.193.56.230:6789/0 29943 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 02:16:03.938384 mon.node1 mon.0 10.193.56.230:6789/0 29944 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 02:16:03.938431 mon.node1 mon.0 10.193.56.230:6789/0 29945 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 02:16:03.938525 mon.node1 mon.0 10.193.56.230:6789/0 29946 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 02:21:03.938449 mon.node1 mon.0 10.193.56.230:6789/0 30001 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 02:21:03.940143 mon.node1 mon.0 10.193.56.230:6789/0 30002 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 02:21:03.940685 mon.node1 mon.0 10.193.56.230:6789/0 30003 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 02:21:03.941133 mon.node1 mon.0 10.193.56.230:6789/0 30004 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 02:26:03.939233 mon.node1 mon.0 10.193.56.230:6789/0 30070 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 02:26:03.941117 mon.node1 mon.0 10.193.56.230:6789/0 30071 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 02:26:03.941905 mon.node1 mon.0 10.193.56.230:6789/0 30072 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 02:26:03.942071 mon.node1 mon.0 10.193.56.230:6789/0 30073 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 02:31:03.938676 mon.node1 mon.0 10.193.56.230:6789/0 30126 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 02:31:03.938712 mon.node1 mon.0 10.193.56.230:6789/0 30127 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 02:31:03.938734 mon.node1 mon.0 10.193.56.230:6789/0 30128 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 02:31:03.938782 mon.node1 mon.0 10.193.56.230:6789/0 30129 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 02:36:03.938867 mon.node1 mon.0 10.193.56.230:6789/0 30198 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 02:36:03.938924 mon.node1 mon.0 10.193.56.230:6789/0 30199 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 02:36:03.938955 mon.node1 mon.0 10.193.56.230:6789/0 30200 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 02:36:03.938982 mon.node1 mon.0 10.193.56.230:6789/0 30201 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 02:41:03.938900 mon.node1 mon.0 10.193.56.230:6789/0 30266 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 02:41:03.938950 mon.node1 mon.0 10.193.56.230:6789/0 30267 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 02:41:03.939001 mon.node1 mon.0 10.193.56.230:6789/0 30268 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 02:41:03.946697 mon.node1 mon.0 10.193.56.230:6789/0 30269 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 02:46:03.939081 mon.node1 mon.0 10.193.56.230:6789/0 30322 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 02:46:03.939192 mon.node1 mon.0 10.193.56.230:6789/0 30323 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 02:46:03.939269 mon.node1 mon.0 10.193.56.230:6789/0 30324 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 02:46:03.939317 mon.node1 mon.0 10.193.56.230:6789/0 30325 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 02:51:03.939183 mon.node1 mon.0 10.193.56.230:6789/0 30390 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 02:51:03.939216 mon.node1 mon.0 10.193.56.230:6789/0 30391 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 02:51:03.939241 mon.node1 mon.0 10.193.56.230:6789/0 30392 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 02:51:03.939269 mon.node1 mon.0 10.193.56.230:6789/0 30393 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 02:56:03.939534 mon.node1 mon.0 10.193.56.230:6789/0 30450 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 02:56:03.939607 mon.node1 mon.0 10.193.56.230:6789/0 30451 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 02:56:03.939716 mon.node1 mon.0 10.193.56.230:6789/0 30452 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 02:56:03.939748 mon.node1 mon.0 10.193.56.230:6789/0 30453 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 03:00:00.000085 mon.node1 mon.0 10.193.56.230:6789/0 30500 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 03:01:03.939701 mon.node1 mon.0 10.193.56.230:6789/0 30515 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 03:01:03.940656 mon.node1 mon.0 10.193.56.230:6789/0 30516 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 03:01:03.941030 mon.node1 mon.0 10.193.56.230:6789/0 30517 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 03:01:03.946879 mon.node1 mon.0 10.193.56.230:6789/0 30518 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 03:06:03.939570 mon.node1 mon.0 10.193.56.230:6789/0 30590 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 03:06:03.939611 mon.node1 mon.0 10.193.56.230:6789/0 30591 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 03:06:03.939645 mon.node1 mon.0 10.193.56.230:6789/0 30592 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 03:06:03.939693 mon.node1 mon.0 10.193.56.230:6789/0 30593 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 03:11:03.939702 mon.node1 mon.0 10.193.56.230:6789/0 30645 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 03:11:03.939772 mon.node1 mon.0 10.193.56.230:6789/0 30646 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 03:11:03.941059 mon.node1 mon.0 10.193.56.230:6789/0 30647 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 03:11:03.943730 mon.node1 mon.0 10.193.56.230:6789/0 30648 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 03:16:03.939853 mon.node1 mon.0 10.193.56.230:6789/0 30699 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 03:16:03.940033 mon.node1 mon.0 10.193.56.230:6789/0 30700 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 03:16:03.940063 mon.node1 mon.0 10.193.56.230:6789/0 30701 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 03:16:03.941369 mon.node1 mon.0 10.193.56.230:6789/0 30702 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 03:21:03.940003 mon.node1 mon.0 10.193.56.230:6789/0 30748 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 03:21:03.940260 mon.node1 mon.0 10.193.56.230:6789/0 30749 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 03:21:03.940286 mon.node1 mon.0 10.193.56.230:6789/0 30750 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 03:21:03.941899 mon.node1 mon.0 10.193.56.230:6789/0 30751 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 03:26:03.940200 mon.node1 mon.0 10.193.56.230:6789/0 30809 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 03:26:03.940581 mon.node1 mon.0 10.193.56.230:6789/0 30810 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 03:26:03.943172 mon.node1 mon.0 10.193.56.230:6789/0 30811 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 03:26:03.944384 mon.node1 mon.0 10.193.56.230:6789/0 30812 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 03:31:03.940196 mon.node1 mon.0 10.193.56.230:6789/0 30885 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 03:31:03.940246 mon.node1 mon.0 10.193.56.230:6789/0 30886 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 03:31:03.940277 mon.node1 mon.0 10.193.56.230:6789/0 30887 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 03:31:03.943025 mon.node1 mon.0 10.193.56.230:6789/0 30888 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 03:36:03.940625 mon.node1 mon.0 10.193.56.230:6789/0 30952 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 03:36:03.940667 mon.node1 mon.0 10.193.56.230:6789/0 30953 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 03:36:03.940740 mon.node1 mon.0 10.193.56.230:6789/0 30954 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 03:36:03.940772 mon.node1 mon.0 10.193.56.230:6789/0 30955 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 03:41:03.940487 mon.node1 mon.0 10.193.56.230:6789/0 31019 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 03:41:03.940532 mon.node1 mon.0 10.193.56.230:6789/0 31020 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 03:41:03.940866 mon.node1 mon.0 10.193.56.230:6789/0 31021 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 03:41:03.941358 mon.node1 mon.0 10.193.56.230:6789/0 31022 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 03:46:03.940895 mon.node1 mon.0 10.193.56.230:6789/0 31089 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 03:46:03.942047 mon.node1 mon.0 10.193.56.230:6789/0 31090 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 03:46:03.943820 mon.node1 mon.0 10.193.56.230:6789/0 31091 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 03:46:03.944631 mon.node1 mon.0 10.193.56.230:6789/0 31092 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 03:51:03.940853 mon.node1 mon.0 10.193.56.230:6789/0 31150 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 03:51:03.940896 mon.node1 mon.0 10.193.56.230:6789/0 31151 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 03:51:03.940927 mon.node1 mon.0 10.193.56.230:6789/0 31152 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 03:51:03.941013 mon.node1 mon.0 10.193.56.230:6789/0 31153 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 03:56:03.940987 mon.node1 mon.0 10.193.56.230:6789/0 31222 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 03:56:03.941017 mon.node1 mon.0 10.193.56.230:6789/0 31223 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 03:56:03.941037 mon.node1 mon.0 10.193.56.230:6789/0 31224 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 03:56:03.941192 mon.node1 mon.0 10.193.56.230:6789/0 31225 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 04:00:00.000085 mon.node1 mon.0 10.193.56.230:6789/0 31268 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 04:01:03.941029 mon.node1 mon.0 10.193.56.230:6789/0 31287 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 04:01:03.941069 mon.node1 mon.0 10.193.56.230:6789/0 31288 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 04:01:03.941095 mon.node1 mon.0 10.193.56.230:6789/0 31289 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 04:01:03.941121 mon.node1 mon.0 10.193.56.230:6789/0 31290 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 04:06:03.941107 mon.node1 mon.0 10.193.56.230:6789/0 31351 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 04:06:03.941141 mon.node1 mon.0 10.193.56.230:6789/0 31352 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 04:06:03.941199 mon.node1 mon.0 10.193.56.230:6789/0 31353 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 04:06:03.941343 mon.node1 mon.0 10.193.56.230:6789/0 31354 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 04:11:03.941661 mon.node1 mon.0 10.193.56.230:6789/0 31417 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 04:11:03.941914 mon.node1 mon.0 10.193.56.230:6789/0 31418 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 04:11:03.941971 mon.node1 mon.0 10.193.56.230:6789/0 31419 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 04:11:03.946526 mon.node1 mon.0 10.193.56.230:6789/0 31420 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 04:16:03.941418 mon.node1 mon.0 10.193.56.230:6789/0 31477 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 04:16:03.941471 mon.node1 mon.0 10.193.56.230:6789/0 31478 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 04:16:03.941505 mon.node1 mon.0 10.193.56.230:6789/0 31479 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 04:16:03.941533 mon.node1 mon.0 10.193.56.230:6789/0 31480 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 04:21:03.941724 mon.node1 mon.0 10.193.56.230:6789/0 31540 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 04:21:03.942170 mon.node1 mon.0 10.193.56.230:6789/0 31541 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 04:21:03.942615 mon.node1 mon.0 10.193.56.230:6789/0 31542 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 04:21:03.943095 mon.node1 mon.0 10.193.56.230:6789/0 31543 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 04:26:03.941703 mon.node1 mon.0 10.193.56.230:6789/0 31596 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 04:26:03.941780 mon.node1 mon.0 10.193.56.230:6789/0 31597 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 04:26:03.941931 mon.node1 mon.0 10.193.56.230:6789/0 31598 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 04:26:03.942115 mon.node1 mon.0 10.193.56.230:6789/0 31599 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 04:31:03.941855 mon.node1 mon.0 10.193.56.230:6789/0 31667 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 04:31:03.942162 mon.node1 mon.0 10.193.56.230:6789/0 31668 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 04:31:03.942216 mon.node1 mon.0 10.193.56.230:6789/0 31669 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 04:31:03.942534 mon.node1 mon.0 10.193.56.230:6789/0 31670 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 04:36:03.941932 mon.node1 mon.0 10.193.56.230:6789/0 31737 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 04:36:03.941975 mon.node1 mon.0 10.193.56.230:6789/0 31738 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 04:36:03.942043 mon.node1 mon.0 10.193.56.230:6789/0 31739 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 04:36:03.942909 mon.node1 mon.0 10.193.56.230:6789/0 31740 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 04:41:03.942200 mon.node1 mon.0 10.193.56.230:6789/0 31795 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 04:41:03.942243 mon.node1 mon.0 10.193.56.230:6789/0 31796 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 04:41:03.942332 mon.node1 mon.0 10.193.56.230:6789/0 31797 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 04:41:03.943236 mon.node1 mon.0 10.193.56.230:6789/0 31798 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 04:46:03.942228 mon.node1 mon.0 10.193.56.230:6789/0 31861 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 04:46:03.942267 mon.node1 mon.0 10.193.56.230:6789/0 31862 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 04:46:03.942479 mon.node1 mon.0 10.193.56.230:6789/0 31863 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 04:46:03.944251 mon.node1 mon.0 10.193.56.230:6789/0 31864 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 04:51:03.942375 mon.node1 mon.0 10.193.56.230:6789/0 31933 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 04:51:03.942425 mon.node1 mon.0 10.193.56.230:6789/0 31934 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 04:51:03.942530 mon.node1 mon.0 10.193.56.230:6789/0 31935 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 04:51:03.942633 mon.node1 mon.0 10.193.56.230:6789/0 31936 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 04:56:03.942499 mon.node1 mon.0 10.193.56.230:6789/0 31995 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 04:56:03.942550 mon.node1 mon.0 10.193.56.230:6789/0 31996 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 04:56:03.942596 mon.node1 mon.0 10.193.56.230:6789/0 31997 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 04:56:03.943816 mon.node1 mon.0 10.193.56.230:6789/0 31998 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 05:00:00.000099 mon.node1 mon.0 10.193.56.230:6789/0 32041 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 05:01:03.942628 mon.node1 mon.0 10.193.56.230:6789/0 32060 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 05:01:03.942753 mon.node1 mon.0 10.193.56.230:6789/0 32061 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 05:01:03.943381 mon.node1 mon.0 10.193.56.230:6789/0 32062 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 05:01:03.944050 mon.node1 mon.0 10.193.56.230:6789/0 32063 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 05:06:03.943688 mon.node1 mon.0 10.193.56.230:6789/0 32118 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 05:06:03.944078 mon.node1 mon.0 10.193.56.230:6789/0 32119 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 05:06:03.944409 mon.node1 mon.0 10.193.56.230:6789/0 32120 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 05:06:03.944962 mon.node1 mon.0 10.193.56.230:6789/0 32121 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 05:11:03.943275 mon.node1 mon.0 10.193.56.230:6789/0 32179 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 05:11:03.943752 mon.node1 mon.0 10.193.56.230:6789/0 32180 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 05:11:03.944226 mon.node1 mon.0 10.193.56.230:6789/0 32181 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 05:11:03.945605 mon.node1 mon.0 10.193.56.230:6789/0 32182 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 05:16:03.943008 mon.node1 mon.0 10.193.56.230:6789/0 32242 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 05:16:03.943115 mon.node1 mon.0 10.193.56.230:6789/0 32243 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 05:16:03.943297 mon.node1 mon.0 10.193.56.230:6789/0 32244 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 05:16:03.944098 mon.node1 mon.0 10.193.56.230:6789/0 32245 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 05:21:03.943161 mon.node1 mon.0 10.193.56.230:6789/0 32306 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 05:21:03.943206 mon.node1 mon.0 10.193.56.230:6789/0 32307 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 05:21:03.943363 mon.node1 mon.0 10.193.56.230:6789/0 32308 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 05:21:03.943426 mon.node1 mon.0 10.193.56.230:6789/0 32309 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 05:26:03.943277 mon.node1 mon.0 10.193.56.230:6789/0 32375 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 05:26:03.943352 mon.node1 mon.0 10.193.56.230:6789/0 32376 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 05:26:03.943377 mon.node1 mon.0 10.193.56.230:6789/0 32377 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 05:26:03.947075 mon.node1 mon.0 10.193.56.230:6789/0 32378 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 05:31:03.943503 mon.node1 mon.0 10.193.56.230:6789/0 32453 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 05:31:03.943544 mon.node1 mon.0 10.193.56.230:6789/0 32454 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 05:31:03.943565 mon.node1 mon.0 10.193.56.230:6789/0 32455 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 05:31:03.943611 mon.node1 mon.0 10.193.56.230:6789/0 32456 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 05:36:03.943604 mon.node1 mon.0 10.193.56.230:6789/0 32507 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 05:36:03.943637 mon.node1 mon.0 10.193.56.230:6789/0 32508 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 05:36:03.943668 mon.node1 mon.0 10.193.56.230:6789/0 32509 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 05:36:03.943689 mon.node1 mon.0 10.193.56.230:6789/0 32510 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 05:41:03.943689 mon.node1 mon.0 10.193.56.230:6789/0 32581 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 05:41:03.943891 mon.node1 mon.0 10.193.56.230:6789/0 32582 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 05:41:03.943939 mon.node1 mon.0 10.193.56.230:6789/0 32583 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 05:41:03.943993 mon.node1 mon.0 10.193.56.230:6789/0 32584 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 05:46:03.943866 mon.node1 mon.0 10.193.56.230:6789/0 32649 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 05:46:03.943899 mon.node1 mon.0 10.193.56.230:6789/0 32650 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 05:46:03.944021 mon.node1 mon.0 10.193.56.230:6789/0 32651 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 05:46:03.944806 mon.node1 mon.0 10.193.56.230:6789/0 32652 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 05:51:03.944010 mon.node1 mon.0 10.193.56.230:6789/0 32712 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 05:51:03.944048 mon.node1 mon.0 10.193.56.230:6789/0 32713 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 05:51:03.944069 mon.node1 mon.0 10.193.56.230:6789/0 32714 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 05:51:03.944093 mon.node1 mon.0 10.193.56.230:6789/0 32715 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 05:56:03.944088 mon.node1 mon.0 10.193.56.230:6789/0 32782 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 05:56:03.944342 mon.node1 mon.0 10.193.56.230:6789/0 32783 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 05:56:03.944858 mon.node1 mon.0 10.193.56.230:6789/0 32784 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 05:56:03.950746 mon.node1 mon.0 10.193.56.230:6789/0 32785 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 06:00:00.000085 mon.node1 mon.0 10.193.56.230:6789/0 32840 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 06:01:03.944232 mon.node1 mon.0 10.193.56.230:6789/0 32856 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 06:01:03.944274 mon.node1 mon.0 10.193.56.230:6789/0 32857 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 06:01:03.944320 mon.node1 mon.0 10.193.56.230:6789/0 32858 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 06:01:03.944338 mon.node1 mon.0 10.193.56.230:6789/0 32859 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 06:06:03.944285 mon.node1 mon.0 10.193.56.230:6789/0 32913 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 06:06:03.944327 mon.node1 mon.0 10.193.56.230:6789/0 32914 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 06:06:03.944350 mon.node1 mon.0 10.193.56.230:6789/0 32915 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 06:06:03.944669 mon.node1 mon.0 10.193.56.230:6789/0 32916 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 06:11:03.944944 mon.node1 mon.0 10.193.56.230:6789/0 32974 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 06:11:03.945240 mon.node1 mon.0 10.193.56.230:6789/0 32975 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 06:11:03.945423 mon.node1 mon.0 10.193.56.230:6789/0 32976 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 06:11:03.945904 mon.node1 mon.0 10.193.56.230:6789/0 32977 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 06:16:03.944945 mon.node1 mon.0 10.193.56.230:6789/0 33042 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 06:16:03.945106 mon.node1 mon.0 10.193.56.230:6789/0 33043 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 06:16:03.945160 mon.node1 mon.0 10.193.56.230:6789/0 33044 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 06:16:03.947175 mon.node1 mon.0 10.193.56.230:6789/0 33045 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 06:21:03.952023 mon.node1 mon.0 10.193.56.230:6789/0 33107 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 06:21:03.953332 mon.node1 mon.0 10.193.56.230:6789/0 33108 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 06:21:03.957821 mon.node1 mon.0 10.193.56.230:6789/0 33109 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 06:21:03.961730 mon.node1 mon.0 10.193.56.230:6789/0 33110 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 06:26:03.948843 mon.node1 mon.0 10.193.56.230:6789/0 33172 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 06:26:03.948880 mon.node1 mon.0 10.193.56.230:6789/0 33173 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 06:26:03.948948 mon.node1 mon.0 10.193.56.230:6789/0 33174 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 06:26:03.949620 mon.node1 mon.0 10.193.56.230:6789/0 33175 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 06:31:03.949004 mon.node1 mon.0 10.193.56.230:6789/0 33236 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 06:31:03.949050 mon.node1 mon.0 10.193.56.230:6789/0 33237 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 06:31:03.949102 mon.node1 mon.0 10.193.56.230:6789/0 33238 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 06:31:03.949123 mon.node1 mon.0 10.193.56.230:6789/0 33239 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 06:36:03.949370 mon.node1 mon.0 10.193.56.230:6789/0 33305 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 06:36:03.950097 mon.node1 mon.0 10.193.56.230:6789/0 33306 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 06:36:03.951595 mon.node1 mon.0 10.193.56.230:6789/0 33307 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 06:36:03.953917 mon.node1 mon.0 10.193.56.230:6789/0 33308 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 06:41:03.949254 mon.node1 mon.0 10.193.56.230:6789/0 33384 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 06:41:03.949292 mon.node1 mon.0 10.193.56.230:6789/0 33385 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 06:41:03.949314 mon.node1 mon.0 10.193.56.230:6789/0 33386 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 06:41:03.949335 mon.node1 mon.0 10.193.56.230:6789/0 33387 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 06:46:03.949394 mon.node1 mon.0 10.193.56.230:6789/0 33443 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 06:46:03.949430 mon.node1 mon.0 10.193.56.230:6789/0 33444 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 06:46:03.949452 mon.node1 mon.0 10.193.56.230:6789/0 33445 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 06:46:03.949513 mon.node1 mon.0 10.193.56.230:6789/0 33446 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 06:51:03.949487 mon.node1 mon.0 10.193.56.230:6789/0 33518 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 06:51:03.949536 mon.node1 mon.0 10.193.56.230:6789/0 33519 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 06:51:03.949559 mon.node1 mon.0 10.193.56.230:6789/0 33520 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 06:51:03.949751 mon.node1 mon.0 10.193.56.230:6789/0 33521 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 06:56:03.949766 mon.node1 mon.0 10.193.56.230:6789/0 33587 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 06:56:03.949841 mon.node1 mon.0 10.193.56.230:6789/0 33588 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 06:56:03.949892 mon.node1 mon.0 10.193.56.230:6789/0 33589 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 06:56:03.949939 mon.node1 mon.0 10.193.56.230:6789/0 33590 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 07:00:00.000091 mon.node1 mon.0 10.193.56.230:6789/0 33642 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 07:01:03.950105 mon.node1 mon.0 10.193.56.230:6789/0 33658 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 07:01:03.950152 mon.node1 mon.0 10.193.56.230:6789/0 33659 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 07:01:03.951738 mon.node1 mon.0 10.193.56.230:6789/0 33660 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 07:01:03.954215 mon.node1 mon.0 10.193.56.230:6789/0 33661 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 07:06:03.949928 mon.node1 mon.0 10.193.56.230:6789/0 33740 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 07:06:03.949971 mon.node1 mon.0 10.193.56.230:6789/0 33741 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 07:06:03.950030 mon.node1 mon.0 10.193.56.230:6789/0 33742 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 07:06:03.950087 mon.node1 mon.0 10.193.56.230:6789/0 33743 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 07:11:03.950052 mon.node1 mon.0 10.193.56.230:6789/0 33805 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 07:11:03.950111 mon.node1 mon.0 10.193.56.230:6789/0 33806 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 07:11:03.950137 mon.node1 mon.0 10.193.56.230:6789/0 33807 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 07:11:03.950187 mon.node1 mon.0 10.193.56.230:6789/0 33808 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 07:16:03.950162 mon.node1 mon.0 10.193.56.230:6789/0 33873 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 07:16:03.950192 mon.node1 mon.0 10.193.56.230:6789/0 33874 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 07:16:03.950217 mon.node1 mon.0 10.193.56.230:6789/0 33875 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 07:16:03.950437 mon.node1 mon.0 10.193.56.230:6789/0 33876 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 07:21:03.950250 mon.node1 mon.0 10.193.56.230:6789/0 33944 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 07:21:03.950285 mon.node1 mon.0 10.193.56.230:6789/0 33945 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 07:21:03.950363 mon.node1 mon.0 10.193.56.230:6789/0 33946 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 07:21:03.954931 mon.node1 mon.0 10.193.56.230:6789/0 33947 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 07:26:03.950516 mon.node1 mon.0 10.193.56.230:6789/0 34008 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 07:26:03.950614 mon.node1 mon.0 10.193.56.230:6789/0 34009 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 07:26:03.950684 mon.node1 mon.0 10.193.56.230:6789/0 34010 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 07:26:03.950708 mon.node1 mon.0 10.193.56.230:6789/0 34011 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 07:31:03.950558 mon.node1 mon.0 10.193.56.230:6789/0 34064 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 07:31:03.950601 mon.node1 mon.0 10.193.56.230:6789/0 34065 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 07:31:03.950660 mon.node1 mon.0 10.193.56.230:6789/0 34066 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 07:31:03.956340 mon.node1 mon.0 10.193.56.230:6789/0 34067 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 07:36:03.950724 mon.node1 mon.0 10.193.56.230:6789/0 34120 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 07:36:03.950758 mon.node1 mon.0 10.193.56.230:6789/0 34121 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 07:36:03.950805 mon.node1 mon.0 10.193.56.230:6789/0 34122 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 07:36:03.952860 mon.node1 mon.0 10.193.56.230:6789/0 34123 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 07:41:03.950830 mon.node1 mon.0 10.193.56.230:6789/0 34192 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 07:41:03.950861 mon.node1 mon.0 10.193.56.230:6789/0 34193 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 07:41:03.950969 mon.node1 mon.0 10.193.56.230:6789/0 34194 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 07:41:03.951100 mon.node1 mon.0 10.193.56.230:6789/0 34195 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 07:46:03.950939 mon.node1 mon.0 10.193.56.230:6789/0 34266 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 07:46:03.951040 mon.node1 mon.0 10.193.56.230:6789/0 34267 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 07:46:03.951074 mon.node1 mon.0 10.193.56.230:6789/0 34268 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 07:46:03.951100 mon.node1 mon.0 10.193.56.230:6789/0 34269 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 07:51:03.951129 mon.node1 mon.0 10.193.56.230:6789/0 34347 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 07:51:03.951194 mon.node1 mon.0 10.193.56.230:6789/0 34348 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 07:51:03.951686 mon.node1 mon.0 10.193.56.230:6789/0 34349 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 07:51:03.953757 mon.node1 mon.0 10.193.56.230:6789/0 34350 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 07:56:03.951196 mon.node1 mon.0 10.193.56.230:6789/0 34405 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 07:56:03.951227 mon.node1 mon.0 10.193.56.230:6789/0 34406 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 07:56:03.951250 mon.node1 mon.0 10.193.56.230:6789/0 34407 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 07:56:03.951271 mon.node1 mon.0 10.193.56.230:6789/0 34408 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 08:00:00.000088 mon.node1 mon.0 10.193.56.230:6789/0 34464 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 08:01:03.951364 mon.node1 mon.0 10.193.56.230:6789/0 34473 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 08:01:03.951406 mon.node1 mon.0 10.193.56.230:6789/0 34474 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 08:01:03.952129 mon.node1 mon.0 10.193.56.230:6789/0 34475 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 08:01:03.952656 mon.node1 mon.0 10.193.56.230:6789/0 34476 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 08:06:03.951631 mon.node1 mon.0 10.193.56.230:6789/0 34528 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 08:06:03.951685 mon.node1 mon.0 10.193.56.230:6789/0 34529 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 08:06:03.951724 mon.node1 mon.0 10.193.56.230:6789/0 34530 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 08:06:03.951764 mon.node1 mon.0 10.193.56.230:6789/0 34531 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 08:11:03.951593 mon.node1 mon.0 10.193.56.230:6789/0 34607 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 08:11:03.951630 mon.node1 mon.0 10.193.56.230:6789/0 34608 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 08:11:03.951658 mon.node1 mon.0 10.193.56.230:6789/0 34609 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 08:11:03.954669 mon.node1 mon.0 10.193.56.230:6789/0 34610 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 08:16:03.956215 mon.node1 mon.0 10.193.56.230:6789/0 34658 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 08:16:03.956249 mon.node1 mon.0 10.193.56.230:6789/0 34659 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 08:16:03.956275 mon.node1 mon.0 10.193.56.230:6789/0 34660 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 08:16:03.956295 mon.node1 mon.0 10.193.56.230:6789/0 34661 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 08:21:03.951839 mon.node1 mon.0 10.193.56.230:6789/0 34731 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 08:21:03.951871 mon.node1 mon.0 10.193.56.230:6789/0 34732 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 08:21:03.951960 mon.node1 mon.0 10.193.56.230:6789/0 34733 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 08:21:03.951986 mon.node1 mon.0 10.193.56.230:6789/0 34734 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 08:26:03.951993 mon.node1 mon.0 10.193.56.230:6789/0 34793 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 08:26:03.952093 mon.node1 mon.0 10.193.56.230:6789/0 34794 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 08:26:03.952257 mon.node1 mon.0 10.193.56.230:6789/0 34795 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 08:26:03.952294 mon.node1 mon.0 10.193.56.230:6789/0 34796 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 08:31:03.960120 mon.node1 mon.0 10.193.56.230:6789/0 34847 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 08:31:03.961586 mon.node1 mon.0 10.193.56.230:6789/0 34848 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 08:31:03.961954 mon.node1 mon.0 10.193.56.230:6789/0 34849 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 08:31:03.962855 mon.node1 mon.0 10.193.56.230:6789/0 34850 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 08:36:03.952993 mon.node1 mon.0 10.193.56.230:6789/0 34918 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 08:36:03.953036 mon.node1 mon.0 10.193.56.230:6789/0 34919 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 08:36:03.953066 mon.node1 mon.0 10.193.56.230:6789/0 34920 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 08:36:03.953154 mon.node1 mon.0 10.193.56.230:6789/0 34921 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 08:41:03.953044 mon.node1 mon.0 10.193.56.230:6789/0 34983 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 08:41:03.953105 mon.node1 mon.0 10.193.56.230:6789/0 34984 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 08:41:03.953128 mon.node1 mon.0 10.193.56.230:6789/0 34985 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 08:41:03.953175 mon.node1 mon.0 10.193.56.230:6789/0 34986 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 08:46:03.953289 mon.node1 mon.0 10.193.56.230:6789/0 35048 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 08:46:03.953321 mon.node1 mon.0 10.193.56.230:6789/0 35049 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 08:46:03.953342 mon.node1 mon.0 10.193.56.230:6789/0 35050 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 08:46:03.953363 mon.node1 mon.0 10.193.56.230:6789/0 35051 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 08:51:03.953346 mon.node1 mon.0 10.193.56.230:6789/0 35123 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 08:51:03.953379 mon.node1 mon.0 10.193.56.230:6789/0 35124 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 08:51:03.953445 mon.node1 mon.0 10.193.56.230:6789/0 35125 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 08:51:03.953481 mon.node1 mon.0 10.193.56.230:6789/0 35126 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 08:56:03.953464 mon.node1 mon.0 10.193.56.230:6789/0 35185 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 08:56:03.953513 mon.node1 mon.0 10.193.56.230:6789/0 35186 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 08:56:03.953580 mon.node1 mon.0 10.193.56.230:6789/0 35187 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 08:56:03.953608 mon.node1 mon.0 10.193.56.230:6789/0 35188 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 09:00:00.000098 mon.node1 mon.0 10.193.56.230:6789/0 35242 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 09:01:03.953648 mon.node1 mon.0 10.193.56.230:6789/0 35257 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 09:01:03.953688 mon.node1 mon.0 10.193.56.230:6789/0 35258 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 09:01:03.953711 mon.node1 mon.0 10.193.56.230:6789/0 35259 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 09:01:03.953733 mon.node1 mon.0 10.193.56.230:6789/0 35260 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 09:06:03.953779 mon.node1 mon.0 10.193.56.230:6789/0 35318 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 09:06:03.953840 mon.node1 mon.0 10.193.56.230:6789/0 35319 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 09:06:03.953899 mon.node1 mon.0 10.193.56.230:6789/0 35320 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 09:06:03.953928 mon.node1 mon.0 10.193.56.230:6789/0 35321 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 09:11:03.953909 mon.node1 mon.0 10.193.56.230:6789/0 35390 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 09:11:03.953939 mon.node1 mon.0 10.193.56.230:6789/0 35391 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 09:11:03.953961 mon.node1 mon.0 10.193.56.230:6789/0 35392 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 09:11:03.955773 mon.node1 mon.0 10.193.56.230:6789/0 35393 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 09:16:03.954128 mon.node1 mon.0 10.193.56.230:6789/0 35457 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 09:16:03.954171 mon.node1 mon.0 10.193.56.230:6789/0 35458 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 09:16:03.954200 mon.node1 mon.0 10.193.56.230:6789/0 35459 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 09:16:03.954227 mon.node1 mon.0 10.193.56.230:6789/0 35460 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 09:21:03.954168 mon.node1 mon.0 10.193.56.230:6789/0 35527 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 09:21:03.954198 mon.node1 mon.0 10.193.56.230:6789/0 35528 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 09:21:03.954221 mon.node1 mon.0 10.193.56.230:6789/0 35529 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 09:21:03.954242 mon.node1 mon.0 10.193.56.230:6789/0 35530 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 09:26:03.954326 mon.node1 mon.0 10.193.56.230:6789/0 35595 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 09:26:03.954380 mon.node1 mon.0 10.193.56.230:6789/0 35596 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 09:26:03.954404 mon.node1 mon.0 10.193.56.230:6789/0 35597 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 09:26:03.954456 mon.node1 mon.0 10.193.56.230:6789/0 35598 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 09:31:03.954391 mon.node1 mon.0 10.193.56.230:6789/0 35657 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 09:31:03.954436 mon.node1 mon.0 10.193.56.230:6789/0 35658 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 09:31:03.954460 mon.node1 mon.0 10.193.56.230:6789/0 35659 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 09:31:03.954490 mon.node1 mon.0 10.193.56.230:6789/0 35660 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 09:36:03.954590 mon.node1 mon.0 10.193.56.230:6789/0 35716 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 09:36:03.954626 mon.node1 mon.0 10.193.56.230:6789/0 35717 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 09:36:03.954651 mon.node1 mon.0 10.193.56.230:6789/0 35718 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 09:36:03.954672 mon.node1 mon.0 10.193.56.230:6789/0 35719 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 09:41:03.954720 mon.node1 mon.0 10.193.56.230:6789/0 35784 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 09:41:03.954752 mon.node1 mon.0 10.193.56.230:6789/0 35785 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 09:41:03.954771 mon.node1 mon.0 10.193.56.230:6789/0 35786 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 09:41:03.954914 mon.node1 mon.0 10.193.56.230:6789/0 35787 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 09:46:03.954849 mon.node1 mon.0 10.193.56.230:6789/0 35848 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 09:46:03.955113 mon.node1 mon.0 10.193.56.230:6789/0 35849 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 09:46:03.955298 mon.node1 mon.0 10.193.56.230:6789/0 35850 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 09:46:03.955900 mon.node1 mon.0 10.193.56.230:6789/0 35851 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 09:51:03.954915 mon.node1 mon.0 10.193.56.230:6789/0 35926 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 09:51:03.955008 mon.node1 mon.0 10.193.56.230:6789/0 35927 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 09:51:03.955033 mon.node1 mon.0 10.193.56.230:6789/0 35928 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 09:51:03.955318 mon.node1 mon.0 10.193.56.230:6789/0 35929 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 09:56:03.955067 mon.node1 mon.0 10.193.56.230:6789/0 35984 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 09:56:03.955102 mon.node1 mon.0 10.193.56.230:6789/0 35985 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 09:56:03.955154 mon.node1 mon.0 10.193.56.230:6789/0 35986 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 09:56:03.955541 mon.node1 mon.0 10.193.56.230:6789/0 35987 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 10:00:00.000092 mon.node1 mon.0 10.193.56.230:6789/0 36041 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 10:01:03.955213 mon.node1 mon.0 10.193.56.230:6789/0 36057 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 10:01:03.955263 mon.node1 mon.0 10.193.56.230:6789/0 36058 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 10:01:03.955289 mon.node1 mon.0 10.193.56.230:6789/0 36059 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 10:01:03.955349 mon.node1 mon.0 10.193.56.230:6789/0 36060 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 10:06:03.955340 mon.node1 mon.0 10.193.56.230:6789/0 36124 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 10:06:03.955377 mon.node1 mon.0 10.193.56.230:6789/0 36125 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 10:06:03.955405 mon.node1 mon.0 10.193.56.230:6789/0 36126 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 10:06:03.955536 mon.node1 mon.0 10.193.56.230:6789/0 36127 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 10:11:03.955891 mon.node1 mon.0 10.193.56.230:6789/0 36188 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 10:11:03.956051 mon.node1 mon.0 10.193.56.230:6789/0 36189 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 10:11:03.956486 mon.node1 mon.0 10.193.56.230:6789/0 36190 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 10:11:03.958619 mon.node1 mon.0 10.193.56.230:6789/0 36191 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 10:16:03.955655 mon.node1 mon.0 10.193.56.230:6789/0 36252 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 10:16:03.955704 mon.node1 mon.0 10.193.56.230:6789/0 36253 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 10:16:03.955776 mon.node1 mon.0 10.193.56.230:6789/0 36254 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 10:16:03.956442 mon.node1 mon.0 10.193.56.230:6789/0 36255 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 10:21:03.956084 mon.node1 mon.0 10.193.56.230:6789/0 36317 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 10:21:03.956138 mon.node1 mon.0 10.193.56.230:6789/0 36318 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 10:21:03.956844 mon.node1 mon.0 10.193.56.230:6789/0 36319 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 10:21:03.957343 mon.node1 mon.0 10.193.56.230:6789/0 36320 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 10:26:03.955901 mon.node1 mon.0 10.193.56.230:6789/0 36373 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 10:26:03.956324 mon.node1 mon.0 10.193.56.230:6789/0 36374 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 10:26:03.958030 mon.node1 mon.0 10.193.56.230:6789/0 36375 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 10:26:03.958297 mon.node1 mon.0 10.193.56.230:6789/0 36376 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 10:31:03.956106 mon.node1 mon.0 10.193.56.230:6789/0 36449 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 10:31:03.956136 mon.node1 mon.0 10.193.56.230:6789/0 36450 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 10:31:03.956650 mon.node1 mon.0 10.193.56.230:6789/0 36451 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 10:31:03.958309 mon.node1 mon.0 10.193.56.230:6789/0 36452 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 10:36:03.956106 mon.node1 mon.0 10.193.56.230:6789/0 36515 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 10:36:03.956142 mon.node1 mon.0 10.193.56.230:6789/0 36516 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 10:36:03.956198 mon.node1 mon.0 10.193.56.230:6789/0 36517 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 10:36:03.961073 mon.node1 mon.0 10.193.56.230:6789/0 36518 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 10:41:03.956219 mon.node1 mon.0 10.193.56.230:6789/0 36587 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 10:41:03.956269 mon.node1 mon.0 10.193.56.230:6789/0 36588 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 10:41:03.956326 mon.node1 mon.0 10.193.56.230:6789/0 36589 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 10:41:03.956502 mon.node1 mon.0 10.193.56.230:6789/0 36590 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 10:46:03.956541 mon.node1 mon.0 10.193.56.230:6789/0 36659 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 10:46:03.956595 mon.node1 mon.0 10.193.56.230:6789/0 36660 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 10:46:03.956637 mon.node1 mon.0 10.193.56.230:6789/0 36661 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 10:46:03.956762 mon.node1 mon.0 10.193.56.230:6789/0 36662 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 10:51:03.956480 mon.node1 mon.0 10.193.56.230:6789/0 36717 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 10:51:03.956546 mon.node1 mon.0 10.193.56.230:6789/0 36718 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 10:51:03.956592 mon.node1 mon.0 10.193.56.230:6789/0 36719 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 10:51:03.956774 mon.node1 mon.0 10.193.56.230:6789/0 36720 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 10:56:03.956629 mon.node1 mon.0 10.193.56.230:6789/0 36781 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 10:56:03.956660 mon.node1 mon.0 10.193.56.230:6789/0 36782 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 10:56:03.956679 mon.node1 mon.0 10.193.56.230:6789/0 36783 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 10:56:03.956697 mon.node1 mon.0 10.193.56.230:6789/0 36784 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 11:00:00.000073 mon.node1 mon.0 10.193.56.230:6789/0 36842 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 11:01:03.956867 mon.node1 mon.0 10.193.56.230:6789/0 36856 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 11:01:03.956902 mon.node1 mon.0 10.193.56.230:6789/0 36857 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 11:01:03.956926 mon.node1 mon.0 10.193.56.230:6789/0 36858 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 11:01:03.956947 mon.node1 mon.0 10.193.56.230:6789/0 36859 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 11:06:03.957016 mon.node1 mon.0 10.193.56.230:6789/0 36926 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 11:06:03.957066 mon.node1 mon.0 10.193.56.230:6789/0 36927 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 11:06:03.957210 mon.node1 mon.0 10.193.56.230:6789/0 36928 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 11:06:03.957283 mon.node1 mon.0 10.193.56.230:6789/0 36929 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 11:11:03.957103 mon.node1 mon.0 10.193.56.230:6789/0 36993 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 11:11:03.957159 mon.node1 mon.0 10.193.56.230:6789/0 36994 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 11:11:03.957183 mon.node1 mon.0 10.193.56.230:6789/0 36995 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 11:11:03.957204 mon.node1 mon.0 10.193.56.230:6789/0 36996 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 11:11:04.134868 mon.node1 mon.0 10.193.56.230:6789/0 36997 : cluster [INF] osd.6 marked itself down 2017-12-18 11:11:04.135200 mon.node1 mon.0 10.193.56.230:6789/0 36998 : cluster [INF] osd.30 marked itself down 2017-12-18 11:11:04.135295 mon.node1 mon.0 10.193.56.230:6789/0 36999 : cluster [INF] osd.88 marked itself down 2017-12-18 11:11:04.135357 mon.node1 mon.0 10.193.56.230:6789/0 37000 : cluster [INF] osd.113 marked itself down 2017-12-18 11:11:04.135522 mon.node1 mon.0 10.193.56.230:6789/0 37001 : cluster [INF] osd.10 marked itself down 2017-12-18 11:11:04.135557 mon.node1 mon.0 10.193.56.230:6789/0 37002 : cluster [INF] osd.25 marked itself down 2017-12-18 11:11:04.135630 mon.node1 mon.0 10.193.56.230:6789/0 37003 : cluster [INF] osd.93 marked itself down 2017-12-18 11:11:04.135681 mon.node1 mon.0 10.193.56.230:6789/0 37004 : cluster [INF] osd.50 marked itself down 2017-12-18 11:11:04.135723 mon.node1 mon.0 10.193.56.230:6789/0 37005 : cluster [INF] osd.65 marked itself down 2017-12-18 11:11:04.135826 mon.node1 mon.0 10.193.56.230:6789/0 37006 : cluster [INF] osd.80 marked itself down 2017-12-18 11:11:04.135911 mon.node1 mon.0 10.193.56.230:6789/0 37007 : cluster [INF] osd.40 marked itself down 2017-12-18 11:11:04.135974 mon.node1 mon.0 10.193.56.230:6789/0 37008 : cluster [INF] osd.108 marked itself down 2017-12-18 11:11:04.136087 mon.node1 mon.0 10.193.56.230:6789/0 37009 : cluster [INF] osd.75 marked itself down 2017-12-18 11:11:04.136152 mon.node1 mon.0 10.193.56.230:6789/0 37010 : cluster [INF] osd.15 marked itself down 2017-12-18 11:11:04.136211 mon.node1 mon.0 10.193.56.230:6789/0 37011 : cluster [INF] osd.4 marked itself down 2017-12-18 11:11:04.136354 mon.node1 mon.0 10.193.56.230:6789/0 37012 : cluster [INF] osd.103 marked itself down 2017-12-18 11:11:04.136509 mon.node1 mon.0 10.193.56.230:6789/0 37013 : cluster [INF] osd.20 marked itself down 2017-12-18 11:11:04.136556 mon.node1 mon.0 10.193.56.230:6789/0 37014 : cluster [INF] osd.35 marked itself down 2017-12-18 11:11:04.136660 mon.node1 mon.0 10.193.56.230:6789/0 37015 : cluster [INF] osd.60 marked itself down 2017-12-18 11:11:04.136746 mon.node1 mon.0 10.193.56.230:6789/0 37016 : cluster [INF] osd.84 marked itself down 2017-12-18 11:11:04.136796 mon.node1 mon.0 10.193.56.230:6789/0 37017 : cluster [INF] osd.55 marked itself down 2017-12-18 11:11:04.136878 mon.node1 mon.0 10.193.56.230:6789/0 37018 : cluster [INF] osd.70 marked itself down 2017-12-18 11:11:04.136981 mon.node1 mon.0 10.193.56.230:6789/0 37019 : cluster [INF] osd.98 marked itself down 2017-12-18 11:11:04.137039 mon.node1 mon.0 10.193.56.230:6789/0 37020 : cluster [INF] osd.45 marked itself down 2017-12-18 11:11:05.067672 mon.node1 mon.0 10.193.56.230:6789/0 37021 : cluster [WRN] Health check failed: 24 osds down (OSD_DOWN) 2017-12-18 11:11:05.067697 mon.node1 mon.0 10.193.56.230:6789/0 37022 : cluster [WRN] Health check failed: 1 host (24 osds) down (OSD_HOST_DOWN) 2017-12-18 11:11:05.200953 mon.node1 mon.0 10.193.56.230:6789/0 37085 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; 24 osds down; 1 host (24 osds) down; application not enabled on 10 pool(s) 2017-12-18 11:11:07.124807 mon.node1 mon.0 10.193.56.230:6789/0 37264 : cluster [WRN] Health check failed: Reduced data availability: 31 pgs inactive, 592 pgs peering (PG_AVAILABILITY) 2017-12-18 11:11:07.124851 mon.node1 mon.0 10.193.56.230:6789/0 37265 : cluster [WRN] Health check failed: Degraded data redundancy: 242754/72879360 objects degraded (0.333%), 934 pgs unclean, 340 pgs degraded (PG_DEGRADED) 2017-12-18 11:11:09.122425 mon.node1 mon.0 10.193.56.230:6789/0 37388 : cluster [INF] osd.1 marked itself down 2017-12-18 11:11:09.122515 mon.node1 mon.0 10.193.56.230:6789/0 37389 : cluster [INF] osd.43 marked itself down 2017-12-18 11:11:09.122585 mon.node1 mon.0 10.193.56.230:6789/0 37390 : cluster [INF] osd.78 marked itself down 2017-12-18 11:11:09.122716 mon.node1 mon.0 10.193.56.230:6789/0 37391 : cluster [INF] osd.63 marked itself down 2017-12-18 11:11:09.122777 mon.node1 mon.0 10.193.56.230:6789/0 37392 : cluster [INF] osd.34 marked itself down 2017-12-18 11:11:09.122826 mon.node1 mon.0 10.193.56.230:6789/0 37393 : cluster [INF] osd.24 marked itself down 2017-12-18 11:11:09.122872 mon.node1 mon.0 10.193.56.230:6789/0 37394 : cluster [INF] osd.87 marked itself down 2017-12-18 11:11:09.122934 mon.node1 mon.0 10.193.56.230:6789/0 37395 : cluster [INF] osd.38 marked itself down 2017-12-18 11:11:09.122982 mon.node1 mon.0 10.193.56.230:6789/0 37396 : cluster [INF] osd.82 marked itself down 2017-12-18 11:11:09.123104 mon.node1 mon.0 10.193.56.230:6789/0 37397 : cluster [INF] osd.58 marked itself down 2017-12-18 11:11:09.123579 mon.node1 mon.0 10.193.56.230:6789/0 37398 : cluster [INF] osd.53 marked itself down 2017-12-18 11:11:09.123708 mon.node1 mon.0 10.193.56.230:6789/0 37399 : cluster [INF] osd.92 marked itself down 2017-12-18 11:11:09.123757 mon.node1 mon.0 10.193.56.230:6789/0 37400 : cluster [INF] osd.107 marked itself down 2017-12-18 11:11:09.123800 mon.node1 mon.0 10.193.56.230:6789/0 37401 : cluster [INF] osd.97 marked itself down 2017-12-18 11:11:09.123847 mon.node1 mon.0 10.193.56.230:6789/0 37402 : cluster [INF] osd.9 marked itself down 2017-12-18 11:11:09.123888 mon.node1 mon.0 10.193.56.230:6789/0 37403 : cluster [INF] osd.18 marked itself down 2017-12-18 11:11:09.123930 mon.node1 mon.0 10.193.56.230:6789/0 37404 : cluster [INF] osd.102 marked itself down 2017-12-18 11:11:09.123976 mon.node1 mon.0 10.193.56.230:6789/0 37405 : cluster [INF] osd.117 marked itself down 2017-12-18 11:11:09.124024 mon.node1 mon.0 10.193.56.230:6789/0 37406 : cluster [INF] osd.29 marked itself down 2017-12-18 11:11:09.124077 mon.node1 mon.0 10.193.56.230:6789/0 37407 : cluster [INF] osd.73 marked itself down 2017-12-18 11:11:09.124130 mon.node1 mon.0 10.193.56.230:6789/0 37408 : cluster [INF] osd.14 marked itself down 2017-12-18 11:11:09.124180 mon.node1 mon.0 10.193.56.230:6789/0 37409 : cluster [INF] osd.112 marked itself down 2017-12-18 11:11:09.124231 mon.node1 mon.0 10.193.56.230:6789/0 37410 : cluster [INF] osd.48 marked itself down 2017-12-18 11:11:09.124281 mon.node1 mon.0 10.193.56.230:6789/0 37411 : cluster [INF] osd.68 marked itself down 2017-12-18 11:11:09.282597 mon.node1 mon.0 10.193.56.230:6789/0 37412 : cluster [INF] osd.113 10.193.56.230:6869/25884 boot 2017-12-18 11:11:09.282711 mon.node1 mon.0 10.193.56.230:6789/0 37413 : cluster [INF] osd.108 10.193.56.230:6881/25896 boot 2017-12-18 11:11:10.811846 mon.node1 mon.0 10.193.56.230:6789/0 37654 : cluster [WRN] Health check update: 46 osds down (OSD_DOWN) 2017-12-18 11:11:12.812312 mon.node1 mon.0 10.193.56.230:6789/0 37776 : cluster [WRN] Health check update: Reduced data availability: 38 pgs inactive, 505 pgs down, 477 pgs peering (PG_AVAILABILITY) 2017-12-18 11:11:12.812370 mon.node1 mon.0 10.193.56.230:6789/0 37777 : cluster [WRN] Health check update: Degraded data redundancy: 8561834/72879360 objects degraded (11.748%), 3241 pgs unclean, 2257 pgs degraded (PG_DEGRADED) 2017-12-18 11:11:13.754820 mon.node1 mon.0 10.193.56.230:6789/0 37779 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (24 osds) down) 2017-12-18 11:11:13.787837 mon.node1 mon.0 10.193.56.230:6789/0 37780 : cluster [INF] osd.112 10.193.56.231:6872/24725 boot 2017-12-18 11:11:14.744203 mon.node1 mon.0 10.193.56.230:6789/0 37901 : cluster [INF] osd.3 marked itself down 2017-12-18 11:11:14.744284 mon.node1 mon.0 10.193.56.230:6789/0 37902 : cluster [INF] osd.94 marked itself down 2017-12-18 11:11:14.744345 mon.node1 mon.0 10.193.56.230:6789/0 37903 : cluster [INF] osd.76 marked itself down 2017-12-18 11:11:14.744458 mon.node1 mon.0 10.193.56.230:6789/0 37904 : cluster [INF] osd.72 marked itself down 2017-12-18 11:11:14.744513 mon.node1 mon.0 10.193.56.230:6789/0 37905 : cluster [INF] osd.41 marked itself down 2017-12-18 11:11:14.744566 mon.node1 mon.0 10.193.56.230:6789/0 37906 : cluster [INF] osd.67 marked itself down 2017-12-18 11:11:14.744630 mon.node1 mon.0 10.193.56.230:6789/0 37907 : cluster [INF] osd.118 marked itself down 2017-12-18 11:11:14.744694 mon.node1 mon.0 10.193.56.230:6789/0 37908 : cluster [INF] osd.57 marked itself down 2017-12-18 11:11:14.744850 mon.node1 mon.0 10.193.56.230:6789/0 37909 : cluster [INF] osd.62 marked itself down 2017-12-18 11:11:14.744956 mon.node1 mon.0 10.193.56.230:6789/0 37910 : cluster [INF] osd.12 marked itself down 2017-12-18 11:11:14.745040 mon.node1 mon.0 10.193.56.230:6789/0 37911 : cluster [INF] osd.36 marked itself down 2017-12-18 11:11:14.745118 mon.node1 mon.0 10.193.56.230:6789/0 37912 : cluster [INF] osd.27 marked itself down 2017-12-18 11:11:14.745183 mon.node1 mon.0 10.193.56.230:6789/0 37913 : cluster [INF] osd.99 marked itself down 2017-12-18 11:11:14.745235 mon.node1 mon.0 10.193.56.230:6789/0 37914 : cluster [INF] osd.32 marked itself down 2017-12-18 11:11:14.745364 mon.node1 mon.0 10.193.56.230:6789/0 37915 : cluster [INF] osd.52 marked itself down 2017-12-18 11:11:14.745437 mon.node1 mon.0 10.193.56.230:6789/0 37916 : cluster [INF] osd.114 marked itself down 2017-12-18 11:11:14.745520 mon.node1 mon.0 10.193.56.230:6789/0 37917 : cluster [INF] osd.17 marked itself down 2017-12-18 11:11:14.745585 mon.node1 mon.0 10.193.56.230:6789/0 37918 : cluster [INF] osd.7 marked itself down 2017-12-18 11:11:14.745664 mon.node1 mon.0 10.193.56.230:6789/0 37919 : cluster [INF] osd.104 marked itself down 2017-12-18 11:11:14.745746 mon.node1 mon.0 10.193.56.230:6789/0 37920 : cluster [INF] osd.109 marked itself down 2017-12-18 11:11:14.745833 mon.node1 mon.0 10.193.56.230:6789/0 37921 : cluster [INF] osd.89 marked itself down 2017-12-18 11:11:14.745919 mon.node1 mon.0 10.193.56.230:6789/0 37922 : cluster [INF] osd.46 marked itself down 2017-12-18 11:11:14.747077 mon.node1 mon.0 10.193.56.230:6789/0 37923 : cluster [INF] osd.22 marked itself down 2017-12-18 11:11:14.872953 mon.node1 mon.0 10.193.56.230:6789/0 37924 : cluster [WRN] Health check failed: 1 host (23 osds) down (OSD_HOST_DOWN) 2017-12-18 11:11:15.942002 mon.node1 mon.0 10.193.56.230:6789/0 38046 : cluster [WRN] Health check update: 67 osds down (OSD_DOWN) 2017-12-18 11:11:15.974176 mon.node1 mon.0 10.193.56.230:6789/0 38047 : cluster [INF] osd.117 10.193.56.231:6892/25462 boot 2017-12-18 11:11:18.873683 mon.node1 mon.0 10.193.56.230:6789/0 38171 : cluster [WRN] Health check update: Reduced data availability: 16 pgs inactive, 3039 pgs down, 27 pgs peering (PG_AVAILABILITY) 2017-12-18 11:11:18.873729 mon.node1 mon.0 10.193.56.230:6789/0 38172 : cluster [WRN] Health check update: Degraded data redundancy: 145086/72879360 objects degraded (0.199%), 3489 pgs unclean, 518 pgs degraded (PG_DEGRADED) 2017-12-18 11:11:18.970058 mon.node1 mon.0 10.193.56.230:6789/0 38173 : cluster [INF] osd.116 marked itself down 2017-12-18 11:11:18.970149 mon.node1 mon.0 10.193.56.230:6789/0 38174 : cluster [INF] osd.96 marked itself down 2017-12-18 11:11:18.970210 mon.node1 mon.0 10.193.56.230:6789/0 38175 : cluster [INF] osd.16 marked itself down 2017-12-18 11:11:18.970304 mon.node1 mon.0 10.193.56.230:6789/0 38176 : cluster [INF] osd.106 marked itself down 2017-12-18 11:11:18.970404 mon.node1 mon.0 10.193.56.230:6789/0 38177 : cluster [INF] osd.11 marked itself down 2017-12-18 11:11:18.970455 mon.node1 mon.0 10.193.56.230:6789/0 38178 : cluster [INF] osd.64 marked itself down 2017-12-18 11:11:18.970508 mon.node1 mon.0 10.193.56.230:6789/0 38179 : cluster [INF] osd.0 marked itself down 2017-12-18 11:11:18.970582 mon.node1 mon.0 10.193.56.230:6789/0 38180 : cluster [INF] osd.111 marked itself down 2017-12-18 11:11:18.970628 mon.node1 mon.0 10.193.56.230:6789/0 38181 : cluster [INF] osd.26 marked itself down 2017-12-18 11:11:18.970696 mon.node1 mon.0 10.193.56.230:6789/0 38182 : cluster [INF] osd.83 marked itself down 2017-12-18 11:11:18.970751 mon.node1 mon.0 10.193.56.230:6789/0 38183 : cluster [INF] osd.5 marked itself down 2017-12-18 11:11:18.970809 mon.node1 mon.0 10.193.56.230:6789/0 38184 : cluster [INF] osd.54 marked itself down 2017-12-18 11:11:18.970883 mon.node1 mon.0 10.193.56.230:6789/0 38185 : cluster [INF] osd.86 marked itself down 2017-12-18 11:11:18.970922 mon.node1 mon.0 10.193.56.230:6789/0 38186 : cluster [INF] osd.101 marked itself down 2017-12-18 11:11:18.970985 mon.node1 mon.0 10.193.56.230:6789/0 38187 : cluster [INF] osd.39 marked itself down 2017-12-18 11:11:18.971032 mon.node1 mon.0 10.193.56.230:6789/0 38188 : cluster [INF] osd.21 marked itself down 2017-12-18 11:11:18.971084 mon.node1 mon.0 10.193.56.230:6789/0 38189 : cluster [INF] osd.49 marked itself down 2017-12-18 11:11:19.669092 mon.node1 mon.0 10.193.56.230:6789/0 38191 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (23 osds) down) 2017-12-18 11:11:19.698558 mon.node1 mon.0 10.193.56.230:6789/0 38192 : cluster [INF] osd.94 10.193.56.232:6868/10140 boot 2017-12-18 11:11:19.698945 mon.node1 mon.0 10.193.56.230:6789/0 38193 : cluster [INF] osd.84 10.193.56.230:6837/25606 boot 2017-12-18 11:11:20.874238 mon.node1 mon.0 10.193.56.230:6789/0 38436 : cluster [INF] osd.80 10.193.56.230:6841/25873 boot 2017-12-18 11:11:20.874304 mon.node1 mon.0 10.193.56.230:6789/0 38437 : cluster [INF] osd.93 10.193.56.230:6813/25411 boot 2017-12-18 11:11:22.880493 mon.node1 mon.0 10.193.56.230:6789/0 38799 : cluster [WRN] Health check update: 80 osds down (OSD_DOWN) 2017-12-18 11:11:22.936712 mon.node1 mon.0 10.193.56.230:6789/0 38803 : cluster [INF] osd.91 failed (root=hci_default,host=node4) (connection refused reported by osd.84) 2017-12-18 11:11:23.242631 mon.node1 mon.0 10.193.56.230:6789/0 38825 : cluster [INF] osd.103 10.193.56.230:6873/25902 boot 2017-12-18 11:11:23.242732 mon.node1 mon.0 10.193.56.230:6789/0 38826 : cluster [INF] osd.4 10.193.56.230:6861/25625 boot 2017-12-18 11:11:23.243256 mon.node1 mon.0 10.193.56.230:6789/0 38827 : cluster [INF] osd.6 10.193.56.230:6817/25407 boot 2017-12-18 11:11:23.243692 mon.node1 mon.0 10.193.56.230:6789/0 38829 : cluster [INF] osd.44 failed (root=hci_default,host=node4) (connection refused reported by osd.37) 2017-12-18 11:11:23.245355 mon.node1 mon.0 10.193.56.230:6789/0 38850 : cluster [INF] osd.59 failed (root=hci_default,host=node4) (connection refused reported by osd.33) 2017-12-18 11:11:23.253541 mon.node1 mon.0 10.193.56.230:6789/0 38868 : cluster [INF] osd.69 failed (root=hci_default,host=node4) (connection refused reported by osd.66) 2017-12-18 11:11:23.260378 mon.node1 mon.0 10.193.56.230:6789/0 38896 : cluster [INF] osd.31 failed (root=hci_default,host=node4) (connection refused reported by osd.33) 2017-12-18 11:11:23.982198 mon.node1 mon.0 10.193.56.230:6789/0 39067 : cluster [INF] osd.47 marked itself down 2017-12-18 11:11:23.982282 mon.node1 mon.0 10.193.56.230:6789/0 39068 : cluster [INF] osd.56 marked itself down 2017-12-18 11:11:24.309886 mon.node1 mon.0 10.193.56.230:6789/0 39074 : cluster [INF] osd.25 10.193.56.230:6821/25555 boot 2017-12-18 11:11:24.310341 mon.node1 mon.0 10.193.56.230:6789/0 39075 : cluster [INF] osd.111 10.193.56.233:6883/29070 boot 2017-12-18 11:11:24.310502 mon.node1 mon.0 10.193.56.230:6789/0 39076 : cluster [INF] osd.116 10.193.56.233:6880/29090 boot 2017-12-18 11:11:24.310570 mon.node1 mon.0 10.193.56.230:6789/0 39077 : cluster [INF] osd.14 10.193.56.231:6844/24693 boot 2017-12-18 11:11:24.310888 mon.node1 mon.0 10.193.56.230:6789/0 39078 : cluster [INF] osd.30 10.193.56.230:6809/25378 boot 2017-12-18 11:11:24.310940 mon.node1 mon.0 10.193.56.230:6789/0 39079 : cluster [INF] osd.20 10.193.56.230:6833/25617 boot 2017-12-18 11:11:24.880883 mon.node1 mon.0 10.193.56.230:6789/0 39204 : cluster [WRN] Health check update: Reduced data availability: 10 pgs inactive, 3065 pgs down, 19 pgs peering (PG_AVAILABILITY) 2017-12-18 11:11:24.880913 mon.node1 mon.0 10.193.56.230:6789/0 39205 : cluster [WRN] Health check update: Degraded data redundancy: 34860/72879360 objects degraded (0.048%), 3523 pgs unclean, 570 pgs degraded (PG_DEGRADED) 2017-12-18 11:11:25.411914 mon.node1 mon.0 10.193.56.230:6789/0 39209 : cluster [INF] osd.87 10.193.56.231:6804/24271 boot 2017-12-18 11:11:25.412012 mon.node1 mon.0 10.193.56.230:6789/0 39210 : cluster [INF] osd.88 10.193.56.230:6877/25881 boot 2017-12-18 11:11:25.412110 mon.node1 mon.0 10.193.56.230:6789/0 39211 : cluster [INF] osd.45 10.193.56.230:6801/25305 boot 2017-12-18 11:11:25.412241 mon.node1 mon.0 10.193.56.230:6789/0 39212 : cluster [INF] osd.40 10.193.56.230:6805/25365 boot 2017-12-18 11:11:25.412303 mon.node1 mon.0 10.193.56.230:6789/0 39213 : cluster [INF] osd.68 10.193.56.231:6816/24142 boot 2017-12-18 11:11:25.412344 mon.node1 mon.0 10.193.56.230:6789/0 39214 : cluster [INF] osd.10 10.193.56.230:6884/25916 boot 2017-12-18 11:11:25.470668 mon.node1 mon.0 10.193.56.230:6789/0 39336 : cluster [INF] osd.61 failed (root=hci_default,host=node5) (connection refused reported by osd.25) 2017-12-18 11:11:25.631773 mon.node1 mon.0 10.193.56.230:6789/0 39464 : cluster [INF] osd.77 failed (root=hci_default,host=node5) (connection refused reported by osd.40) 2017-12-18 11:11:26.086040 mon.node1 mon.0 10.193.56.230:6789/0 39475 : cluster [INF] osd.28 failed (root=hci_default,host=node5) (connection refused reported by osd.14) 2017-12-18 11:11:26.180128 mon.node1 mon.0 10.193.56.230:6789/0 39497 : cluster [INF] osd.23 failed (root=hci_default,host=node5) (connection refused reported by osd.20) 2017-12-18 11:11:26.246711 mon.node1 mon.0 10.193.56.230:6789/0 39512 : cluster [INF] osd.42 failed (root=hci_default,host=node5) (connection refused reported by osd.20) 2017-12-18 11:11:26.253168 mon.node1 mon.0 10.193.56.230:6789/0 39517 : cluster [INF] osd.100 failed (root=hci_default,host=node5) (connection refused reported by osd.84) 2017-12-18 11:11:26.317265 mon.node1 mon.0 10.193.56.230:6789/0 39554 : cluster [INF] osd.105 failed (root=hci_default,host=node5) (connection refused reported by osd.84) 2017-12-18 11:11:26.615283 mon.node1 mon.0 10.193.56.230:6789/0 39612 : cluster [INF] osd.1 10.193.56.231:6873/24708 boot 2017-12-18 11:11:26.615364 mon.node1 mon.0 10.193.56.230:6789/0 39613 : cluster [INF] osd.102 10.193.56.231:6868/24391 boot 2017-12-18 11:11:26.615721 mon.node1 mon.0 10.193.56.230:6789/0 39614 : cluster [INF] osd.82 10.193.56.231:6880/24906 boot 2017-12-18 11:11:26.615978 mon.node1 mon.0 10.193.56.230:6789/0 39615 : cluster [INF] osd.98 10.193.56.230:6888/25906 boot 2017-12-18 11:11:26.616039 mon.node1 mon.0 10.193.56.230:6789/0 39616 : cluster [INF] osd.107 10.193.56.231:6814/24388 boot 2017-12-18 11:11:26.616096 mon.node1 mon.0 10.193.56.230:6789/0 39617 : cluster [INF] osd.92 10.193.56.231:6864/24701 boot 2017-12-18 11:11:26.616155 mon.node1 mon.0 10.193.56.230:6789/0 39618 : cluster [INF] osd.48 10.193.56.231:6860/24697 boot 2017-12-18 11:11:26.616993 mon.node1 mon.0 10.193.56.230:6789/0 39620 : cluster [INF] osd.33 failed (root=hci_default,host=node5) (connection refused reported by osd.14) 2017-12-18 11:11:26.704525 mon.node1 mon.0 10.193.56.230:6789/0 39757 : cluster [INF] osd.8 failed (root=hci_default,host=node5) (connection refused reported by osd.4) 2017-12-18 11:11:26.748395 mon.node1 mon.0 10.193.56.230:6789/0 39779 : cluster [INF] osd.95 failed (root=hci_default,host=node5) (connection refused reported by osd.87) 2017-12-18 11:11:26.778117 mon.node1 mon.0 10.193.56.230:6789/0 39802 : cluster [INF] osd.110 failed (root=hci_default,host=node5) (connection refused reported by osd.111) 2017-12-18 11:11:26.863112 mon.node1 mon.0 10.193.56.230:6789/0 39832 : cluster [INF] osd.115 failed (root=hci_default,host=node5) (connection refused reported by osd.112) 2017-12-18 11:11:26.963243 mon.node1 mon.0 10.193.56.230:6789/0 39879 : cluster [INF] osd.66 failed (root=hci_default,host=node5) (connection refused reported by osd.25) 2017-12-18 11:11:26.981757 mon.node1 mon.0 10.193.56.230:6789/0 39892 : cluster [INF] osd.71 failed (root=hci_default,host=node5) (connection refused reported by osd.48) 2017-12-18 11:11:27.276221 mon.node1 mon.0 10.193.56.230:6789/0 39935 : cluster [INF] osd.19 failed (root=hci_default,host=node5) (connection refused reported by osd.14) 2017-12-18 11:11:27.440689 mon.node1 mon.0 10.193.56.230:6789/0 39958 : cluster [INF] osd.37 failed (root=hci_default,host=node5) (connection refused reported by osd.4) 2017-12-18 11:11:27.556393 mon.node1 mon.0 10.193.56.230:6789/0 39975 : cluster [INF] osd.90 failed (root=hci_default,host=node5) (connection refused reported by osd.84) 2017-12-18 11:11:27.678896 mon.node1 mon.0 10.193.56.230:6789/0 39995 : cluster [INF] osd.55 10.193.56.230:6845/25233 boot 2017-12-18 11:11:27.679282 mon.node1 mon.0 10.193.56.230:6789/0 39996 : cluster [INF] osd.29 10.193.56.231:6820/24300 boot 2017-12-18 11:11:27.679718 mon.node1 mon.0 10.193.56.230:6789/0 39997 : cluster [INF] osd.58 10.193.56.231:6848/24904 boot 2017-12-18 11:11:27.953357 mon.node1 mon.0 10.193.56.230:6789/0 40121 : cluster [INF] osd.85 failed (root=hci_default,host=node5) (connection refused reported by osd.84) 2017-12-18 11:11:28.112397 mon.node1 mon.0 10.193.56.230:6789/0 40152 : cluster [INF] osd.51 failed (root=hci_default,host=node5) (connection refused reported by osd.48) 2017-12-18 11:11:28.173179 mon.node1 mon.0 10.193.56.230:6789/0 40168 : cluster [INF] osd.81 failed (root=hci_default,host=node5) (connection refused reported by osd.84) 2017-12-18 11:11:28.245121 mon.node1 mon.0 10.193.56.230:6789/0 40203 : cluster [INF] osd.13 failed (root=hci_default,host=node5) (connection refused reported by osd.14) 2017-12-18 11:11:28.741045 mon.node1 mon.0 10.193.56.230:6789/0 40259 : cluster [INF] osd.110 10.193.56.234:6852/22242 boot 2017-12-18 11:11:28.741524 mon.node1 mon.0 10.193.56.230:6789/0 40260 : cluster [INF] osd.115 10.193.56.234:6856/22370 boot 2017-12-18 11:11:28.741617 mon.node1 mon.0 10.193.56.230:6789/0 40261 : cluster [INF] osd.73 10.193.56.231:6828/24358 boot 2017-12-18 11:11:28.741701 mon.node1 mon.0 10.193.56.230:6789/0 40262 : cluster [INF] osd.15 10.193.56.230:6825/25598 boot 2017-12-18 11:11:28.881720 mon.node1 mon.0 10.193.56.230:6789/0 40383 : cluster [WRN] Health check update: 79 osds down (OSD_DOWN) 2017-12-18 11:11:29.798914 mon.node1 mon.0 10.193.56.230:6789/0 40395 : cluster [INF] osd.24 10.193.56.231:6852/24214 boot 2017-12-18 11:11:29.799073 mon.node1 mon.0 10.193.56.230:6789/0 40396 : cluster [INF] osd.60 10.193.56.230:6829/25609 boot 2017-12-18 11:11:29.799595 mon.node1 mon.0 10.193.56.230:6789/0 40397 : cluster [INF] osd.75 10.193.56.230:6853/25614 boot 2017-12-18 11:11:29.799668 mon.node1 mon.0 10.193.56.230:6789/0 40398 : cluster [INF] osd.70 10.193.56.230:6857/26448 boot 2017-12-18 11:11:29.799838 mon.node1 mon.0 10.193.56.230:6789/0 40399 : cluster [INF] osd.114 10.193.56.232:6856/10130 boot 2017-12-18 11:11:29.799900 mon.node1 mon.0 10.193.56.230:6789/0 40400 : cluster [INF] osd.35 10.193.56.230:6849/25622 boot 2017-12-18 11:11:29.799964 mon.node1 mon.0 10.193.56.230:6789/0 40401 : cluster [INF] osd.50 10.193.56.230:6893/26138 boot 2017-12-18 11:11:30.858992 mon.node1 mon.0 10.193.56.230:6789/0 40526 : cluster [INF] osd.34 10.193.56.231:6824/25351 boot 2017-12-18 11:11:30.859070 mon.node1 mon.0 10.193.56.230:6789/0 40527 : cluster [INF] osd.12 10.193.56.232:6820/9626 boot 2017-12-18 11:11:30.859427 mon.node1 mon.0 10.193.56.230:6789/0 40528 : cluster [INF] osd.18 10.193.56.231:6836/24553 boot 2017-12-18 11:11:30.859769 mon.node1 mon.0 10.193.56.230:6789/0 40529 : cluster [INF] osd.63 10.193.56.231:6888/24964 boot 2017-12-18 11:11:30.860317 mon.node1 mon.0 10.193.56.230:6789/0 40530 : cluster [INF] osd.109 10.193.56.232:6864/10500 boot 2017-12-18 11:11:30.860405 mon.node1 mon.0 10.193.56.230:6789/0 40531 : cluster [INF] osd.53 10.193.56.231:6808/24495 boot 2017-12-18 11:11:30.860680 mon.node1 mon.0 10.193.56.230:6789/0 40532 : cluster [INF] osd.7 10.193.56.232:6830/9547 boot 2017-12-18 11:11:30.882202 mon.node1 mon.0 10.193.56.230:6789/0 40602 : cluster [WRN] Health check update: Reduced data availability: 31 pgs inactive, 3119 pgs down, 16 pgs peering (PG_AVAILABILITY) 2017-12-18 11:11:30.883607 mon.node1 mon.0 10.193.56.230:6789/0 40603 : cluster [WRN] Health check update: Degraded data redundancy: 23142/72879360 objects degraded (0.032%), 3528 pgs unclean, 521 pgs degraded (PG_DEGRADED) 2017-12-18 11:11:32.880966 mon.node1 mon.0 10.193.56.230:6789/0 40663 : cluster [INF] osd.89 10.193.56.232:6880/10507 boot 2017-12-18 11:11:32.881577 mon.node1 mon.0 10.193.56.230:6789/0 40664 : cluster [INF] osd.104 10.193.56.232:6828/9564 boot 2017-12-18 11:11:32.881778 mon.node1 mon.0 10.193.56.230:6789/0 40665 : cluster [INF] osd.118 10.193.56.232:6824/9852 boot 2017-12-18 11:11:32.881842 mon.node1 mon.0 10.193.56.230:6789/0 40666 : cluster [INF] osd.38 10.193.56.231:6800/24472 boot 2017-12-18 11:11:32.881890 mon.node1 mon.0 10.193.56.230:6789/0 40667 : cluster [INF] osd.97 10.193.56.231:6856/24386 boot 2017-12-18 11:11:32.881937 mon.node1 mon.0 10.193.56.230:6789/0 40668 : cluster [INF] osd.36 10.193.56.232:6808/9523 boot 2017-12-18 11:11:33.958198 mon.node1 mon.0 10.193.56.230:6789/0 40796 : cluster [WRN] Health check update: 53 osds down (OSD_DOWN) 2017-12-18 11:11:33.988857 mon.node1 mon.0 10.193.56.230:6789/0 40797 : cluster [INF] osd.65 10.193.56.230:6865/25878 boot 2017-12-18 11:11:33.989622 mon.node1 mon.0 10.193.56.230:6789/0 40798 : cluster [INF] osd.99 10.193.56.232:6812/9808 boot 2017-12-18 11:11:33.990295 mon.node1 mon.0 10.193.56.230:6789/0 40799 : cluster [INF] osd.76 10.193.56.232:6872/10146 boot 2017-12-18 11:11:33.990420 mon.node1 mon.0 10.193.56.230:6789/0 40800 : cluster [INF] osd.52 10.193.56.232:6816/9530 boot 2017-12-18 11:11:33.990587 mon.node1 mon.0 10.193.56.230:6789/0 40801 : cluster [INF] osd.43 10.193.56.231:6884/24910 boot 2017-12-18 11:11:33.990654 mon.node1 mon.0 10.193.56.230:6789/0 40802 : cluster [INF] osd.78 10.193.56.231:6832/24690 boot 2017-12-18 11:11:34.890213 mon.node1 mon.0 10.193.56.230:6789/0 40927 : cluster [INF] osd.79 marked down after no beacon for 31.436130 seconds 2017-12-18 11:11:34.952743 mon.node1 mon.0 10.193.56.230:6789/0 40928 : cluster [INF] osd.22 10.193.56.232:6852/9697 boot 2017-12-18 11:11:34.953133 mon.node1 mon.0 10.193.56.230:6789/0 40929 : cluster [INF] osd.9 10.193.56.231:6840/24355 boot 2017-12-18 11:11:34.953659 mon.node1 mon.0 10.193.56.230:6789/0 40930 : cluster [INF] osd.96 10.193.56.233:6816/28429 boot 2017-12-18 11:11:36.282046 mon.node1 mon.0 10.193.56.230:6789/0 41056 : cluster [WRN] Health check update: Reduced data availability: 188 pgs inactive, 3435 pgs down, 18 pgs peering (PG_AVAILABILITY) 2017-12-18 11:11:36.282069 mon.node1 mon.0 10.193.56.230:6789/0 41057 : cluster [WRN] Health check update: Degraded data redundancy: 5703/72879360 objects degraded (0.008%), 3574 pgs unclean, 190 pgs degraded (PG_DEGRADED) 2017-12-18 11:11:36.467054 mon.node1 mon.0 10.193.56.230:6789/0 41058 : cluster [INF] osd.79 10.193.56.233:6856/27638 boot 2017-12-18 11:11:36.467897 mon.node1 mon.0 10.193.56.230:6789/0 41059 : cluster [INF] osd.41 10.193.56.232:6832/10403 boot 2017-12-18 11:11:36.470179 mon.node1 mon.0 10.193.56.230:6789/0 41060 : cluster [INF] osd.27 10.193.56.232:6803/9879 boot 2017-12-18 11:11:36.470868 mon.node1 mon.0 10.193.56.230:6789/0 41061 : cluster [INF] osd.32 10.193.56.232:6800/9908 boot 2017-12-18 11:11:36.470948 mon.node1 mon.0 10.193.56.230:6789/0 41062 : cluster [INF] osd.106 10.193.56.233:6836/28858 boot 2017-12-18 11:11:36.471003 mon.node1 mon.0 10.193.56.230:6789/0 41063 : cluster [INF] osd.83 10.193.56.233:6828/28660 boot 2017-12-18 11:11:37.526402 mon.node1 mon.0 10.193.56.230:6789/0 41188 : cluster [INF] osd.67 10.193.56.232:6844/9901 boot 2017-12-18 11:11:37.527682 mon.node1 mon.0 10.193.56.230:6789/0 41189 : cluster [INF] osd.86 10.193.56.233:6868/29655 boot 2017-12-18 11:11:37.527770 mon.node1 mon.0 10.193.56.230:6789/0 41190 : cluster [INF] osd.17 10.193.56.232:6884/10163 boot 2017-12-18 11:11:37.527813 mon.node1 mon.0 10.193.56.230:6789/0 41191 : cluster [INF] osd.46 10.193.56.232:6887/10155 boot 2017-12-18 11:11:38.719118 mon.node1 mon.0 10.193.56.230:6789/0 41318 : cluster [INF] osd.16 10.193.56.233:6892/29118 boot 2017-12-18 11:11:38.724073 mon.node1 mon.0 10.193.56.230:6789/0 41319 : cluster [INF] osd.3 10.193.56.232:6876/10145 boot 2017-12-18 11:11:38.724155 mon.node1 mon.0 10.193.56.230:6789/0 41320 : cluster [INF] osd.0 10.193.56.233:6812/28670 boot 2017-12-18 11:11:38.724219 mon.node1 mon.0 10.193.56.230:6789/0 41321 : cluster [INF] osd.72 10.193.56.232:6804/9505 boot 2017-12-18 11:11:39.745004 mon.node1 mon.0 10.193.56.230:6789/0 41447 : cluster [WRN] Health check update: 32 osds down (OSD_DOWN) 2017-12-18 11:11:40.002465 mon.node1 mon.0 10.193.56.230:6789/0 41449 : cluster [INF] osd.64 10.193.56.233:6881/29094 boot 2017-12-18 11:11:40.003025 mon.node1 mon.0 10.193.56.230:6789/0 41450 : cluster [INF] osd.105 10.193.56.234:6880/21975 boot 2017-12-18 11:11:40.003091 mon.node1 mon.0 10.193.56.230:6789/0 41451 : cluster [INF] osd.100 10.193.56.234:6844/21962 boot 2017-12-18 11:11:40.003157 mon.node1 mon.0 10.193.56.230:6789/0 41452 : cluster [INF] osd.49 10.193.56.233:6864/28875 boot 2017-12-18 11:11:40.003210 mon.node1 mon.0 10.193.56.230:6789/0 41453 : cluster [INF] osd.39 10.193.56.233:6820/28640 boot 2017-12-18 11:11:41.061389 mon.node1 mon.0 10.193.56.230:6789/0 41580 : cluster [INF] osd.31 10.193.56.233:6872/29652 boot 2017-12-18 11:11:41.063346 mon.node1 mon.0 10.193.56.230:6789/0 41581 : cluster [INF] osd.62 10.193.56.232:6848/9653 boot 2017-12-18 11:11:41.063421 mon.node1 mon.0 10.193.56.230:6789/0 41582 : cluster [INF] osd.26 10.193.56.233:6876/28882 boot 2017-12-18 11:11:42.125314 mon.node1 mon.0 10.193.56.230:6789/0 41711 : cluster [INF] osd.74 10.193.56.233:6860/27641 boot 2017-12-18 11:11:42.125411 mon.node1 mon.0 10.193.56.230:6789/0 41712 : cluster [INF] osd.61 10.193.56.234:6848/21660 boot 2017-12-18 11:11:42.125485 mon.node1 mon.0 10.193.56.230:6789/0 41713 : cluster [INF] osd.47 10.193.56.234:6839/22103 boot 2017-12-18 11:11:42.126140 mon.node1 mon.0 10.193.56.230:6789/0 41714 : cluster [INF] osd.54 10.193.56.233:6840/28213 boot 2017-12-18 11:11:42.126331 mon.node1 mon.0 10.193.56.230:6789/0 41715 : cluster [INF] osd.90 10.193.56.234:6872/22834 boot 2017-12-18 11:11:42.126460 mon.node1 mon.0 10.193.56.230:6789/0 41716 : cluster [INF] osd.57 10.193.56.232:6860/10149 boot 2017-12-18 11:11:42.126750 mon.node1 mon.0 10.193.56.230:6789/0 41717 : cluster [INF] osd.33 10.193.56.234:6876/22168 boot 2017-12-18 11:11:42.126824 mon.node1 mon.0 10.193.56.230:6789/0 41718 : cluster [INF] osd.11 10.193.56.233:6808/28108 boot 2017-12-18 11:11:42.127529 mon.node1 mon.0 10.193.56.230:6789/0 41719 : cluster [INF] osd.101 10.193.56.233:6848/28865 boot 2017-12-18 11:11:42.127599 mon.node1 mon.0 10.193.56.230:6789/0 41720 : cluster [INF] osd.28 10.193.56.234:6816/21832 boot 2017-12-18 11:11:42.932923 mon.node1 mon.0 10.193.56.230:6789/0 41966 : cluster [WRN] Health check update: Reduced data availability: 165 pgs inactive, 3465 pgs down, 22 pgs peering (PG_AVAILABILITY) 2017-12-18 11:11:42.932961 mon.node1 mon.0 10.193.56.230:6789/0 41967 : cluster [WRN] Health check update: Degraded data redundancy: 12/72879360 objects degraded (0.000%), 3526 pgs unclean, 76 pgs degraded (PG_DEGRADED) 2017-12-18 11:11:43.306653 mon.node1 mon.0 10.193.56.230:6789/0 41970 : cluster [INF] osd.69 10.193.56.233:6852/29494 boot 2017-12-18 11:11:43.307107 mon.node1 mon.0 10.193.56.230:6789/0 41971 : cluster [INF] osd.21 10.193.56.233:6800/28509 boot 2017-12-18 11:11:43.307170 mon.node1 mon.0 10.193.56.230:6789/0 41972 : cluster [INF] osd.91 10.193.56.233:6832/29271 boot 2017-12-18 11:11:43.307273 mon.node1 mon.0 10.193.56.230:6789/0 41973 : cluster [INF] osd.81 10.193.56.234:6808/23011 boot 2017-12-18 11:11:44.404528 mon.node1 mon.0 10.193.56.230:6789/0 42101 : cluster [INF] osd.5 10.193.56.233:6804/28189 boot 2017-12-18 11:11:44.405086 mon.node1 mon.0 10.193.56.230:6789/0 42102 : cluster [INF] osd.85 10.193.56.234:6868/22960 boot 2017-12-18 11:11:44.405143 mon.node1 mon.0 10.193.56.230:6789/0 42103 : cluster [INF] osd.19 10.193.56.234:6812/22620 boot 2017-12-18 11:11:44.405212 mon.node1 mon.0 10.193.56.230:6789/0 42104 : cluster [INF] osd.77 10.193.56.234:6860/21677 boot 2017-12-18 11:11:44.933244 mon.node1 mon.0 10.193.56.230:6789/0 42226 : cluster [WRN] Health check update: 13 osds down (OSD_DOWN) 2017-12-18 11:11:45.458211 mon.node1 mon.0 10.193.56.230:6789/0 42231 : cluster [INF] osd.2 10.193.56.234:6824/22126 boot 2017-12-18 11:11:45.459632 mon.node1 mon.0 10.193.56.230:6789/0 42232 : cluster [INF] osd.44 10.193.56.233:6824/29325 boot 2017-12-18 11:11:45.459802 mon.node1 mon.0 10.193.56.230:6789/0 42233 : cluster [INF] osd.56 10.193.56.234:6820/21856 boot 2017-12-18 11:11:45.460550 mon.node1 mon.0 10.193.56.230:6789/0 42234 : cluster [INF] osd.51 10.193.56.234:6840/22996 boot 2017-12-18 11:11:46.556213 mon.node1 mon.0 10.193.56.230:6789/0 42358 : cluster [INF] osd.59 10.193.56.233:6844/29424 boot 2017-12-18 11:11:46.556345 mon.node1 mon.0 10.193.56.230:6789/0 42359 : cluster [INF] osd.42 10.193.56.234:6800/21936 boot 2017-12-18 11:11:46.556707 mon.node1 mon.0 10.193.56.230:6789/0 42360 : cluster [INF] osd.8 10.193.56.234:6884/22208 boot 2017-12-18 11:11:46.556750 mon.node1 mon.0 10.193.56.230:6789/0 42361 : cluster [INF] osd.66 10.193.56.234:6858/22405 boot 2017-12-18 11:11:47.614724 mon.node1 mon.0 10.193.56.230:6789/0 42488 : cluster [INF] osd.13 10.193.56.234:6864/23104 boot 2017-12-18 11:11:47.614896 mon.node1 mon.0 10.193.56.230:6789/0 42489 : cluster [INF] osd.95 10.193.56.234:6804/22210 boot 2017-12-18 11:11:47.614965 mon.node1 mon.0 10.193.56.230:6789/0 42490 : cluster [INF] osd.23 10.193.56.234:6832/21903 boot 2017-12-18 11:11:47.615097 mon.node1 mon.0 10.193.56.230:6789/0 42491 : cluster [INF] osd.37 10.193.56.234:6828/22766 boot 2017-12-18 11:11:48.673951 mon.node1 mon.0 10.193.56.230:6789/0 42613 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2017-12-18 11:11:48.704741 mon.node1 mon.0 10.193.56.230:6789/0 42614 : cluster [INF] osd.71 10.193.56.234:6892/22477 boot 2017-12-18 11:11:48.933952 mon.node1 mon.0 10.193.56.230:6789/0 42735 : cluster [WRN] Health check update: Reduced data availability: 78 pgs inactive, 2547 pgs down, 44 pgs peering (PG_AVAILABILITY) 2017-12-18 11:11:48.934010 mon.node1 mon.0 10.193.56.230:6789/0 42736 : cluster [WRN] Health check update: Degraded data redundancy: 1/72879360 objects degraded (0.000%), 2844 pgs unclean, 41 pgs degraded (PG_DEGRADED) 2017-12-18 11:11:54.934753 mon.node1 mon.0 10.193.56.230:6789/0 42985 : cluster [WRN] Health check update: Reduced data availability: 3 pgs inactive, 151 pgs down, 24 pgs peering (PG_AVAILABILITY) 2017-12-18 11:11:54.934819 mon.node1 mon.0 10.193.56.230:6789/0 42986 : cluster [WRN] Health check update: Degraded data redundancy: 382 pgs unclean, 5 pgs degraded (PG_DEGRADED) 2017-12-18 11:11:55.911387 mon.node1 mon.0 10.193.56.230:6789/0 42989 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 151 pgs down, 24 pgs peering) 2017-12-18 11:11:57.952075 mon.node1 mon.0 10.193.56.230:6789/0 42991 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 23 pgs unclean) 2017-12-18 11:12:05.201059 mon.node1 mon.0 10.193.56.230:6789/0 43004 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 11:16:03.957235 mon.node1 mon.0 10.193.56.230:6789/0 43221 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 11:16:03.957272 mon.node1 mon.0 10.193.56.230:6789/0 43222 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 11:16:03.957325 mon.node1 mon.0 10.193.56.230:6789/0 43223 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 11:16:03.957348 mon.node1 mon.0 10.193.56.230:6789/0 43224 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 11:21:03.957309 mon.node1 mon.0 10.193.56.230:6789/0 43287 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 11:21:03.957346 mon.node1 mon.0 10.193.56.230:6789/0 43288 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 11:21:03.957365 mon.node1 mon.0 10.193.56.230:6789/0 43289 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 11:21:03.957442 mon.node1 mon.0 10.193.56.230:6789/0 43290 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 11:26:03.957493 mon.node1 mon.0 10.193.56.230:6789/0 43348 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 11:26:03.957528 mon.node1 mon.0 10.193.56.230:6789/0 43349 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 11:26:03.957556 mon.node1 mon.0 10.193.56.230:6789/0 43350 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 11:26:03.957589 mon.node1 mon.0 10.193.56.230:6789/0 43351 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 11:31:03.957548 mon.node1 mon.0 10.193.56.230:6789/0 43421 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 11:31:03.957597 mon.node1 mon.0 10.193.56.230:6789/0 43422 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 11:31:03.957635 mon.node1 mon.0 10.193.56.230:6789/0 43423 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 11:31:03.957655 mon.node1 mon.0 10.193.56.230:6789/0 43424 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 11:36:03.957583 mon.node1 mon.0 10.193.56.230:6789/0 43486 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 11:36:03.957616 mon.node1 mon.0 10.193.56.230:6789/0 43487 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 11:36:03.957667 mon.node1 mon.0 10.193.56.230:6789/0 43488 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 11:36:03.957698 mon.node1 mon.0 10.193.56.230:6789/0 43489 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 11:41:03.957781 mon.node1 mon.0 10.193.56.230:6789/0 43541 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 11:41:03.957824 mon.node1 mon.0 10.193.56.230:6789/0 43542 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 11:41:03.957863 mon.node1 mon.0 10.193.56.230:6789/0 43543 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 11:41:03.957893 mon.node1 mon.0 10.193.56.230:6789/0 43544 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 11:46:03.957911 mon.node1 mon.0 10.193.56.230:6789/0 43602 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 11:46:03.957954 mon.node1 mon.0 10.193.56.230:6789/0 43603 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 11:46:03.957977 mon.node1 mon.0 10.193.56.230:6789/0 43604 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 11:46:03.959503 mon.node1 mon.0 10.193.56.230:6789/0 43605 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 11:51:03.958090 mon.node1 mon.0 10.193.56.230:6789/0 43661 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 11:51:03.958121 mon.node1 mon.0 10.193.56.230:6789/0 43662 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 11:51:03.958148 mon.node1 mon.0 10.193.56.230:6789/0 43663 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 11:51:03.958168 mon.node1 mon.0 10.193.56.230:6789/0 43664 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 11:56:03.958256 mon.node1 mon.0 10.193.56.230:6789/0 43714 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 11:56:03.958348 mon.node1 mon.0 10.193.56.230:6789/0 43715 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 11:56:03.958578 mon.node1 mon.0 10.193.56.230:6789/0 43716 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 11:56:03.958711 mon.node1 mon.0 10.193.56.230:6789/0 43717 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 12:00:00.000088 mon.node1 mon.0 10.193.56.230:6789/0 43777 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 12:01:00.041956 mon.node1 mon.0 10.193.56.230:6789/0 43791 : cluster [INF] osd.75 marked itself down 2017-12-18 12:01:00.042016 mon.node1 mon.0 10.193.56.230:6789/0 43792 : cluster [INF] osd.20 marked itself down 2017-12-18 12:01:00.042123 mon.node1 mon.0 10.193.56.230:6789/0 43793 : cluster [INF] osd.35 marked itself down 2017-12-18 12:01:00.042207 mon.node1 mon.0 10.193.56.230:6789/0 43794 : cluster [INF] osd.45 marked itself down 2017-12-18 12:01:00.042298 mon.node1 mon.0 10.193.56.230:6789/0 43795 : cluster [INF] osd.10 marked itself down 2017-12-18 12:01:00.042345 mon.node1 mon.0 10.193.56.230:6789/0 43796 : cluster [INF] osd.25 marked itself down 2017-12-18 12:01:00.042377 mon.node1 mon.0 10.193.56.230:6789/0 43797 : cluster [INF] osd.108 marked itself down 2017-12-18 12:01:00.042432 mon.node1 mon.0 10.193.56.230:6789/0 43798 : cluster [INF] osd.40 marked itself down 2017-12-18 12:01:00.042581 mon.node1 mon.0 10.193.56.230:6789/0 43799 : cluster [INF] osd.60 marked itself down 2017-12-18 12:01:00.042635 mon.node1 mon.0 10.193.56.230:6789/0 43800 : cluster [INF] osd.98 marked itself down 2017-12-18 12:01:00.042679 mon.node1 mon.0 10.193.56.230:6789/0 43801 : cluster [INF] osd.4 marked itself down 2017-12-18 12:01:00.042812 mon.node1 mon.0 10.193.56.230:6789/0 43802 : cluster [INF] osd.88 marked itself down 2017-12-18 12:01:00.042904 mon.node1 mon.0 10.193.56.230:6789/0 43803 : cluster [INF] osd.103 marked itself down 2017-12-18 12:01:00.043104 mon.node1 mon.0 10.193.56.230:6789/0 43804 : cluster [INF] osd.93 marked itself down 2017-12-18 12:01:00.043150 mon.node1 mon.0 10.193.56.230:6789/0 43805 : cluster [INF] osd.15 marked itself down 2017-12-18 12:01:00.043338 mon.node1 mon.0 10.193.56.230:6789/0 43806 : cluster [INF] osd.50 marked itself down 2017-12-18 12:01:00.043490 mon.node1 mon.0 10.193.56.230:6789/0 43807 : cluster [INF] osd.6 marked itself down 2017-12-18 12:01:00.043547 mon.node1 mon.0 10.193.56.230:6789/0 43808 : cluster [INF] osd.55 marked itself down 2017-12-18 12:01:00.043816 mon.node1 mon.0 10.193.56.230:6789/0 43809 : cluster [INF] osd.80 marked itself down 2017-12-18 12:01:00.043869 mon.node1 mon.0 10.193.56.230:6789/0 43810 : cluster [INF] osd.65 marked itself down 2017-12-18 12:01:00.043914 mon.node1 mon.0 10.193.56.230:6789/0 43811 : cluster [INF] osd.113 marked itself down 2017-12-18 12:01:00.043975 mon.node1 mon.0 10.193.56.230:6789/0 43812 : cluster [INF] osd.70 marked itself down 2017-12-18 12:01:00.045790 mon.node1 mon.0 10.193.56.230:6789/0 43813 : cluster [INF] osd.30 marked itself down 2017-12-18 12:01:00.047411 mon.node1 mon.0 10.193.56.230:6789/0 43814 : cluster [INF] osd.84 marked itself down 2017-12-18 12:01:00.336904 mon.node1 mon.0 10.193.56.230:6789/0 43815 : cluster [INF] osd.18 marked itself down 2017-12-18 12:01:00.337007 mon.node1 mon.0 10.193.56.230:6789/0 43816 : cluster [INF] osd.92 marked itself down 2017-12-18 12:01:00.337053 mon.node1 mon.0 10.193.56.230:6789/0 43817 : cluster [INF] osd.48 marked itself down 2017-12-18 12:01:00.337140 mon.node1 mon.0 10.193.56.230:6789/0 43818 : cluster [INF] osd.112 marked itself down 2017-12-18 12:01:00.337189 mon.node1 mon.0 10.193.56.230:6789/0 43819 : cluster [INF] osd.1 marked itself down 2017-12-18 12:01:00.337260 mon.node1 mon.0 10.193.56.230:6789/0 43820 : cluster [INF] osd.63 marked itself down 2017-12-18 12:01:00.337304 mon.node1 mon.0 10.193.56.230:6789/0 43821 : cluster [INF] osd.78 marked itself down 2017-12-18 12:01:00.337379 mon.node1 mon.0 10.193.56.230:6789/0 43822 : cluster [INF] osd.43 marked itself down 2017-12-18 12:01:00.337459 mon.node1 mon.0 10.193.56.230:6789/0 43823 : cluster [INF] osd.102 marked itself down 2017-12-18 12:01:00.337505 mon.node1 mon.0 10.193.56.230:6789/0 43824 : cluster [INF] osd.82 marked itself down 2017-12-18 12:01:00.337581 mon.node1 mon.0 10.193.56.230:6789/0 43825 : cluster [INF] osd.29 marked itself down 2017-12-18 12:01:00.337669 mon.node1 mon.0 10.193.56.230:6789/0 43826 : cluster [INF] osd.34 marked itself down 2017-12-18 12:01:00.337741 mon.node1 mon.0 10.193.56.230:6789/0 43827 : cluster [INF] osd.53 marked itself down 2017-12-18 12:01:00.337814 mon.node1 mon.0 10.193.56.230:6789/0 43828 : cluster [INF] osd.107 marked itself down 2017-12-18 12:01:00.337942 mon.node1 mon.0 10.193.56.230:6789/0 43829 : cluster [INF] osd.9 marked itself down 2017-12-18 12:01:00.338017 mon.node1 mon.0 10.193.56.230:6789/0 43830 : cluster [INF] osd.14 marked itself down 2017-12-18 12:01:00.338158 mon.node1 mon.0 10.193.56.230:6789/0 43831 : cluster [INF] osd.24 marked itself down 2017-12-18 12:01:00.338220 mon.node1 mon.0 10.193.56.230:6789/0 43832 : cluster [INF] osd.38 marked itself down 2017-12-18 12:01:00.338291 mon.node1 mon.0 10.193.56.230:6789/0 43833 : cluster [INF] osd.58 marked itself down 2017-12-18 12:01:00.338398 mon.node1 mon.0 10.193.56.230:6789/0 43834 : cluster [INF] osd.117 marked itself down 2017-12-18 12:01:00.338491 mon.node1 mon.0 10.193.56.230:6789/0 43835 : cluster [INF] osd.87 marked itself down 2017-12-18 12:01:00.338551 mon.node1 mon.0 10.193.56.230:6789/0 43836 : cluster [INF] osd.73 marked itself down 2017-12-18 12:01:00.338626 mon.node1 mon.0 10.193.56.230:6789/0 43837 : cluster [INF] osd.68 marked itself down 2017-12-18 12:01:00.338690 mon.node1 mon.0 10.193.56.230:6789/0 43838 : cluster [INF] osd.97 marked itself down 2017-12-18 12:01:00.629164 mon.node1 mon.0 10.193.56.230:6789/0 43839 : cluster [INF] osd.72 marked itself down 2017-12-18 12:01:00.629274 mon.node1 mon.0 10.193.56.230:6789/0 43840 : cluster [INF] osd.22 marked itself down 2017-12-18 12:01:00.629668 mon.node1 mon.0 10.193.56.230:6789/0 43841 : cluster [INF] osd.76 marked itself down 2017-12-18 12:01:00.629747 mon.node1 mon.0 10.193.56.230:6789/0 43842 : cluster [INF] osd.89 marked itself down 2017-12-18 12:01:00.629795 mon.node1 mon.0 10.193.56.230:6789/0 43843 : cluster [INF] osd.57 marked itself down 2017-12-18 12:01:00.629867 mon.node1 mon.0 10.193.56.230:6789/0 43844 : cluster [INF] osd.99 marked itself down 2017-12-18 12:01:00.630030 mon.node1 mon.0 10.193.56.230:6789/0 43845 : cluster [INF] osd.118 marked itself down 2017-12-18 12:01:00.630108 mon.node1 mon.0 10.193.56.230:6789/0 43846 : cluster [INF] osd.52 marked itself down 2017-12-18 12:01:00.630175 mon.node1 mon.0 10.193.56.230:6789/0 43847 : cluster [INF] osd.67 marked itself down 2017-12-18 12:01:00.630228 mon.node1 mon.0 10.193.56.230:6789/0 43848 : cluster [INF] osd.3 marked itself down 2017-12-18 12:01:00.630291 mon.node1 mon.0 10.193.56.230:6789/0 43849 : cluster [INF] osd.41 marked itself down 2017-12-18 12:01:00.630354 mon.node1 mon.0 10.193.56.230:6789/0 43850 : cluster [INF] osd.27 marked itself down 2017-12-18 12:01:00.630443 mon.node1 mon.0 10.193.56.230:6789/0 43851 : cluster [INF] osd.109 marked itself down 2017-12-18 12:01:00.630522 mon.node1 mon.0 10.193.56.230:6789/0 43852 : cluster [INF] osd.94 marked itself down 2017-12-18 12:01:00.630592 mon.node1 mon.0 10.193.56.230:6789/0 43853 : cluster [INF] osd.46 marked itself down 2017-12-18 12:01:00.630664 mon.node1 mon.0 10.193.56.230:6789/0 43854 : cluster [INF] osd.104 marked itself down 2017-12-18 12:01:00.630732 mon.node1 mon.0 10.193.56.230:6789/0 43855 : cluster [INF] osd.12 marked itself down 2017-12-18 12:01:00.631080 mon.node1 mon.0 10.193.56.230:6789/0 43856 : cluster [INF] osd.36 marked itself down 2017-12-18 12:01:00.631154 mon.node1 mon.0 10.193.56.230:6789/0 43857 : cluster [INF] osd.32 marked itself down 2017-12-18 12:01:00.631422 mon.node1 mon.0 10.193.56.230:6789/0 43858 : cluster [INF] osd.7 marked itself down 2017-12-18 12:01:00.631512 mon.node1 mon.0 10.193.56.230:6789/0 43859 : cluster [INF] osd.62 marked itself down 2017-12-18 12:01:00.632454 mon.node1 mon.0 10.193.56.230:6789/0 43860 : cluster [INF] osd.114 marked itself down 2017-12-18 12:01:00.633298 mon.node1 mon.0 10.193.56.230:6789/0 43861 : cluster [INF] osd.17 marked itself down 2017-12-18 12:01:00.781633 mon.node1 mon.0 10.193.56.230:6789/0 43862 : cluster [WRN] Health check failed: 71 osds down (OSD_DOWN) 2017-12-18 12:01:00.781665 mon.node1 mon.0 10.193.56.230:6789/0 43863 : cluster [WRN] Health check failed: 3 hosts (71 osds) down (OSD_HOST_DOWN) 2017-12-18 12:01:01.580005 mon.node1 mon.0 10.193.56.230:6789/0 44104 : cluster [INF] osd.116 marked itself down 2017-12-18 12:01:01.580283 mon.node1 mon.0 10.193.56.230:6789/0 44105 : cluster [INF] osd.59 marked itself down 2017-12-18 12:01:01.580409 mon.node1 mon.0 10.193.56.230:6789/0 44106 : cluster [INF] osd.0 marked itself down 2017-12-18 12:01:01.580564 mon.node1 mon.0 10.193.56.230:6789/0 44107 : cluster [INF] osd.16 marked itself down 2017-12-18 12:01:01.580663 mon.node1 mon.0 10.193.56.230:6789/0 44108 : cluster [INF] osd.96 marked itself down 2017-12-18 12:01:01.581299 mon.node1 mon.0 10.193.56.230:6789/0 44109 : cluster [INF] osd.44 marked itself down 2017-12-18 12:01:01.583821 mon.node1 mon.0 10.193.56.230:6789/0 44110 : cluster [INF] osd.5 marked itself down 2017-12-18 12:01:01.584004 mon.node1 mon.0 10.193.56.230:6789/0 44111 : cluster [INF] osd.91 marked itself down 2017-12-18 12:01:01.584182 mon.node1 mon.0 10.193.56.230:6789/0 44112 : cluster [INF] osd.106 marked itself down 2017-12-18 12:01:01.584276 mon.node1 mon.0 10.193.56.230:6789/0 44113 : cluster [INF] osd.26 marked itself down 2017-12-18 12:01:01.584372 mon.node1 mon.0 10.193.56.230:6789/0 44114 : cluster [INF] osd.79 marked itself down 2017-12-18 12:01:01.584473 mon.node1 mon.0 10.193.56.230:6789/0 44115 : cluster [INF] osd.21 marked itself down 2017-12-18 12:01:01.584543 mon.node1 mon.0 10.193.56.230:6789/0 44116 : cluster [INF] osd.101 marked itself down 2017-12-18 12:01:02.183100 mon.node1 mon.0 10.193.56.230:6789/0 44117 : cluster [WRN] Health check failed: Reduced data availability: 125 pgs inactive, 217 pgs down, 44 pgs peering (PG_AVAILABILITY) 2017-12-18 12:01:02.183166 mon.node1 mon.0 10.193.56.230:6789/0 44118 : cluster [WRN] Health check failed: Degraded data redundancy: 213 pgs unclean, 8 pgs degraded (PG_DEGRADED) 2017-12-18 12:01:03.958436 mon.node1 mon.0 10.193.56.230:6789/0 44239 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 12:01:03.958492 mon.node1 mon.0 10.193.56.230:6789/0 44240 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 12:01:03.958533 mon.node1 mon.0 10.193.56.230:6789/0 44241 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 12:01:03.959081 mon.node1 mon.0 10.193.56.230:6789/0 44242 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 12:01:04.952288 mon.node1 mon.0 10.193.56.230:6789/0 44248 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 3 hosts (71 osds) down) 2017-12-18 12:01:04.983253 mon.node1 mon.0 10.193.56.230:6789/0 44249 : cluster [INF] osd.94 10.193.56.232:6868/15650 boot 2017-12-18 12:01:04.983346 mon.node1 mon.0 10.193.56.230:6789/0 44250 : cluster [INF] osd.117 10.193.56.231:6872/19867 boot 2017-12-18 12:01:04.983410 mon.node1 mon.0 10.193.56.230:6789/0 44251 : cluster [INF] osd.112 10.193.56.231:6888/19863 boot 2017-12-18 12:01:04.983477 mon.node1 mon.0 10.193.56.230:6789/0 44252 : cluster [INF] osd.113 10.193.56.230:6869/22561 boot 2017-12-18 12:01:04.983854 mon.node1 mon.0 10.193.56.230:6789/0 44253 : cluster [INF] osd.108 10.193.56.230:6881/22565 boot 2017-12-18 12:01:05.074538 mon.node1 mon.0 10.193.56.230:6789/0 44376 : cluster [INF] osd.8 failed (root=hci_default,host=node5) (connection refused reported by osd.113) 2017-12-18 12:01:05.075117 mon.node1 mon.0 10.193.56.230:6789/0 44379 : cluster [INF] osd.115 failed (root=hci_default,host=node5) (connection refused reported by osd.113) 2017-12-18 12:01:05.075571 mon.node1 mon.0 10.193.56.230:6789/0 44381 : cluster [INF] osd.23 failed (root=hci_default,host=node5) (connection refused reported by osd.113) 2017-12-18 12:01:05.085891 mon.node1 mon.0 10.193.56.230:6789/0 44384 : cluster [INF] osd.105 failed (root=hci_default,host=node5) (connection refused reported by osd.94) 2017-12-18 12:01:05.205446 mon.node1 mon.0 10.193.56.230:6789/0 44386 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; 79 osds down; Reduced data availability: 309 pgs inactive, 515 pgs down, 64 pgs peering; Degraded data redundancy: 547 pgs unclean, 24 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 12:01:05.806352 mon.node1 mon.0 10.193.56.230:6789/0 44390 : cluster [WRN] Health check update: 79 osds down (OSD_DOWN) 2017-12-18 12:01:06.082701 mon.node1 mon.0 10.193.56.230:6789/0 44391 : cluster [INF] osd.116 10.193.56.233:6880/9508 boot 2017-12-18 12:01:07.171381 mon.node1 mon.0 10.193.56.230:6789/0 44512 : cluster [INF] osd.111 10.193.56.233:6872/9291 boot 2017-12-18 12:01:07.171459 mon.node1 mon.0 10.193.56.230:6789/0 44513 : cluster [INF] osd.110 10.193.56.234:6852/20346 boot 2017-12-18 12:01:07.171528 mon.node1 mon.0 10.193.56.230:6789/0 44514 : cluster [INF] osd.115 10.193.56.234:6856/20368 boot 2017-12-18 12:01:07.807055 mon.node1 mon.0 10.193.56.230:6789/0 44635 : cluster [WRN] Health check update: Reduced data availability: 309 pgs inactive, 515 pgs down, 64 pgs peering (PG_AVAILABILITY) 2017-12-18 12:01:07.807125 mon.node1 mon.0 10.193.56.230:6789/0 44636 : cluster [WRN] Health check update: Degraded data redundancy: 547 pgs unclean, 24 pgs degraded (PG_DEGRADED) 2017-12-18 12:01:11.364486 mon.node1 mon.0 10.193.56.230:6789/0 44645 : cluster [WRN] Health check update: 78 osds down (OSD_DOWN) 2017-12-18 12:01:11.396025 mon.node1 mon.0 10.193.56.230:6789/0 44648 : cluster [INF] osd.114 10.193.56.232:6812/14634 boot 2017-12-18 12:01:11.396122 mon.node1 mon.0 10.193.56.230:6789/0 44649 : cluster [INF] osd.92 10.193.56.231:6826/19074 boot 2017-12-18 12:01:11.396193 mon.node1 mon.0 10.193.56.230:6789/0 44650 : cluster [INF] osd.80 10.193.56.230:6801/21383 boot 2017-12-18 12:01:12.465419 mon.node1 mon.0 10.193.56.230:6789/0 44782 : cluster [INF] osd.103 10.193.56.230:6893/21886 boot 2017-12-18 12:01:12.465491 mon.node1 mon.0 10.193.56.230:6789/0 44783 : cluster [INF] osd.84 10.193.56.230:6841/21670 boot 2017-12-18 12:01:12.465539 mon.node1 mon.0 10.193.56.230:6789/0 44784 : cluster [INF] osd.87 10.193.56.231:6822/19072 boot 2017-12-18 12:01:12.465841 mon.node1 mon.0 10.193.56.230:6789/0 44785 : cluster [INF] osd.109 10.193.56.232:6824/14769 boot 2017-12-18 12:01:12.465913 mon.node1 mon.0 10.193.56.230:6789/0 44786 : cluster [INF] osd.93 10.193.56.230:6857/21687 boot 2017-12-18 12:01:12.466007 mon.node1 mon.0 10.193.56.230:6789/0 44787 : cluster [INF] osd.82 10.193.56.231:6834/19070 boot 2017-12-18 12:01:12.467363 mon.node1 mon.0 10.193.56.230:6789/0 44788 : cluster [INF] osd.102 10.193.56.231:6869/19235 boot 2017-12-18 12:01:12.467474 mon.node1 mon.0 10.193.56.230:6789/0 44789 : cluster [INF] osd.118 10.193.56.232:6856/14860 boot 2017-12-18 12:01:12.467718 mon.node1 mon.0 10.193.56.230:6789/0 44790 : cluster [INF] osd.106 10.193.56.233:6836/8843 boot 2017-12-18 12:01:12.467826 mon.node1 mon.0 10.193.56.230:6789/0 44791 : cluster [INF] osd.107 10.193.56.231:6818/19065 boot 2017-12-18 12:01:12.467927 mon.node1 mon.0 10.193.56.230:6789/0 44792 : cluster [INF] osd.96 10.193.56.233:6856/8859 boot 2017-12-18 12:01:13.508167 mon.node1 mon.0 10.193.56.230:6789/0 44922 : cluster [WRN] Health check update: Reduced data availability: 538 pgs inactive, 888 pgs down, 105 pgs peering (PG_AVAILABILITY) 2017-12-18 12:01:13.508198 mon.node1 mon.0 10.193.56.230:6789/0 44923 : cluster [WRN] Health check update: Degraded data redundancy: 936 pgs unclean, 24 pgs degraded (PG_DEGRADED) 2017-12-18 12:01:13.536482 mon.node1 mon.0 10.193.56.230:6789/0 44925 : cluster [INF] osd.81 10.193.56.234:6820/19739 boot 2017-12-18 12:01:13.536552 mon.node1 mon.0 10.193.56.230:6789/0 44926 : cluster [INF] osd.86 10.193.56.233:6828/8080 boot 2017-12-18 12:01:13.536610 mon.node1 mon.0 10.193.56.230:6789/0 44927 : cluster [INF] osd.85 10.193.56.234:6874/19888 boot 2017-12-18 12:01:13.536666 mon.node1 mon.0 10.193.56.230:6789/0 44928 : cluster [INF] osd.83 10.193.56.233:6840/8140 boot 2017-12-18 12:01:13.536744 mon.node1 mon.0 10.193.56.230:6789/0 44929 : cluster [INF] osd.90 10.193.56.234:6883/19891 boot 2017-12-18 12:01:13.537431 mon.node1 mon.0 10.193.56.230:6789/0 44930 : cluster [INF] osd.72 10.193.56.232:6887/15002 boot 2017-12-18 12:01:13.537611 mon.node1 mon.0 10.193.56.230:6789/0 44931 : cluster [INF] osd.43 10.193.56.231:6884/19317 boot 2017-12-18 12:01:13.537933 mon.node1 mon.0 10.193.56.230:6789/0 44932 : cluster [INF] osd.104 10.193.56.232:6880/15878 boot 2017-12-18 12:01:13.538000 mon.node1 mon.0 10.193.56.230:6789/0 44933 : cluster [INF] osd.68 10.193.56.231:6853/19088 boot 2017-12-18 12:01:13.538143 mon.node1 mon.0 10.193.56.230:6789/0 44934 : cluster [INF] osd.89 10.193.56.232:6844/15857 boot 2017-12-18 12:01:14.599844 mon.node1 mon.0 10.193.56.230:6789/0 45069 : cluster [INF] osd.100 10.193.56.234:6839/19749 boot 2017-12-18 12:01:14.599919 mon.node1 mon.0 10.193.56.230:6789/0 45070 : cluster [INF] osd.11 10.193.56.233:6808/7988 boot 2017-12-18 12:01:14.599972 mon.node1 mon.0 10.193.56.230:6789/0 45071 : cluster [INF] osd.76 10.193.56.232:6808/14627 boot 2017-12-18 12:01:14.600550 mon.node1 mon.0 10.193.56.230:6789/0 45072 : cluster [INF] osd.75 10.193.56.230:6888/21866 boot 2017-12-18 12:01:14.600615 mon.node1 mon.0 10.193.56.230:6789/0 45073 : cluster [INF] osd.36 10.193.56.232:6800/14789 boot 2017-12-18 12:01:14.600747 mon.node1 mon.0 10.193.56.230:6789/0 45074 : cluster [INF] osd.99 10.193.56.232:6860/14878 boot 2017-12-18 12:01:14.600872 mon.node1 mon.0 10.193.56.230:6789/0 45075 : cluster [INF] osd.29 10.193.56.231:6800/18876 boot 2017-12-18 12:01:14.600934 mon.node1 mon.0 10.193.56.230:6789/0 45076 : cluster [INF] osd.48 10.193.56.231:6830/19079 boot 2017-12-18 12:01:14.601006 mon.node1 mon.0 10.193.56.230:6789/0 45077 : cluster [INF] osd.12 10.193.56.232:6820/14439 boot 2017-12-18 12:01:14.601084 mon.node1 mon.0 10.193.56.230:6789/0 45078 : cluster [INF] osd.58 10.193.56.231:6852/19091 boot 2017-12-18 12:01:14.601185 mon.node1 mon.0 10.193.56.230:6789/0 45079 : cluster [INF] osd.32 10.193.56.232:6872/14936 boot 2017-12-18 12:01:14.601247 mon.node1 mon.0 10.193.56.230:6789/0 45080 : cluster [INF] osd.59 10.193.56.233:6876/8978 boot 2017-12-18 12:01:15.667846 mon.node1 mon.0 10.193.56.230:6789/0 45215 : cluster [INF] osd.71 10.193.56.234:6892/19913 boot 2017-12-18 12:01:15.667922 mon.node1 mon.0 10.193.56.230:6789/0 45216 : cluster [INF] osd.47 10.193.56.234:6800/19454 boot 2017-12-18 12:01:15.668136 mon.node1 mon.0 10.193.56.230:6789/0 45217 : cluster [INF] osd.61 10.193.56.234:6850/19788 boot 2017-12-18 12:01:15.668197 mon.node1 mon.0 10.193.56.230:6789/0 45218 : cluster [INF] osd.14 10.193.56.231:6873/19796 boot 2017-12-18 12:01:15.668275 mon.node1 mon.0 10.193.56.230:6789/0 45219 : cluster [INF] osd.60 10.193.56.230:6829/22921 boot 2017-12-18 12:01:15.669218 mon.node1 mon.0 10.193.56.230:6789/0 45220 : cluster [INF] osd.79 10.193.56.233:6824/8754 boot 2017-12-18 12:01:15.669394 mon.node1 mon.0 10.193.56.230:6789/0 45221 : cluster [INF] osd.41 10.193.56.232:6816/14755 boot 2017-12-18 12:01:15.669559 mon.node1 mon.0 10.193.56.230:6789/0 45222 : cluster [INF] osd.52 10.193.56.232:6805/14889 boot 2017-12-18 12:01:15.669644 mon.node1 mon.0 10.193.56.230:6789/0 45223 : cluster [INF] osd.25 10.193.56.230:6849/21681 boot 2017-12-18 12:01:15.669750 mon.node1 mon.0 10.193.56.230:6789/0 45224 : cluster [INF] osd.105 10.193.56.234:6863/20558 boot 2017-12-18 12:01:15.669997 mon.node1 mon.0 10.193.56.230:6789/0 45225 : cluster [INF] osd.7 10.193.56.232:6830/14389 boot 2017-12-18 12:01:15.670423 mon.node1 mon.0 10.193.56.230:6789/0 45226 : cluster [INF] osd.73 10.193.56.231:6860/19096 boot 2017-12-18 12:01:15.670527 mon.node1 mon.0 10.193.56.230:6789/0 45227 : cluster [INF] osd.9 10.193.56.231:6812/18722 boot 2017-12-18 12:01:15.808854 mon.node1 mon.0 10.193.56.230:6789/0 45348 : cluster [INF] osd.31 marked down after no beacon for 30.119637 seconds 2017-12-18 12:01:15.808902 mon.node1 mon.0 10.193.56.230:6789/0 45349 : cluster [INF] osd.39 marked down after no beacon for 30.240325 seconds 2017-12-18 12:01:15.934079 mon.node1 mon.0 10.193.56.230:6789/0 45352 : cluster [INF] osd.28 10.193.56.234:6841/19775 boot 2017-12-18 12:01:15.934158 mon.node1 mon.0 10.193.56.230:6789/0 45353 : cluster [INF] osd.64 10.193.56.233:6852/8155 boot 2017-12-18 12:01:15.934231 mon.node1 mon.0 10.193.56.230:6789/0 45354 : cluster [INF] osd.33 10.193.56.234:6834/20456 boot 2017-12-18 12:01:15.934516 mon.node1 mon.0 10.193.56.230:6789/0 45355 : cluster [INF] osd.45 10.193.56.230:6805/21358 boot 2017-12-18 12:01:15.934624 mon.node1 mon.0 10.193.56.230:6789/0 45356 : cluster [INF] osd.30 10.193.56.230:6809/21463 boot 2017-12-18 12:01:16.959276 mon.node1 mon.0 10.193.56.230:6789/0 45485 : cluster [WRN] Health check update: 35 osds down (OSD_DOWN) 2017-12-18 12:01:16.993201 mon.node1 mon.0 10.193.56.230:6789/0 45487 : cluster [INF] osd.88 10.193.56.230:6865/21713 boot 2017-12-18 12:01:16.993462 mon.node1 mon.0 10.193.56.230:6789/0 45488 : cluster [INF] osd.97 10.193.56.231:6804/18923 boot 2017-12-18 12:01:16.994066 mon.node1 mon.0 10.193.56.230:6789/0 45489 : cluster [INF] osd.24 10.193.56.231:6848/19081 boot 2017-12-18 12:01:16.994134 mon.node1 mon.0 10.193.56.230:6789/0 45490 : cluster [INF] osd.91 10.193.56.233:6832/8818 boot 2017-12-18 12:01:16.994196 mon.node1 mon.0 10.193.56.230:6789/0 45491 : cluster [INF] osd.22 10.193.56.232:6832/14785 boot 2017-12-18 12:01:16.994394 mon.node1 mon.0 10.193.56.230:6789/0 45492 : cluster [INF] osd.20 10.193.56.230:6877/21735 boot 2017-12-18 12:01:16.994538 mon.node1 mon.0 10.193.56.230:6789/0 45493 : cluster [INF] osd.101 10.193.56.233:6844/8869 boot 2017-12-18 12:01:16.994602 mon.node1 mon.0 10.193.56.230:6789/0 45494 : cluster [INF] osd.1 10.193.56.231:6844/19733 boot 2017-12-18 12:01:17.908896 mon.node1 mon.0 10.193.56.230:6789/0 45626 : cluster [INF] osd.49 marked down after no beacon for 31.277999 seconds 2017-12-18 12:01:17.908930 mon.node1 mon.0 10.193.56.230:6789/0 45627 : cluster [INF] osd.54 marked down after no beacon for 30.681509 seconds 2017-12-18 12:01:17.908950 mon.node1 mon.0 10.193.56.230:6789/0 45628 : cluster [INF] osd.74 marked down after no beacon for 31.282809 seconds 2017-12-18 12:01:17.975746 mon.node1 mon.0 10.193.56.230:6789/0 45631 : cluster [INF] osd.95 10.193.56.234:6849/19779 boot 2017-12-18 12:01:17.975867 mon.node1 mon.0 10.193.56.230:6789/0 45632 : cluster [INF] osd.34 10.193.56.231:6814/18931 boot 2017-12-18 12:01:17.976309 mon.node1 mon.0 10.193.56.230:6789/0 45633 : cluster [INF] osd.5 10.193.56.233:6804/8374 boot 2017-12-18 12:01:17.976438 mon.node1 mon.0 10.193.56.230:6789/0 45634 : cluster [INF] osd.4 10.193.56.230:6817/21049 boot 2017-12-18 12:01:17.977009 mon.node1 mon.0 10.193.56.230:6789/0 45635 : cluster [INF] osd.18 10.193.56.231:6838/18731 boot 2017-12-18 12:01:17.977481 mon.node1 mon.0 10.193.56.230:6789/0 45636 : cluster [INF] osd.40 10.193.56.230:6866/21699 boot 2017-12-18 12:01:17.977861 mon.node1 mon.0 10.193.56.230:6789/0 45637 : cluster [INF] osd.63 10.193.56.231:6892/19917 boot 2017-12-18 12:01:17.977923 mon.node1 mon.0 10.193.56.230:6789/0 45638 : cluster [INF] osd.17 10.193.56.232:6884/15688 boot 2017-12-18 12:01:19.034843 mon.node1 mon.0 10.193.56.230:6789/0 45768 : cluster [INF] osd.51 10.193.56.234:6847/19760 boot 2017-12-18 12:01:19.034925 mon.node1 mon.0 10.193.56.230:6789/0 45769 : cluster [INF] osd.56 10.193.56.234:6816/19600 boot 2017-12-18 12:01:19.034990 mon.node1 mon.0 10.193.56.230:6789/0 45770 : cluster [INF] osd.13 10.193.56.234:6812/19322 boot 2017-12-18 12:01:19.035049 mon.node1 mon.0 10.193.56.230:6789/0 45771 : cluster [INF] osd.49 10.193.56.233:6820/8076 boot 2017-12-18 12:01:19.035103 mon.node1 mon.0 10.193.56.230:6789/0 45772 : cluster [INF] osd.66 10.193.56.234:6804/19545 boot 2017-12-18 12:01:19.035157 mon.node1 mon.0 10.193.56.230:6789/0 45773 : cluster [INF] osd.6 10.193.56.230:6884/21174 boot 2017-12-18 12:01:19.036257 mon.node1 mon.0 10.193.56.230:6789/0 45774 : cluster [INF] osd.39 10.193.56.233:6812/8147 boot 2017-12-18 12:01:19.036601 mon.node1 mon.0 10.193.56.230:6789/0 45775 : cluster [INF] osd.31 10.193.56.233:6883/9331 boot 2017-12-18 12:01:19.038590 mon.node1 mon.0 10.193.56.230:6789/0 45776 : cluster [INF] osd.53 10.193.56.231:6862/19094 boot 2017-12-18 12:01:19.038724 mon.node1 mon.0 10.193.56.230:6789/0 45777 : cluster [INF] osd.46 10.193.56.232:6848/14795 boot 2017-12-18 12:01:19.038918 mon.node1 mon.0 10.193.56.230:6789/0 45778 : cluster [INF] osd.27 10.193.56.232:6803/15765 boot 2017-12-18 12:01:19.039025 mon.node1 mon.0 10.193.56.230:6789/0 45779 : cluster [INF] osd.8 10.193.56.234:6832/20423 boot 2017-12-18 12:01:19.039558 mon.node1 mon.0 10.193.56.230:6789/0 45780 : cluster [INF] osd.10 10.193.56.230:6861/21169 boot 2017-12-18 12:01:19.039709 mon.node1 mon.0 10.193.56.230:6789/0 45781 : cluster [INF] osd.98 10.193.56.230:6850/21674 boot 2017-12-18 12:01:19.039772 mon.node1 mon.0 10.193.56.230:6789/0 45782 : cluster [INF] osd.15 10.193.56.230:6825/21164 boot 2017-12-18 12:01:19.950347 mon.node1 mon.0 10.193.56.230:6789/0 45911 : cluster [WRN] Health check update: Reduced data availability: 620 pgs inactive, 1148 pgs down, 329 pgs peering (PG_AVAILABILITY) 2017-12-18 12:01:19.950375 mon.node1 mon.0 10.193.56.230:6789/0 45912 : cluster [WRN] Health check update: Degraded data redundancy: 308073/73044990 objects degraded (0.422%), 1791 pgs unclean, 362 pgs degraded (PG_DEGRADED) 2017-12-18 12:01:19.950408 mon.node1 mon.0 10.193.56.230:6789/0 45913 : cluster [INF] osd.69 marked down after no beacon for 31.385537 seconds 2017-12-18 12:01:20.017464 mon.node1 mon.0 10.193.56.230:6789/0 45915 : cluster [INF] osd.77 10.193.56.234:6885/20568 boot 2017-12-18 12:01:20.017543 mon.node1 mon.0 10.193.56.230:6789/0 45916 : cluster [INF] osd.2 10.193.56.234:6864/19328 boot 2017-12-18 12:01:20.017673 mon.node1 mon.0 10.193.56.230:6789/0 45917 : cluster [INF] osd.42 10.193.56.234:6808/19582 boot 2017-12-18 12:01:20.017729 mon.node1 mon.0 10.193.56.230:6789/0 45918 : cluster [INF] osd.19 10.193.56.234:6824/19324 boot 2017-12-18 12:01:20.019065 mon.node1 mon.0 10.193.56.230:6789/0 45919 : cluster [INF] osd.16 10.193.56.233:6892/8380 boot 2017-12-18 12:01:20.019383 mon.node1 mon.0 10.193.56.230:6789/0 45920 : cluster [INF] osd.67 10.193.56.232:6837/15771 boot 2017-12-18 12:01:20.019451 mon.node1 mon.0 10.193.56.230:6789/0 45921 : cluster [INF] osd.26 10.193.56.233:6848/8820 boot 2017-12-18 12:01:20.019616 mon.node1 mon.0 10.193.56.230:6789/0 45922 : cluster [INF] osd.54 10.193.56.233:6860/8166 boot 2017-12-18 12:01:20.019850 mon.node1 mon.0 10.193.56.230:6789/0 45923 : cluster [INF] osd.38 10.193.56.231:6808/18906 boot 2017-12-18 12:01:20.019923 mon.node1 mon.0 10.193.56.230:6789/0 45924 : cluster [INF] osd.50 10.193.56.230:6845/21662 boot 2017-12-18 12:01:20.020047 mon.node1 mon.0 10.193.56.230:6789/0 45925 : cluster [INF] osd.74 10.193.56.233:6864/8174 boot 2017-12-18 12:01:21.066317 mon.node1 mon.0 10.193.56.230:6789/0 46053 : cluster [INF] osd.69 10.193.56.233:6868/8159 boot 2017-12-18 12:01:21.067698 mon.node1 mon.0 10.193.56.230:6789/0 46054 : cluster [INF] osd.0 10.193.56.233:6881/8269 boot 2017-12-18 12:01:21.067835 mon.node1 mon.0 10.193.56.230:6789/0 46055 : cluster [INF] osd.55 10.193.56.230:6813/21652 boot 2017-12-18 12:01:21.067937 mon.node1 mon.0 10.193.56.230:6789/0 46056 : cluster [INF] osd.21 10.193.56.233:6816/8736 boot 2017-12-18 12:01:21.068158 mon.node1 mon.0 10.193.56.230:6789/0 46057 : cluster [INF] osd.70 10.193.56.230:6833/21659 boot 2017-12-18 12:01:21.068596 mon.node1 mon.0 10.193.56.230:6789/0 46058 : cluster [INF] osd.35 10.193.56.230:6821/21657 boot 2017-12-18 12:01:21.069067 mon.node1 mon.0 10.193.56.230:6789/0 46059 : cluster [INF] osd.23 10.193.56.234:6838/20481 boot 2017-12-18 12:01:21.991970 mon.node1 mon.0 10.193.56.230:6789/0 46180 : cluster [WRN] Health check update: 7 osds down (OSD_DOWN) 2017-12-18 12:01:22.123443 mon.node1 mon.0 10.193.56.230:6789/0 46182 : cluster [INF] osd.37 10.193.56.234:6828/19712 boot 2017-12-18 12:01:23.188191 mon.node1 mon.0 10.193.56.230:6789/0 46307 : cluster [INF] osd.57 10.193.56.232:6852/14841 boot 2017-12-18 12:01:23.188514 mon.node1 mon.0 10.193.56.230:6789/0 46308 : cluster [INF] osd.3 10.193.56.232:6876/14446 boot 2017-12-18 12:01:23.188585 mon.node1 mon.0 10.193.56.230:6789/0 46309 : cluster [INF] osd.62 10.193.56.232:6804/14880 boot 2017-12-18 12:01:23.188661 mon.node1 mon.0 10.193.56.230:6789/0 46310 : cluster [INF] osd.78 10.193.56.231:6868/19221 boot 2017-12-18 12:01:23.188710 mon.node1 mon.0 10.193.56.230:6789/0 46311 : cluster [INF] osd.44 10.193.56.233:6800/8627 boot 2017-12-18 12:01:24.218547 mon.node1 mon.0 10.193.56.230:6789/0 46433 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2017-12-18 12:01:24.249973 mon.node1 mon.0 10.193.56.230:6789/0 46434 : cluster [INF] osd.65 10.193.56.230:6837/21665 boot 2017-12-18 12:01:25.992537 mon.node1 mon.0 10.193.56.230:6789/0 46677 : cluster [WRN] Health check update: Reduced data availability: 318 pgs inactive, 894 pgs down, 479 pgs peering (PG_AVAILABILITY) 2017-12-18 12:01:25.992579 mon.node1 mon.0 10.193.56.230:6789/0 46678 : cluster [WRN] Health check update: Degraded data redundancy: 1406083/73045300 objects degraded (1.925%), 1795 pgs unclean, 493 pgs degraded (PG_DEGRADED) 2017-12-18 12:01:31.560590 mon.node1 mon.0 10.193.56.230:6789/0 46680 : cluster [WRN] Health check update: Degraded data redundancy: 56/73046270 objects degraded (0.000%), 8 pgs unclean, 21 pgs degraded (PG_DEGRADED) 2017-12-18 12:01:31.560621 mon.node1 mon.0 10.193.56.230:6789/0 46681 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 21 pgs peering) 2017-12-18 12:01:37.932035 mon.node1 mon.0 10.193.56.230:6789/0 46682 : cluster [WRN] Health check update: Degraded data redundancy: 63/73047430 objects degraded (0.000%), 10 pgs unclean, 19 pgs degraded (PG_DEGRADED) 2017-12-18 12:01:43.995279 mon.node1 mon.0 10.193.56.230:6789/0 46685 : cluster [WRN] Health check update: Degraded data redundancy: 88/73047810 objects degraded (0.000%), 10 pgs unclean, 18 pgs degraded (PG_DEGRADED) 2017-12-18 12:01:49.995911 mon.node1 mon.0 10.193.56.230:6789/0 46689 : cluster [WRN] Health check update: Degraded data redundancy: 113/73049010 objects degraded (0.000%), 10 pgs unclean, 16 pgs degraded (PG_DEGRADED) 2017-12-18 12:01:56.004463 mon.node1 mon.0 10.193.56.230:6789/0 46692 : cluster [WRN] Health check update: Degraded data redundancy: 139/73050190 objects degraded (0.000%), 12 pgs unclean, 15 pgs degraded (PG_DEGRADED) 2017-12-18 12:02:02.005973 mon.node1 mon.0 10.193.56.230:6789/0 46693 : cluster [WRN] Health check update: Degraded data redundancy: 116/73051360 objects degraded (0.000%), 13 pgs unclean, 13 pgs degraded (PG_DEGRADED) 2017-12-18 12:02:05.205583 mon.node1 mon.0 10.193.56.230:6789/0 46694 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 124/73052040 objects degraded (0.000%), 12 pgs unclean, 12 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 12:02:08.006605 mon.node1 mon.0 10.193.56.230:6789/0 46695 : cluster [WRN] Health check update: Degraded data redundancy: 124/73052350 objects degraded (0.000%), 12 pgs unclean, 12 pgs degraded (PG_DEGRADED) 2017-12-18 12:02:14.007208 mon.node1 mon.0 10.193.56.230:6789/0 46698 : cluster [WRN] Health check update: Degraded data redundancy: 102/73053320 objects degraded (0.000%), 10 pgs unclean, 10 pgs degraded (PG_DEGRADED) 2017-12-18 12:02:20.007843 mon.node1 mon.0 10.193.56.230:6789/0 46704 : cluster [WRN] Health check update: Degraded data redundancy: 118/73054180 objects degraded (0.000%), 9 pgs unclean, 9 pgs degraded (PG_DEGRADED) 2017-12-18 12:02:25.854649 mon.node1 mon.0 10.193.56.230:6789/0 46707 : cluster [WRN] Health check update: Degraded data redundancy: 115/73055240 objects degraded (0.000%), 7 pgs unclean, 7 pgs degraded (PG_DEGRADED) 2017-12-18 12:02:31.859671 mon.node1 mon.0 10.193.56.230:6789/0 46708 : cluster [WRN] Health check update: Degraded data redundancy: 95/73055790 objects degraded (0.000%), 6 pgs unclean, 6 pgs degraded (PG_DEGRADED) 2017-12-18 12:02:38.009635 mon.node1 mon.0 10.193.56.230:6789/0 46710 : cluster [WRN] Health check update: Degraded data redundancy: 31/73056470 objects degraded (0.000%), 4 pgs unclean, 4 pgs degraded (PG_DEGRADED) 2017-12-18 12:02:44.010229 mon.node1 mon.0 10.193.56.230:6789/0 46712 : cluster [WRN] Health check update: Degraded data redundancy: 11/73057190 objects degraded (0.000%), 2 pgs unclean, 2 pgs degraded (PG_DEGRADED) 2017-12-18 12:02:48.617193 mon.node1 mon.0 10.193.56.230:6789/0 46713 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 1 pg unclean, 1 pg degraded) 2017-12-18 12:03:05.205713 mon.node1 mon.0 10.193.56.230:6789/0 46716 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 12:06:03.958408 mon.node1 mon.0 10.193.56.230:6789/0 46758 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 12:06:03.958459 mon.node1 mon.0 10.193.56.230:6789/0 46759 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 12:06:03.958518 mon.node1 mon.0 10.193.56.230:6789/0 46760 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 12:06:03.958543 mon.node1 mon.0 10.193.56.230:6789/0 46761 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 12:11:03.958743 mon.node1 mon.0 10.193.56.230:6789/0 46820 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 12:11:03.959492 mon.node1 mon.0 10.193.56.230:6789/0 46821 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 12:11:03.961648 mon.node1 mon.0 10.193.56.230:6789/0 46822 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 12:11:03.962546 mon.node1 mon.0 10.193.56.230:6789/0 46823 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 12:16:03.958723 mon.node1 mon.0 10.193.56.230:6789/0 46878 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 12:16:03.958762 mon.node1 mon.0 10.193.56.230:6789/0 46879 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 12:16:03.958786 mon.node1 mon.0 10.193.56.230:6789/0 46880 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 12:16:03.958941 mon.node1 mon.0 10.193.56.230:6789/0 46881 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 12:21:03.958991 mon.node1 mon.0 10.193.56.230:6789/0 46937 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 12:21:03.959157 mon.node1 mon.0 10.193.56.230:6789/0 46938 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 12:21:03.960105 mon.node1 mon.0 10.193.56.230:6789/0 46939 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 12:21:03.961552 mon.node1 mon.0 10.193.56.230:6789/0 46940 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 12:26:03.958939 mon.node1 mon.0 10.193.56.230:6789/0 47006 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 12:26:03.958981 mon.node1 mon.0 10.193.56.230:6789/0 47007 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 12:26:03.959003 mon.node1 mon.0 10.193.56.230:6789/0 47008 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 12:26:03.959022 mon.node1 mon.0 10.193.56.230:6789/0 47009 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 12:31:03.959943 mon.node1 mon.0 10.193.56.230:6789/0 47067 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 12:31:03.960309 mon.node1 mon.0 10.193.56.230:6789/0 47068 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 12:31:03.960973 mon.node1 mon.0 10.193.56.230:6789/0 47069 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 12:31:03.961575 mon.node1 mon.0 10.193.56.230:6789/0 47070 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 12:36:03.959316 mon.node1 mon.0 10.193.56.230:6789/0 47137 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 12:36:03.959912 mon.node1 mon.0 10.193.56.230:6789/0 47138 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 12:36:03.961064 mon.node1 mon.0 10.193.56.230:6789/0 47139 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 12:36:03.962494 mon.node1 mon.0 10.193.56.230:6789/0 47140 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 12:41:03.959361 mon.node1 mon.0 10.193.56.230:6789/0 47208 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 12:41:03.959396 mon.node1 mon.0 10.193.56.230:6789/0 47209 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 12:41:03.959481 mon.node1 mon.0 10.193.56.230:6789/0 47210 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 12:41:03.959897 mon.node1 mon.0 10.193.56.230:6789/0 47211 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 12:46:03.960144 mon.node1 mon.0 10.193.56.230:6789/0 47269 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 12:46:03.960910 mon.node1 mon.0 10.193.56.230:6789/0 47270 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 12:46:03.964067 mon.node1 mon.0 10.193.56.230:6789/0 47271 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 12:46:03.964272 mon.node1 mon.0 10.193.56.230:6789/0 47272 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 12:51:03.959852 mon.node1 mon.0 10.193.56.230:6789/0 47337 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 12:51:03.959882 mon.node1 mon.0 10.193.56.230:6789/0 47338 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 12:51:03.959904 mon.node1 mon.0 10.193.56.230:6789/0 47339 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 12:51:03.960715 mon.node1 mon.0 10.193.56.230:6789/0 47340 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 12:56:03.959832 mon.node1 mon.0 10.193.56.230:6789/0 47398 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 12:56:03.959869 mon.node1 mon.0 10.193.56.230:6789/0 47399 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 12:56:03.959897 mon.node1 mon.0 10.193.56.230:6789/0 47400 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 12:56:03.959921 mon.node1 mon.0 10.193.56.230:6789/0 47401 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 13:00:00.000093 mon.node1 mon.0 10.193.56.230:6789/0 47457 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 13:01:03.960106 mon.node1 mon.0 10.193.56.230:6789/0 47472 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 13:01:03.961075 mon.node1 mon.0 10.193.56.230:6789/0 47473 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 13:01:03.961681 mon.node1 mon.0 10.193.56.230:6789/0 47474 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 13:01:03.962051 mon.node1 mon.0 10.193.56.230:6789/0 47475 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 13:06:03.961498 mon.node1 mon.0 10.193.56.230:6789/0 47532 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 13:06:03.961849 mon.node1 mon.0 10.193.56.230:6789/0 47533 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 13:06:03.964238 mon.node1 mon.0 10.193.56.230:6789/0 47534 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 13:06:03.965102 mon.node1 mon.0 10.193.56.230:6789/0 47535 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 13:11:03.960192 mon.node1 mon.0 10.193.56.230:6789/0 47595 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 13:11:03.960230 mon.node1 mon.0 10.193.56.230:6789/0 47596 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 13:11:03.960425 mon.node1 mon.0 10.193.56.230:6789/0 47597 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 13:11:03.960569 mon.node1 mon.0 10.193.56.230:6789/0 47598 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 13:16:03.960335 mon.node1 mon.0 10.193.56.230:6789/0 47649 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 13:16:03.960382 mon.node1 mon.0 10.193.56.230:6789/0 47650 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 13:16:03.960571 mon.node1 mon.0 10.193.56.230:6789/0 47651 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 13:16:03.960711 mon.node1 mon.0 10.193.56.230:6789/0 47652 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 13:21:03.960413 mon.node1 mon.0 10.193.56.230:6789/0 47729 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 13:21:03.960479 mon.node1 mon.0 10.193.56.230:6789/0 47730 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 13:21:03.960534 mon.node1 mon.0 10.193.56.230:6789/0 47731 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 13:21:03.961200 mon.node1 mon.0 10.193.56.230:6789/0 47732 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 13:26:03.960592 mon.node1 mon.0 10.193.56.230:6789/0 47805 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 13:26:03.960623 mon.node1 mon.0 10.193.56.230:6789/0 47806 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 13:26:03.960675 mon.node1 mon.0 10.193.56.230:6789/0 47807 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 13:26:03.960803 mon.node1 mon.0 10.193.56.230:6789/0 47808 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 13:31:03.960718 mon.node1 mon.0 10.193.56.230:6789/0 47864 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 13:31:03.960790 mon.node1 mon.0 10.193.56.230:6789/0 47865 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 13:31:03.965558 mon.node1 mon.0 10.193.56.230:6789/0 47866 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 13:31:03.966940 mon.node1 mon.0 10.193.56.230:6789/0 47867 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 13:36:03.960892 mon.node1 mon.0 10.193.56.230:6789/0 47926 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 13:36:03.960941 mon.node1 mon.0 10.193.56.230:6789/0 47927 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 13:36:03.960964 mon.node1 mon.0 10.193.56.230:6789/0 47928 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 13:36:03.960984 mon.node1 mon.0 10.193.56.230:6789/0 47929 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 13:41:03.960997 mon.node1 mon.0 10.193.56.230:6789/0 47982 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 13:41:03.961027 mon.node1 mon.0 10.193.56.230:6789/0 47983 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 13:41:03.961290 mon.node1 mon.0 10.193.56.230:6789/0 47984 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 13:41:03.962560 mon.node1 mon.0 10.193.56.230:6789/0 47985 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 13:46:03.961097 mon.node1 mon.0 10.193.56.230:6789/0 48055 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 13:46:03.961135 mon.node1 mon.0 10.193.56.230:6789/0 48056 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 13:46:03.961391 mon.node1 mon.0 10.193.56.230:6789/0 48057 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 13:46:03.961462 mon.node1 mon.0 10.193.56.230:6789/0 48058 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 13:51:03.961229 mon.node1 mon.0 10.193.56.230:6789/0 48127 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 13:51:03.961259 mon.node1 mon.0 10.193.56.230:6789/0 48128 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 13:51:03.961282 mon.node1 mon.0 10.193.56.230:6789/0 48129 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 13:51:03.962105 mon.node1 mon.0 10.193.56.230:6789/0 48130 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 13:56:03.961356 mon.node1 mon.0 10.193.56.230:6789/0 48191 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 13:56:03.961451 mon.node1 mon.0 10.193.56.230:6789/0 48192 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 13:56:03.961484 mon.node1 mon.0 10.193.56.230:6789/0 48193 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 13:56:03.961540 mon.node1 mon.0 10.193.56.230:6789/0 48194 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 14:00:00.000089 mon.node1 mon.0 10.193.56.230:6789/0 48238 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 14:01:03.961503 mon.node1 mon.0 10.193.56.230:6789/0 48250 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 14:01:03.961536 mon.node1 mon.0 10.193.56.230:6789/0 48251 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 14:01:03.961690 mon.node1 mon.0 10.193.56.230:6789/0 48252 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 14:01:03.962746 mon.node1 mon.0 10.193.56.230:6789/0 48253 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 14:06:03.963977 mon.node1 mon.0 10.193.56.230:6789/0 48310 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 14:06:03.964555 mon.node1 mon.0 10.193.56.230:6789/0 48311 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 14:06:03.966081 mon.node1 mon.0 10.193.56.230:6789/0 48312 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 14:06:03.969095 mon.node1 mon.0 10.193.56.230:6789/0 48313 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 14:11:03.962102 mon.node1 mon.0 10.193.56.230:6789/0 48378 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 14:11:03.962276 mon.node1 mon.0 10.193.56.230:6789/0 48379 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 14:11:03.963256 mon.node1 mon.0 10.193.56.230:6789/0 48380 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 14:11:03.963637 mon.node1 mon.0 10.193.56.230:6789/0 48381 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 14:16:03.961948 mon.node1 mon.0 10.193.56.230:6789/0 48441 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 14:16:03.961978 mon.node1 mon.0 10.193.56.230:6789/0 48442 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 14:16:03.965434 mon.node1 mon.0 10.193.56.230:6789/0 48443 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 14:16:03.967309 mon.node1 mon.0 10.193.56.230:6789/0 48444 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 14:21:03.962035 mon.node1 mon.0 10.193.56.230:6789/0 48503 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 14:21:03.962266 mon.node1 mon.0 10.193.56.230:6789/0 48504 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 14:21:03.962701 mon.node1 mon.0 10.193.56.230:6789/0 48505 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 14:21:03.963966 mon.node1 mon.0 10.193.56.230:6789/0 48506 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 14:26:03.962413 mon.node1 mon.0 10.193.56.230:6789/0 48583 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 14:26:03.962454 mon.node1 mon.0 10.193.56.230:6789/0 48584 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 14:26:03.962547 mon.node1 mon.0 10.193.56.230:6789/0 48585 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 14:26:03.969366 mon.node1 mon.0 10.193.56.230:6789/0 48586 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 14:31:03.962412 mon.node1 mon.0 10.193.56.230:6789/0 48658 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 14:31:03.962449 mon.node1 mon.0 10.193.56.230:6789/0 48659 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 14:31:03.963777 mon.node1 mon.0 10.193.56.230:6789/0 48660 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 14:31:04.301175 mon.node1 mon.0 10.193.56.230:6789/0 48661 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 14:36:03.962567 mon.node1 mon.0 10.193.56.230:6789/0 48730 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 14:36:03.962759 mon.node1 mon.0 10.193.56.230:6789/0 48731 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 14:36:03.963202 mon.node1 mon.0 10.193.56.230:6789/0 48732 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 14:36:03.963294 mon.node1 mon.0 10.193.56.230:6789/0 48733 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 14:41:03.962621 mon.node1 mon.0 10.193.56.230:6789/0 48795 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 14:41:03.962651 mon.node1 mon.0 10.193.56.230:6789/0 48796 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 14:41:03.962708 mon.node1 mon.0 10.193.56.230:6789/0 48797 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 14:41:03.962734 mon.node1 mon.0 10.193.56.230:6789/0 48798 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 14:46:03.962746 mon.node1 mon.0 10.193.56.230:6789/0 48856 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 14:46:03.962779 mon.node1 mon.0 10.193.56.230:6789/0 48857 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 14:46:03.962832 mon.node1 mon.0 10.193.56.230:6789/0 48858 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 14:46:03.962860 mon.node1 mon.0 10.193.56.230:6789/0 48859 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 14:51:03.962858 mon.node1 mon.0 10.193.56.230:6789/0 48931 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 14:51:03.962919 mon.node1 mon.0 10.193.56.230:6789/0 48932 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 14:51:03.962993 mon.node1 mon.0 10.193.56.230:6789/0 48933 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 14:51:03.963023 mon.node1 mon.0 10.193.56.230:6789/0 48934 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 14:56:03.962998 mon.node1 mon.0 10.193.56.230:6789/0 49005 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 14:56:03.963050 mon.node1 mon.0 10.193.56.230:6789/0 49006 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 14:56:03.963092 mon.node1 mon.0 10.193.56.230:6789/0 49007 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 14:56:03.963158 mon.node1 mon.0 10.193.56.230:6789/0 49008 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 15:00:00.000089 mon.node1 mon.0 10.193.56.230:6789/0 49050 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 15:01:03.963149 mon.node1 mon.0 10.193.56.230:6789/0 49064 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 15:01:03.963193 mon.node1 mon.0 10.193.56.230:6789/0 49065 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 15:01:03.963222 mon.node1 mon.0 10.193.56.230:6789/0 49066 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 15:01:03.963277 mon.node1 mon.0 10.193.56.230:6789/0 49067 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 15:06:03.963607 mon.node1 mon.0 10.193.56.230:6789/0 49129 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 15:06:03.964798 mon.node1 mon.0 10.193.56.230:6789/0 49130 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 15:06:03.965922 mon.node1 mon.0 10.193.56.230:6789/0 49131 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 15:06:03.969223 mon.node1 mon.0 10.193.56.230:6789/0 49132 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 15:11:03.963429 mon.node1 mon.0 10.193.56.230:6789/0 49184 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 15:11:03.963465 mon.node1 mon.0 10.193.56.230:6789/0 49185 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 15:11:03.963522 mon.node1 mon.0 10.193.56.230:6789/0 49186 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 15:11:03.966292 mon.node1 mon.0 10.193.56.230:6789/0 49187 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 15:16:03.963543 mon.node1 mon.0 10.193.56.230:6789/0 49252 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 15:16:03.963587 mon.node1 mon.0 10.193.56.230:6789/0 49253 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 15:16:03.963650 mon.node1 mon.0 10.193.56.230:6789/0 49254 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 15:16:03.963681 mon.node1 mon.0 10.193.56.230:6789/0 49255 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 15:21:03.967213 mon.node1 mon.0 10.193.56.230:6789/0 49306 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 15:21:03.967824 mon.node1 mon.0 10.193.56.230:6789/0 49307 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 15:21:03.968491 mon.node1 mon.0 10.193.56.230:6789/0 49308 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 15:21:03.968893 mon.node1 mon.0 10.193.56.230:6789/0 49309 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 15:26:03.964078 mon.node1 mon.0 10.193.56.230:6789/0 49374 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 15:26:03.964508 mon.node1 mon.0 10.193.56.230:6789/0 49375 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 15:26:03.964770 mon.node1 mon.0 10.193.56.230:6789/0 49376 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 15:26:03.967593 mon.node1 mon.0 10.193.56.230:6789/0 49377 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 15:31:03.963912 mon.node1 mon.0 10.193.56.230:6789/0 49444 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 15:31:03.964025 mon.node1 mon.0 10.193.56.230:6789/0 49445 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 15:31:03.964818 mon.node1 mon.0 10.193.56.230:6789/0 49446 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 15:31:03.966759 mon.node1 mon.0 10.193.56.230:6789/0 49447 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 15:36:03.963997 mon.node1 mon.0 10.193.56.230:6789/0 49510 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 15:36:03.964040 mon.node1 mon.0 10.193.56.230:6789/0 49511 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 15:36:03.964099 mon.node1 mon.0 10.193.56.230:6789/0 49512 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 15:36:03.964153 mon.node1 mon.0 10.193.56.230:6789/0 49513 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 15:41:03.964835 mon.node1 mon.0 10.193.56.230:6789/0 49563 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 15:41:03.966473 mon.node1 mon.0 10.193.56.230:6789/0 49564 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 15:41:03.966835 mon.node1 mon.0 10.193.56.230:6789/0 49565 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 15:41:03.967855 mon.node1 mon.0 10.193.56.230:6789/0 49566 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 15:46:03.964289 mon.node1 mon.0 10.193.56.230:6789/0 49630 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 15:46:03.964323 mon.node1 mon.0 10.193.56.230:6789/0 49631 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 15:46:03.964353 mon.node1 mon.0 10.193.56.230:6789/0 49632 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 15:46:03.964541 mon.node1 mon.0 10.193.56.230:6789/0 49633 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 15:51:03.964464 mon.node1 mon.0 10.193.56.230:6789/0 49696 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 15:51:03.964513 mon.node1 mon.0 10.193.56.230:6789/0 49697 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 15:51:03.964621 mon.node1 mon.0 10.193.56.230:6789/0 49698 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 15:51:03.964677 mon.node1 mon.0 10.193.56.230:6789/0 49699 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 15:56:03.967179 mon.node1 mon.0 10.193.56.230:6789/0 49760 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 15:56:03.967225 mon.node1 mon.0 10.193.56.230:6789/0 49761 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 15:56:03.967263 mon.node1 mon.0 10.193.56.230:6789/0 49762 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 15:56:03.970170 mon.node1 mon.0 10.193.56.230:6789/0 49763 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 16:00:00.000098 mon.node1 mon.0 10.193.56.230:6789/0 49810 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 16:01:03.964693 mon.node1 mon.0 10.193.56.230:6789/0 49826 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 16:01:03.964741 mon.node1 mon.0 10.193.56.230:6789/0 49827 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 16:01:03.965197 mon.node1 mon.0 10.193.56.230:6789/0 49828 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 16:01:03.965243 mon.node1 mon.0 10.193.56.230:6789/0 49829 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 16:06:03.965757 mon.node1 mon.0 10.193.56.230:6789/0 49888 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 16:06:03.966139 mon.node1 mon.0 10.193.56.230:6789/0 49889 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 16:06:03.968783 mon.node1 mon.0 10.193.56.230:6789/0 49890 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 16:06:04.176939 mon.node1 mon.0 10.193.56.230:6789/0 49891 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 16:11:03.964958 mon.node1 mon.0 10.193.56.230:6789/0 49941 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 16:11:03.964989 mon.node1 mon.0 10.193.56.230:6789/0 49942 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 16:11:03.965166 mon.node1 mon.0 10.193.56.230:6789/0 49943 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 16:11:03.971723 mon.node1 mon.0 10.193.56.230:6789/0 49944 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 16:16:03.965179 mon.node1 mon.0 10.193.56.230:6789/0 49993 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 16:16:03.965260 mon.node1 mon.0 10.193.56.230:6789/0 49994 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 16:16:03.965400 mon.node1 mon.0 10.193.56.230:6789/0 49995 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 16:16:03.965878 mon.node1 mon.0 10.193.56.230:6789/0 49996 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 16:21:03.965302 mon.node1 mon.0 10.193.56.230:6789/0 50063 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 16:21:03.965355 mon.node1 mon.0 10.193.56.230:6789/0 50064 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 16:21:03.966045 mon.node1 mon.0 10.193.56.230:6789/0 50065 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 16:21:03.966113 mon.node1 mon.0 10.193.56.230:6789/0 50066 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 16:26:03.965621 mon.node1 mon.0 10.193.56.230:6789/0 50130 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 16:26:03.966110 mon.node1 mon.0 10.193.56.230:6789/0 50131 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 16:26:03.967164 mon.node1 mon.0 10.193.56.230:6789/0 50132 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 16:26:03.967730 mon.node1 mon.0 10.193.56.230:6789/0 50133 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 16:31:03.965557 mon.node1 mon.0 10.193.56.230:6789/0 50203 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 16:31:03.965593 mon.node1 mon.0 10.193.56.230:6789/0 50204 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 16:31:03.965618 mon.node1 mon.0 10.193.56.230:6789/0 50205 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 16:31:03.965730 mon.node1 mon.0 10.193.56.230:6789/0 50206 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 16:36:03.965722 mon.node1 mon.0 10.193.56.230:6789/0 50275 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 16:36:03.965827 mon.node1 mon.0 10.193.56.230:6789/0 50276 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 16:36:03.968195 mon.node1 mon.0 10.193.56.230:6789/0 50277 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 16:36:04.232078 mon.node1 mon.0 10.193.56.230:6789/0 50278 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 16:41:03.965842 mon.node1 mon.0 10.193.56.230:6789/0 50342 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 16:41:03.966280 mon.node1 mon.0 10.193.56.230:6789/0 50343 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 16:41:03.966561 mon.node1 mon.0 10.193.56.230:6789/0 50344 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 16:41:03.968293 mon.node1 mon.0 10.193.56.230:6789/0 50345 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 16:46:03.966005 mon.node1 mon.0 10.193.56.230:6789/0 50403 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 16:46:03.966045 mon.node1 mon.0 10.193.56.230:6789/0 50404 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 16:46:03.966067 mon.node1 mon.0 10.193.56.230:6789/0 50405 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 16:46:03.967889 mon.node1 mon.0 10.193.56.230:6789/0 50406 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 16:51:03.966301 mon.node1 mon.0 10.193.56.230:6789/0 50460 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 16:51:03.966428 mon.node1 mon.0 10.193.56.230:6789/0 50461 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 16:51:03.968495 mon.node1 mon.0 10.193.56.230:6789/0 50462 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 16:51:03.969342 mon.node1 mon.0 10.193.56.230:6789/0 50463 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 16:56:03.966198 mon.node1 mon.0 10.193.56.230:6789/0 50517 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 16:56:03.966231 mon.node1 mon.0 10.193.56.230:6789/0 50518 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 16:56:03.966277 mon.node1 mon.0 10.193.56.230:6789/0 50519 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 16:56:03.970408 mon.node1 mon.0 10.193.56.230:6789/0 50520 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 17:00:00.000115 mon.node1 mon.0 10.193.56.230:6789/0 50564 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 17:01:03.966981 mon.node1 mon.0 10.193.56.230:6789/0 50577 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 17:01:03.968139 mon.node1 mon.0 10.193.56.230:6789/0 50578 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 17:01:03.969274 mon.node1 mon.0 10.193.56.230:6789/0 50579 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 17:01:03.974693 mon.node1 mon.0 10.193.56.230:6789/0 50580 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 17:06:03.966580 mon.node1 mon.0 10.193.56.230:6789/0 50635 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 17:06:03.967109 mon.node1 mon.0 10.193.56.230:6789/0 50636 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 17:06:03.967876 mon.node1 mon.0 10.193.56.230:6789/0 50637 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 17:06:03.968215 mon.node1 mon.0 10.193.56.230:6789/0 50638 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 17:11:03.966753 mon.node1 mon.0 10.193.56.230:6789/0 50825 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 17:11:03.970219 mon.node1 mon.0 10.193.56.230:6789/0 50826 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 17:11:03.970565 mon.node1 mon.0 10.193.56.230:6789/0 50827 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 17:11:03.970717 mon.node1 mon.0 10.193.56.230:6789/0 50828 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 17:16:03.966749 mon.node1 mon.0 10.193.56.230:6789/0 50887 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 17:16:03.967350 mon.node1 mon.0 10.193.56.230:6789/0 50888 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 17:16:03.970310 mon.node1 mon.0 10.193.56.230:6789/0 50889 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 17:16:03.973522 mon.node1 mon.0 10.193.56.230:6789/0 50890 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 17:21:03.966908 mon.node1 mon.0 10.193.56.230:6789/0 50952 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 17:21:03.966953 mon.node1 mon.0 10.193.56.230:6789/0 50953 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 17:21:03.966985 mon.node1 mon.0 10.193.56.230:6789/0 50954 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 17:21:03.967015 mon.node1 mon.0 10.193.56.230:6789/0 50955 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 17:26:03.967166 mon.node1 mon.0 10.193.56.230:6789/0 51020 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 17:26:03.969378 mon.node1 mon.0 10.193.56.230:6789/0 51021 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 17:26:03.969465 mon.node1 mon.0 10.193.56.230:6789/0 51022 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 17:26:03.969933 mon.node1 mon.0 10.193.56.230:6789/0 51023 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 17:31:03.967116 mon.node1 mon.0 10.193.56.230:6789/0 51073 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 17:31:03.967318 mon.node1 mon.0 10.193.56.230:6789/0 51074 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 17:31:03.967619 mon.node1 mon.0 10.193.56.230:6789/0 51075 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 17:31:03.971172 mon.node1 mon.0 10.193.56.230:6789/0 51076 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 17:36:03.967297 mon.node1 mon.0 10.193.56.230:6789/0 51131 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 17:36:03.967339 mon.node1 mon.0 10.193.56.230:6789/0 51132 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 17:36:03.967370 mon.node1 mon.0 10.193.56.230:6789/0 51133 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 17:36:03.967473 mon.node1 mon.0 10.193.56.230:6789/0 51134 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 17:41:03.969056 mon.node1 mon.0 10.193.56.230:6789/0 51194 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 17:41:03.969238 mon.node1 mon.0 10.193.56.230:6789/0 51195 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 17:41:03.970137 mon.node1 mon.0 10.193.56.230:6789/0 51196 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 17:41:03.970665 mon.node1 mon.0 10.193.56.230:6789/0 51197 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 17:46:03.967615 mon.node1 mon.0 10.193.56.230:6789/0 51260 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 17:46:03.967656 mon.node1 mon.0 10.193.56.230:6789/0 51261 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 17:46:03.967685 mon.node1 mon.0 10.193.56.230:6789/0 51262 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 17:46:03.967714 mon.node1 mon.0 10.193.56.230:6789/0 51263 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 17:51:03.967913 mon.node1 mon.0 10.193.56.230:6789/0 51328 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 17:51:03.968099 mon.node1 mon.0 10.193.56.230:6789/0 51329 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 17:51:03.968373 mon.node1 mon.0 10.193.56.230:6789/0 51330 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 17:51:03.968406 mon.node1 mon.0 10.193.56.230:6789/0 51331 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 17:56:03.970184 mon.node1 mon.0 10.193.56.230:6789/0 51381 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 17:56:03.972000 mon.node1 mon.0 10.193.56.230:6789/0 51382 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 17:56:03.972533 mon.node1 mon.0 10.193.56.230:6789/0 51383 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 17:56:03.975055 mon.node1 mon.0 10.193.56.230:6789/0 51384 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 18:00:00.000088 mon.node1 mon.0 10.193.56.230:6789/0 51427 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 18:01:03.967923 mon.node1 mon.0 10.193.56.230:6789/0 51445 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 18:01:03.967956 mon.node1 mon.0 10.193.56.230:6789/0 51446 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 18:01:03.968291 mon.node1 mon.0 10.193.56.230:6789/0 51447 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 18:01:03.969177 mon.node1 mon.0 10.193.56.230:6789/0 51448 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 18:06:03.968114 mon.node1 mon.0 10.193.56.230:6789/0 51508 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 18:06:03.968245 mon.node1 mon.0 10.193.56.230:6789/0 51509 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 18:06:03.968293 mon.node1 mon.0 10.193.56.230:6789/0 51510 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 18:06:03.968341 mon.node1 mon.0 10.193.56.230:6789/0 51511 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 18:11:03.968284 mon.node1 mon.0 10.193.56.230:6789/0 51702 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 18:11:03.968327 mon.node1 mon.0 10.193.56.230:6789/0 51703 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 18:11:03.968358 mon.node1 mon.0 10.193.56.230:6789/0 51704 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 18:11:03.971707 mon.node1 mon.0 10.193.56.230:6789/0 51705 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 18:16:03.968525 mon.node1 mon.0 10.193.56.230:6789/0 51764 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 18:16:03.968577 mon.node1 mon.0 10.193.56.230:6789/0 51765 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 18:16:03.968676 mon.node1 mon.0 10.193.56.230:6789/0 51766 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 18:16:03.969025 mon.node1 mon.0 10.193.56.230:6789/0 51767 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 18:21:03.968381 mon.node1 mon.0 10.193.56.230:6789/0 51838 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 18:21:03.968460 mon.node1 mon.0 10.193.56.230:6789/0 51839 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 18:21:03.968490 mon.node1 mon.0 10.193.56.230:6789/0 51840 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 18:21:03.968651 mon.node1 mon.0 10.193.56.230:6789/0 51841 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 18:26:03.969145 mon.node1 mon.0 10.193.56.230:6789/0 51895 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 18:26:03.969480 mon.node1 mon.0 10.193.56.230:6789/0 51896 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 18:26:03.969721 mon.node1 mon.0 10.193.56.230:6789/0 51897 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 18:26:03.971267 mon.node1 mon.0 10.193.56.230:6789/0 51898 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 18:31:03.968720 mon.node1 mon.0 10.193.56.230:6789/0 51963 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 18:31:03.968906 mon.node1 mon.0 10.193.56.230:6789/0 51964 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 18:31:03.969144 mon.node1 mon.0 10.193.56.230:6789/0 51965 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 18:31:03.971118 mon.node1 mon.0 10.193.56.230:6789/0 51966 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 18:36:03.969108 mon.node1 mon.0 10.193.56.230:6789/0 52023 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 18:36:03.969769 mon.node1 mon.0 10.193.56.230:6789/0 52024 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 18:36:03.971264 mon.node1 mon.0 10.193.56.230:6789/0 52025 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 18:36:03.973756 mon.node1 mon.0 10.193.56.230:6789/0 52026 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 18:41:03.969501 mon.node1 mon.0 10.193.56.230:6789/0 52082 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 18:41:03.970284 mon.node1 mon.0 10.193.56.230:6789/0 52083 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 18:41:03.971643 mon.node1 mon.0 10.193.56.230:6789/0 52084 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 18:41:03.972282 mon.node1 mon.0 10.193.56.230:6789/0 52085 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 18:46:03.969111 mon.node1 mon.0 10.193.56.230:6789/0 52169 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 18:46:03.969160 mon.node1 mon.0 10.193.56.230:6789/0 52170 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 18:46:03.969188 mon.node1 mon.0 10.193.56.230:6789/0 52171 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 18:46:03.970145 mon.node1 mon.0 10.193.56.230:6789/0 52172 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 18:51:03.969622 mon.node1 mon.0 10.193.56.230:6789/0 52236 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 18:51:03.971282 mon.node1 mon.0 10.193.56.230:6789/0 52237 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 18:51:03.971346 mon.node1 mon.0 10.193.56.230:6789/0 52238 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 18:51:03.972212 mon.node1 mon.0 10.193.56.230:6789/0 52239 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 18:56:03.969504 mon.node1 mon.0 10.193.56.230:6789/0 52311 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 18:56:03.969618 mon.node1 mon.0 10.193.56.230:6789/0 52312 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 18:56:03.969665 mon.node1 mon.0 10.193.56.230:6789/0 52313 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 18:56:03.970859 mon.node1 mon.0 10.193.56.230:6789/0 52314 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 18:56:43.145872 mon.node1 mon.0 10.193.56.230:6789/0 52324 : cluster [INF] osd.13 marked down after no beacon for 30.756964 seconds 2017-12-18 18:56:43.151904 mon.node1 mon.0 10.193.56.230:6789/0 52325 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2017-12-18 18:56:44.677862 mon.node1 mon.0 10.193.56.230:6789/0 52688 : cluster [WRN] Health check failed: Reduced data availability: 11 pgs peering (PG_AVAILABILITY) 2017-12-18 18:56:44.677900 mon.node1 mon.0 10.193.56.230:6789/0 52689 : cluster [WRN] Health check failed: Degraded data redundancy: 11 pgs unclean (PG_DEGRADED) 2017-12-18 18:56:50.014810 mon.node1 mon.0 10.193.56.230:6789/0 52690 : cluster [WRN] Health check update: Degraded data redundancy: 839348/86994580 objects degraded (0.965%), 102 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 18:56:50.014849 mon.node1 mon.0 10.193.56.230:6789/0 52691 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 30 pgs peering) 2017-12-18 18:56:55.162992 mon.node1 mon.0 10.193.56.230:6789/0 52694 : cluster [WRN] Health check update: Degraded data redundancy: 910278/86997310 objects degraded (1.046%), 130 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 18:57:00.709436 mon.node1 mon.0 10.193.56.230:6789/0 52700 : cluster [WRN] Health check update: Degraded data redundancy: 910998/87002530 objects degraded (1.047%), 149 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 18:57:06.053351 mon.node1 mon.0 10.193.56.230:6789/0 52703 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; 1 osds down; Degraded data redundancy: 911412/87004520 objects degraded (1.048%), 169 pgs unclean, 284 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 18:57:06.067827 mon.node1 mon.0 10.193.56.230:6789/0 52704 : cluster [WRN] Health check update: Degraded data redundancy: 911835/87006140 objects degraded (1.048%), 169 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 18:57:11.165115 mon.node1 mon.0 10.193.56.230:6789/0 52705 : cluster [WRN] Health check update: Degraded data redundancy: 912123/87007920 objects degraded (1.048%), 169 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 18:57:17.165806 mon.node1 mon.0 10.193.56.230:6789/0 52706 : cluster [WRN] Health check update: Degraded data redundancy: 912330/87010940 objects degraded (1.049%), 169 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 18:57:22.346502 mon.node1 mon.0 10.193.56.230:6789/0 52708 : cluster [WRN] Health check update: Degraded data redundancy: 912384/87015300 objects degraded (1.049%), 214 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 18:57:28.571336 mon.node1 mon.0 10.193.56.230:6789/0 52711 : cluster [WRN] Health check update: Degraded data redundancy: 912519/87019400 objects degraded (1.049%), 284 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 18:57:34.649171 mon.node1 mon.0 10.193.56.230:6789/0 52712 : cluster [WRN] Health check update: Degraded data redundancy: 913266/87023850 objects degraded (1.049%), 284 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 18:57:40.962092 mon.node1 mon.0 10.193.56.230:6789/0 52714 : cluster [WRN] Health check update: Degraded data redundancy: 913788/87027050 objects degraded (1.050%), 284 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 18:57:46.286773 mon.node1 mon.0 10.193.56.230:6789/0 52715 : cluster [WRN] Health check update: Degraded data redundancy: 914229/87030560 objects degraded (1.050%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:57:52.320411 mon.node1 mon.0 10.193.56.230:6789/0 52717 : cluster [WRN] Health check update: Degraded data redundancy: 914292/87034650 objects degraded (1.050%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:57:59.102804 mon.node1 mon.0 10.193.56.230:6789/0 52720 : cluster [WRN] Health check update: Degraded data redundancy: 914373/87038400 objects degraded (1.051%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:58:04.425890 mon.node1 mon.0 10.193.56.230:6789/0 52722 : cluster [WRN] Health check update: Degraded data redundancy: 914778/87042760 objects degraded (1.051%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:58:06.053486 mon.node1 mon.0 10.193.56.230:6789/0 52724 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; 1 osds down; Degraded data redundancy: 914778/87042760 objects degraded (1.051%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized; application not enabled on 10 pool(s) 2017-12-18 18:58:11.120100 mon.node1 mon.0 10.193.56.230:6789/0 52725 : cluster [WRN] Health check update: Degraded data redundancy: 915039/87044890 objects degraded (1.051%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:58:16.452511 mon.node1 mon.0 10.193.56.230:6789/0 52728 : cluster [WRN] Health check update: Degraded data redundancy: 915093/87047950 objects degraded (1.051%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:58:22.620887 mon.node1 mon.0 10.193.56.230:6789/0 52730 : cluster [WRN] Health check update: Degraded data redundancy: 915102/87051930 objects degraded (1.051%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:58:28.636741 mon.node1 mon.0 10.193.56.230:6789/0 52733 : cluster [WRN] Health check update: Degraded data redundancy: 915642/87056590 objects degraded (1.052%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:58:35.175676 mon.node1 mon.0 10.193.56.230:6789/0 52736 : cluster [WRN] Health check update: Degraded data redundancy: 916344/87060570 objects degraded (1.053%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:58:41.176345 mon.node1 mon.0 10.193.56.230:6789/0 52739 : cluster [WRN] Health check update: Degraded data redundancy: 917055/87063490 objects degraded (1.053%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:58:46.702185 mon.node1 mon.0 10.193.56.230:6789/0 52744 : cluster [WRN] Health check update: Degraded data redundancy: 917163/87066670 objects degraded (1.053%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:58:52.754155 mon.node1 mon.0 10.193.56.230:6789/0 52746 : cluster [WRN] Health check update: Degraded data redundancy: 917190/87070370 objects degraded (1.053%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:58:59.178382 mon.node1 mon.0 10.193.56.230:6789/0 52748 : cluster [WRN] Health check update: Degraded data redundancy: 917523/87073070 objects degraded (1.054%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:59:05.179145 mon.node1 mon.0 10.193.56.230:6789/0 52750 : cluster [WRN] Health check update: Degraded data redundancy: 918180/87078290 objects degraded (1.054%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:59:06.053602 mon.node1 mon.0 10.193.56.230:6789/0 52751 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; 1 osds down; Degraded data redundancy: 918369/87080380 objects degraded (1.055%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized; application not enabled on 10 pool(s) 2017-12-18 18:59:11.179868 mon.node1 mon.0 10.193.56.230:6789/0 52752 : cluster [WRN] Health check update: Degraded data redundancy: 918675/87082930 objects degraded (1.055%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:59:16.885702 mon.node1 mon.0 10.193.56.230:6789/0 52754 : cluster [WRN] Health check update: Degraded data redundancy: 918855/87087500 objects degraded (1.055%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:59:22.826273 mon.node1 mon.0 10.193.56.230:6789/0 52756 : cluster [WRN] Health check update: Degraded data redundancy: 918873/87091400 objects degraded (1.055%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:59:29.181776 mon.node1 mon.0 10.193.56.230:6789/0 52760 : cluster [WRN] Health check update: Degraded data redundancy: 919170/87093840 objects degraded (1.055%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:59:34.935135 mon.node1 mon.0 10.193.56.230:6789/0 52761 : cluster [WRN] Health check update: Degraded data redundancy: 920016/87099520 objects degraded (1.056%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:59:41.191180 mon.node1 mon.0 10.193.56.230:6789/0 52766 : cluster [WRN] Health check update: Degraded data redundancy: 920403/87101440 objects degraded (1.057%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:59:46.995389 mon.node1 mon.0 10.193.56.230:6789/0 52767 : cluster [WRN] Health check update: Degraded data redundancy: 920646/87105650 objects degraded (1.057%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:59:53.192590 mon.node1 mon.0 10.193.56.230:6789/0 52768 : cluster [WRN] Health check update: Degraded data redundancy: 920646/87106480 objects degraded (1.057%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 18:59:59.193308 mon.node1 mon.0 10.193.56.230:6789/0 52769 : cluster [WRN] Health check update: Degraded data redundancy: 921060/87108910 objects degraded (1.057%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:00:00.000082 mon.node1 mon.0 10.193.56.230:6789/0 52770 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; 1 osds down; Degraded data redundancy: 921159/87110170 objects degraded (1.057%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized; application not enabled on 10 pool(s) 2017-12-18 19:00:05.099643 mon.node1 mon.0 10.193.56.230:6789/0 52774 : cluster [WRN] Health check update: Degraded data redundancy: 921888/87114830 objects degraded (1.058%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:00:06.053716 mon.node1 mon.0 10.193.56.230:6789/0 52776 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; 1 osds down; Degraded data redundancy: 921888/87114830 objects degraded (1.058%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized; application not enabled on 10 pool(s) 2017-12-18 19:00:09.248974 mon.node1 mon.0 10.193.56.230:6789/0 52796 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2017-12-18 19:00:09.280107 mon.node1 mon.0 10.193.56.230:6789/0 52797 : cluster [INF] osd.13 10.193.56.234:6812/19322 boot 2017-12-18 19:00:11.194718 mon.node1 mon.0 10.193.56.230:6789/0 53038 : cluster [WRN] Health check update: Degraded data redundancy: 922293/87118430 objects degraded (1.059%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:00:11.358049 mon.node1 mon.0 10.193.56.230:6789/0 53039 : cluster [WRN] Health check failed: Reduced data availability: 9 pgs peering (PG_AVAILABILITY) 2017-12-18 19:00:08.332994 osd.13 osd.13 10.193.56.234:6812/19322 1 : cluster [WRN] Monitor daemon marked osd.13 down, but it is still running 2017-12-18 19:00:17.195431 mon.node1 mon.0 10.193.56.230:6789/0 53045 : cluster [WRN] Health check update: Reduced data availability: 3 pgs inactive, 4 pgs peering (PG_AVAILABILITY) 2017-12-18 19:00:17.195486 mon.node1 mon.0 10.193.56.230:6789/0 53046 : cluster [WRN] Health check update: Degraded data redundancy: 1372/87122910 objects degraded (0.002%), 269 pgs unclean, 242 pgs degraded (PG_DEGRADED) 2017-12-18 19:00:19.127194 mon.node1 mon.0 10.193.56.230:6789/0 53047 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive) 2017-12-18 19:00:23.147171 mon.node1 mon.0 10.193.56.230:6789/0 53049 : cluster [WRN] Health check update: Degraded data redundancy: 2765/87127260 objects degraded (0.003%), 256 pgs unclean, 256 pgs degraded (PG_DEGRADED) 2017-12-18 19:00:29.196748 mon.node1 mon.0 10.193.56.230:6789/0 53052 : cluster [WRN] Health check update: Degraded data redundancy: 2765/87129540 objects degraded (0.003%), 256 pgs unclean, 256 pgs degraded (PG_DEGRADED) 2017-12-18 19:00:35.197396 mon.node1 mon.0 10.193.56.230:6789/0 53053 : cluster [WRN] Health check update: Degraded data redundancy: 2765/87133160 objects degraded (0.003%), 256 pgs unclean, 256 pgs degraded (PG_DEGRADED) 2017-12-18 19:00:38.537066 mon.node1 mon.0 10.193.56.230:6789/0 53058 : cluster [INF] osd.13 failed (root=hci_default,host=node5) (2 reporters from different host after 20.000089 >= grace 20.000000) 2017-12-18 19:00:38.592288 mon.node1 mon.0 10.193.56.230:6789/0 53059 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2017-12-18 19:00:41.198070 mon.node1 mon.0 10.193.56.230:6789/0 53300 : cluster [WRN] Health check update: Degraded data redundancy: 1939/87137190 objects degraded (0.002%), 256 pgs unclean, 187 pgs degraded (PG_DEGRADED) 2017-12-18 19:00:41.670535 mon.node1 mon.0 10.193.56.230:6789/0 53301 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2017-12-18 19:00:41.670584 mon.node1 mon.0 10.193.56.230:6789/0 53302 : cluster [WRN] Health check failed: 4 slow requests are blocked > 32 sec (REQUEST_SLOW) 2017-12-18 19:00:45.816028 mon.node1 mon.0 10.193.56.230:6789/0 53304 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2017-12-18 19:00:47.198821 mon.node1 mon.0 10.193.56.230:6789/0 53305 : cluster [WRN] Health check update: Degraded data redundancy: 911367/87141130 objects degraded (1.046%), 262 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 19:00:47.198874 mon.node1 mon.0 10.193.56.230:6789/0 53306 : cluster [WRN] Health check update: 2 slow requests are blocked > 32 sec (REQUEST_SLOW) 2017-12-18 19:00:47.860693 mon.node1 mon.0 10.193.56.230:6789/0 53307 : cluster [INF] Health check cleared: REQUEST_SLOW (was: 2 slow requests are blocked > 32 sec) 2017-12-18 19:00:53.199602 mon.node1 mon.0 10.193.56.230:6789/0 53308 : cluster [WRN] Health check update: Degraded data redundancy: 912213/87145180 objects degraded (1.047%), 262 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 19:00:59.211462 mon.node1 mon.0 10.193.56.230:6789/0 53309 : cluster [WRN] Health check update: Degraded data redundancy: 912807/87148460 objects degraded (1.047%), 262 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 19:01:03.970344 mon.node1 mon.0 10.193.56.230:6789/0 53310 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 19:01:03.970606 mon.node1 mon.0 10.193.56.230:6789/0 53311 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 19:01:03.971767 mon.node1 mon.0 10.193.56.230:6789/0 53312 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 19:01:03.972337 mon.node1 mon.0 10.193.56.230:6789/0 53313 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 19:01:05.212179 mon.node1 mon.0 10.193.56.230:6789/0 53314 : cluster [WRN] Health check update: Degraded data redundancy: 913437/87152170 objects degraded (1.048%), 262 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 19:01:06.053839 mon.node1 mon.0 10.193.56.230:6789/0 53315 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; 1 osds down; Degraded data redundancy: 913725/87154190 objects degraded (1.048%), 262 pgs unclean, 284 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:01:11.212915 mon.node1 mon.0 10.193.56.230:6789/0 53318 : cluster [WRN] Health check update: Degraded data redundancy: 914184/87158110 objects degraded (1.049%), 262 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 19:01:17.213667 mon.node1 mon.0 10.193.56.230:6789/0 53320 : cluster [WRN] Health check update: Degraded data redundancy: 914490/87163610 objects degraded (1.049%), 284 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 19:01:23.214373 mon.node1 mon.0 10.193.56.230:6789/0 53321 : cluster [WRN] Health check update: Degraded data redundancy: 914733/87166720 objects degraded (1.049%), 284 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 19:01:28.337208 mon.node1 mon.0 10.193.56.230:6789/0 53326 : cluster [WRN] Health check update: Degraded data redundancy: 915183/87169470 objects degraded (1.050%), 284 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 19:01:33.522771 mon.node1 mon.0 10.193.56.230:6789/0 53327 : cluster [WRN] Health check update: Degraded data redundancy: 915399/87172400 objects degraded (1.050%), 284 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 19:01:39.216144 mon.node1 mon.0 10.193.56.230:6789/0 53330 : cluster [WRN] Health check update: Degraded data redundancy: 916002/87175710 objects degraded (1.051%), 284 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 19:01:44.227440 mon.node1 mon.0 10.193.56.230:6789/0 53332 : cluster [WRN] Health check update: Degraded data redundancy: 916497/87180910 objects degraded (1.051%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:01:49.651985 mon.node1 mon.0 10.193.56.230:6789/0 53333 : cluster [WRN] Health check update: Degraded data redundancy: 916695/87184650 objects degraded (1.051%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:01:55.217939 mon.node1 mon.0 10.193.56.230:6789/0 53334 : cluster [WRN] Health check update: Degraded data redundancy: 916866/87186670 objects degraded (1.052%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:02:01.218665 mon.node1 mon.0 10.193.56.230:6789/0 53335 : cluster [WRN] Health check update: Degraded data redundancy: 917091/87189430 objects degraded (1.052%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:02:06.053982 mon.node1 mon.0 10.193.56.230:6789/0 53336 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; 1 osds down; Degraded data redundancy: 917505/87192640 objects degraded (1.052%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized; application not enabled on 10 pool(s) 2017-12-18 19:02:07.219334 mon.node1 mon.0 10.193.56.230:6789/0 53337 : cluster [WRN] Health check update: Degraded data redundancy: 917505/87192640 objects degraded (1.052%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:02:13.220014 mon.node1 mon.0 10.193.56.230:6789/0 53338 : cluster [WRN] Health check update: Degraded data redundancy: 917982/87196790 objects degraded (1.053%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:02:19.220726 mon.node1 mon.0 10.193.56.230:6789/0 53340 : cluster [WRN] Health check update: Degraded data redundancy: 918054/87201770 objects degraded (1.053%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:02:25.221413 mon.node1 mon.0 10.193.56.230:6789/0 53342 : cluster [WRN] Health check update: Degraded data redundancy: 918180/87204510 objects degraded (1.053%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:02:30.409880 mon.node1 mon.0 10.193.56.230:6789/0 53346 : cluster [WRN] Health check update: Degraded data redundancy: 918351/87207380 objects degraded (1.053%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:02:36.017276 mon.node1 mon.0 10.193.56.230:6789/0 53347 : cluster [WRN] Health check update: Degraded data redundancy: 918351/87210130 objects degraded (1.053%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:02:41.223215 mon.node1 mon.0 10.193.56.230:6789/0 53351 : cluster [WRN] Health check update: Degraded data redundancy: 918351/87212020 objects degraded (1.053%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:02:46.581810 mon.node1 mon.0 10.193.56.230:6789/0 53354 : cluster [WRN] Health check update: Degraded data redundancy: 918873/87216450 objects degraded (1.054%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:02:52.854038 mon.node1 mon.0 10.193.56.230:6789/0 53355 : cluster [WRN] Health check update: Degraded data redundancy: 919566/87221570 objects degraded (1.054%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:02:58.034329 mon.node1 mon.0 10.193.56.230:6789/0 53360 : cluster [WRN] Health check update: Degraded data redundancy: 920313/87225970 objects degraded (1.055%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:03:03.225770 mon.node1 mon.0 10.193.56.230:6789/0 53361 : cluster [WRN] Health check update: Degraded data redundancy: 920781/87227920 objects degraded (1.056%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:03:06.054116 mon.node1 mon.0 10.193.56.230:6789/0 53362 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; 1 osds down; Degraded data redundancy: 920826/87228340 objects degraded (1.056%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized; application not enabled on 10 pool(s) 2017-12-18 19:03:09.004092 mon.node1 mon.0 10.193.56.230:6789/0 53365 : cluster [WRN] Health check update: Degraded data redundancy: 920943/87230230 objects degraded (1.056%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:03:14.153853 mon.node1 mon.0 10.193.56.230:6789/0 53366 : cluster [WRN] Health check update: Degraded data redundancy: 920943/87232800 objects degraded (1.056%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:03:19.230992 mon.node1 mon.0 10.193.56.230:6789/0 53368 : cluster [WRN] Health check update: Degraded data redundancy: 921114/87236230 objects degraded (1.056%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:03:24.500609 mon.node1 mon.0 10.193.56.230:6789/0 53373 : cluster [WRN] Health check update: Degraded data redundancy: 921726/87242730 objects degraded (1.057%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:03:30.671349 mon.node1 mon.0 10.193.56.230:6789/0 53375 : cluster [WRN] Health check update: Degraded data redundancy: 922428/87247440 objects degraded (1.057%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:03:36.266980 mon.node1 mon.0 10.193.56.230:6789/0 53376 : cluster [WRN] Health check update: Degraded data redundancy: 922815/87250660 objects degraded (1.058%), 284 pgs unclean, 284 pgs degraded, 284 pgs undersized (PG_DEGRADED) 2017-12-18 19:03:40.401623 mon.node1 mon.0 10.193.56.230:6789/0 53388 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2017-12-18 19:03:40.434243 mon.node1 mon.0 10.193.56.230:6789/0 53389 : cluster [INF] osd.13 10.193.56.234:6812/19322 boot 2017-12-18 19:03:42.588321 mon.node1 mon.0 10.193.56.230:6789/0 53750 : cluster [WRN] Health check failed: Reduced data availability: 13 pgs peering (PG_AVAILABILITY) 2017-12-18 19:03:42.588366 mon.node1 mon.0 10.193.56.230:6789/0 53751 : cluster [WRN] Health check update: Degraded data redundancy: 634209/87252420 objects degraded (0.727%), 280 pgs unclean, 224 pgs degraded, 194 pgs undersized (PG_DEGRADED) 2017-12-18 19:03:38.682068 osd.13 osd.13 10.193.56.234:6812/19322 3 : cluster [WRN] Monitor daemon marked osd.13 down, but it is still running 2017-12-18 19:03:48.282229 mon.node1 mon.0 10.193.56.230:6789/0 53753 : cluster [WRN] Health check update: Degraded data redundancy: 3944/87255740 objects degraded (0.005%), 256 pgs unclean, 256 pgs degraded (PG_DEGRADED) 2017-12-18 19:03:48.282270 mon.node1 mon.0 10.193.56.230:6789/0 53754 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2017-12-18 19:03:54.318243 mon.node1 mon.0 10.193.56.230:6789/0 53756 : cluster [WRN] Health check update: Degraded data redundancy: 4554/87260790 objects degraded (0.005%), 256 pgs unclean, 256 pgs degraded (PG_DEGRADED) 2017-12-18 19:04:00.671765 mon.node1 mon.0 10.193.56.230:6789/0 53757 : cluster [WRN] Health check update: Degraded data redundancy: 5211/87264810 objects degraded (0.006%), 256 pgs unclean, 256 pgs degraded (PG_DEGRADED) 2017-12-18 19:04:06.054269 mon.node1 mon.0 10.193.56.230:6789/0 53759 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 5571/87266250 objects degraded (0.006%), 255 pgs unclean, 255 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:04:06.421766 mon.node1 mon.0 10.193.56.230:6789/0 53760 : cluster [WRN] Health check update: Degraded data redundancy: 5703/87267060 objects degraded (0.007%), 255 pgs unclean, 255 pgs degraded (PG_DEGRADED) 2017-12-18 19:04:12.552027 mon.node1 mon.0 10.193.56.230:6789/0 53762 : cluster [WRN] Health check update: Degraded data redundancy: 5862/87268810 objects degraded (0.007%), 255 pgs unclean, 255 pgs degraded (PG_DEGRADED) 2017-12-18 19:04:18.723118 mon.node1 mon.0 10.193.56.230:6789/0 53765 : cluster [WRN] Health check update: Degraded data redundancy: 5854/87272750 objects degraded (0.007%), 255 pgs unclean, 255 pgs degraded (PG_DEGRADED) 2017-12-18 19:04:24.478477 mon.node1 mon.0 10.193.56.230:6789/0 53767 : cluster [WRN] Health check update: Degraded data redundancy: 6059/87278240 objects degraded (0.007%), 255 pgs unclean, 255 pgs degraded (PG_DEGRADED) 2017-12-18 19:04:30.586492 mon.node1 mon.0 10.193.56.230:6789/0 53768 : cluster [WRN] Health check update: Degraded data redundancy: 6687/87282810 objects degraded (0.008%), 255 pgs unclean, 255 pgs degraded (PG_DEGRADED) 2017-12-18 19:04:37.239506 mon.node1 mon.0 10.193.56.230:6789/0 53772 : cluster [WRN] Health check update: Degraded data redundancy: 7206/87285160 objects degraded (0.008%), 255 pgs unclean, 255 pgs degraded (PG_DEGRADED) 2017-12-18 19:04:42.656413 mon.node1 mon.0 10.193.56.230:6789/0 53775 : cluster [WRN] Health check update: Degraded data redundancy: 7652/87289760 objects degraded (0.009%), 255 pgs unclean, 255 pgs degraded (PG_DEGRADED) 2017-12-18 19:04:48.613024 mon.node1 mon.0 10.193.56.230:6789/0 53782 : cluster [WRN] Health check update: Degraded data redundancy: 7638/87293290 objects degraded (0.009%), 254 pgs unclean, 254 pgs degraded (PG_DEGRADED) 2017-12-18 19:04:55.112745 mon.node1 mon.0 10.193.56.230:6789/0 53786 : cluster [WRN] Health check update: Degraded data redundancy: 7789/87297820 objects degraded (0.009%), 254 pgs unclean, 254 pgs degraded (PG_DEGRADED) 2017-12-18 19:05:00.954184 mon.node1 mon.0 10.193.56.230:6789/0 53787 : cluster [WRN] Health check update: Degraded data redundancy: 8504/87302970 objects degraded (0.010%), 254 pgs unclean, 254 pgs degraded (PG_DEGRADED) 2017-12-18 19:05:06.054388 mon.node1 mon.0 10.193.56.230:6789/0 53788 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 9008/87305020 objects degraded (0.010%), 254 pgs unclean, 254 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:05:06.754460 mon.node1 mon.0 10.193.56.230:6789/0 53789 : cluster [WRN] Health check update: Degraded data redundancy: 9249/87306390 objects degraded (0.011%), 254 pgs unclean, 254 pgs degraded (PG_DEGRADED) 2017-12-18 19:05:12.887898 mon.node1 mon.0 10.193.56.230:6789/0 53790 : cluster [WRN] Health check update: Degraded data redundancy: 9589/87309360 objects degraded (0.011%), 254 pgs unclean, 254 pgs degraded (PG_DEGRADED) 2017-12-18 19:05:18.782259 mon.node1 mon.0 10.193.56.230:6789/0 53791 : cluster [WRN] Health check update: Degraded data redundancy: 9565/87312780 objects degraded (0.011%), 253 pgs unclean, 253 pgs degraded (PG_DEGRADED) 2017-12-18 19:05:24.817037 mon.node1 mon.0 10.193.56.230:6789/0 53796 : cluster [WRN] Health check update: Degraded data redundancy: 9632/87317510 objects degraded (0.011%), 253 pgs unclean, 253 pgs degraded (PG_DEGRADED) 2017-12-18 19:05:30.949984 mon.node1 mon.0 10.193.56.230:6789/0 53800 : cluster [WRN] Health check update: Degraded data redundancy: 10314/87322770 objects degraded (0.012%), 253 pgs unclean, 253 pgs degraded (PG_DEGRADED) 2017-12-18 19:05:36.934438 mon.node1 mon.0 10.193.56.230:6789/0 53801 : cluster [WRN] Health check update: Degraded data redundancy: 10905/87326380 objects degraded (0.012%), 253 pgs unclean, 253 pgs degraded (PG_DEGRADED) 2017-12-18 19:05:43.222248 mon.node1 mon.0 10.193.56.230:6789/0 53802 : cluster [WRN] Health check update: Degraded data redundancy: 11362/87328980 objects degraded (0.013%), 253 pgs unclean, 253 pgs degraded (PG_DEGRADED) 2017-12-18 19:05:48.951095 mon.node1 mon.0 10.193.56.230:6789/0 53803 : cluster [WRN] Health check update: Degraded data redundancy: 11321/87331900 objects degraded (0.013%), 252 pgs unclean, 252 pgs degraded (PG_DEGRADED) 2017-12-18 19:05:54.985563 mon.node1 mon.0 10.193.56.230:6789/0 53804 : cluster [WRN] Health check update: Degraded data redundancy: 11505/87336430 objects degraded (0.013%), 252 pgs unclean, 252 pgs degraded (PG_DEGRADED) 2017-12-18 19:05:59.523037 mon.node1 mon.0 10.193.56.230:6789/0 53807 : cluster [INF] osd.13 failed (root=hci_default,host=node5) (connection refused reported by osd.7) 2017-12-18 19:06:00.044637 mon.node1 mon.0 10.193.56.230:6789/0 53891 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2017-12-18 19:06:01.223766 mon.node1 mon.0 10.193.56.230:6789/0 54132 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive, 5 pgs peering (PG_AVAILABILITY) 2017-12-18 19:06:01.223801 mon.node1 mon.0 10.193.56.230:6789/0 54133 : cluster [WRN] Health check update: Degraded data redundancy: 186940/87342100 objects degraded (0.214%), 260 pgs unclean, 230 pgs degraded (PG_DEGRADED) 2017-12-18 19:06:03.969734 mon.node1 mon.0 10.193.56.230:6789/0 54254 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 19:06:03.969776 mon.node1 mon.0 10.193.56.230:6789/0 54255 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 19:06:03.969857 mon.node1 mon.0 10.193.56.230:6789/0 54256 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 19:06:03.969901 mon.node1 mon.0 10.193.56.230:6789/0 54257 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 19:06:06.054508 mon.node1 mon.0 10.193.56.230:6789/0 54259 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; 1 osds down; Reduced data availability: 1 pg inactive, 5 pgs peering; Degraded data redundancy: 781428/87344250 objects degraded (0.895%), 281 pgs unclean, 254 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:06:07.208973 mon.node1 mon.0 10.193.56.230:6789/0 54260 : cluster [WRN] Health check update: Degraded data redundancy: 906569/87345400 objects degraded (1.038%), 281 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 19:06:07.209004 mon.node1 mon.0 10.193.56.230:6789/0 54261 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive, 5 pgs peering) 2017-12-18 19:06:13.262144 mon.node1 mon.0 10.193.56.230:6789/0 54264 : cluster [WRN] Health check update: Degraded data redundancy: 913970/87347120 objects degraded (1.046%), 282 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 19:06:19.262901 mon.node1 mon.0 10.193.56.230:6789/0 54269 : cluster [WRN] Health check update: Degraded data redundancy: 914024/87349880 objects degraded (1.046%), 282 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 19:06:25.144716 mon.node1 mon.0 10.193.56.230:6789/0 54271 : cluster [WRN] Health check update: Degraded data redundancy: 914123/87355610 objects degraded (1.046%), 283 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 19:06:31.264303 mon.node1 mon.0 10.193.56.230:6789/0 54273 : cluster [WRN] Health check update: Degraded data redundancy: 914429/87359000 objects degraded (1.047%), 283 pgs unclean, 284 pgs degraded (PG_DEGRADED) 2017-12-18 19:06:34.428438 mon.node1 mon.0 10.193.56.230:6789/0 54276 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2017-12-18 19:06:34.454748 mon.node1 mon.0 10.193.56.230:6789/0 54277 : cluster [INF] osd.13 10.193.56.234:6812/22537 boot 2017-12-18 19:06:37.265043 mon.node1 mon.0 10.193.56.230:6789/0 54639 : cluster [WRN] Health check update: Degraded data redundancy: 839945/87363470 objects degraded (0.961%), 280 pgs unclean, 281 pgs degraded (PG_DEGRADED) 2017-12-18 19:06:43.265690 mon.node1 mon.0 10.193.56.230:6789/0 54642 : cluster [WRN] Health check update: Degraded data redundancy: 3151/87365520 objects degraded (0.004%), 254 pgs unclean, 254 pgs degraded (PG_DEGRADED) 2017-12-18 19:06:49.264710 mon.node1 mon.0 10.193.56.230:6789/0 54643 : cluster [WRN] Health check update: Degraded data redundancy: 3158/87368490 objects degraded (0.004%), 254 pgs unclean, 254 pgs degraded (PG_DEGRADED) 2017-12-18 19:06:55.274209 mon.node1 mon.0 10.193.56.230:6789/0 54646 : cluster [WRN] Health check update: Degraded data redundancy: 3156/87371430 objects degraded (0.004%), 254 pgs unclean, 254 pgs degraded (PG_DEGRADED) 2017-12-18 19:07:01.274887 mon.node1 mon.0 10.193.56.230:6789/0 54647 : cluster [WRN] Health check update: Degraded data redundancy: 3218/87375500 objects degraded (0.004%), 254 pgs unclean, 254 pgs degraded (PG_DEGRADED) 2017-12-18 19:07:06.054638 mon.node1 mon.0 10.193.56.230:6789/0 54649 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 3927/87379710 objects degraded (0.004%), 254 pgs unclean, 254 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:07:07.275584 mon.node1 mon.0 10.193.56.230:6789/0 54650 : cluster [WRN] Health check update: Degraded data redundancy: 3927/87379710 objects degraded (0.004%), 254 pgs unclean, 254 pgs degraded (PG_DEGRADED) 2017-12-18 19:07:13.276239 mon.node1 mon.0 10.193.56.230:6789/0 54653 : cluster [WRN] Health check update: Degraded data redundancy: 4778/87383090 objects degraded (0.005%), 253 pgs unclean, 253 pgs degraded (PG_DEGRADED) 2017-12-18 19:07:19.276963 mon.node1 mon.0 10.193.56.230:6789/0 54654 : cluster [WRN] Health check update: Degraded data redundancy: 5231/87386900 objects degraded (0.006%), 253 pgs unclean, 253 pgs degraded (PG_DEGRADED) 2017-12-18 19:07:25.277705 mon.node1 mon.0 10.193.56.230:6789/0 54656 : cluster [WRN] Health check update: Degraded data redundancy: 5422/87390670 objects degraded (0.006%), 253 pgs unclean, 253 pgs degraded (PG_DEGRADED) 2017-12-18 19:07:31.278361 mon.node1 mon.0 10.193.56.230:6789/0 54658 : cluster [WRN] Health check update: Degraded data redundancy: 5420/87394120 objects degraded (0.006%), 253 pgs unclean, 253 pgs degraded (PG_DEGRADED) 2017-12-18 19:07:37.279087 mon.node1 mon.0 10.193.56.230:6789/0 54659 : cluster [WRN] Health check update: Degraded data redundancy: 5679/87398510 objects degraded (0.006%), 252 pgs unclean, 252 pgs degraded (PG_DEGRADED) 2017-12-18 19:07:43.279790 mon.node1 mon.0 10.193.56.230:6789/0 54661 : cluster [WRN] Health check update: Degraded data redundancy: 6476/87403220 objects degraded (0.007%), 251 pgs unclean, 251 pgs degraded (PG_DEGRADED) 2017-12-18 19:07:49.280883 mon.node1 mon.0 10.193.56.230:6789/0 54664 : cluster [WRN] Health check update: Degraded data redundancy: 7050/87407720 objects degraded (0.008%), 251 pgs unclean, 251 pgs degraded (PG_DEGRADED) 2017-12-18 19:07:54.488348 mon.node1 mon.0 10.193.56.230:6789/0 54666 : cluster [WRN] Health check update: Degraded data redundancy: 7173/87411320 objects degraded (0.008%), 251 pgs unclean, 251 pgs degraded (PG_DEGRADED) 2017-12-18 19:07:59.609641 mon.node1 mon.0 10.193.56.230:6789/0 54667 : cluster [WRN] Health check update: Degraded data redundancy: 7171/87415070 objects degraded (0.008%), 251 pgs unclean, 251 pgs degraded (PG_DEGRADED) 2017-12-18 19:08:05.282527 mon.node1 mon.0 10.193.56.230:6789/0 54669 : cluster [WRN] Health check update: Degraded data redundancy: 7187/87417040 objects degraded (0.008%), 251 pgs unclean, 251 pgs degraded (PG_DEGRADED) 2017-12-18 19:08:06.054761 mon.node1 mon.0 10.193.56.230:6789/0 54671 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 7187/87417040 objects degraded (0.008%), 251 pgs unclean, 251 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:08:11.283187 mon.node1 mon.0 10.193.56.230:6789/0 54673 : cluster [WRN] Health check update: Degraded data redundancy: 7958/87420350 objects degraded (0.009%), 251 pgs unclean, 251 pgs degraded (PG_DEGRADED) 2017-12-18 19:08:17.283883 mon.node1 mon.0 10.193.56.230:6789/0 54677 : cluster [WRN] Health check update: Degraded data redundancy: 8556/87424060 objects degraded (0.010%), 249 pgs unclean, 249 pgs degraded (PG_DEGRADED) 2017-12-18 19:08:23.284567 mon.node1 mon.0 10.193.56.230:6789/0 54679 : cluster [WRN] Health check update: Degraded data redundancy: 8850/87427440 objects degraded (0.010%), 249 pgs unclean, 249 pgs degraded (PG_DEGRADED) 2017-12-18 19:08:28.654610 mon.node1 mon.0 10.193.56.230:6789/0 54681 : cluster [WRN] Health check update: Degraded data redundancy: 8848/87429060 objects degraded (0.010%), 249 pgs unclean, 249 pgs degraded (PG_DEGRADED) 2017-12-18 19:08:33.874431 mon.node1 mon.0 10.193.56.230:6789/0 54684 : cluster [WRN] Health check update: Degraded data redundancy: 8882/87432080 objects degraded (0.010%), 249 pgs unclean, 249 pgs degraded (PG_DEGRADED) 2017-12-18 19:08:39.286363 mon.node1 mon.0 10.193.56.230:6789/0 54685 : cluster [WRN] Health check update: Degraded data redundancy: 9392/87435540 objects degraded (0.011%), 249 pgs unclean, 249 pgs degraded (PG_DEGRADED) 2017-12-18 19:08:44.414129 mon.node1 mon.0 10.193.56.230:6789/0 54689 : cluster [WRN] Health check update: Degraded data redundancy: 9813/87441160 objects degraded (0.011%), 249 pgs unclean, 249 pgs degraded (PG_DEGRADED) 2017-12-18 19:08:49.927243 mon.node1 mon.0 10.193.56.230:6789/0 54691 : cluster [WRN] Health check update: Degraded data redundancy: 10411/87445900 objects degraded (0.012%), 248 pgs unclean, 248 pgs degraded (PG_DEGRADED) 2017-12-18 19:08:55.288192 mon.node1 mon.0 10.193.56.230:6789/0 54694 : cluster [WRN] Health check update: Degraded data redundancy: 10508/87447110 objects degraded (0.012%), 248 pgs unclean, 248 pgs degraded (PG_DEGRADED) 2017-12-18 19:09:01.288851 mon.node1 mon.0 10.193.56.230:6789/0 54695 : cluster [WRN] Health check update: Degraded data redundancy: 10505/87449030 objects degraded (0.012%), 248 pgs unclean, 248 pgs degraded (PG_DEGRADED) 2017-12-18 19:09:06.054901 mon.node1 mon.0 10.193.56.230:6789/0 54697 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 10657/87452190 objects degraded (0.012%), 247 pgs unclean, 247 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:09:07.289526 mon.node1 mon.0 10.193.56.230:6789/0 54698 : cluster [WRN] Health check update: Degraded data redundancy: 10657/87452190 objects degraded (0.012%), 247 pgs unclean, 247 pgs degraded (PG_DEGRADED) 2017-12-18 19:09:13.290341 mon.node1 mon.0 10.193.56.230:6789/0 54699 : cluster [WRN] Health check update: Degraded data redundancy: 11310/87458890 objects degraded (0.013%), 247 pgs unclean, 247 pgs degraded (PG_DEGRADED) 2017-12-18 19:09:18.427595 mon.node1 mon.0 10.193.56.230:6789/0 54702 : cluster [WRN] Health check update: Degraded data redundancy: 11839/87465440 objects degraded (0.014%), 247 pgs unclean, 247 pgs degraded (PG_DEGRADED) 2017-12-18 19:09:24.586316 mon.node1 mon.0 10.193.56.230:6789/0 54710 : cluster [WRN] Health check update: Degraded data redundancy: 12225/87469330 objects degraded (0.014%), 246 pgs unclean, 246 pgs degraded (PG_DEGRADED) 2017-12-18 19:09:30.197261 mon.node1 mon.0 10.193.56.230:6789/0 54712 : cluster [WRN] Health check update: Degraded data redundancy: 12229/87470820 objects degraded (0.014%), 246 pgs unclean, 246 pgs degraded (PG_DEGRADED) 2017-12-18 19:09:35.300547 mon.node1 mon.0 10.193.56.230:6789/0 54713 : cluster [WRN] Health check update: Degraded data redundancy: 12274/87472030 objects degraded (0.014%), 246 pgs unclean, 246 pgs degraded (PG_DEGRADED) 2017-12-18 19:09:40.502799 mon.node1 mon.0 10.193.56.230:6789/0 54716 : cluster [WRN] Health check update: Degraded data redundancy: 12559/87476630 objects degraded (0.014%), 245 pgs unclean, 245 pgs degraded (PG_DEGRADED) 2017-12-18 19:09:46.243347 mon.node1 mon.0 10.193.56.230:6789/0 54718 : cluster [WRN] Health check update: Degraded data redundancy: 13203/87482220 objects degraded (0.015%), 245 pgs unclean, 245 pgs degraded (PG_DEGRADED) 2017-12-18 19:09:51.302339 mon.node1 mon.0 10.193.56.230:6789/0 54720 : cluster [WRN] Health check update: Degraded data redundancy: 13464/87485750 objects degraded (0.015%), 245 pgs unclean, 245 pgs degraded (PG_DEGRADED) 2017-12-18 19:09:57.303023 mon.node1 mon.0 10.193.56.230:6789/0 54722 : cluster [WRN] Health check update: Degraded data redundancy: 13702/87488780 objects degraded (0.016%), 245 pgs unclean, 245 pgs degraded (PG_DEGRADED) 2017-12-18 19:10:02.359658 mon.node1 mon.0 10.193.56.230:6789/0 54723 : cluster [WRN] Health check update: Degraded data redundancy: 13700/87489980 objects degraded (0.016%), 245 pgs unclean, 245 pgs degraded (PG_DEGRADED) 2017-12-18 19:10:06.055047 mon.node1 mon.0 10.193.56.230:6789/0 54724 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 13736/87490190 objects degraded (0.016%), 245 pgs unclean, 245 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:10:08.362515 mon.node1 mon.0 10.193.56.230:6789/0 54725 : cluster [WRN] Health check update: Degraded data redundancy: 13905/87492970 objects degraded (0.016%), 244 pgs unclean, 244 pgs degraded (PG_DEGRADED) 2017-12-18 19:10:14.523070 mon.node1 mon.0 10.193.56.230:6789/0 54726 : cluster [WRN] Health check update: Degraded data redundancy: 14542/87498810 objects degraded (0.017%), 244 pgs unclean, 244 pgs degraded (PG_DEGRADED) 2017-12-18 19:10:20.434018 mon.node1 mon.0 10.193.56.230:6789/0 54727 : cluster [WRN] Health check update: Degraded data redundancy: 14987/87504640 objects degraded (0.017%), 244 pgs unclean, 244 pgs degraded (PG_DEGRADED) 2017-12-18 19:10:26.463337 mon.node1 mon.0 10.193.56.230:6789/0 54728 : cluster [WRN] Health check update: Degraded data redundancy: 15021/87508190 objects degraded (0.017%), 243 pgs unclean, 243 pgs degraded (PG_DEGRADED) 2017-12-18 19:10:32.561690 mon.node1 mon.0 10.193.56.230:6789/0 54730 : cluster [WRN] Health check update: Degraded data redundancy: 15018/87509610 objects degraded (0.017%), 243 pgs unclean, 243 pgs degraded (PG_DEGRADED) 2017-12-18 19:10:38.762961 mon.node1 mon.0 10.193.56.230:6789/0 54733 : cluster [WRN] Health check update: Degraded data redundancy: 15187/87512280 objects degraded (0.017%), 243 pgs unclean, 243 pgs degraded (PG_DEGRADED) 2017-12-18 19:10:45.214680 mon.node1 mon.0 10.193.56.230:6789/0 54736 : cluster [WRN] Health check update: Degraded data redundancy: 15356/87516770 objects degraded (0.018%), 243 pgs unclean, 243 pgs degraded (PG_DEGRADED) 2017-12-18 19:10:50.599437 mon.node1 mon.0 10.193.56.230:6789/0 54737 : cluster [WRN] Health check update: Degraded data redundancy: 16002/87521920 objects degraded (0.018%), 243 pgs unclean, 243 pgs degraded (PG_DEGRADED) 2017-12-18 19:10:56.632020 mon.node1 mon.0 10.193.56.230:6789/0 54740 : cluster [WRN] Health check update: Degraded data redundancy: 16513/87526220 objects degraded (0.019%), 243 pgs unclean, 243 pgs degraded (PG_DEGRADED) 2017-12-18 19:11:02.992406 mon.node1 mon.0 10.193.56.230:6789/0 54742 : cluster [WRN] Health check update: Degraded data redundancy: 16447/87527850 objects degraded (0.019%), 242 pgs unclean, 242 pgs degraded (PG_DEGRADED) 2017-12-18 19:11:03.969825 mon.node1 mon.0 10.193.56.230:6789/0 54743 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 19:11:03.969892 mon.node1 mon.0 10.193.56.230:6789/0 54744 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 19:11:03.969917 mon.node1 mon.0 10.193.56.230:6789/0 54745 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 19:11:03.970104 mon.node1 mon.0 10.193.56.230:6789/0 54746 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 19:11:06.055256 mon.node1 mon.0 10.193.56.230:6789/0 54747 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 16445/87528140 objects degraded (0.019%), 242 pgs unclean, 242 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:11:08.695683 mon.node1 mon.0 10.193.56.230:6789/0 54749 : cluster [WRN] Health check update: Degraded data redundancy: 16445/87529750 objects degraded (0.019%), 242 pgs unclean, 242 pgs degraded (PG_DEGRADED) 2017-12-18 19:11:14.806139 mon.node1 mon.0 10.193.56.230:6789/0 54751 : cluster [WRN] Health check update: Degraded data redundancy: 16530/87534160 objects degraded (0.019%), 242 pgs unclean, 242 pgs degraded (PG_DEGRADED) 2017-12-18 19:11:20.765380 mon.node1 mon.0 10.193.56.230:6789/0 54752 : cluster [WRN] Health check update: Degraded data redundancy: 17032/87539060 objects degraded (0.019%), 241 pgs unclean, 241 pgs degraded (PG_DEGRADED) 2017-12-18 19:11:26.798217 mon.node1 mon.0 10.193.56.230:6789/0 54758 : cluster [WRN] Health check update: Degraded data redundancy: 17694/87544210 objects degraded (0.020%), 241 pgs unclean, 241 pgs degraded (PG_DEGRADED) 2017-12-18 19:11:32.943950 mon.node1 mon.0 10.193.56.230:6789/0 54760 : cluster [WRN] Health check update: Degraded data redundancy: 18331/87547460 objects degraded (0.021%), 240 pgs unclean, 240 pgs degraded (PG_DEGRADED) 2017-12-18 19:11:38.903332 mon.node1 mon.0 10.193.56.230:6789/0 54763 : cluster [WRN] Health check update: Degraded data redundancy: 18572/87549140 objects degraded (0.021%), 240 pgs unclean, 240 pgs degraded (PG_DEGRADED) 2017-12-18 19:11:45.074699 mon.node1 mon.0 10.193.56.230:6789/0 54765 : cluster [WRN] Health check update: Degraded data redundancy: 18569/87552700 objects degraded (0.021%), 240 pgs unclean, 240 pgs degraded (PG_DEGRADED) 2017-12-18 19:11:51.267951 mon.node1 mon.0 10.193.56.230:6789/0 54766 : cluster [WRN] Health check update: Degraded data redundancy: 18774/87557540 objects degraded (0.021%), 240 pgs unclean, 240 pgs degraded (PG_DEGRADED) 2017-12-18 19:11:57.004885 mon.node1 mon.0 10.193.56.230:6789/0 54768 : cluster [WRN] Health check update: Degraded data redundancy: 19228/87563790 objects degraded (0.022%), 239 pgs unclean, 239 pgs degraded (PG_DEGRADED) 2017-12-18 19:12:03.211552 mon.node1 mon.0 10.193.56.230:6789/0 54770 : cluster [WRN] Health check update: Degraded data redundancy: 19622/87567530 objects degraded (0.022%), 239 pgs unclean, 239 pgs degraded (PG_DEGRADED) 2017-12-18 19:12:06.055378 mon.node1 mon.0 10.193.56.230:6789/0 54771 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 19802/87568560 objects degraded (0.023%), 239 pgs unclean, 239 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:12:09.064618 mon.node1 mon.0 10.193.56.230:6789/0 54772 : cluster [WRN] Health check update: Degraded data redundancy: 19863/87570030 objects degraded (0.023%), 238 pgs unclean, 238 pgs degraded (PG_DEGRADED) 2017-12-18 19:12:15.138311 mon.node1 mon.0 10.193.56.230:6789/0 54775 : cluster [WRN] Health check update: Degraded data redundancy: 19897/87572730 objects degraded (0.023%), 238 pgs unclean, 238 pgs degraded (PG_DEGRADED) 2017-12-18 19:12:21.330337 mon.node1 mon.0 10.193.56.230:6789/0 54777 : cluster [WRN] Health check update: Degraded data redundancy: 19895/87574980 objects degraded (0.023%), 238 pgs unclean, 238 pgs degraded (PG_DEGRADED) 2017-12-18 19:12:27.331110 mon.node1 mon.0 10.193.56.230:6789/0 54780 : cluster [WRN] Health check update: Degraded data redundancy: 20172/87579700 objects degraded (0.023%), 238 pgs unclean, 238 pgs degraded (PG_DEGRADED) 2017-12-18 19:12:33.286661 mon.node1 mon.0 10.193.56.230:6789/0 54781 : cluster [WRN] Health check update: Degraded data redundancy: 20959/87585850 objects degraded (0.024%), 238 pgs unclean, 238 pgs degraded (PG_DEGRADED) 2017-12-18 19:12:39.276763 mon.node1 mon.0 10.193.56.230:6789/0 54783 : cluster [WRN] Health check update: Degraded data redundancy: 21299/87587300 objects degraded (0.024%), 238 pgs unclean, 238 pgs degraded (PG_DEGRADED) 2017-12-18 19:12:45.333670 mon.node1 mon.0 10.193.56.230:6789/0 54786 : cluster [WRN] Health check update: Degraded data redundancy: 21423/87588020 objects degraded (0.024%), 238 pgs unclean, 238 pgs degraded (PG_DEGRADED) 2017-12-18 19:12:51.334324 mon.node1 mon.0 10.193.56.230:6789/0 54788 : cluster [WRN] Health check update: Degraded data redundancy: 21492/87591160 objects degraded (0.025%), 238 pgs unclean, 238 pgs degraded (PG_DEGRADED) 2017-12-18 19:12:57.334930 mon.node1 mon.0 10.193.56.230:6789/0 54790 : cluster [WRN] Health check update: Degraded data redundancy: 21469/87595530 objects degraded (0.025%), 237 pgs unclean, 237 pgs degraded (PG_DEGRADED) 2017-12-18 19:13:03.335579 mon.node1 mon.0 10.193.56.230:6789/0 54792 : cluster [WRN] Health check update: Degraded data redundancy: 22088/87601380 objects degraded (0.025%), 237 pgs unclean, 237 pgs degraded (PG_DEGRADED) 2017-12-18 19:13:06.055499 mon.node1 mon.0 10.193.56.230:6789/0 54794 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 22329/87603760 objects degraded (0.025%), 237 pgs unclean, 237 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:13:09.336246 mon.node1 mon.0 10.193.56.230:6789/0 54796 : cluster [WRN] Health check update: Degraded data redundancy: 22644/87605800 objects degraded (0.026%), 237 pgs unclean, 237 pgs degraded (PG_DEGRADED) 2017-12-18 19:13:15.336902 mon.node1 mon.0 10.193.56.230:6789/0 54798 : cluster [WRN] Health check update: Degraded data redundancy: 23127/87609850 objects degraded (0.026%), 237 pgs unclean, 237 pgs degraded (PG_DEGRADED) 2017-12-18 19:13:21.337576 mon.node1 mon.0 10.193.56.230:6789/0 54799 : cluster [WRN] Health check update: Degraded data redundancy: 23062/87614040 objects degraded (0.026%), 236 pgs unclean, 236 pgs degraded (PG_DEGRADED) 2017-12-18 19:13:27.338256 mon.node1 mon.0 10.193.56.230:6789/0 54802 : cluster [WRN] Health check update: Degraded data redundancy: 23068/87617810 objects degraded (0.026%), 236 pgs unclean, 236 pgs degraded (PG_DEGRADED) 2017-12-18 19:13:33.338922 mon.node1 mon.0 10.193.56.230:6789/0 54804 : cluster [WRN] Health check update: Degraded data redundancy: 23586/87622480 objects degraded (0.027%), 236 pgs unclean, 236 pgs degraded (PG_DEGRADED) 2017-12-18 19:13:39.339635 mon.node1 mon.0 10.193.56.230:6789/0 54807 : cluster [WRN] Health check update: Degraded data redundancy: 23935/87626340 objects degraded (0.027%), 235 pgs unclean, 235 pgs degraded (PG_DEGRADED) 2017-12-18 19:13:45.340297 mon.node1 mon.0 10.193.56.230:6789/0 54809 : cluster [WRN] Health check update: Degraded data redundancy: 24338/87629760 objects degraded (0.028%), 235 pgs unclean, 235 pgs degraded (PG_DEGRADED) 2017-12-18 19:13:50.371393 mon.node1 mon.0 10.193.56.230:6789/0 54811 : cluster [WRN] Health check update: Degraded data redundancy: 24588/87633760 objects degraded (0.028%), 235 pgs unclean, 235 pgs degraded (PG_DEGRADED) 2017-12-18 19:13:56.567056 mon.node1 mon.0 10.193.56.230:6789/0 54814 : cluster [WRN] Health check update: Degraded data redundancy: 24583/87637130 objects degraded (0.028%), 235 pgs unclean, 235 pgs degraded (PG_DEGRADED) 2017-12-18 19:14:01.776455 mon.node1 mon.0 10.193.56.230:6789/0 54815 : cluster [WRN] Health check update: Degraded data redundancy: 24923/87641010 objects degraded (0.028%), 235 pgs unclean, 235 pgs degraded (PG_DEGRADED) 2017-12-18 19:14:06.055633 mon.node1 mon.0 10.193.56.230:6789/0 54816 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 25298/87643630 objects degraded (0.029%), 235 pgs unclean, 235 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:14:07.342624 mon.node1 mon.0 10.193.56.230:6789/0 54817 : cluster [WRN] Health check update: Degraded data redundancy: 25298/87643630 objects degraded (0.029%), 235 pgs unclean, 235 pgs degraded (PG_DEGRADED) 2017-12-18 19:14:13.343368 mon.node1 mon.0 10.193.56.230:6789/0 54818 : cluster [WRN] Health check update: Degraded data redundancy: 25854/87647360 objects degraded (0.029%), 235 pgs unclean, 235 pgs degraded (PG_DEGRADED) 2017-12-18 19:14:18.509931 mon.node1 mon.0 10.193.56.230:6789/0 54822 : cluster [WRN] Health check update: Degraded data redundancy: 26086/87650580 objects degraded (0.030%), 234 pgs unclean, 234 pgs degraded (PG_DEGRADED) 2017-12-18 19:14:24.713021 mon.node1 mon.0 10.193.56.230:6789/0 54824 : cluster [WRN] Health check update: Degraded data redundancy: 26155/87654580 objects degraded (0.030%), 234 pgs unclean, 234 pgs degraded (PG_DEGRADED) 2017-12-18 19:14:30.785723 mon.node1 mon.0 10.193.56.230:6789/0 54825 : cluster [WRN] Health check update: Degraded data redundancy: 26162/87658810 objects degraded (0.030%), 234 pgs unclean, 234 pgs degraded (PG_DEGRADED) 2017-12-18 19:14:35.891596 mon.node1 mon.0 10.193.56.230:6789/0 54826 : cluster [WRN] Health check update: Degraded data redundancy: 26727/87662960 objects degraded (0.030%), 234 pgs unclean, 234 pgs degraded (PG_DEGRADED) 2017-12-18 19:14:41.346452 mon.node1 mon.0 10.193.56.230:6789/0 54830 : cluster [WRN] Health check update: Degraded data redundancy: 26933/87664440 objects degraded (0.031%), 233 pgs unclean, 233 pgs degraded (PG_DEGRADED) 2017-12-18 19:14:47.347103 mon.node1 mon.0 10.193.56.230:6789/0 54831 : cluster [WRN] Health check update: Degraded data redundancy: 27648/87668310 objects degraded (0.032%), 233 pgs unclean, 233 pgs degraded (PG_DEGRADED) 2017-12-18 19:14:52.546219 mon.node1 mon.0 10.193.56.230:6789/0 54834 : cluster [WRN] Health check update: Degraded data redundancy: 27817/87672010 objects degraded (0.032%), 233 pgs unclean, 233 pgs degraded (PG_DEGRADED) 2017-12-18 19:14:57.989438 mon.node1 mon.0 10.193.56.230:6789/0 54835 : cluster [WRN] Health check update: Degraded data redundancy: 27815/87676730 objects degraded (0.032%), 233 pgs unclean, 233 pgs degraded (PG_DEGRADED) 2017-12-18 19:15:03.348799 mon.node1 mon.0 10.193.56.230:6789/0 54836 : cluster [WRN] Health check update: Degraded data redundancy: 27902/87679300 objects degraded (0.032%), 232 pgs unclean, 232 pgs degraded (PG_DEGRADED) 2017-12-18 19:15:06.055780 mon.node1 mon.0 10.193.56.230:6789/0 54837 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 27956/87680460 objects degraded (0.032%), 232 pgs unclean, 232 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:15:08.550615 mon.node1 mon.0 10.193.56.230:6789/0 54839 : cluster [WRN] Health check update: Degraded data redundancy: 28224/87682610 objects degraded (0.032%), 232 pgs unclean, 232 pgs degraded (PG_DEGRADED) 2017-12-18 19:15:14.075301 mon.node1 mon.0 10.193.56.230:6789/0 54840 : cluster [WRN] Health check update: Degraded data redundancy: 28455/87684470 objects degraded (0.032%), 232 pgs unclean, 232 pgs degraded (PG_DEGRADED) 2017-12-18 19:15:19.350704 mon.node1 mon.0 10.193.56.230:6789/0 54844 : cluster [WRN] Health check update: Degraded data redundancy: 28543/87686760 objects degraded (0.033%), 232 pgs unclean, 232 pgs degraded (PG_DEGRADED) 2017-12-18 19:15:24.380802 mon.node1 mon.0 10.193.56.230:6789/0 54845 : cluster [WRN] Health check update: Degraded data redundancy: 28370/87690220 objects degraded (0.032%), 231 pgs unclean, 231 pgs degraded (PG_DEGRADED) 2017-12-18 19:15:30.517766 mon.node1 mon.0 10.193.56.230:6789/0 54847 : cluster [WRN] Health check update: Degraded data redundancy: 28392/87694170 objects degraded (0.032%), 231 pgs unclean, 231 pgs degraded (PG_DEGRADED) 2017-12-18 19:15:36.226259 mon.node1 mon.0 10.193.56.230:6789/0 54848 : cluster [WRN] Health check update: Degraded data redundancy: 29046/87699510 objects degraded (0.033%), 231 pgs unclean, 231 pgs degraded (PG_DEGRADED) 2017-12-18 19:15:41.353046 mon.node1 mon.0 10.193.56.230:6789/0 54849 : cluster [WRN] Health check update: Degraded data redundancy: 29476/87701780 objects degraded (0.034%), 231 pgs unclean, 231 pgs degraded (PG_DEGRADED) 2017-12-18 19:15:46.426046 mon.node1 mon.0 10.193.56.230:6789/0 54850 : cluster [WRN] Health check update: Degraded data redundancy: 30266/87705230 objects degraded (0.035%), 231 pgs unclean, 231 pgs degraded (PG_DEGRADED) 2017-12-18 19:15:52.355674 mon.node1 mon.0 10.193.56.230:6789/0 54852 : cluster [WRN] Health check update: Degraded data redundancy: 30543/87708300 objects degraded (0.035%), 231 pgs unclean, 231 pgs degraded (PG_DEGRADED) 2017-12-18 19:15:57.358861 mon.node1 mon.0 10.193.56.230:6789/0 54853 : cluster [WRN] Health check update: Degraded data redundancy: 30477/87709880 objects degraded (0.035%), 230 pgs unclean, 230 pgs degraded (PG_DEGRADED) 2017-12-18 19:16:03.359522 mon.node1 mon.0 10.193.56.230:6789/0 54854 : cluster [WRN] Health check update: Degraded data redundancy: 30475/87713960 objects degraded (0.035%), 230 pgs unclean, 230 pgs degraded (PG_DEGRADED) 2017-12-18 19:16:03.971170 mon.node1 mon.0 10.193.56.230:6789/0 54855 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 19:16:03.971690 mon.node1 mon.0 10.193.56.230:6789/0 54856 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 19:16:03.972282 mon.node1 mon.0 10.193.56.230:6789/0 54857 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 19:16:03.975681 mon.node1 mon.0 10.193.56.230:6789/0 54858 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 19:16:06.055895 mon.node1 mon.0 10.193.56.230:6789/0 54859 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 30526/87716400 objects degraded (0.035%), 230 pgs unclean, 230 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:16:08.833309 mon.node1 mon.0 10.193.56.230:6789/0 54860 : cluster [WRN] Health check update: Degraded data redundancy: 30839/87720470 objects degraded (0.035%), 230 pgs unclean, 230 pgs degraded (PG_DEGRADED) 2017-12-18 19:16:14.683132 mon.node1 mon.0 10.193.56.230:6789/0 54861 : cluster [WRN] Health check update: Degraded data redundancy: 31530/87725540 objects degraded (0.036%), 230 pgs unclean, 230 pgs degraded (PG_DEGRADED) 2017-12-18 19:16:20.855679 mon.node1 mon.0 10.193.56.230:6789/0 54865 : cluster [WRN] Health check update: Degraded data redundancy: 31905/87728170 objects degraded (0.036%), 230 pgs unclean, 230 pgs degraded (PG_DEGRADED) 2017-12-18 19:16:26.474031 mon.node1 mon.0 10.193.56.230:6789/0 54868 : cluster [WRN] Health check update: Degraded data redundancy: 31944/87730850 objects degraded (0.036%), 229 pgs unclean, 229 pgs degraded (PG_DEGRADED) 2017-12-18 19:16:33.374917 mon.node1 mon.0 10.193.56.230:6789/0 54871 : cluster [WRN] Health check update: Degraded data redundancy: 31944/87732630 objects degraded (0.036%), 229 pgs unclean, 229 pgs degraded (PG_DEGRADED) 2017-12-18 19:16:38.539942 mon.node1 mon.0 10.193.56.230:6789/0 54872 : cluster [WRN] Health check update: Degraded data redundancy: 32209/87738550 objects degraded (0.037%), 229 pgs unclean, 229 pgs degraded (PG_DEGRADED) 2017-12-18 19:16:44.750256 mon.node1 mon.0 10.193.56.230:6789/0 54876 : cluster [WRN] Health check update: Degraded data redundancy: 32738/87743350 objects degraded (0.037%), 229 pgs unclean, 229 pgs degraded (PG_DEGRADED) 2017-12-18 19:16:50.642919 mon.node1 mon.0 10.193.56.230:6789/0 54878 : cluster [WRN] Health check update: Degraded data redundancy: 33052/87745630 objects degraded (0.038%), 228 pgs unclean, 228 pgs degraded (PG_DEGRADED) 2017-12-18 19:16:56.862203 mon.node1 mon.0 10.193.56.230:6789/0 54880 : cluster [WRN] Health check update: Degraded data redundancy: 33344/87747570 objects degraded (0.038%), 228 pgs unclean, 228 pgs degraded (PG_DEGRADED) 2017-12-18 19:17:02.670327 mon.node1 mon.0 10.193.56.230:6789/0 54884 : cluster [WRN] Health check update: Degraded data redundancy: 33342/87749300 objects degraded (0.038%), 228 pgs unclean, 228 pgs degraded (PG_DEGRADED) 2017-12-18 19:17:06.056010 mon.node1 mon.0 10.193.56.230:6789/0 54885 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 33351/87750780 objects degraded (0.038%), 228 pgs unclean, 228 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:17:09.107968 mon.node1 mon.0 10.193.56.230:6789/0 54887 : cluster [WRN] Health check update: Degraded data redundancy: 33439/87753630 objects degraded (0.038%), 228 pgs unclean, 228 pgs degraded (PG_DEGRADED) 2017-12-18 19:17:14.742727 mon.node1 mon.0 10.193.56.230:6789/0 54888 : cluster [WRN] Health check update: Degraded data redundancy: 33966/87759940 objects degraded (0.039%), 227 pgs unclean, 227 pgs degraded (PG_DEGRADED) 2017-12-18 19:17:21.134407 mon.node1 mon.0 10.193.56.230:6789/0 54890 : cluster [WRN] Health check update: Degraded data redundancy: 34603/87765040 objects degraded (0.039%), 227 pgs unclean, 227 pgs degraded (PG_DEGRADED) 2017-12-18 19:17:26.811153 mon.node1 mon.0 10.193.56.230:6789/0 54893 : cluster [WRN] Health check update: Degraded data redundancy: 34808/87768640 objects degraded (0.040%), 227 pgs unclean, 227 pgs degraded (PG_DEGRADED) 2017-12-18 19:17:33.381301 mon.node1 mon.0 10.193.56.230:6789/0 54897 : cluster [WRN] Health check update: Degraded data redundancy: 34805/87770140 objects degraded (0.040%), 227 pgs unclean, 227 pgs degraded (PG_DEGRADED) 2017-12-18 19:17:38.873568 mon.node1 mon.0 10.193.56.230:6789/0 54898 : cluster [WRN] Health check update: Degraded data redundancy: 34839/87774960 objects degraded (0.040%), 227 pgs unclean, 227 pgs degraded (PG_DEGRADED) 2017-12-18 19:17:45.390808 mon.node1 mon.0 10.193.56.230:6789/0 54901 : cluster [WRN] Health check update: Degraded data redundancy: 35080/87778280 objects degraded (0.040%), 226 pgs unclean, 226 pgs degraded (PG_DEGRADED) 2017-12-18 19:17:50.987085 mon.node1 mon.0 10.193.56.230:6789/0 54902 : cluster [WRN] Health check update: Degraded data redundancy: 35840/87784980 objects degraded (0.041%), 226 pgs unclean, 226 pgs degraded (PG_DEGRADED) 2017-12-18 19:17:57.114451 mon.node1 mon.0 10.193.56.230:6789/0 54903 : cluster [WRN] Health check update: Degraded data redundancy: 36225/87788520 objects degraded (0.041%), 226 pgs unclean, 226 pgs degraded (PG_DEGRADED) 2017-12-18 19:18:03.002921 mon.node1 mon.0 10.193.56.230:6789/0 54906 : cluster [WRN] Health check update: Degraded data redundancy: 36097/87790840 objects degraded (0.041%), 225 pgs unclean, 225 pgs degraded (PG_DEGRADED) 2017-12-18 19:18:06.056110 mon.node1 mon.0 10.193.56.230:6789/0 54908 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 36097/87791850 objects degraded (0.041%), 225 pgs unclean, 225 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:18:09.380047 mon.node1 mon.0 10.193.56.230:6789/0 54911 : cluster [WRN] Health check update: Degraded data redundancy: 36103/87794090 objects degraded (0.041%), 225 pgs unclean, 225 pgs degraded (PG_DEGRADED) 2017-12-18 19:18:15.138035 mon.node1 mon.0 10.193.56.230:6789/0 54912 : cluster [WRN] Health check update: Degraded data redundancy: 36461/87798270 objects degraded (0.042%), 225 pgs unclean, 225 pgs degraded (PG_DEGRADED) 2017-12-18 19:18:21.394734 mon.node1 mon.0 10.193.56.230:6789/0 54915 : cluster [WRN] Health check update: Degraded data redundancy: 36738/87801710 objects degraded (0.042%), 225 pgs unclean, 225 pgs degraded (PG_DEGRADED) 2017-12-18 19:18:27.224787 mon.node1 mon.0 10.193.56.230:6789/0 54917 : cluster [WRN] Health check update: Degraded data redundancy: 37545/87807920 objects degraded (0.043%), 225 pgs unclean, 225 pgs degraded (PG_DEGRADED) 2017-12-18 19:18:33.395998 mon.node1 mon.0 10.193.56.230:6789/0 54919 : cluster [WRN] Health check update: Degraded data redundancy: 37445/87809580 objects degraded (0.043%), 224 pgs unclean, 224 pgs degraded (PG_DEGRADED) 2017-12-18 19:18:39.202455 mon.node1 mon.0 10.193.56.230:6789/0 54923 : cluster [WRN] Health check update: Degraded data redundancy: 37441/87813380 objects degraded (0.043%), 224 pgs unclean, 224 pgs degraded (PG_DEGRADED) 2017-12-18 19:18:45.397253 mon.node1 mon.0 10.193.56.230:6789/0 54928 : cluster [WRN] Health check update: Degraded data redundancy: 37483/87815470 objects degraded (0.043%), 224 pgs unclean, 224 pgs degraded (PG_DEGRADED) 2017-12-18 19:18:51.324154 mon.node1 mon.0 10.193.56.230:6789/0 54929 : cluster [WRN] Health check update: Degraded data redundancy: 38408/87822070 objects degraded (0.044%), 224 pgs unclean, 224 pgs degraded (PG_DEGRADED) 2017-12-18 19:18:57.398573 mon.node1 mon.0 10.193.56.230:6789/0 54931 : cluster [WRN] Health check update: Degraded data redundancy: 38531/87824910 objects degraded (0.044%), 223 pgs unclean, 223 pgs degraded (PG_DEGRADED) 2017-12-18 19:19:03.336813 mon.node1 mon.0 10.193.56.230:6789/0 54933 : cluster [WRN] Health check update: Degraded data redundancy: 38943/87830340 objects degraded (0.044%), 223 pgs unclean, 223 pgs degraded (PG_DEGRADED) 2017-12-18 19:19:06.056237 mon.node1 mon.0 10.193.56.230:6789/0 54935 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 38941/87831200 objects degraded (0.044%), 223 pgs unclean, 223 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:19:09.399804 mon.node1 mon.0 10.193.56.230:6789/0 54937 : cluster [WRN] Health check update: Degraded data redundancy: 38941/87832270 objects degraded (0.044%), 223 pgs unclean, 223 pgs degraded (PG_DEGRADED) 2017-12-18 19:19:15.399268 mon.node1 mon.0 10.193.56.230:6789/0 54938 : cluster [WRN] Health check update: Degraded data redundancy: 38722/87835890 objects degraded (0.044%), 222 pgs unclean, 222 pgs degraded (PG_DEGRADED) 2017-12-18 19:19:21.406802 mon.node1 mon.0 10.193.56.230:6789/0 54944 : cluster [WRN] Health check update: Degraded data redundancy: 39034/87838550 objects degraded (0.044%), 222 pgs unclean, 222 pgs degraded (PG_DEGRADED) 2017-12-18 19:19:27.407375 mon.node1 mon.0 10.193.56.230:6789/0 54946 : cluster [WRN] Health check update: Degraded data redundancy: 39428/87842010 objects degraded (0.045%), 222 pgs unclean, 222 pgs degraded (PG_DEGRADED) 2017-12-18 19:19:33.408035 mon.node1 mon.0 10.193.56.230:6789/0 54947 : cluster [WRN] Health check update: Degraded data redundancy: 39723/87846440 objects degraded (0.045%), 222 pgs unclean, 222 pgs degraded (PG_DEGRADED) 2017-12-18 19:19:39.408708 mon.node1 mon.0 10.193.56.230:6789/0 54950 : cluster [WRN] Health check update: Degraded data redundancy: 39718/87850010 objects degraded (0.045%), 222 pgs unclean, 222 pgs degraded (PG_DEGRADED) 2017-12-18 19:19:45.409354 mon.node1 mon.0 10.193.56.230:6789/0 54953 : cluster [WRN] Health check update: Degraded data redundancy: 39716/87853070 objects degraded (0.045%), 222 pgs unclean, 222 pgs degraded (PG_DEGRADED) 2017-12-18 19:19:51.410055 mon.node1 mon.0 10.193.56.230:6789/0 54955 : cluster [WRN] Health check update: Degraded data redundancy: 39948/87856830 objects degraded (0.045%), 221 pgs unclean, 221 pgs degraded (PG_DEGRADED) 2017-12-18 19:19:57.410726 mon.node1 mon.0 10.193.56.230:6789/0 54957 : cluster [WRN] Health check update: Degraded data redundancy: 40495/87860500 objects degraded (0.046%), 221 pgs unclean, 221 pgs degraded (PG_DEGRADED) 2017-12-18 19:20:03.411364 mon.node1 mon.0 10.193.56.230:6789/0 54960 : cluster [WRN] Health check update: Degraded data redundancy: 41192/87865450 objects degraded (0.047%), 221 pgs unclean, 221 pgs degraded (PG_DEGRADED) 2017-12-18 19:20:06.056384 mon.node1 mon.0 10.193.56.230:6789/0 54963 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 41462/87867960 objects degraded (0.047%), 221 pgs unclean, 221 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:20:09.412049 mon.node1 mon.0 10.193.56.230:6789/0 54966 : cluster [WRN] Health check update: Degraded data redundancy: 41541/87869520 objects degraded (0.047%), 221 pgs unclean, 221 pgs degraded (PG_DEGRADED) 2017-12-18 19:20:14.625801 mon.node1 mon.0 10.193.56.230:6789/0 54969 : cluster [WRN] Health check update: Degraded data redundancy: 41538/87871620 objects degraded (0.047%), 221 pgs unclean, 221 pgs degraded (PG_DEGRADED) 2017-12-18 19:20:19.757076 mon.node1 mon.0 10.193.56.230:6789/0 54970 : cluster [WRN] Health check update: Degraded data redundancy: 41417/87874990 objects degraded (0.047%), 220 pgs unclean, 220 pgs degraded (PG_DEGRADED) 2017-12-18 19:20:25.413782 mon.node1 mon.0 10.193.56.230:6789/0 54973 : cluster [WRN] Health check update: Degraded data redundancy: 41649/87877420 objects degraded (0.047%), 220 pgs unclean, 220 pgs degraded (PG_DEGRADED) 2017-12-18 19:20:31.414458 mon.node1 mon.0 10.193.56.230:6789/0 54975 : cluster [WRN] Health check update: Degraded data redundancy: 42330/87882790 objects degraded (0.048%), 220 pgs unclean, 220 pgs degraded (PG_DEGRADED) 2017-12-18 19:20:37.415212 mon.node1 mon.0 10.193.56.230:6789/0 54977 : cluster [WRN] Health check update: Degraded data redundancy: 42832/87888070 objects degraded (0.049%), 220 pgs unclean, 220 pgs degraded (PG_DEGRADED) 2017-12-18 19:20:43.415873 mon.node1 mon.0 10.193.56.230:6789/0 54982 : cluster [WRN] Health check update: Degraded data redundancy: 42893/87891970 objects degraded (0.049%), 220 pgs unclean, 220 pgs degraded (PG_DEGRADED) 2017-12-18 19:20:49.416590 mon.node1 mon.0 10.193.56.230:6789/0 54984 : cluster [WRN] Health check update: Degraded data redundancy: 42772/87894560 objects degraded (0.049%), 219 pgs unclean, 219 pgs degraded (PG_DEGRADED) 2017-12-18 19:20:54.753206 mon.node1 mon.0 10.193.56.230:6789/0 54985 : cluster [WRN] Health check update: Degraded data redundancy: 42994/87898230 objects degraded (0.049%), 219 pgs unclean, 219 pgs degraded (PG_DEGRADED) 2017-12-18 19:20:59.980597 mon.node1 mon.0 10.193.56.230:6789/0 54986 : cluster [WRN] Health check update: Degraded data redundancy: 43658/87901670 objects degraded (0.050%), 219 pgs unclean, 219 pgs degraded (PG_DEGRADED) 2017-12-18 19:21:03.970039 mon.node1 mon.0 10.193.56.230:6789/0 54987 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 19:21:03.970074 mon.node1 mon.0 10.193.56.230:6789/0 54988 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 19:21:03.971966 mon.node1 mon.0 10.193.56.230:6789/0 54989 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 19:21:03.972910 mon.node1 mon.0 10.193.56.230:6789/0 54990 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 19:21:05.418332 mon.node1 mon.0 10.193.56.230:6789/0 54991 : cluster [WRN] Health check update: Degraded data redundancy: 44052/87903740 objects degraded (0.050%), 219 pgs unclean, 219 pgs degraded (PG_DEGRADED) 2017-12-18 19:21:06.056519 mon.node1 mon.0 10.193.56.230:6789/0 54992 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 44052/87903740 objects degraded (0.050%), 219 pgs unclean, 219 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:21:11.419047 mon.node1 mon.0 10.193.56.230:6789/0 54993 : cluster [WRN] Health check update: Degraded data redundancy: 44121/87907010 objects degraded (0.050%), 218 pgs unclean, 218 pgs degraded (PG_DEGRADED) 2017-12-18 19:21:17.419789 mon.node1 mon.0 10.193.56.230:6789/0 54994 : cluster [WRN] Health check update: Degraded data redundancy: 44119/87908480 objects degraded (0.050%), 218 pgs unclean, 218 pgs degraded (PG_DEGRADED) 2017-12-18 19:21:23.420524 mon.node1 mon.0 10.193.56.230:6789/0 54998 : cluster [WRN] Health check update: Degraded data redundancy: 44297/87911770 objects degraded (0.050%), 218 pgs unclean, 218 pgs degraded (PG_DEGRADED) 2017-12-18 19:21:29.421200 mon.node1 mon.0 10.193.56.230:6789/0 55002 : cluster [WRN] Health check update: Degraded data redundancy: 44697/87917510 objects degraded (0.051%), 218 pgs unclean, 218 pgs degraded (PG_DEGRADED) 2017-12-18 19:21:34.768811 mon.node1 mon.0 10.193.56.230:6789/0 55004 : cluster [WRN] Health check update: Degraded data redundancy: 44913/87923120 objects degraded (0.051%), 217 pgs unclean, 217 pgs degraded (PG_DEGRADED) 2017-12-18 19:21:40.965001 mon.node1 mon.0 10.193.56.230:6789/0 55009 : cluster [WRN] Health check update: Degraded data redundancy: 45160/87926690 objects degraded (0.051%), 217 pgs unclean, 217 pgs degraded (PG_DEGRADED) 2017-12-18 19:21:46.233536 mon.node1 mon.0 10.193.56.230:6789/0 55013 : cluster [WRN] Health check update: Degraded data redundancy: 45158/87928830 objects degraded (0.051%), 217 pgs unclean, 217 pgs degraded (PG_DEGRADED) 2017-12-18 19:21:51.423649 mon.node1 mon.0 10.193.56.230:6789/0 55014 : cluster [WRN] Health check update: Degraded data redundancy: 45165/87930110 objects degraded (0.051%), 217 pgs unclean, 217 pgs degraded (PG_DEGRADED) 2017-12-18 19:21:56.446557 mon.node1 mon.0 10.193.56.230:6789/0 55017 : cluster [WRN] Health check update: Degraded data redundancy: 45550/87935850 objects degraded (0.052%), 216 pgs unclean, 216 pgs degraded (PG_DEGRADED) 2017-12-18 19:22:02.369497 mon.node1 mon.0 10.193.56.230:6789/0 55018 : cluster [WRN] Health check update: Degraded data redundancy: 45935/87942410 objects degraded (0.052%), 216 pgs unclean, 216 pgs degraded (PG_DEGRADED) 2017-12-18 19:22:06.056624 mon.node1 mon.0 10.193.56.230:6789/0 55019 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 46031/87944170 objects degraded (0.052%), 216 pgs unclean, 216 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:22:07.425492 mon.node1 mon.0 10.193.56.230:6789/0 55021 : cluster [WRN] Health check update: Degraded data redundancy: 46373/87945610 objects degraded (0.053%), 216 pgs unclean, 216 pgs degraded (PG_DEGRADED) 2017-12-18 19:22:12.803590 mon.node1 mon.0 10.193.56.230:6789/0 55023 : cluster [WRN] Health check update: Degraded data redundancy: 46307/87948370 objects degraded (0.053%), 215 pgs unclean, 215 pgs degraded (PG_DEGRADED) 2017-12-18 19:22:18.450487 mon.node1 mon.0 10.193.56.230:6789/0 55024 : cluster [WRN] Health check update: Degraded data redundancy: 46304/87950350 objects degraded (0.053%), 215 pgs unclean, 215 pgs degraded (PG_DEGRADED) 2017-12-18 19:22:25.044681 mon.node1 mon.0 10.193.56.230:6789/0 55026 : cluster [WRN] Health check update: Degraded data redundancy: 46321/87952600 objects degraded (0.053%), 214 pgs unclean, 214 pgs degraded (PG_DEGRADED) 2017-12-18 19:22:30.486537 mon.node1 mon.0 10.193.56.230:6789/0 55028 : cluster [WRN] Health check update: Degraded data redundancy: 46813/87957650 objects degraded (0.053%), 214 pgs unclean, 214 pgs degraded (PG_DEGRADED) 2017-12-18 19:22:36.519618 mon.node1 mon.0 10.193.56.230:6789/0 55030 : cluster [WRN] Health check update: Degraded data redundancy: 47396/87963620 objects degraded (0.054%), 214 pgs unclean, 214 pgs degraded (PG_DEGRADED) 2017-12-18 19:22:43.417512 mon.node1 mon.0 10.193.56.230:6789/0 55032 : cluster [WRN] Health check update: Degraded data redundancy: 47295/87967870 objects degraded (0.054%), 213 pgs unclean, 213 pgs degraded (PG_DEGRADED) 2017-12-18 19:22:48.611884 mon.node1 mon.0 10.193.56.230:6789/0 55033 : cluster [WRN] Health check update: Degraded data redundancy: 47293/87969820 objects degraded (0.054%), 213 pgs unclean, 213 pgs degraded (PG_DEGRADED) 2017-12-18 19:22:54.691338 mon.node1 mon.0 10.193.56.230:6789/0 55036 : cluster [WRN] Health check update: Degraded data redundancy: 47414/87971570 objects degraded (0.054%), 213 pgs unclean, 213 pgs degraded (PG_DEGRADED) 2017-12-18 19:23:00.878952 mon.node1 mon.0 10.193.56.230:6789/0 55038 : cluster [WRN] Health check update: Degraded data redundancy: 47664/87975750 objects degraded (0.054%), 212 pgs unclean, 212 pgs degraded (PG_DEGRADED) 2017-12-18 19:23:06.056753 mon.node1 mon.0 10.193.56.230:6789/0 55040 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 48131/87980150 objects degraded (0.055%), 212 pgs unclean, 212 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:23:06.889783 mon.node1 mon.0 10.193.56.230:6789/0 55041 : cluster [WRN] Health check update: Degraded data redundancy: 48329/87981880 objects degraded (0.055%), 212 pgs unclean, 212 pgs degraded (PG_DEGRADED) 2017-12-18 19:23:13.074588 mon.node1 mon.0 10.193.56.230:6789/0 55043 : cluster [WRN] Health check update: Degraded data redundancy: 48540/87986980 objects degraded (0.055%), 212 pgs unclean, 212 pgs degraded (PG_DEGRADED) 2017-12-18 19:23:18.747854 mon.node1 mon.0 10.193.56.230:6789/0 55044 : cluster [WRN] Health check update: Degraded data redundancy: 48538/87989410 objects degraded (0.055%), 212 pgs unclean, 212 pgs degraded (PG_DEGRADED) 2017-12-18 19:23:24.951807 mon.node1 mon.0 10.193.56.230:6789/0 55052 : cluster [WRN] Health check update: Degraded data redundancy: 48752/87991830 objects degraded (0.055%), 212 pgs unclean, 212 pgs degraded (PG_DEGRADED) 2017-12-18 19:23:30.817268 mon.node1 mon.0 10.193.56.230:6789/0 55054 : cluster [WRN] Health check update: Degraded data redundancy: 49289/87995130 objects degraded (0.056%), 212 pgs unclean, 212 pgs degraded (PG_DEGRADED) 2017-12-18 19:23:37.448061 mon.node1 mon.0 10.193.56.230:6789/0 55056 : cluster [WRN] Health check update: Degraded data redundancy: 49314/87998040 objects degraded (0.056%), 211 pgs unclean, 211 pgs degraded (PG_DEGRADED) 2017-12-18 19:23:43.448752 mon.node1 mon.0 10.193.56.230:6789/0 55058 : cluster [WRN] Health check update: Degraded data redundancy: 49563/88003830 objects degraded (0.056%), 211 pgs unclean, 211 pgs degraded (PG_DEGRADED) 2017-12-18 19:23:48.948828 mon.node1 mon.0 10.193.56.230:6789/0 55059 : cluster [WRN] Health check update: Degraded data redundancy: 49559/88009050 objects degraded (0.056%), 211 pgs unclean, 211 pgs degraded (PG_DEGRADED) 2017-12-18 19:23:54.946503 mon.node1 mon.0 10.193.56.230:6789/0 55060 : cluster [WRN] Health check update: Degraded data redundancy: 49556/88010290 objects degraded (0.056%), 211 pgs unclean, 211 pgs degraded (PG_DEGRADED) 2017-12-18 19:24:01.450828 mon.node1 mon.0 10.193.56.230:6789/0 55061 : cluster [WRN] Health check update: Degraded data redundancy: 49554/88011110 objects degraded (0.056%), 211 pgs unclean, 211 pgs degraded (PG_DEGRADED) 2017-12-18 19:24:06.056892 mon.node1 mon.0 10.193.56.230:6789/0 55062 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 49705/88014210 objects degraded (0.056%), 210 pgs unclean, 210 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:24:07.120176 mon.node1 mon.0 10.193.56.230:6789/0 55063 : cluster [WRN] Health check update: Degraded data redundancy: 49984/88016190 objects degraded (0.057%), 210 pgs unclean, 210 pgs degraded (PG_DEGRADED) 2017-12-18 19:24:13.052132 mon.node1 mon.0 10.193.56.230:6789/0 55065 : cluster [WRN] Health check update: Degraded data redundancy: 50645/88022790 objects degraded (0.058%), 210 pgs unclean, 210 pgs degraded (PG_DEGRADED) 2017-12-18 19:24:19.108041 mon.node1 mon.0 10.193.56.230:6789/0 55067 : cluster [WRN] Health check update: Degraded data redundancy: 51327/88027490 objects degraded (0.058%), 210 pgs unclean, 210 pgs degraded (PG_DEGRADED) 2017-12-18 19:24:25.114600 mon.node1 mon.0 10.193.56.230:6789/0 55070 : cluster [WRN] Health check update: Degraded data redundancy: 51523/88029050 objects degraded (0.059%), 210 pgs unclean, 210 pgs degraded (PG_DEGRADED) 2017-12-18 19:24:31.147638 mon.node1 mon.0 10.193.56.230:6789/0 55071 : cluster [WRN] Health check update: Degraded data redundancy: 51520/88030240 objects degraded (0.059%), 210 pgs unclean, 210 pgs degraded (PG_DEGRADED) 2017-12-18 19:24:37.454728 mon.node1 mon.0 10.193.56.230:6789/0 55072 : cluster [WRN] Health check update: Degraded data redundancy: 51545/88033160 objects degraded (0.059%), 210 pgs unclean, 210 pgs degraded (PG_DEGRADED) 2017-12-18 19:24:43.295074 mon.node1 mon.0 10.193.56.230:6789/0 55075 : cluster [WRN] Health check update: Degraded data redundancy: 52118/88042270 objects degraded (0.059%), 209 pgs unclean, 209 pgs degraded (PG_DEGRADED) 2017-12-18 19:24:49.257660 mon.node1 mon.0 10.193.56.230:6789/0 55078 : cluster [WRN] Health check update: Degraded data redundancy: 52682/88048550 objects degraded (0.060%), 209 pgs unclean, 209 pgs degraded (PG_DEGRADED) 2017-12-18 19:24:55.456898 mon.node1 mon.0 10.193.56.230:6789/0 55080 : cluster [WRN] Health check update: Degraded data redundancy: 52887/88050410 objects degraded (0.060%), 209 pgs unclean, 209 pgs degraded (PG_DEGRADED) 2017-12-18 19:25:01.457525 mon.node1 mon.0 10.193.56.230:6789/0 55082 : cluster [WRN] Health check update: Degraded data redundancy: 52894/88050510 objects degraded (0.060%), 209 pgs unclean, 209 pgs degraded (PG_DEGRADED) 2017-12-18 19:25:06.057038 mon.node1 mon.0 10.193.56.230:6789/0 55083 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 52695/88051210 objects degraded (0.060%), 208 pgs unclean, 208 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:25:07.214817 mon.node1 mon.0 10.193.56.230:6789/0 55084 : cluster [WRN] Health check update: Degraded data redundancy: 52692/88053010 objects degraded (0.060%), 208 pgs unclean, 208 pgs degraded (PG_DEGRADED) 2017-12-18 19:25:13.385234 mon.node1 mon.0 10.193.56.230:6789/0 55087 : cluster [WRN] Health check update: Degraded data redundancy: 53194/88060560 objects degraded (0.060%), 208 pgs unclean, 208 pgs degraded (PG_DEGRADED) 2017-12-18 19:25:19.421427 mon.node1 mon.0 10.193.56.230:6789/0 55088 : cluster [WRN] Health check update: Degraded data redundancy: 53849/88065540 objects degraded (0.061%), 208 pgs unclean, 208 pgs degraded (PG_DEGRADED) 2017-12-18 19:25:25.460226 mon.node1 mon.0 10.193.56.230:6789/0 55092 : cluster [WRN] Health check update: Degraded data redundancy: 54071/88067130 objects degraded (0.061%), 208 pgs unclean, 208 pgs degraded (PG_DEGRADED) 2017-12-18 19:25:31.460832 mon.node1 mon.0 10.193.56.230:6789/0 55093 : cluster [WRN] Health check update: Degraded data redundancy: 54231/88067860 objects degraded (0.062%), 208 pgs unclean, 208 pgs degraded (PG_DEGRADED) 2017-12-18 19:25:37.461529 mon.node1 mon.0 10.193.56.230:6789/0 55094 : cluster [WRN] Health check update: Degraded data redundancy: 53981/88069230 objects degraded (0.061%), 207 pgs unclean, 207 pgs degraded (PG_DEGRADED) 2017-12-18 19:25:43.462293 mon.node1 mon.0 10.193.56.230:6789/0 55096 : cluster [WRN] Health check update: Degraded data redundancy: 54338/88073810 objects degraded (0.062%), 207 pgs unclean, 207 pgs degraded (PG_DEGRADED) 2017-12-18 19:25:49.463080 mon.node1 mon.0 10.193.56.230:6789/0 55098 : cluster [WRN] Health check update: Degraded data redundancy: 54831/88080580 objects degraded (0.062%), 207 pgs unclean, 207 pgs degraded (PG_DEGRADED) 2017-12-18 19:25:55.463721 mon.node1 mon.0 10.193.56.230:6789/0 55100 : cluster [WRN] Health check update: Degraded data redundancy: 55053/88085540 objects degraded (0.062%), 206 pgs unclean, 206 pgs degraded (PG_DEGRADED) 2017-12-18 19:26:01.464452 mon.node1 mon.0 10.193.56.230:6789/0 55101 : cluster [WRN] Health check update: Degraded data redundancy: 55258/88087880 objects degraded (0.063%), 206 pgs unclean, 206 pgs degraded (PG_DEGRADED) 2017-12-18 19:26:03.970287 mon.node1 mon.0 10.193.56.230:6789/0 55102 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 19:26:03.970330 mon.node1 mon.0 10.193.56.230:6789/0 55103 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 19:26:03.970685 mon.node1 mon.0 10.193.56.230:6789/0 55104 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 19:26:03.970721 mon.node1 mon.0 10.193.56.230:6789/0 55105 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 19:26:06.057184 mon.node1 mon.0 10.193.56.230:6789/0 55106 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 55255/88090030 objects degraded (0.063%), 206 pgs unclean, 206 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:26:07.470973 mon.node1 mon.0 10.193.56.230:6789/0 55107 : cluster [WRN] Health check update: Degraded data redundancy: 55255/88090030 objects degraded (0.063%), 206 pgs unclean, 206 pgs degraded (PG_DEGRADED) 2017-12-18 19:26:13.471652 mon.node1 mon.0 10.193.56.230:6789/0 55109 : cluster [WRN] Health check update: Degraded data redundancy: 55566/88094910 objects degraded (0.063%), 206 pgs unclean, 206 pgs degraded (PG_DEGRADED) 2017-12-18 19:26:18.647367 mon.node1 mon.0 10.193.56.230:6789/0 55112 : cluster [WRN] Health check update: Degraded data redundancy: 55654/88100910 objects degraded (0.063%), 205 pgs unclean, 205 pgs degraded (PG_DEGRADED) 2017-12-18 19:26:23.825487 mon.node1 mon.0 10.193.56.230:6789/0 55113 : cluster [WRN] Health check update: Degraded data redundancy: 56066/88106190 objects degraded (0.064%), 205 pgs unclean, 205 pgs degraded (PG_DEGRADED) 2017-12-18 19:26:29.473437 mon.node1 mon.0 10.193.56.230:6789/0 55114 : cluster [WRN] Health check update: Degraded data redundancy: 56361/88108650 objects degraded (0.064%), 205 pgs unclean, 205 pgs degraded (PG_DEGRADED) 2017-12-18 19:26:35.474130 mon.node1 mon.0 10.193.56.230:6789/0 55118 : cluster [WRN] Health check update: Degraded data redundancy: 56368/88110370 objects degraded (0.064%), 205 pgs unclean, 205 pgs degraded (PG_DEGRADED) 2017-12-18 19:26:41.474952 mon.node1 mon.0 10.193.56.230:6789/0 55121 : cluster [WRN] Health check update: Degraded data redundancy: 56410/88113140 objects degraded (0.064%), 205 pgs unclean, 205 pgs degraded (PG_DEGRADED) 2017-12-18 19:26:47.475633 mon.node1 mon.0 10.193.56.230:6789/0 55127 : cluster [WRN] Health check update: Degraded data redundancy: 56738/88118450 objects degraded (0.064%), 204 pgs unclean, 204 pgs degraded (PG_DEGRADED) 2017-12-18 19:26:53.476395 mon.node1 mon.0 10.193.56.230:6789/0 55128 : cluster [WRN] Health check update: Degraded data redundancy: 57060/88123770 objects degraded (0.065%), 204 pgs unclean, 204 pgs degraded (PG_DEGRADED) 2017-12-18 19:26:59.477081 mon.node1 mon.0 10.193.56.230:6789/0 55130 : cluster [WRN] Health check update: Degraded data redundancy: 57427/88128110 objects degraded (0.065%), 204 pgs unclean, 204 pgs degraded (PG_DEGRADED) 2017-12-18 19:27:05.477725 mon.node1 mon.0 10.193.56.230:6789/0 55132 : cluster [WRN] Health check update: Degraded data redundancy: 57424/88129360 objects degraded (0.065%), 204 pgs unclean, 204 pgs degraded (PG_DEGRADED) 2017-12-18 19:27:06.057312 mon.node1 mon.0 10.193.56.230:6789/0 55133 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 57424/88129360 objects degraded (0.065%), 204 pgs unclean, 204 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:27:11.478387 mon.node1 mon.0 10.193.56.230:6789/0 55134 : cluster [WRN] Health check update: Degraded data redundancy: 57153/88132210 objects degraded (0.065%), 203 pgs unclean, 203 pgs degraded (PG_DEGRADED) 2017-12-18 19:27:17.479058 mon.node1 mon.0 10.193.56.230:6789/0 55135 : cluster [WRN] Health check update: Degraded data redundancy: 57653/88137370 objects degraded (0.065%), 203 pgs unclean, 203 pgs degraded (PG_DEGRADED) 2017-12-18 19:27:23.479737 mon.node1 mon.0 10.193.56.230:6789/0 55137 : cluster [WRN] Health check update: Degraded data redundancy: 58118/88141890 objects degraded (0.066%), 203 pgs unclean, 203 pgs degraded (PG_DEGRADED) 2017-12-18 19:27:29.480398 mon.node1 mon.0 10.193.56.230:6789/0 55140 : cluster [WRN] Health check update: Degraded data redundancy: 58368/88145580 objects degraded (0.066%), 203 pgs unclean, 203 pgs degraded (PG_DEGRADED) 2017-12-18 19:27:35.481071 mon.node1 mon.0 10.193.56.230:6789/0 55142 : cluster [WRN] Health check update: Degraded data redundancy: 58060/88146320 objects degraded (0.066%), 202 pgs unclean, 202 pgs degraded (PG_DEGRADED) 2017-12-18 19:27:41.481793 mon.node1 mon.0 10.193.56.230:6789/0 55144 : cluster [WRN] Health check update: Degraded data redundancy: 58119/88147380 objects degraded (0.066%), 202 pgs unclean, 202 pgs degraded (PG_DEGRADED) 2017-12-18 19:27:47.482443 mon.node1 mon.0 10.193.56.230:6789/0 55153 : cluster [WRN] Health check update: Degraded data redundancy: 58171/88148000 objects degraded (0.066%), 202 pgs unclean, 202 pgs degraded (PG_DEGRADED) 2017-12-18 19:27:53.483073 mon.node1 mon.0 10.193.56.230:6789/0 55156 : cluster [WRN] Health check update: Degraded data redundancy: 58169/88148260 objects degraded (0.066%), 202 pgs unclean, 202 pgs degraded (PG_DEGRADED) 2017-12-18 19:27:59.483900 mon.node1 mon.0 10.193.56.230:6789/0 55158 : cluster [WRN] Health check update: Degraded data redundancy: 58005/88148260 objects degraded (0.066%), 201 pgs unclean, 201 pgs degraded (PG_DEGRADED) 2017-12-18 19:28:05.484554 mon.node1 mon.0 10.193.56.230:6789/0 55159 : cluster [WRN] Health check update: Degraded data redundancy: 58000/88148260 objects degraded (0.066%), 201 pgs unclean, 201 pgs degraded (PG_DEGRADED) 2017-12-18 19:28:06.057459 mon.node1 mon.0 10.193.56.230:6789/0 55160 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 58000/88148260 objects degraded (0.066%), 201 pgs unclean, 201 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:28:10.660476 mon.node1 mon.0 10.193.56.230:6789/0 55161 : cluster [WRN] Health check update: Degraded data redundancy: 57998/88148260 objects degraded (0.066%), 201 pgs unclean, 201 pgs degraded (PG_DEGRADED) 2017-12-18 19:28:17.499431 mon.node1 mon.0 10.193.56.230:6789/0 55163 : cluster [WRN] Health check update: Degraded data redundancy: 57996/88148260 objects degraded (0.066%), 201 pgs unclean, 201 pgs degraded (PG_DEGRADED) 2017-12-18 19:28:23.500077 mon.node1 mon.0 10.193.56.230:6789/0 55168 : cluster [WRN] Health check update: Degraded data redundancy: 57724/88148260 objects degraded (0.065%), 200 pgs unclean, 200 pgs degraded (PG_DEGRADED) 2017-12-18 19:28:29.500767 mon.node1 mon.0 10.193.56.230:6789/0 55172 : cluster [WRN] Health check update: Degraded data redundancy: 57722/88148260 objects degraded (0.065%), 200 pgs unclean, 200 pgs degraded (PG_DEGRADED) 2017-12-18 19:28:34.514900 mon.node1 mon.0 10.193.56.230:6789/0 55173 : cluster [WRN] Health check update: Degraded data redundancy: 57717/88148260 objects degraded (0.065%), 200 pgs unclean, 200 pgs degraded (PG_DEGRADED) 2017-12-18 19:28:40.489072 mon.node1 mon.0 10.193.56.230:6789/0 55176 : cluster [WRN] Health check update: Degraded data redundancy: 57714/88148260 objects degraded (0.065%), 200 pgs unclean, 200 pgs degraded (PG_DEGRADED) 2017-12-18 19:28:45.502521 mon.node1 mon.0 10.193.56.230:6789/0 55177 : cluster [WRN] Health check update: Degraded data redundancy: 57712/88148260 objects degraded (0.065%), 200 pgs unclean, 200 pgs degraded (PG_DEGRADED) 2017-12-18 19:28:50.542771 mon.node1 mon.0 10.193.56.230:6789/0 55178 : cluster [WRN] Health check update: Degraded data redundancy: 57710/88148260 objects degraded (0.065%), 200 pgs unclean, 200 pgs degraded (PG_DEGRADED) 2017-12-18 19:28:57.503841 mon.node1 mon.0 10.193.56.230:6789/0 55179 : cluster [WRN] Health check update: Degraded data redundancy: 57707/88148260 objects degraded (0.065%), 200 pgs unclean, 200 pgs degraded (PG_DEGRADED) 2017-12-18 19:29:03.504480 mon.node1 mon.0 10.193.56.230:6789/0 55182 : cluster [WRN] Health check update: Degraded data redundancy: 57435/88148260 objects degraded (0.065%), 199 pgs unclean, 199 pgs degraded (PG_DEGRADED) 2017-12-18 19:29:06.057609 mon.node1 mon.0 10.193.56.230:6789/0 55184 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 56854/88148260 objects degraded (0.064%), 197 pgs unclean, 197 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:29:08.898520 mon.node1 mon.0 10.193.56.230:6789/0 55186 : cluster [WRN] Health check update: Degraded data redundancy: 56853/88148260 objects degraded (0.064%), 197 pgs unclean, 197 pgs degraded (PG_DEGRADED) 2017-12-18 19:29:15.071477 mon.node1 mon.0 10.193.56.230:6789/0 55192 : cluster [WRN] Health check update: Degraded data redundancy: 55060/88148260 objects degraded (0.062%), 191 pgs unclean, 191 pgs degraded (PG_DEGRADED) 2017-12-18 19:29:21.226515 mon.node1 mon.0 10.193.56.230:6789/0 55198 : cluster [WRN] Health check update: Degraded data redundancy: 52298/88148260 objects degraded (0.059%), 182 pgs unclean, 182 pgs degraded (PG_DEGRADED) 2017-12-18 19:29:26.727403 mon.node1 mon.0 10.193.56.230:6789/0 55203 : cluster [WRN] Health check update: Degraded data redundancy: 49814/88148260 objects degraded (0.057%), 174 pgs unclean, 174 pgs degraded (PG_DEGRADED) 2017-12-18 19:29:33.507687 mon.node1 mon.0 10.193.56.230:6789/0 55205 : cluster [WRN] Health check update: Degraded data redundancy: 47753/88148260 objects degraded (0.054%), 167 pgs unclean, 167 pgs degraded (PG_DEGRADED) 2017-12-18 19:29:39.326070 mon.node1 mon.0 10.193.56.230:6789/0 55207 : cluster [WRN] Health check update: Degraded data redundancy: 46002/88148260 objects degraded (0.052%), 161 pgs unclean, 161 pgs degraded (PG_DEGRADED) 2017-12-18 19:29:45.516960 mon.node1 mon.0 10.193.56.230:6789/0 55213 : cluster [WRN] Health check update: Degraded data redundancy: 42999/88148260 objects degraded (0.049%), 150 pgs unclean, 150 pgs degraded (PG_DEGRADED) 2017-12-18 19:29:50.847943 mon.node1 mon.0 10.193.56.230:6789/0 55215 : cluster [WRN] Health check update: Degraded data redundancy: 39095/88148260 objects degraded (0.044%), 136 pgs unclean, 136 pgs degraded (PG_DEGRADED) 2017-12-18 19:29:57.518320 mon.node1 mon.0 10.193.56.230:6789/0 55216 : cluster [WRN] Health check update: Degraded data redundancy: 37833/88148260 objects degraded (0.043%), 132 pgs unclean, 132 pgs degraded (PG_DEGRADED) 2017-12-18 19:30:02.976748 mon.node1 mon.0 10.193.56.230:6789/0 55217 : cluster [WRN] Health check update: Degraded data redundancy: 34315/88148260 objects degraded (0.039%), 120 pgs unclean, 120 pgs degraded (PG_DEGRADED) 2017-12-18 19:30:06.057754 mon.node1 mon.0 10.193.56.230:6789/0 55218 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 33187/88148260 objects degraded (0.038%), 116 pgs unclean, 116 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:30:09.519617 mon.node1 mon.0 10.193.56.230:6789/0 55219 : cluster [WRN] Health check update: Degraded data redundancy: 31551/88148260 objects degraded (0.036%), 110 pgs unclean, 110 pgs degraded (PG_DEGRADED) 2017-12-18 19:30:15.340335 mon.node1 mon.0 10.193.56.230:6789/0 55220 : cluster [WRN] Health check update: Degraded data redundancy: 28829/88148260 objects degraded (0.033%), 101 pgs unclean, 101 pgs degraded (PG_DEGRADED) 2017-12-18 19:30:21.520932 mon.node1 mon.0 10.193.56.230:6789/0 55221 : cluster [WRN] Health check update: Degraded data redundancy: 27015/88148260 objects degraded (0.031%), 94 pgs unclean, 94 pgs degraded (PG_DEGRADED) 2017-12-18 19:30:27.025445 mon.node1 mon.0 10.193.56.230:6789/0 55223 : cluster [WRN] Health check update: Degraded data redundancy: 23297/88148260 objects degraded (0.026%), 81 pgs unclean, 81 pgs degraded (PG_DEGRADED) 2017-12-18 19:30:33.054769 mon.node1 mon.0 10.193.56.230:6789/0 55224 : cluster [WRN] Health check update: Degraded data redundancy: 21329/88148260 objects degraded (0.024%), 74 pgs unclean, 74 pgs degraded (PG_DEGRADED) 2017-12-18 19:30:39.522843 mon.node1 mon.0 10.193.56.230:6789/0 55227 : cluster [WRN] Health check update: Degraded data redundancy: 18127/88148260 objects degraded (0.021%), 63 pgs unclean, 63 pgs degraded (PG_DEGRADED) 2017-12-18 19:30:45.429247 mon.node1 mon.0 10.193.56.230:6789/0 55230 : cluster [WRN] Health check update: Degraded data redundancy: 15463/88148260 objects degraded (0.018%), 54 pgs unclean, 54 pgs degraded (PG_DEGRADED) 2017-12-18 19:30:51.524133 mon.node1 mon.0 10.193.56.230:6789/0 55233 : cluster [WRN] Health check update: Degraded data redundancy: 13879/88148260 objects degraded (0.016%), 49 pgs unclean, 49 pgs degraded (PG_DEGRADED) 2017-12-18 19:30:57.524844 mon.node1 mon.0 10.193.56.230:6789/0 55235 : cluster [WRN] Health check update: Degraded data redundancy: 11728/88148260 objects degraded (0.013%), 42 pgs unclean, 42 pgs degraded (PG_DEGRADED) 2017-12-18 19:31:03.525486 mon.node1 mon.0 10.193.56.230:6789/0 55237 : cluster [WRN] Health check update: Degraded data redundancy: 8183/88148260 objects degraded (0.009%), 29 pgs unclean, 29 pgs degraded (PG_DEGRADED) 2017-12-18 19:31:03.970505 mon.node1 mon.0 10.193.56.230:6789/0 55238 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 19:31:03.970546 mon.node1 mon.0 10.193.56.230:6789/0 55239 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 19:31:03.970572 mon.node1 mon.0 10.193.56.230:6789/0 55240 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 19:31:03.970598 mon.node1 mon.0 10.193.56.230:6789/0 55241 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 19:31:06.057897 mon.node1 mon.0 10.193.56.230:6789/0 55243 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 7022/88148260 objects degraded (0.008%), 25 pgs unclean, 25 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:31:09.393225 mon.node1 mon.0 10.193.56.230:6789/0 55245 : cluster [WRN] Health check update: Degraded data redundancy: 4632/88148260 objects degraded (0.005%), 16 pgs unclean, 16 pgs degraded (PG_DEGRADED) 2017-12-18 19:31:15.526730 mon.node1 mon.0 10.193.56.230:6789/0 55249 : cluster [WRN] Health check update: Degraded data redundancy: 2903/88148260 objects degraded (0.003%), 10 pgs unclean, 10 pgs degraded (PG_DEGRADED) 2017-12-18 19:31:21.527367 mon.node1 mon.0 10.193.56.230:6789/0 55252 : cluster [WRN] Health check update: Degraded data redundancy: 787/88148260 objects degraded (0.001%), 3 pgs unclean, 3 pgs degraded (PG_DEGRADED) 2017-12-18 19:31:21.721618 mon.node1 mon.0 10.193.56.230:6789/0 55253 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 787/88148260 objects degraded (0.001%), 3 pgs unclean, 3 pgs degraded) 2017-12-18 19:32:06.058027 mon.node1 mon.0 10.193.56.230:6789/0 55271 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 19:32:39.651222 mon.node1 mon.0 10.193.56.230:6789/0 55279 : cluster [INF] osd.35 marked itself down 2017-12-18 19:32:39.651277 mon.node1 mon.0 10.193.56.230:6789/0 55280 : cluster [INF] osd.113 marked itself down 2017-12-18 19:32:39.651330 mon.node1 mon.0 10.193.56.230:6789/0 55281 : cluster [INF] osd.15 marked itself down 2017-12-18 19:32:39.651553 mon.node1 mon.0 10.193.56.230:6789/0 55282 : cluster [INF] osd.10 marked itself down 2017-12-18 19:32:39.651647 mon.node1 mon.0 10.193.56.230:6789/0 55283 : cluster [INF] osd.55 marked itself down 2017-12-18 19:32:39.651724 mon.node1 mon.0 10.193.56.230:6789/0 55284 : cluster [INF] osd.25 marked itself down 2017-12-18 19:32:39.651787 mon.node1 mon.0 10.193.56.230:6789/0 55285 : cluster [INF] osd.80 marked itself down 2017-12-18 19:32:39.652007 mon.node1 mon.0 10.193.56.230:6789/0 55286 : cluster [INF] osd.93 marked itself down 2017-12-18 19:32:39.652104 mon.node1 mon.0 10.193.56.230:6789/0 55287 : cluster [INF] osd.20 marked itself down 2017-12-18 19:32:39.652234 mon.node1 mon.0 10.193.56.230:6789/0 55288 : cluster [INF] osd.30 marked itself down 2017-12-18 19:32:39.652341 mon.node1 mon.0 10.193.56.230:6789/0 55289 : cluster [INF] osd.40 marked itself down 2017-12-18 19:32:39.652475 mon.node1 mon.0 10.193.56.230:6789/0 55290 : cluster [INF] osd.108 marked itself down 2017-12-18 19:32:39.652618 mon.node1 mon.0 10.193.56.230:6789/0 55291 : cluster [INF] osd.98 marked itself down 2017-12-18 19:32:39.652756 mon.node1 mon.0 10.193.56.230:6789/0 55292 : cluster [INF] osd.6 marked itself down 2017-12-18 19:32:39.652939 mon.node1 mon.0 10.193.56.230:6789/0 55293 : cluster [INF] osd.4 marked itself down 2017-12-18 19:32:39.653010 mon.node1 mon.0 10.193.56.230:6789/0 55294 : cluster [INF] osd.75 marked itself down 2017-12-18 19:32:39.653059 mon.node1 mon.0 10.193.56.230:6789/0 55295 : cluster [INF] osd.70 marked itself down 2017-12-18 19:32:39.653111 mon.node1 mon.0 10.193.56.230:6789/0 55296 : cluster [INF] osd.45 marked itself down 2017-12-18 19:32:39.653167 mon.node1 mon.0 10.193.56.230:6789/0 55297 : cluster [INF] osd.103 marked itself down 2017-12-18 19:32:39.653393 mon.node1 mon.0 10.193.56.230:6789/0 55298 : cluster [INF] osd.84 marked itself down 2017-12-18 19:32:39.653455 mon.node1 mon.0 10.193.56.230:6789/0 55299 : cluster [INF] osd.88 marked itself down 2017-12-18 19:32:39.653569 mon.node1 mon.0 10.193.56.230:6789/0 55300 : cluster [INF] osd.65 marked itself down 2017-12-18 19:32:39.653636 mon.node1 mon.0 10.193.56.230:6789/0 55301 : cluster [INF] osd.50 marked itself down 2017-12-18 19:32:39.653723 mon.node1 mon.0 10.193.56.230:6789/0 55302 : cluster [INF] osd.60 marked itself down 2017-12-18 19:32:39.853060 mon.node1 mon.0 10.193.56.230:6789/0 55303 : cluster [WRN] Health check failed: 24 osds down (OSD_DOWN) 2017-12-18 19:32:39.853087 mon.node1 mon.0 10.193.56.230:6789/0 55304 : cluster [WRN] Health check failed: 1 host (24 osds) down (OSD_HOST_DOWN) 2017-12-18 19:32:39.956248 mon.node1 mon.0 10.193.56.230:6789/0 55364 : cluster [INF] osd.43 marked itself down 2017-12-18 19:32:39.957056 mon.node1 mon.0 10.193.56.230:6789/0 55365 : cluster [INF] osd.1 marked itself down 2017-12-18 19:32:39.957755 mon.node1 mon.0 10.193.56.230:6789/0 55366 : cluster [INF] osd.48 marked itself down 2017-12-18 19:32:39.958714 mon.node1 mon.0 10.193.56.230:6789/0 55367 : cluster [INF] osd.92 marked itself down 2017-12-18 19:32:39.961492 mon.node1 mon.0 10.193.56.230:6789/0 55369 : cluster [INF] osd.9 marked itself down 2017-12-18 19:32:39.962607 mon.node1 mon.0 10.193.56.230:6789/0 55370 : cluster [INF] osd.73 marked itself down 2017-12-18 19:32:39.963351 mon.node1 mon.0 10.193.56.230:6789/0 55371 : cluster [INF] osd.87 marked itself down 2017-12-18 19:32:39.964302 mon.node1 mon.0 10.193.56.230:6789/0 55372 : cluster [INF] osd.68 marked itself down 2017-12-18 19:32:39.964812 mon.node1 mon.0 10.193.56.230:6789/0 55373 : cluster [INF] osd.112 marked itself down 2017-12-18 19:32:39.969735 mon.node1 mon.0 10.193.56.230:6789/0 55375 : cluster [INF] osd.34 marked itself down 2017-12-18 19:32:39.971502 mon.node1 mon.0 10.193.56.230:6789/0 55376 : cluster [INF] osd.38 marked itself down 2017-12-18 19:32:39.975264 mon.node1 mon.0 10.193.56.230:6789/0 55377 : cluster [INF] osd.58 marked itself down 2017-12-18 19:32:39.976043 mon.node1 mon.0 10.193.56.230:6789/0 55378 : cluster [INF] osd.102 marked itself down 2017-12-18 19:32:39.981759 mon.node1 mon.0 10.193.56.230:6789/0 55380 : cluster [INF] osd.78 marked itself down 2017-12-18 19:32:39.983359 mon.node1 mon.0 10.193.56.230:6789/0 55381 : cluster [INF] osd.107 marked itself down 2017-12-18 19:32:39.984216 mon.node1 mon.0 10.193.56.230:6789/0 55382 : cluster [INF] osd.53 marked itself down 2017-12-18 19:32:40.169127 mon.node1 mon.0 10.193.56.230:6789/0 55434 : cluster [INF] osd.14 marked itself down 2017-12-18 19:32:40.169184 mon.node1 mon.0 10.193.56.230:6789/0 55435 : cluster [INF] osd.82 marked itself down 2017-12-18 19:32:40.169230 mon.node1 mon.0 10.193.56.230:6789/0 55436 : cluster [INF] osd.29 marked itself down 2017-12-18 19:32:40.169301 mon.node1 mon.0 10.193.56.230:6789/0 55437 : cluster [INF] osd.63 marked itself down 2017-12-18 19:32:40.169377 mon.node1 mon.0 10.193.56.230:6789/0 55438 : cluster [INF] osd.18 marked itself down 2017-12-18 19:32:40.169448 mon.node1 mon.0 10.193.56.230:6789/0 55439 : cluster [INF] osd.117 marked itself down 2017-12-18 19:32:40.169535 mon.node1 mon.0 10.193.56.230:6789/0 55440 : cluster [INF] osd.97 marked itself down 2017-12-18 19:32:40.169604 mon.node1 mon.0 10.193.56.230:6789/0 55441 : cluster [INF] osd.24 marked itself down 2017-12-18 19:32:41.100324 mon.node1 mon.0 10.193.56.230:6789/0 55570 : cluster [INF] osd.22 marked itself down 2017-12-18 19:32:41.100417 mon.node1 mon.0 10.193.56.230:6789/0 55571 : cluster [INF] osd.46 marked itself down 2017-12-18 19:32:41.100501 mon.node1 mon.0 10.193.56.230:6789/0 55572 : cluster [INF] osd.118 marked itself down 2017-12-18 19:32:41.100555 mon.node1 mon.0 10.193.56.230:6789/0 55573 : cluster [INF] osd.41 marked itself down 2017-12-18 19:32:41.100861 mon.node1 mon.0 10.193.56.230:6789/0 55574 : cluster [INF] osd.7 marked itself down 2017-12-18 19:32:41.100962 mon.node1 mon.0 10.193.56.230:6789/0 55575 : cluster [INF] osd.3 marked itself down 2017-12-18 19:32:41.101093 mon.node1 mon.0 10.193.56.230:6789/0 55576 : cluster [INF] osd.17 marked itself down 2017-12-18 19:32:41.101210 mon.node1 mon.0 10.193.56.230:6789/0 55577 : cluster [INF] osd.52 marked itself down 2017-12-18 19:32:41.101303 mon.node1 mon.0 10.193.56.230:6789/0 55578 : cluster [INF] osd.76 marked itself down 2017-12-18 19:32:41.101388 mon.node1 mon.0 10.193.56.230:6789/0 55579 : cluster [INF] osd.99 marked itself down 2017-12-18 19:32:41.101449 mon.node1 mon.0 10.193.56.230:6789/0 55580 : cluster [INF] osd.12 marked itself down 2017-12-18 19:32:41.101585 mon.node1 mon.0 10.193.56.230:6789/0 55581 : cluster [INF] osd.104 marked itself down 2017-12-18 19:32:41.101693 mon.node1 mon.0 10.193.56.230:6789/0 55582 : cluster [INF] osd.62 marked itself down 2017-12-18 19:32:41.101777 mon.node1 mon.0 10.193.56.230:6789/0 55583 : cluster [INF] osd.109 marked itself down 2017-12-18 19:32:41.101862 mon.node1 mon.0 10.193.56.230:6789/0 55584 : cluster [INF] osd.36 marked itself down 2017-12-18 19:32:41.102008 mon.node1 mon.0 10.193.56.230:6789/0 55585 : cluster [INF] osd.89 marked itself down 2017-12-18 19:32:41.102088 mon.node1 mon.0 10.193.56.230:6789/0 55586 : cluster [INF] osd.27 marked itself down 2017-12-18 19:32:41.102168 mon.node1 mon.0 10.193.56.230:6789/0 55587 : cluster [INF] osd.72 marked itself down 2017-12-18 19:32:41.102249 mon.node1 mon.0 10.193.56.230:6789/0 55588 : cluster [INF] osd.94 marked itself down 2017-12-18 19:32:41.102314 mon.node1 mon.0 10.193.56.230:6789/0 55589 : cluster [INF] osd.57 marked itself down 2017-12-18 19:32:41.102428 mon.node1 mon.0 10.193.56.230:6789/0 55590 : cluster [INF] osd.114 marked itself down 2017-12-18 19:32:41.102514 mon.node1 mon.0 10.193.56.230:6789/0 55591 : cluster [INF] osd.32 marked itself down 2017-12-18 19:32:41.102594 mon.node1 mon.0 10.193.56.230:6789/0 55592 : cluster [INF] osd.67 marked itself down 2017-12-18 19:32:42.304440 mon.node1 mon.0 10.193.56.230:6789/0 55713 : cluster [WRN] Health check failed: Reduced data availability: 40 pgs inactive, 271 pgs down, 405 pgs peering (PG_AVAILABILITY) 2017-12-18 19:32:42.304480 mon.node1 mon.0 10.193.56.230:6789/0 55714 : cluster [WRN] Health check failed: Degraded data redundancy: 677 pgs unclean, 1 pg degraded (PG_DEGRADED) 2017-12-18 19:32:42.498861 mon.node1 mon.0 10.193.56.230:6789/0 55835 : cluster [INF] osd.116 marked itself down 2017-12-18 19:32:42.498940 mon.node1 mon.0 10.193.56.230:6789/0 55836 : cluster [INF] osd.59 marked itself down 2017-12-18 19:32:42.499186 mon.node1 mon.0 10.193.56.230:6789/0 55837 : cluster [INF] osd.96 marked itself down 2017-12-18 19:32:42.499247 mon.node1 mon.0 10.193.56.230:6789/0 55838 : cluster [INF] osd.0 marked itself down 2017-12-18 19:32:42.499300 mon.node1 mon.0 10.193.56.230:6789/0 55839 : cluster [INF] osd.44 marked itself down 2017-12-18 19:32:42.499365 mon.node1 mon.0 10.193.56.230:6789/0 55840 : cluster [INF] osd.16 marked itself down 2017-12-18 19:32:42.499419 mon.node1 mon.0 10.193.56.230:6789/0 55841 : cluster [INF] osd.74 marked itself down 2017-12-18 19:32:42.499679 mon.node1 mon.0 10.193.56.230:6789/0 55842 : cluster [INF] osd.106 marked itself down 2017-12-18 19:32:42.499730 mon.node1 mon.0 10.193.56.230:6789/0 55843 : cluster [INF] osd.111 marked itself down 2017-12-18 19:32:42.499775 mon.node1 mon.0 10.193.56.230:6789/0 55844 : cluster [INF] osd.5 marked itself down 2017-12-18 19:32:42.499814 mon.node1 mon.0 10.193.56.230:6789/0 55845 : cluster [INF] osd.83 marked itself down 2017-12-18 19:32:42.500036 mon.node1 mon.0 10.193.56.230:6789/0 55846 : cluster [INF] osd.79 marked itself down 2017-12-18 19:32:42.500092 mon.node1 mon.0 10.193.56.230:6789/0 55847 : cluster [INF] osd.86 marked itself down 2017-12-18 19:32:44.592615 mon.node1 mon.0 10.193.56.230:6789/0 55971 : cluster [INF] osd.112 10.193.56.231:6888/16082 boot 2017-12-18 19:32:44.592726 mon.node1 mon.0 10.193.56.230:6789/0 55972 : cluster [INF] osd.113 10.193.56.230:6880/1695 boot 2017-12-18 19:32:44.592782 mon.node1 mon.0 10.193.56.230:6789/0 55973 : cluster [INF] osd.108 10.193.56.230:6813/1876 boot 2017-12-18 19:32:44.706867 mon.node1 mon.0 10.193.56.230:6789/0 56096 : cluster [INF] osd.11 failed (root=hci_default,host=node4) (connection refused reported by osd.113) 2017-12-18 19:32:44.706987 mon.node1 mon.0 10.193.56.230:6789/0 56098 : cluster [INF] osd.21 failed (root=hci_default,host=node4) (connection refused reported by osd.113) 2017-12-18 19:32:44.707101 mon.node1 mon.0 10.193.56.230:6789/0 56100 : cluster [INF] osd.13 failed (root=hci_default,host=node5) (connection refused reported by osd.113) 2017-12-18 19:32:45.537116 mon.node1 mon.0 10.193.56.230:6789/0 56102 : cluster [WRN] Health check update: 81 osds down (OSD_DOWN) 2017-12-18 19:32:45.537157 mon.node1 mon.0 10.193.56.230:6789/0 56103 : cluster [WRN] Health check update: 1 host (23 osds) down (OSD_HOST_DOWN) 2017-12-18 19:32:45.716868 mon.node1 mon.0 10.193.56.230:6789/0 56104 : cluster [INF] Health check cleared: OSD_HOST_DOWN (was: 1 host (23 osds) down) 2017-12-18 19:32:45.779163 mon.node1 mon.0 10.193.56.230:6789/0 56105 : cluster [INF] osd.94 10.193.56.232:6803/13607 boot 2017-12-18 19:32:45.779247 mon.node1 mon.0 10.193.56.230:6789/0 56106 : cluster [INF] osd.117 10.193.56.231:6826/16347 boot 2017-12-18 19:32:45.801355 mon.node1 mon.0 10.193.56.230:6789/0 56158 : cluster [INF] osd.8 failed (root=hci_default,host=node5) (connection refused reported by osd.113) 2017-12-18 19:32:45.803906 mon.node1 mon.0 10.193.56.230:6789/0 56163 : cluster [INF] osd.23 failed (root=hci_default,host=node5) (connection refused reported by osd.113) 2017-12-18 19:32:46.878369 mon.node1 mon.0 10.193.56.230:6789/0 56236 : cluster [INF] osd.111 10.193.56.233:6872/15024 boot 2017-12-18 19:32:46.878460 mon.node1 mon.0 10.193.56.230:6789/0 56237 : cluster [INF] osd.116 10.193.56.233:6880/15021 boot 2017-12-18 19:32:46.895033 mon.node1 mon.0 10.193.56.230:6789/0 56241 : cluster [INF] osd.105 failed (root=hci_default,host=node5) (connection refused reported by osd.108) 2017-12-18 19:32:47.537819 mon.node1 mon.0 10.193.56.230:6789/0 56364 : cluster [WRN] Health check update: Reduced data availability: 65 pgs inactive, 973 pgs down, 399 pgs peering (PG_AVAILABILITY) 2017-12-18 19:32:47.537869 mon.node1 mon.0 10.193.56.230:6789/0 56365 : cluster [WRN] Health check update: Degraded data redundancy: 1/88148260 objects degraded (0.000%), 1436 pgs unclean, 72 pgs degraded (PG_DEGRADED) 2017-12-18 19:32:49.048337 mon.node1 mon.0 10.193.56.230:6789/0 56486 : cluster [INF] osd.110 10.193.56.234:6944/17793 boot 2017-12-18 19:32:49.048457 mon.node1 mon.0 10.193.56.230:6789/0 56487 : cluster [INF] osd.115 10.193.56.234:6948/17864 boot 2017-12-18 19:32:49.110822 mon.node1 mon.0 10.193.56.230:6789/0 56557 : cluster [INF] osd.101 failed (root=hci_default,host=node4) (connection refused reported by osd.108) 2017-12-18 19:32:51.539000 mon.node1 mon.0 10.193.56.230:6789/0 56732 : cluster [WRN] Health check update: 84 osds down (OSD_DOWN) 2017-12-18 19:32:57.312916 mon.node1 mon.0 10.193.56.230:6789/0 56744 : cluster [WRN] Health check update: 82 osds down (OSD_DOWN) 2017-12-18 19:32:57.340098 mon.node1 mon.0 10.193.56.230:6789/0 56746 : cluster [INF] osd.80 10.193.56.230:6901/2074 boot 2017-12-18 19:32:57.340376 mon.node1 mon.0 10.193.56.230:6789/0 56747 : cluster [INF] osd.93 10.193.56.230:6857/1642 boot 2017-12-18 19:32:57.478282 mon.node1 mon.0 10.193.56.230:6789/0 56869 : cluster [INF] osd.91 failed (root=hci_default,host=node4) (connection refused reported by osd.93) 2017-12-18 19:32:57.478415 mon.node1 mon.0 10.193.56.230:6789/0 56871 : cluster [INF] osd.95 failed (root=hci_default,host=node5) (connection refused reported by osd.93) 2017-12-18 19:32:58.411587 mon.node1 mon.0 10.193.56.230:6789/0 56879 : cluster [INF] osd.88 10.193.56.230:6861/2165 boot 2017-12-18 19:32:58.411944 mon.node1 mon.0 10.193.56.230:6789/0 56880 : cluster [INF] osd.84 10.193.56.230:6914/2518 boot 2017-12-18 19:32:58.411992 mon.node1 mon.0 10.193.56.230:6789/0 56881 : cluster [INF] osd.114 10.193.56.232:6804/13925 boot 2017-12-18 19:32:58.472495 mon.node1 mon.0 10.193.56.230:6789/0 57003 : cluster [INF] osd.85 failed (root=hci_default,host=node5) (connection refused reported by osd.93) 2017-12-18 19:32:58.488584 mon.node1 mon.0 10.193.56.230:6789/0 57007 : cluster [INF] osd.33 failed (root=hci_default,host=node5) (connection refused reported by osd.117) 2017-12-18 19:32:58.489050 mon.node1 mon.0 10.193.56.230:6789/0 57009 : cluster [INF] osd.2 failed (root=hci_default,host=node5) (connection refused reported by osd.117) 2017-12-18 19:32:59.476179 mon.node1 mon.0 10.193.56.230:6789/0 57022 : cluster [INF] osd.60 10.193.56.230:6829/1149 boot 2017-12-18 19:32:59.476351 mon.node1 mon.0 10.193.56.230:6789/0 57023 : cluster [INF] osd.89 10.193.56.232:6895/14165 boot 2017-12-18 19:32:59.476472 mon.node1 mon.0 10.193.56.230:6789/0 57024 : cluster [INF] osd.103 10.193.56.230:6871/1669 boot 2017-12-18 19:32:59.476815 mon.node1 mon.0 10.193.56.230:6789/0 57025 : cluster [INF] osd.6 10.193.56.230:6837/1333 boot 2017-12-18 19:32:59.476881 mon.node1 mon.0 10.193.56.230:6789/0 57026 : cluster [INF] osd.78 10.193.56.231:6846/16311 boot 2017-12-18 19:32:59.476946 mon.node1 mon.0 10.193.56.230:6789/0 57027 : cluster [INF] osd.1 10.193.56.231:6875/16401 boot 2017-12-18 19:32:59.477307 mon.node1 mon.0 10.193.56.230:6789/0 57028 : cluster [INF] osd.99 10.193.56.232:6811/13624 boot 2017-12-18 19:32:59.477365 mon.node1 mon.0 10.193.56.230:6789/0 57029 : cluster [INF] osd.109 10.193.56.232:6903/14216 boot 2017-12-18 19:32:59.539914 mon.node1 mon.0 10.193.56.230:6789/0 57122 : cluster [INF] osd.90 failed (root=hci_default,host=node5) (connection refused reported by osd.114) 2017-12-18 19:32:59.616817 mon.node1 mon.0 10.193.56.230:6789/0 57158 : cluster [INF] osd.31 failed (root=hci_default,host=node4) (connection refused reported by osd.1) 2017-12-18 19:32:59.616991 mon.node1 mon.0 10.193.56.230:6789/0 57160 : cluster [INF] osd.26 failed (root=hci_default,host=node4) (connection refused reported by osd.1) 2017-12-18 19:32:59.617552 mon.node1 mon.0 10.193.56.230:6789/0 57165 : cluster [INF] osd.19 failed (root=hci_default,host=node5) (connection refused reported by osd.1) 2017-12-18 19:32:59.617789 mon.node1 mon.0 10.193.56.230:6789/0 57170 : cluster [INF] osd.39 failed (root=hci_default,host=node4) (connection refused reported by osd.1) 2017-12-18 19:32:59.626212 mon.node1 mon.0 10.193.56.230:6789/0 57186 : cluster [INF] osd.64 failed (root=hci_default,host=node4) (connection refused reported by osd.78) 2017-12-18 19:32:59.714903 mon.node1 mon.0 10.193.56.230:6789/0 57209 : cluster [INF] osd.49 failed (root=hci_default,host=node4) (connection refused reported by osd.6) 2017-12-18 19:32:59.769702 mon.node1 mon.0 10.193.56.230:6789/0 57227 : cluster [INF] osd.69 failed (root=hci_default,host=node4) (connection refused reported by osd.60) 2017-12-18 19:33:00.518232 mon.node1 mon.0 10.193.56.230:6789/0 57237 : cluster [WRN] Health check update: Reduced data availability: 65 pgs inactive, 1039 pgs down, 397 pgs peering (PG_AVAILABILITY) 2017-12-18 19:33:00.518273 mon.node1 mon.0 10.193.56.230:6789/0 57238 : cluster [WRN] Health check update: Degraded data redundancy: 1/88148260 objects degraded (0.000%), 1504 pgs unclean, 75 pgs degraded (PG_DEGRADED) 2017-12-18 19:33:00.552371 mon.node1 mon.0 10.193.56.230:6789/0 57244 : cluster [INF] osd.65 10.193.56.230:6805/1464 boot 2017-12-18 19:33:00.552558 mon.node1 mon.0 10.193.56.230:6789/0 57245 : cluster [INF] osd.24 10.193.56.231:6848/15825 boot 2017-12-18 19:33:00.552718 mon.node1 mon.0 10.193.56.230:6789/0 57246 : cluster [INF] osd.96 10.193.56.233:6838/14403 boot 2017-12-18 19:33:00.552958 mon.node1 mon.0 10.193.56.230:6789/0 57247 : cluster [INF] osd.118 10.193.56.232:6856/13361 boot 2017-12-18 19:33:00.553255 mon.node1 mon.0 10.193.56.230:6789/0 57248 : cluster [INF] osd.98 10.193.56.230:6801/1828 boot 2017-12-18 19:33:00.553631 mon.node1 mon.0 10.193.56.230:6789/0 57249 : cluster [INF] osd.15 10.193.56.230:6841/2349 boot 2017-12-18 19:33:00.553742 mon.node1 mon.0 10.193.56.230:6789/0 57250 : cluster [INF] osd.106 10.193.56.233:6946/14506 boot 2017-12-18 19:33:00.611984 mon.node1 mon.0 10.193.56.230:6789/0 57356 : cluster [INF] osd.54 failed (root=hci_default,host=node4) (connection refused reported by osd.6) 2017-12-18 19:33:00.620827 mon.node1 mon.0 10.193.56.230:6789/0 57368 : cluster [INF] osd.61 failed (root=hci_default,host=node5) (connection refused reported by osd.78) 2017-12-18 19:33:01.639561 mon.node1 mon.0 10.193.56.230:6789/0 57444 : cluster [INF] osd.64 10.193.56.233:6912/13300 boot 2017-12-18 19:33:01.639638 mon.node1 mon.0 10.193.56.230:6789/0 57445 : cluster [INF] osd.100 10.193.56.234:6932/17663 boot 2017-12-18 19:33:01.639695 mon.node1 mon.0 10.193.56.230:6789/0 57446 : cluster [INF] osd.107 10.193.56.231:6928/16596 boot 2017-12-18 19:33:01.639833 mon.node1 mon.0 10.193.56.230:6789/0 57447 : cluster [INF] osd.87 10.193.56.231:6821/16518 boot 2017-12-18 19:33:01.640010 mon.node1 mon.0 10.193.56.230:6789/0 57448 : cluster [INF] osd.72 10.193.56.232:6818/13471 boot 2017-12-18 19:33:01.640288 mon.node1 mon.0 10.193.56.230:6789/0 57449 : cluster [INF] osd.43 10.193.56.231:6884/17095 boot 2017-12-18 19:33:01.640392 mon.node1 mon.0 10.193.56.230:6789/0 57450 : cluster [INF] osd.38 10.193.56.231:6896/15041 boot 2017-12-18 19:33:01.640462 mon.node1 mon.0 10.193.56.230:6789/0 57451 : cluster [INF] osd.75 10.193.56.230:6888/1231 boot 2017-12-18 19:33:01.640672 mon.node1 mon.0 10.193.56.230:6789/0 57452 : cluster [INF] osd.27 10.193.56.232:6846/13920 boot 2017-12-18 19:33:01.640727 mon.node1 mon.0 10.193.56.230:6789/0 57453 : cluster [INF] osd.58 10.193.56.231:6904/15203 boot 2017-12-18 19:33:01.640813 mon.node1 mon.0 10.193.56.230:6789/0 57454 : cluster [INF] osd.68 10.193.56.231:6853/16220 boot 2017-12-18 19:33:01.640876 mon.node1 mon.0 10.193.56.230:6789/0 57455 : cluster [INF] osd.92 10.193.56.231:6812/16477 boot 2017-12-18 19:33:01.640923 mon.node1 mon.0 10.193.56.230:6789/0 57456 : cluster [INF] osd.10 10.193.56.230:6910/2461 boot 2017-12-18 19:33:01.640972 mon.node1 mon.0 10.193.56.230:6789/0 57457 : cluster [INF] osd.40 10.193.56.230:6855/1422 boot 2017-12-18 19:33:01.641264 mon.node1 mon.0 10.193.56.230:6789/0 57458 : cluster [INF] osd.82 10.193.56.231:6932/17098 boot 2017-12-18 19:33:01.641312 mon.node1 mon.0 10.193.56.230:6789/0 57459 : cluster [INF] osd.57 10.193.56.232:6907/14218 boot 2017-12-18 19:33:01.641917 mon.node1 mon.0 10.193.56.230:6789/0 57460 : cluster [INF] osd.102 10.193.56.231:6877/16985 boot 2017-12-18 19:33:01.641967 mon.node1 mon.0 10.193.56.230:6789/0 57461 : cluster [INF] osd.25 10.193.56.230:6884/1416 boot 2017-12-18 19:33:01.642014 mon.node1 mon.0 10.193.56.230:6789/0 57462 : cluster [INF] osd.11 10.193.56.233:6896/12850 boot 2017-12-18 19:33:01.642061 mon.node1 mon.0 10.193.56.230:6789/0 57463 : cluster [INF] osd.7 10.193.56.232:6830/14848 boot 2017-12-18 19:33:01.642107 mon.node1 mon.0 10.193.56.230:6789/0 57464 : cluster [INF] osd.31 10.193.56.233:6932/13788 boot 2017-12-18 19:33:02.705586 mon.node1 mon.0 10.193.56.230:6789/0 57598 : cluster [WRN] Health check update: 43 osds down (OSD_DOWN) 2017-12-18 19:33:05.441588 mon.node1 mon.0 10.193.56.230:6789/0 57620 : cluster [INF] osd.61 10.193.56.234:6898/16875 boot 2017-12-18 19:33:05.441662 mon.node1 mon.0 10.193.56.230:6789/0 57621 : cluster [INF] osd.63 10.193.56.231:6804/15754 boot 2017-12-18 19:33:05.441719 mon.node1 mon.0 10.193.56.230:6789/0 57622 : cluster [INF] osd.30 10.193.56.230:6817/1681 boot 2017-12-18 19:33:05.444580 mon.node1 mon.0 10.193.56.230:6789/0 57623 : cluster [INF] osd.62 10.193.56.232:6899/14213 boot 2017-12-18 19:33:05.444853 mon.node1 mon.0 10.193.56.230:6789/0 57624 : cluster [INF] osd.67 10.193.56.232:6840/13728 boot 2017-12-18 19:33:05.444976 mon.node1 mon.0 10.193.56.230:6789/0 57625 : cluster [INF] osd.14 10.193.56.231:6834/17043 boot 2017-12-18 19:33:05.446027 mon.node1 mon.0 10.193.56.230:6789/0 57626 : cluster [INF] osd.29 10.193.56.231:6800/15700 boot 2017-12-18 19:33:05.446277 mon.node1 mon.0 10.193.56.230:6789/0 57627 : cluster [INF] osd.86 10.193.56.233:6828/15583 boot 2017-12-18 19:33:05.446322 mon.node1 mon.0 10.193.56.230:6789/0 57628 : cluster [INF] osd.105 10.193.56.234:6952/18425 boot 2017-12-18 19:33:05.446479 mon.node1 mon.0 10.193.56.230:6789/0 57629 : cluster [INF] osd.39 10.193.56.233:6920/13675 boot 2017-12-18 19:33:05.446582 mon.node1 mon.0 10.193.56.230:6789/0 57630 : cluster [INF] osd.8 10.193.56.234:6830/17098 boot 2017-12-18 19:33:05.446617 mon.node1 mon.0 10.193.56.230:6789/0 57631 : cluster [INF] osd.104 10.193.56.232:6883/14977 boot 2017-12-18 19:33:05.446662 mon.node1 mon.0 10.193.56.230:6789/0 57632 : cluster [INF] osd.52 10.193.56.232:6855/13929 boot 2017-12-18 19:33:05.446819 mon.node1 mon.0 10.193.56.230:6789/0 57633 : cluster [INF] osd.20 10.193.56.230:6876/2018 boot 2017-12-18 19:33:05.446854 mon.node1 mon.0 10.193.56.230:6789/0 57634 : cluster [INF] osd.79 10.193.56.233:6953/14793 boot 2017-12-18 19:33:05.446889 mon.node1 mon.0 10.193.56.230:6789/0 57635 : cluster [INF] osd.26 10.193.56.233:6904/13147 boot 2017-12-18 19:33:05.446925 mon.node1 mon.0 10.193.56.230:6789/0 57636 : cluster [INF] osd.69 10.193.56.233:6900/12935 boot 2017-12-18 19:33:05.616460 mon.node1 mon.0 10.193.56.230:6789/0 57774 : cluster [WRN] Health check update: Reduced data availability: 60 pgs inactive, 1415 pgs down, 316 pgs peering (PG_AVAILABILITY) 2017-12-18 19:33:05.616512 mon.node1 mon.0 10.193.56.230:6789/0 57775 : cluster [WRN] Health check update: Degraded data redundancy: 1/88148260 objects degraded (0.000%), 1817 pgs unclean, 87 pgs degraded (PG_DEGRADED) 2017-12-18 19:33:05.616573 mon.node1 mon.0 10.193.56.230:6789/0 57776 : cluster [INF] osd.28 marked down after no beacon for 30.847157 seconds 2017-12-18 19:33:05.616604 mon.node1 mon.0 10.193.56.230:6789/0 57777 : cluster [INF] osd.47 marked down after no beacon for 31.311945 seconds 2017-12-18 19:33:05.616631 mon.node1 mon.0 10.193.56.230:6789/0 57778 : cluster [INF] osd.71 marked down after no beacon for 34.437248 seconds 2017-12-18 19:33:05.616655 mon.node1 mon.0 10.193.56.230:6789/0 57779 : cluster [INF] osd.81 marked down after no beacon for 34.807409 seconds 2017-12-18 19:33:05.790172 mon.node1 mon.0 10.193.56.230:6789/0 57780 : cluster [INF] osd.42 10.193.56.234:6906/17150 boot 2017-12-18 19:33:05.790315 mon.node1 mon.0 10.193.56.230:6789/0 57781 : cluster [INF] osd.3 10.193.56.232:6878/14910 boot 2017-12-18 19:33:05.790399 mon.node1 mon.0 10.193.56.230:6789/0 57782 : cluster [INF] osd.90 10.193.56.234:6887/17382 boot 2017-12-18 19:33:05.790457 mon.node1 mon.0 10.193.56.230:6789/0 57783 : cluster [INF] osd.59 10.193.56.233:6894/14468 boot 2017-12-18 19:33:05.790536 mon.node1 mon.0 10.193.56.230:6789/0 57784 : cluster [INF] osd.73 10.193.56.231:6900/15065 boot 2017-12-18 19:33:05.790600 mon.node1 mon.0 10.193.56.230:6789/0 57785 : cluster [INF] osd.23 10.193.56.234:6924/17415 boot 2017-12-18 19:33:05.791224 mon.node1 mon.0 10.193.56.230:6789/0 57786 : cluster [INF] osd.16 10.193.56.233:6840/14574 boot 2017-12-18 19:33:05.791313 mon.node1 mon.0 10.193.56.230:6789/0 57787 : cluster [INF] osd.19 10.193.56.234:6810/17071 boot 2017-12-18 19:33:05.791417 mon.node1 mon.0 10.193.56.230:6789/0 57788 : cluster [INF] osd.74 10.193.56.233:6800/14277 boot 2017-12-18 19:33:05.791460 mon.node1 mon.0 10.193.56.230:6789/0 57789 : cluster [INF] osd.21 10.193.56.233:6936/13862 boot 2017-12-18 19:33:05.792049 mon.node1 mon.0 10.193.56.230:6789/0 57790 : cluster [INF] osd.13 10.193.56.234:6814/16740 boot 2017-12-18 19:33:05.792671 mon.node1 mon.0 10.193.56.230:6789/0 57791 : cluster [INF] osd.41 10.193.56.232:6824/13832 boot 2017-12-18 19:33:05.793436 mon.node1 mon.0 10.193.56.230:6789/0 57792 : cluster [INF] osd.83 10.193.56.233:6824/14745 boot 2017-12-18 19:33:05.794072 mon.node1 mon.0 10.193.56.230:6789/0 57793 : cluster [INF] osd.35 10.193.56.230:6821/2715 boot 2017-12-18 19:33:06.060868 mon.node1 mon.0 10.193.56.230:6789/0 57883 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; 35 osds down; Reduced data availability: 60 pgs inactive, 1415 pgs down, 316 pgs peering; Degraded data redundancy: 1/88148260 objects degraded (0.000%), 1817 pgs unclean, 87 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 19:33:06.852823 mon.node1 mon.0 10.193.56.230:6789/0 57922 : cluster [INF] osd.81 10.193.56.234:6940/17672 boot 2017-12-18 19:33:06.853173 mon.node1 mon.0 10.193.56.230:6789/0 57923 : cluster [INF] osd.66 10.193.56.234:6802/18417 boot 2017-12-18 19:33:06.853613 mon.node1 mon.0 10.193.56.230:6789/0 57924 : cluster [INF] osd.56 10.193.56.234:6920/17420 boot 2017-12-18 19:33:06.853671 mon.node1 mon.0 10.193.56.230:6789/0 57925 : cluster [INF] osd.9 10.193.56.231:6837/16590 boot 2017-12-18 19:33:06.853753 mon.node1 mon.0 10.193.56.230:6789/0 57926 : cluster [INF] osd.55 10.193.56.230:6825/2169 boot 2017-12-18 19:33:06.853801 mon.node1 mon.0 10.193.56.230:6789/0 57927 : cluster [INF] osd.70 10.193.56.230:6833/2745 boot 2017-12-18 19:33:06.853844 mon.node1 mon.0 10.193.56.230:6789/0 57928 : cluster [INF] osd.34 10.193.56.231:6814/16309 boot 2017-12-18 19:33:06.853892 mon.node1 mon.0 10.193.56.230:6789/0 57929 : cluster [INF] osd.50 10.193.56.230:6906/2172 boot 2017-12-18 19:33:06.853988 mon.node1 mon.0 10.193.56.230:6789/0 57930 : cluster [INF] osd.45 10.193.56.230:6845/1676 boot 2017-12-18 19:33:06.854034 mon.node1 mon.0 10.193.56.230:6789/0 57931 : cluster [INF] osd.5 10.193.56.233:6940/14158 boot 2017-12-18 19:33:06.854493 mon.node1 mon.0 10.193.56.230:6789/0 57932 : cluster [INF] osd.36 10.193.56.232:6822/13628 boot 2017-12-18 19:33:06.855448 mon.node1 mon.0 10.193.56.230:6789/0 57933 : cluster [INF] osd.101 10.193.56.233:6928/13690 boot 2017-12-18 19:33:06.859890 mon.node1 mon.0 10.193.56.230:6789/0 57934 : cluster [INF] osd.44 10.193.56.233:6836/14313 boot 2017-12-18 19:33:06.860437 mon.node1 mon.0 10.193.56.230:6789/0 57935 : cluster [INF] osd.71 10.193.56.234:6916/17397 boot 2017-12-18 19:33:06.861587 mon.node1 mon.0 10.193.56.230:6789/0 57936 : cluster [INF] osd.47 10.193.56.234:6956/18430 boot 2017-12-18 19:33:06.862532 mon.node1 mon.0 10.193.56.230:6789/0 57937 : cluster [INF] osd.28 10.193.56.234:6822/17389 boot 2017-12-18 19:33:06.862801 mon.node1 mon.0 10.193.56.230:6789/0 57938 : cluster [INF] osd.2 10.193.56.234:6912/17393 boot 2017-12-18 19:33:06.862896 mon.node1 mon.0 10.193.56.230:6789/0 57939 : cluster [INF] osd.85 10.193.56.234:6851/17198 boot 2017-12-18 19:33:06.863136 mon.node1 mon.0 10.193.56.230:6789/0 57940 : cluster [INF] osd.91 10.193.56.233:6908/13155 boot 2017-12-18 19:33:06.863992 mon.node1 mon.0 10.193.56.230:6789/0 57941 : cluster [INF] osd.22 10.193.56.232:6832/13148 boot 2017-12-18 19:33:06.864296 mon.node1 mon.0 10.193.56.230:6789/0 57942 : cluster [INF] osd.97 10.193.56.231:6917/15760 boot 2017-12-18 19:33:06.865223 mon.node1 mon.0 10.193.56.230:6789/0 57943 : cluster [INF] osd.76 10.193.56.232:6831/13684 boot 2017-12-18 19:33:06.865400 mon.node1 mon.0 10.193.56.230:6789/0 57944 : cluster [INF] osd.32 10.193.56.232:6872/13022 boot 2017-12-18 19:33:06.866260 mon.node1 mon.0 10.193.56.230:6789/0 57945 : cluster [INF] osd.95 10.193.56.234:6936/17638 boot 2017-12-18 19:33:06.866381 mon.node1 mon.0 10.193.56.230:6789/0 57946 : cluster [INF] osd.48 10.193.56.231:6830/16873 boot 2017-12-18 19:33:06.866646 mon.node1 mon.0 10.193.56.230:6789/0 57947 : cluster [INF] osd.12 10.193.56.232:6800/13490 boot 2017-12-18 19:33:07.756549 mon.node1 mon.0 10.193.56.230:6789/0 58071 : cluster [WRN] Health check update: 11 osds down (OSD_DOWN) 2017-12-18 19:33:07.756647 mon.node1 mon.0 10.193.56.230:6789/0 58072 : cluster [INF] osd.77 marked down after no beacon for 30.263387 seconds 2017-12-18 19:33:07.920910 mon.node1 mon.0 10.193.56.230:6789/0 58073 : cluster [INF] osd.37 10.193.56.234:6818/17155 boot 2017-12-18 19:33:07.921349 mon.node1 mon.0 10.193.56.230:6789/0 58074 : cluster [INF] osd.51 10.193.56.234:6852/17603 boot 2017-12-18 19:33:07.921782 mon.node1 mon.0 10.193.56.230:6789/0 58075 : cluster [INF] osd.46 10.193.56.232:6868/13866 boot 2017-12-18 19:33:07.923588 mon.node1 mon.0 10.193.56.230:6789/0 58076 : cluster [INF] osd.54 10.193.56.233:6924/13718 boot 2017-12-18 19:33:07.923696 mon.node1 mon.0 10.193.56.230:6789/0 58077 : cluster [INF] osd.33 10.193.56.234:6960/18729 boot 2017-12-18 19:33:07.924451 mon.node1 mon.0 10.193.56.230:6789/0 58078 : cluster [INF] osd.0 10.193.56.233:6843/14785 boot 2017-12-18 19:33:07.926640 mon.node1 mon.0 10.193.56.230:6789/0 58079 : cluster [INF] osd.53 10.193.56.231:6908/15219 boot 2017-12-18 19:33:07.926865 mon.node1 mon.0 10.193.56.230:6789/0 58080 : cluster [INF] osd.4 10.193.56.230:6847/1974 boot 2017-12-18 19:33:09.008215 mon.node1 mon.0 10.193.56.230:6789/0 58202 : cluster [INF] osd.77 10.193.56.234:6928/17660 boot 2017-12-18 19:33:09.009626 mon.node1 mon.0 10.193.56.230:6789/0 58203 : cluster [INF] osd.49 10.193.56.233:6913/13229 boot 2017-12-18 19:33:11.639732 mon.node1 mon.0 10.193.56.230:6789/0 58574 : cluster [INF] osd.17 10.193.56.232:6864/13911 boot 2017-12-18 19:33:11.892283 mon.node1 mon.0 10.193.56.230:6789/0 58695 : cluster [WRN] Health check update: Reduced data availability: 100 pgs inactive, 1907 pgs down, 973 pgs peering (PG_AVAILABILITY) 2017-12-18 19:33:11.892325 mon.node1 mon.0 10.193.56.230:6789/0 58696 : cluster [WRN] Health check update: Degraded data redundancy: 91782/88148260 objects degraded (0.104%), 3266 pgs unclean, 148 pgs degraded (PG_DEGRADED) 2017-12-18 19:33:12.672290 mon.node1 mon.0 10.193.56.230:6789/0 58699 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2017-12-18 19:33:13.359093 mon.node1 mon.0 10.193.56.230:6789/0 58701 : cluster [INF] osd.18 10.193.56.231:6921/15763 boot 2017-12-18 19:33:17.893884 mon.node1 mon.0 10.193.56.230:6789/0 58952 : cluster [WRN] Health check update: Reduced data availability: 6 pgs down, 3 pgs peering (PG_AVAILABILITY) 2017-12-18 19:33:17.893929 mon.node1 mon.0 10.193.56.230:6789/0 58953 : cluster [WRN] Health check update: Degraded data redundancy: 1016722/88148260 objects degraded (1.153%), 335 pgs unclean, 242 pgs degraded (PG_DEGRADED) 2017-12-18 19:33:17.984614 mon.node1 mon.0 10.193.56.230:6789/0 58954 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 6 pgs down, 3 pgs peering) 2017-12-18 19:33:22.076232 mon.node1 mon.0 10.193.56.230:6789/0 58965 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 11 pgs unclean) 2017-12-18 19:34:06.061005 mon.node1 mon.0 10.193.56.230:6789/0 59070 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 19:35:28.846282 mon.node1 mon.0 10.193.56.230:6789/0 1 : cluster [INF] mon.node1 calling new monitor election 2017-12-18 19:35:28.878096 mon.node1 mon.0 10.193.56.230:6789/0 2 : cluster [INF] mon.node1@0 won leader election with quorum 0,1,2,3,4 2017-12-18 19:35:28.880993 mon.node1 mon.0 10.193.56.230:6789/0 3 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 19:35:28.901613 mon.node1 mon.0 10.193.56.230:6789/0 4 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 19:35:33.051798 mon.node1 mon.0 10.193.56.230:6789/0 5 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 19:35:33.358887 mon.node1 mon.0 10.193.56.230:6789/0 6 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 19:35:43.041536 mon.node2 mon.1 10.193.56.231:6789/0 1 : cluster [INF] mon.node2 calling new monitor election 2017-12-18 19:35:48.821716 mon.node1 mon.0 10.193.56.230:6789/0 30 : cluster [INF] monmap e1: 5 mons at {node1=10.193.56.230:6789/0,node2=10.193.56.231:6789/0,node3=10.193.56.232:6789/0,node4=10.193.56.233:6789/0,node5=10.193.56.234:6789/0} 2017-12-18 19:35:52.710602 mon.node1 mon.0 10.193.56.230:6789/0 34 : cluster [INF] mon.node1 calling new monitor election 2017-12-18 19:35:52.723729 mon.node1 mon.0 10.193.56.230:6789/0 35 : cluster [INF] mon.node1@0 won leader election with quorum 0,1,2,3,4 2017-12-18 19:35:52.728486 mon.node1 mon.0 10.193.56.230:6789/0 36 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 19:35:52.734441 mon.node1 mon.0 10.193.56.230:6789/0 37 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 19:35:52.740556 mon.node1 mon.0 10.193.56.230:6789/0 38 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 19:35:52.742394 mon.node1 mon.0 10.193.56.230:6789/0 39 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 19:35:54.841562 mon.node1 mon.0 10.193.56.230:6789/0 40 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 19:35:54.859461 mon.node1 mon.0 10.193.56.230:6789/0 41 : cluster [INF] monmap e1: 5 mons at {node1=10.193.56.230:6789/0,node2=10.193.56.231:6789/0,node3=10.193.56.232:6789/0,node4=10.193.56.233:6789/0,node5=10.193.56.234:6789/0} 2017-12-18 19:35:52.333853 mon.node3 mon.2 10.193.56.232:6789/0 1 : cluster [INF] mon.node3 calling new monitor election 2017-12-18 19:35:52.354873 mon.node2 mon.1 10.193.56.231:6789/0 3 : cluster [INF] mon.node2 calling new monitor election 2017-12-18 19:35:54.864293 mon.node1 mon.0 10.193.56.230:6789/0 45 : cluster [INF] Manager daemon node1 is now available 2017-12-18 19:36:01.501634 mon.node4 mon.3 10.193.56.233:6789/0 1 : cluster [INF] mon.node4 calling new monitor election 2017-12-18 19:36:01.514331 mon.node3 mon.2 10.193.56.232:6789/0 16 : cluster [INF] mon.node3 calling new monitor election 2017-12-18 19:36:01.516074 mon.node1 mon.0 10.193.56.230:6789/0 75 : cluster [INF] mon.node1 calling new monitor election 2017-12-18 19:36:01.527356 mon.node2 mon.1 10.193.56.231:6789/0 11 : cluster [INF] mon.node2 calling new monitor election 2017-12-18 19:36:01.539538 mon.node1 mon.0 10.193.56.230:6789/0 76 : cluster [INF] mon.node1@0 won leader election with quorum 0,1,2,3,4 2017-12-18 19:36:01.544045 mon.node1 mon.0 10.193.56.230:6789/0 77 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 19:36:01.546817 mon.node1 mon.0 10.193.56.230:6789/0 78 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 19:36:01.550311 mon.node1 mon.0 10.193.56.230:6789/0 79 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 19:36:01.551993 mon.node1 mon.0 10.193.56.230:6789/0 80 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 19:36:01.556115 mon.node1 mon.0 10.193.56.230:6789/0 81 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 19:36:01.567662 mon.node1 mon.0 10.193.56.230:6789/0 82 : cluster [INF] monmap e1: 5 mons at {node1=10.193.56.230:6789/0,node2=10.193.56.231:6789/0,node3=10.193.56.232:6789/0,node4=10.193.56.233:6789/0,node5=10.193.56.234:6789/0} 2017-12-18 19:36:11.334633 mon.node5 mon.4 10.193.56.234:6789/0 1 : cluster [INF] mon.node5 calling new monitor election 2017-12-18 19:36:11.337130 mon.node1 mon.0 10.193.56.230:6789/0 109 : cluster [INF] mon.node1 calling new monitor election 2017-12-18 19:36:11.338095 mon.node3 mon.2 10.193.56.232:6789/0 52 : cluster [INF] mon.node3 calling new monitor election 2017-12-18 19:36:11.343995 mon.node4 mon.3 10.193.56.233:6789/0 30 : cluster [INF] mon.node4 calling new monitor election 2017-12-18 19:36:11.347202 mon.node2 mon.1 10.193.56.231:6789/0 44 : cluster [INF] mon.node2 calling new monitor election 2017-12-18 19:36:11.355643 mon.node1 mon.0 10.193.56.230:6789/0 110 : cluster [INF] mon.node1@0 won leader election with quorum 0,1,2,3,4 2017-12-18 19:36:11.360290 mon.node1 mon.0 10.193.56.230:6789/0 111 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 19:36:11.363997 mon.node1 mon.0 10.193.56.230:6789/0 112 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 19:36:11.366358 mon.node1 mon.0 10.193.56.230:6789/0 113 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 19:36:11.366838 mon.node1 mon.0 10.193.56.230:6789/0 114 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 19:36:11.367184 mon.node1 mon.0 10.193.56.230:6789/0 115 : cluster [INF] monmap e1: 5 mons at {node1=10.193.56.230:6789/0,node2=10.193.56.231:6789/0,node3=10.193.56.232:6789/0,node4=10.193.56.233:6789/0,node5=10.193.56.234:6789/0} 2017-12-18 19:36:11.372944 mon.node1 mon.0 10.193.56.230:6789/0 119 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 19:41:11.360544 mon.node1 mon.0 10.193.56.230:6789/0 193 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 19:41:11.360590 mon.node1 mon.0 10.193.56.230:6789/0 194 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 19:41:11.360670 mon.node1 mon.0 10.193.56.230:6789/0 195 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 19:41:11.360725 mon.node1 mon.0 10.193.56.230:6789/0 196 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 19:46:11.360701 mon.node1 mon.0 10.193.56.230:6789/0 257 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 19:46:11.360734 mon.node1 mon.0 10.193.56.230:6789/0 258 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 19:46:11.360781 mon.node1 mon.0 10.193.56.230:6789/0 259 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 19:46:11.361186 mon.node1 mon.0 10.193.56.230:6789/0 260 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 19:51:11.360751 mon.node1 mon.0 10.193.56.230:6789/0 335 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 19:51:11.360794 mon.node1 mon.0 10.193.56.230:6789/0 336 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 19:51:11.360828 mon.node1 mon.0 10.193.56.230:6789/0 337 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 19:51:11.360845 mon.node1 mon.0 10.193.56.230:6789/0 338 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 19:56:11.360917 mon.node1 mon.0 10.193.56.230:6789/0 395 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 19:56:11.360959 mon.node1 mon.0 10.193.56.230:6789/0 396 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 19:56:11.361026 mon.node1 mon.0 10.193.56.230:6789/0 397 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 19:56:11.361515 mon.node1 mon.0 10.193.56.230:6789/0 398 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 20:00:00.000089 mon.node1 mon.0 10.193.56.230:6789/0 448 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 20:01:11.361336 mon.node1 mon.0 10.193.56.230:6789/0 461 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 20:01:11.361374 mon.node1 mon.0 10.193.56.230:6789/0 462 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 20:01:11.361390 mon.node1 mon.0 10.193.56.230:6789/0 463 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 20:01:11.362496 mon.node1 mon.0 10.193.56.230:6789/0 464 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 20:02:18.147010 mon.node1 mon.0 10.193.56.230:6789/0 484 : cluster [INF] osd.20 failed (root=hci_default,host=node1) (connection refused reported by osd.24) 2017-12-18 20:02:19.005431 mon.node1 mon.0 10.193.56.230:6789/0 638 : cluster [WRN] Health check failed: 1 osds down (OSD_DOWN) 2017-12-18 20:02:23.951257 mon.node1 mon.0 10.193.56.230:6789/0 643 : cluster [WRN] Health check failed: Degraded data redundancy: 931719/88894920 objects degraded (1.048%), 59 pgs unclean, 271 pgs degraded (PG_DEGRADED) 2017-12-18 20:02:29.127736 mon.node1 mon.0 10.193.56.230:6789/0 645 : cluster [WRN] Health check update: Degraded data redundancy: 931719/88897430 objects degraded (1.048%), 66 pgs unclean, 271 pgs degraded (PG_DEGRADED) 2017-12-18 20:02:34.326102 mon.node1 mon.0 10.193.56.230:6789/0 646 : cluster [WRN] Health check update: Degraded data redundancy: 932151/88900270 objects degraded (1.049%), 81 pgs unclean, 271 pgs degraded (PG_DEGRADED) 2017-12-18 20:02:40.332448 mon.node1 mon.0 10.193.56.230:6789/0 648 : cluster [WRN] Health check update: Degraded data redundancy: 932646/88903280 objects degraded (1.049%), 105 pgs unclean, 271 pgs degraded (PG_DEGRADED) 2017-12-18 20:02:47.129826 mon.node1 mon.0 10.193.56.230:6789/0 652 : cluster [WRN] Health check update: Degraded data redundancy: 933096/88906190 objects degraded (1.050%), 111 pgs unclean, 271 pgs degraded (PG_DEGRADED) 2017-12-18 20:02:49.694338 mon.node1 mon.0 10.193.56.230:6789/0 655 : cluster [INF] Health check cleared: OSD_DOWN (was: 1 osds down) 2017-12-18 20:02:49.736933 mon.node1 mon.0 10.193.56.230:6789/0 656 : cluster [INF] osd.20 10.193.56.230:6800/5058 boot 2017-12-18 20:02:53.130498 mon.node1 mon.0 10.193.56.230:6789/0 661 : cluster [WRN] Health check update: Degraded data redundancy: 933429/88908870 objects degraded (1.050%), 111 pgs unclean, 271 pgs degraded (PG_DEGRADED) 2017-12-18 20:02:59.131222 mon.node1 mon.0 10.193.56.230:6789/0 666 : cluster [WRN] Health check update: Degraded data redundancy: 322/88914260 objects degraded (0.000%), 40 pgs unclean, 110 pgs degraded (PG_DEGRADED) 2017-12-18 20:03:04.254242 mon.node1 mon.0 10.193.56.230:6789/0 670 : cluster [WRN] Health check update: Degraded data redundancy: 276/88917190 objects degraded (0.000%), 37 pgs unclean, 81 pgs degraded (PG_DEGRADED) 2017-12-18 20:03:10.425461 mon.node1 mon.0 10.193.56.230:6789/0 674 : cluster [WRN] Health check update: Degraded data redundancy: 418/88921650 objects degraded (0.000%), 53 pgs unclean, 67 pgs degraded (PG_DEGRADED) 2017-12-18 20:03:11.362579 mon.node1 mon.0 10.193.56.230:6789/0 676 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; Degraded data redundancy: 418/88921650 objects degraded (0.000%), 53 pgs unclean, 67 pgs degraded; application not enabled on 10 pool(s) 2017-12-18 20:03:16.247929 mon.node1 mon.0 10.193.56.230:6789/0 682 : cluster [WRN] Health check update: Degraded data redundancy: 449/88925400 objects degraded (0.001%), 52 pgs unclean, 52 pgs degraded (PG_DEGRADED) 2017-12-18 20:03:22.241799 mon.node1 mon.0 10.193.56.230:6789/0 684 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 273/88928640 objects degraded (0.000%), 28 pgs unclean, 28 pgs degraded) 2017-12-18 20:04:11.362690 mon.node1 mon.0 10.193.56.230:6789/0 692 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 20:06:11.361010 mon.node1 mon.0 10.193.56.230:6789/0 723 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 20:06:11.361216 mon.node1 mon.0 10.193.56.230:6789/0 724 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 20:06:11.361247 mon.node1 mon.0 10.193.56.230:6789/0 725 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 20:06:11.361729 mon.node1 mon.0 10.193.56.230:6789/0 726 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 20:11:11.361149 mon.node1 mon.0 10.193.56.230:6789/0 779 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 20:11:11.361188 mon.node1 mon.0 10.193.56.230:6789/0 780 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 20:11:11.361267 mon.node1 mon.0 10.193.56.230:6789/0 781 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 20:11:11.361292 mon.node1 mon.0 10.193.56.230:6789/0 782 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 20:16:11.361340 mon.node1 mon.0 10.193.56.230:6789/0 852 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 20:16:11.361384 mon.node1 mon.0 10.193.56.230:6789/0 853 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 20:16:11.361460 mon.node1 mon.0 10.193.56.230:6789/0 854 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 20:16:11.363453 mon.node1 mon.0 10.193.56.230:6789/0 855 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 20:21:11.361433 mon.node1 mon.0 10.193.56.230:6789/0 914 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 20:21:11.361464 mon.node1 mon.0 10.193.56.230:6789/0 915 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 20:21:11.361505 mon.node1 mon.0 10.193.56.230:6789/0 916 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 20:21:11.361536 mon.node1 mon.0 10.193.56.230:6789/0 917 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 20:26:11.361449 mon.node1 mon.0 10.193.56.230:6789/0 989 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 20:26:11.361599 mon.node1 mon.0 10.193.56.230:6789/0 990 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 20:26:11.361670 mon.node1 mon.0 10.193.56.230:6789/0 991 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 20:26:11.362161 mon.node1 mon.0 10.193.56.230:6789/0 992 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 20:31:11.361524 mon.node1 mon.0 10.193.56.230:6789/0 1050 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 20:31:11.361556 mon.node1 mon.0 10.193.56.230:6789/0 1051 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 20:31:11.362403 mon.node1 mon.0 10.193.56.230:6789/0 1052 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 20:31:11.362685 mon.node1 mon.0 10.193.56.230:6789/0 1053 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 20:36:11.361670 mon.node1 mon.0 10.193.56.230:6789/0 1111 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 20:36:11.361715 mon.node1 mon.0 10.193.56.230:6789/0 1112 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 20:36:11.361823 mon.node1 mon.0 10.193.56.230:6789/0 1113 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 20:36:11.362338 mon.node1 mon.0 10.193.56.230:6789/0 1114 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 20:41:11.362189 mon.node1 mon.0 10.193.56.230:6789/0 1177 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 20:41:11.362338 mon.node1 mon.0 10.193.56.230:6789/0 1178 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 20:41:11.362439 mon.node1 mon.0 10.193.56.230:6789/0 1179 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 20:41:11.363821 mon.node1 mon.0 10.193.56.230:6789/0 1180 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 20:46:11.361866 mon.node1 mon.0 10.193.56.230:6789/0 1237 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 20:46:11.361906 mon.node1 mon.0 10.193.56.230:6789/0 1238 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 20:46:11.361934 mon.node1 mon.0 10.193.56.230:6789/0 1239 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 20:46:11.361976 mon.node1 mon.0 10.193.56.230:6789/0 1240 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 20:51:11.362036 mon.node1 mon.0 10.193.56.230:6789/0 1300 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 20:51:11.363144 mon.node1 mon.0 10.193.56.230:6789/0 1301 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 20:51:11.363205 mon.node1 mon.0 10.193.56.230:6789/0 1302 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 20:51:11.363608 mon.node1 mon.0 10.193.56.230:6789/0 1303 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 20:56:11.362108 mon.node1 mon.0 10.193.56.230:6789/0 1359 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 20:56:11.363230 mon.node1 mon.0 10.193.56.230:6789/0 1360 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 20:56:11.365287 mon.node1 mon.0 10.193.56.230:6789/0 1361 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 20:56:11.366827 mon.node1 mon.0 10.193.56.230:6789/0 1362 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 21:00:00.000101 mon.node1 mon.0 10.193.56.230:6789/0 1403 : cluster [WRN] overall HEALTH_WARN noscrub,nodeep-scrub flag(s) set; application not enabled on 10 pool(s) 2017-12-18 21:01:11.362131 mon.node1 mon.0 10.193.56.230:6789/0 1415 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 21:01:11.362164 mon.node1 mon.0 10.193.56.230:6789/0 1416 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 21:01:11.362208 mon.node1 mon.0 10.193.56.230:6789/0 1417 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 21:01:11.362229 mon.node1 mon.0 10.193.56.230:6789/0 1418 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 21:06:11.362238 mon.node1 mon.0 10.193.56.230:6789/0 1480 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 21:06:11.362407 mon.node1 mon.0 10.193.56.230:6789/0 1481 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 21:06:11.362553 mon.node1 mon.0 10.193.56.230:6789/0 1482 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 21:06:11.365821 mon.node1 mon.0 10.193.56.230:6789/0 1483 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 21:11:11.362274 mon.node1 mon.0 10.193.56.230:6789/0 1526 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 21:11:11.362310 mon.node1 mon.0 10.193.56.230:6789/0 1527 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 21:11:11.362325 mon.node1 mon.0 10.193.56.230:6789/0 1528 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 21:11:11.362361 mon.node1 mon.0 10.193.56.230:6789/0 1529 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 21:16:11.362396 mon.node1 mon.0 10.193.56.230:6789/0 1590 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 21:16:11.362434 mon.node1 mon.0 10.193.56.230:6789/0 1591 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 21:16:11.362483 mon.node1 mon.0 10.193.56.230:6789/0 1592 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 21:16:11.362496 mon.node1 mon.0 10.193.56.230:6789/0 1593 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 21:21:11.362470 mon.node1 mon.0 10.193.56.230:6789/0 1643 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 21:21:11.364403 mon.node1 mon.0 10.193.56.230:6789/0 1644 : cluster [INF] mon.2 10.193.56.232:6789/0 2017-12-18 21:21:11.365247 mon.node1 mon.0 10.193.56.230:6789/0 1645 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 21:21:11.366361 mon.node1 mon.0 10.193.56.230:6789/0 1646 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 21:26:11.362847 mon.node1 mon.0 10.193.56.230:6789/0 1701 : cluster [INF] mon.1 10.193.56.231:6789/0 2017-12-18 21:26:11.363558 mon.node1 mon.0 10.193.56.230:6789/0 1702 : cluster [INF] mon.4 10.193.56.234:6789/0 2017-12-18 21:26:11.364502 mon.node1 mon.0 10.193.56.230:6789/0 1703 : cluster [INF] mon.3 10.193.56.233:6789/0 2017-12-18 21:26:11.365809 mon.node1 mon.0 10.193.56.230:6789/0 1704 : cluster [INF] mon.2 10.193.56.232:6789/0