|
2019-05-21 11:00:52.360 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:52.360 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:52.360 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:52.360 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:52.376 7f09b94a7700 10 mgr.server tick
|
|
2019-05-21 11:00:52.376 7f09b94a7700 10 mgr update_delta_stats v3
|
|
2019-05-21 11:00:52.376 7f09b94a7700 10 mgr.server operator() 32 pgs: 6 active+clean, 26 active+clean+remapped; 3.8 KiB data, 4.1 GiB used, 36 GiB / 44 GiB avail; 295/603 objects misplaced (48.922%)
|
|
2019-05-21 11:00:52.376 7f09b94a7700 10 mgr.server operator() 1 health checks
|
|
2019-05-21 11:00:52.376 7f09b94a7700 20 mgr.server operator() health checks:
|
|
{
|
|
"MGR_ZABBIX_SEND_FAILED": {
|
|
"severity": "HEALTH_WARN",
|
|
"summary": {
|
|
"message": "Failed to send data to Zabbix"
|
|
},
|
|
"detail": [
|
|
{
|
|
"message": "[Errno 2] No such file or directory: '/usr/bin/zabbix_sender': '/usr/bin/zabbix_sender'"
|
|
}
|
|
]
|
|
}
|
|
}
|
|
|
|
2019-05-21 11:00:52.376 7f09b94a7700 0 log_channel(cluster) log [DBG] : pgmap v3: 32 pgs: 6 active+clean, 26 active+clean+remapped; 3.8 KiB data, 4.1 GiB used, 36 GiB / 44 GiB avail; 295/603 objects misplaced (48.922%)
|
|
2019-05-21 11:00:52.376 7f09b94a7700 20 mgr.server send_report + osd,0 SLOW_OPS(0|(0,0))
|
|
2019-05-21 11:00:52.376 7f09b94a7700 20 mgr.server send_report + osd,0 PENDING_CREATING_PGS(0|(0,0))
|
|
2019-05-21 11:00:52.376 7f09b94a7700 10 monclient: _send_mon_message to mon.c at v2:<ip>:40569/0
|
|
2019-05-21 11:00:52.376 7f09b94a7700 1 -- <ip>:0/582 --> [v2:<ip>:40569/0,v1:<ip>:40570/0] -- monmgrreport(1 checks, 0 progress events) v2 -- 0x55bc63ba2280 con 0x55bc60121680
|
|
2019-05-21 11:00:52.376 7f09b94a7700 20 mgr.server adjust_pgs
|
|
2019-05-21 11:00:52.376 7f09b94a7700 10 mgr.server operator() creating_or_unknown 0 max_creating 1024 left 1024
|
|
2019-05-21 11:00:52.376 7f09b94a7700 20 mgr.server operator() misplaced_ratio 0.489221 degraded_ratio 0 inactive_pgs_ratio 0 unknown_pgs_ratio 0; target_max_misplaced_ratio 0.05
|
|
2019-05-21 11:00:53.244 7f09c5790700 10 mgr tick tick
|
|
2019-05-21 11:00:53.244 7f09c5790700 4 mgr send_beacon active
|
|
2019-05-21 11:00:53.244 7f09c5790700 10 mgr send_beacon sending beacon as gid 8266
|
|
2019-05-21 11:00:53.244 7f09c5790700 10 monclient: _send_mon_message to mon.c at v2:<ip>:40569/0
|
|
2019-05-21 11:00:53.244 7f09c5790700 1 -- <ip>:0/582 --> [v2:<ip>:40569/0,v1:<ip>:40570/0] -- mgrbeacon mgr.x(75bce6bb-80ba-41f4-b684-5bdc04976167,8266, [v2:<ip>:6800/582,v1:<ip>:6801/582], 1) v8 -- 0x55bc638598c0 con 0x55bc60121680
|
|
2019-05-21 11:00:53.424 7f09c8f97700 1 -- <ip>:0/582 <== mon.2 v2:<ip>:40569/0 29 ==== service_map(e2 1 svc) v1 ==== 886+0+0 (crc 0 0 0) 0x55bc639c9a00 con 0x55bc60121680
|
|
2019-05-21 11:00:53.424 7f09c8f97700 4 mgr ms_dispatch2 active service_map(e2 1 svc) v1
|
|
2019-05-21 11:00:53.424 7f09c8f97700 4 mgr ms_dispatch2 service_map(e2 1 svc) v1
|
|
2019-05-21 11:00:53.424 7f09c8f97700 10 mgr handle_service_map e2
|
|
2019-05-21 11:00:53.424 7f09c8f97700 10 mgr.server operator() got updated map e2
|
|
2019-05-21 11:00:53.424 7f09c8f97700 10 mgr notify_all notify_all: notify_all service_map
|
|
2019-05-21 11:00:53.424 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.424 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.424 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.424 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.424 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.424 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.424 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.424 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.424 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.424 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.424 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.424 7f09bacaa700 20 mgr[restful] Unhandled notification type 'service_map'
|
|
2019-05-21 11:00:53.424 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.424 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.424 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.424 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.424 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.424 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.424 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.424 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.424 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.436 7f09c8f97700 1 -- <ip>:0/582 <== mon.2 v2:<ip>:40569/0 30 ==== log(1 entries from seq 1817 at 2019-05-21 11:00:52.314858) v1 ==== 245+0+0 (crc 0 0 0) 0x55bc63bec000 con 0x55bc60121680
|
|
2019-05-21 11:00:53.436 7f09c8f97700 4 mgr ms_dispatch2 active log(1 entries from seq 1817 at 2019-05-21 11:00:52.314858) v1
|
|
2019-05-21 11:00:53.436 7f09c8f97700 4 mgr ms_dispatch2 log(1 entries from seq 1817 at 2019-05-21 11:00:52.314858) v1
|
|
2019-05-21 11:00:53.436 7f09c8f97700 10 mgr notify_all notify_all: notify_all (clog)
|
|
2019-05-21 11:00:53.436 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.436 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.436 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.436 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.436 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.436 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.436 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.436 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.436 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.436 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.436 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.436 7f09bacaa700 20 mgr[restful] Unhandled notification type 'clog'
|
|
2019-05-21 11:00:53.436 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.436 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.436 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.436 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.436 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.436 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.436 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.436 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.436 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.452 7f09c8f97700 1 -- <ip>:0/582 <== mon.2 v2:<ip>:40569/0 31 ==== service_map(e2 1 svc) v1 ==== 886+0+0 (crc 0 0 0) 0x55bc639c9c00 con 0x55bc60121680
|
|
2019-05-21 11:00:53.452 7f09c8f97700 4 mgr ms_dispatch2 active service_map(e2 1 svc) v1
|
|
2019-05-21 11:00:53.452 7f09c8f97700 4 mgr ms_dispatch2 service_map(e2 1 svc) v1
|
|
2019-05-21 11:00:53.452 7f09c8f97700 10 mgr handle_service_map e2
|
|
2019-05-21 11:00:53.452 7f09c8f97700 10 mgr.server operator() got updated map e2
|
|
2019-05-21 11:00:53.452 7f09c8f97700 10 mgr notify_all notify_all: notify_all service_map
|
|
2019-05-21 11:00:53.452 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.452 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.452 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.452 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.452 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.452 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.452 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.452 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.452 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.452 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.452 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.452 7f09bacaa700 20 mgr[restful] Unhandled notification type 'service_map'
|
|
2019-05-21 11:00:53.452 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.452 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.452 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.452 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.452 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.452 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.452 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.452 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:53.452 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:54.376 7f09b94a7700 10 mgr.server tick
|
|
2019-05-21 11:00:54.376 7f09b94a7700 10 mgr update_delta_stats v4
|
|
2019-05-21 11:00:54.376 7f09b94a7700 10 mgr.server operator() 32 pgs: 6 active+clean, 26 active+clean+remapped; 3.8 KiB data, 4.1 GiB used, 36 GiB / 44 GiB avail; 295/603 objects misplaced (48.922%)
|
|
2019-05-21 11:00:54.380 7f09b94a7700 10 mgr.server operator() 1 health checks
|
|
2019-05-21 11:00:54.380 7f09b94a7700 20 mgr.server operator() health checks:
|
|
{
|
|
"MGR_ZABBIX_SEND_FAILED": {
|
|
"severity": "HEALTH_WARN",
|
|
"summary": {
|
|
"message": "Failed to send data to Zabbix"
|
|
},
|
|
"detail": [
|
|
{
|
|
"message": "[Errno 2] No such file or directory: '/usr/bin/zabbix_sender': '/usr/bin/zabbix_sender'"
|
|
}
|
|
]
|
|
}
|
|
}
|
|
|
|
2019-05-21 11:00:54.380 7f09b94a7700 0 log_channel(cluster) log [DBG] : pgmap v4: 32 pgs: 6 active+clean, 26 active+clean+remapped; 3.8 KiB data, 4.1 GiB used, 36 GiB / 44 GiB avail; 295/603 objects misplaced (48.922%)
|
|
2019-05-21 11:00:54.380 7f09b94a7700 20 mgr.server send_report + osd,0 SLOW_OPS(0|(0,0))
|
|
2019-05-21 11:00:54.380 7f09b94a7700 20 mgr.server send_report + osd,0 PENDING_CREATING_PGS(0|(0,0))
|
|
2019-05-21 11:00:54.380 7f09b94a7700 10 monclient: _send_mon_message to mon.c at v2:<ip>:40569/0
|
|
2019-05-21 11:00:54.380 7f09b94a7700 1 -- <ip>:0/582 --> [v2:<ip>:40569/0,v1:<ip>:40570/0] -- monmgrreport(1 checks, 0 progress events) v2 -- 0x55bc63ba2500 con 0x55bc60121680
|
|
2019-05-21 11:00:54.380 7f09b94a7700 20 mgr.server adjust_pgs
|
|
2019-05-21 11:00:54.380 7f09b94a7700 10 mgr.server operator() creating_or_unknown 0 max_creating 1024 left 1024
|
|
2019-05-21 11:00:54.380 7f09b94a7700 20 mgr.server operator() misplaced_ratio 0.489221 degraded_ratio 0 inactive_pgs_ratio 0 unknown_pgs_ratio 0; target_max_misplaced_ratio 0.05
|
|
2019-05-21 11:00:54.460 7f09c8f97700 1 -- <ip>:0/582 <== mon.2 v2:<ip>:40569/0 32 ==== service_map(e2 1 svc) v1 ==== 886+0+0 (crc 0 0 0) 0x55bc63804400 con 0x55bc60121680
|
|
2019-05-21 11:00:54.464 7f09c8f97700 4 mgr ms_dispatch2 active service_map(e2 1 svc) v1
|
|
2019-05-21 11:00:54.464 7f09c8f97700 4 mgr ms_dispatch2 service_map(e2 1 svc) v1
|
|
2019-05-21 11:00:54.464 7f09c8f97700 10 mgr handle_service_map e2
|
|
2019-05-21 11:00:54.464 7f09c8f97700 10 mgr.server operator() got updated map e2
|
|
2019-05-21 11:00:54.464 7f09c8f97700 10 mgr notify_all notify_all: notify_all service_map
|
|
2019-05-21 11:00:54.464 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:54.464 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:54.464 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:54.464 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:54.464 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:54.464 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:54.464 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:54.464 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:54.464 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:54.464 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:54.464 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:54.464 7f09bacaa700 20 mgr[restful] Unhandled notification type 'service_map'
|
|
2019-05-21 11:00:54.464 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:54.464 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:54.464 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:54.464 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:54.464 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:54.464 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:54.464 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:54.464 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:54.464 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:54.688 7f09c7f95700 10 monclient: tick
|
|
2019-05-21 11:00:54.688 7f09c7f95700 10 monclient: _check_auth_rotating have uptodate secrets (they expire after 2019-05-21 11:00:24.691208)
|
|
2019-05-21 11:00:54.688 7f09c7f95700 10 log_client log_queue is 3 last_log 3 sent 0 num 3 unsent 3 sending 3
|
|
2019-05-21 11:00:54.688 7f09c7f95700 10 log_client will send 2019-05-21 11:00:51.352282 mgr.x (mgr.8266) 1 : cluster [DBG] pgmap v2: 32 pgs: 6 active+clean, 26 active+clean+remapped; 3.8 KiB data, 4.1 GiB used, 36 GiB / 44 GiB avail; 295/603 objects misplaced (48.922%)
|
|
2019-05-21 11:00:54.688 7f09c7f95700 10 log_client will send 2019-05-21 11:00:52.379601 mgr.x (mgr.8266) 2 : cluster [DBG] pgmap v3: 32 pgs: 6 active+clean, 26 active+clean+remapped; 3.8 KiB data, 4.1 GiB used, 36 GiB / 44 GiB avail; 295/603 objects misplaced (48.922%)
|
|
2019-05-21 11:00:54.688 7f09c7f95700 10 log_client will send 2019-05-21 11:00:54.381014 mgr.x (mgr.8266) 3 : cluster [DBG] pgmap v4: 32 pgs: 6 active+clean, 26 active+clean+remapped; 3.8 KiB data, 4.1 GiB used, 36 GiB / 44 GiB avail; 295/603 objects misplaced (48.922%)
|
|
2019-05-21 11:00:54.688 7f09c7f95700 10 monclient: _send_mon_message to mon.c at v2:<ip>:40569/0
|
|
2019-05-21 11:00:54.688 7f09c7f95700 1 -- <ip>:0/582 --> [v2:<ip>:40569/0,v1:<ip>:40570/0] -- log(3 entries from seq 1 at 2019-05-21 11:00:51.352282) v1 -- 0x55bc5f5b4240 con 0x55bc60121680
|
|
2019-05-21 11:00:54.688 7f09c7f95700 20 monclient: _un_backoff reopen_interval_multipler now 1
|
|
2019-05-21 11:00:55.244 7f09c5790700 10 mgr tick tick
|
|
2019-05-21 11:00:55.244 7f09c5790700 4 mgr send_beacon active
|
|
2019-05-21 11:00:55.244 7f09c5790700 10 mgr send_beacon sending beacon as gid 8266
|
|
2019-05-21 11:00:55.244 7f09c5790700 10 monclient: _send_mon_message to mon.c at v2:<ip>:40569/0
|
|
2019-05-21 11:00:55.244 7f09c5790700 1 -- <ip>:0/582 --> [v2:<ip>:40569/0,v1:<ip>:40570/0] -- mgrbeacon mgr.x(75bce6bb-80ba-41f4-b684-5bdc04976167,8266, [v2:<ip>:6800/582,v1:<ip>:6801/582], 1) v8 -- 0x55bc63859600 con 0x55bc60121680
|
|
2019-05-21 11:00:55.492 7f09c8f97700 1 -- <ip>:0/582 <== mon.2 v2:<ip>:40569/0 33 ==== service_map(e2 1 svc) v1 ==== 886+0+0 (crc 0 0 0) 0x55bc639c9e00 con 0x55bc60121680
|
|
2019-05-21 11:00:55.492 7f09c8f97700 4 mgr ms_dispatch2 active service_map(e2 1 svc) v1
|
|
2019-05-21 11:00:55.492 7f09c8f97700 4 mgr ms_dispatch2 service_map(e2 1 svc) v1
|
|
2019-05-21 11:00:55.492 7f09c8f97700 10 mgr handle_service_map e2
|
|
2019-05-21 11:00:55.492 7f09c8f97700 10 mgr.server operator() got updated map e2
|
|
2019-05-21 11:00:55.492 7f09c8f97700 10 mgr notify_all notify_all: notify_all service_map
|
|
2019-05-21 11:00:55.492 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:55.492 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:55.492 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:55.492 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:55.492 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:55.492 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:55.492 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:55.492 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:55.492 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:55.492 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:55.492 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:55.492 7f09c8f97700 1 -- <ip>:0/582 <== mon.2 v2:<ip>:40569/0 34 ==== log(last 3) v1 ==== 28+0+0 (crc 0 0 0) 0x55bc63acf400 con 0x55bc60121680
|
|
2019-05-21 11:00:55.492 7f09bacaa700 20 mgr[restful] Unhandled notification type 'service_map'
|
|
2019-05-21 11:00:55.492 7f09c8f97700 10 log_client handle_log_ack log(last 3) v1
|
|
2019-05-21 11:00:55.492 7f09c8f97700 10 log_client logged 2019-05-21 11:00:51.352282 mgr.x (mgr.8266) 1 : cluster [DBG] pgmap v2: 32 pgs: 6 active+clean, 26 active+clean+remapped; 3.8 KiB data, 4.1 GiB used, 36 GiB / 44 GiB avail; 295/603 objects misplaced (48.922%)
|
|
2019-05-21 11:00:55.492 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:55.492 7f09c8f97700 10 log_client logged 2019-05-21 11:00:52.379601 mgr.x (mgr.8266) 2 : cluster [DBG] pgmap v3: 32 pgs: 6 active+clean, 26 active+clean+remapped; 3.8 KiB data, 4.1 GiB used, 36 GiB / 44 GiB avail; 295/603 objects misplaced (48.922%)
|
|
2019-05-21 11:00:55.492 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:55.492 7f09c8f97700 10 log_client logged 2019-05-21 11:00:54.381014 mgr.x (mgr.8266) 3 : cluster [DBG] pgmap v4: 32 pgs: 6 active+clean, 26 active+clean+remapped; 3.8 KiB data, 4.1 GiB used, 36 GiB / 44 GiB avail; 295/603 objects misplaced (48.922%)
|
|
2019-05-21 11:00:55.492 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:55.492 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:55.492 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:55.492 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:55.492 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:55.492 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:55.492 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:55.936 7f09ce7a2700 1 --2- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> conn(0x55bc63c51180 0x55bc63a92680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).accept
|
|
2019-05-21 11:00:55.936 7f09cbf9d700 1 --2- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> conn(0x55bc63c51180 0x55bc63a92680 unknown :-1 s=BANNER_ACCEPTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0
|
|
2019-05-21 11:00:55.940 7f09cbf9d700 10 monclient: handle_auth_request added challenge on 0x55bc63c51180
|
|
2019-05-21 11:00:55.940 7f09cbf9d700 10 mgr.server ms_handle_authentication ms_handle_authentication new session 0x55bc63865e60 con 0x55bc63c51180 entity client.admin addr
|
|
2019-05-21 11:00:55.940 7f09cbf9d700 10 mgr.server ms_handle_authentication session 0x55bc63865e60 client.admin has caps allow * 'allow *'
|
|
2019-05-21 11:00:55.940 7f09cbf9d700 1 --2- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> <ip>:0/13407580 conn(0x55bc63c51180 0x55bc63a92680 crc :-1 s=READY pgs=4 cs=0 l=1 rx=0 tx=0).ready entity=client.8290 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
|
|
2019-05-21 11:00:56.204 7f09cbf9d700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> <ip>:0/13407580 conn(0x55bc63c51180 msgr2=0x55bc63a92680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 47
|
|
2019-05-21 11:00:56.204 7f09cbf9d700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> <ip>:0/13407580 conn(0x55bc63c51180 msgr2=0x55bc63a92680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed
|
|
2019-05-21 11:00:56.204 7f09cbf9d700 1 --2- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> <ip>:0/13407580 conn(0x55bc63c51180 0x55bc63a92680 crc :-1 s=READY pgs=4 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted)
|
|
2019-05-21 11:00:56.204 7f09cbf9d700 1 --2- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> <ip>:0/13407580 conn(0x55bc63c51180 0x55bc63a92680 crc :-1 s=READY pgs=4 cs=0 l=1 rx=0 tx=0).stop
|
|
2019-05-21 11:00:56.331 7f09ba4a9700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] <== mgr.8269 <ip>:0/584 3 ==== mgrreport(mgr.y +0-0 packed 38) v7 ==== 72+0+0 (crc 0 0 0) 0x55bc6387f500 con 0x55bc63988480
|
|
2019-05-21 11:00:56.331 7f09ba4a9700 4 mgr.server handle_report from 0x55bc63988480 mgr,y
|
|
2019-05-21 11:00:56.331 7f09ba4a9700 20 mgr.server handle_report updating existing DaemonState for mgr,y
|
|
2019-05-21 11:00:56.331 7f09ba4a9700 20 mgr update loading 0 new types, 0 old types, had 204 types, got 38 bytes of data
|
|
2019-05-21 11:00:56.335 7f09ba4a9700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] <== osd.0 v2:<ip>:6802/42959 4 ==== mgrreport(osd.0 +0-0 packed 1198 daemon_metrics=2) v7 ==== 1262+0+0 (crc 0 0 0) 0x55bc63862380 con 0x55bc63988000
|
|
2019-05-21 11:00:56.335 7f09ba4a9700 4 mgr.server handle_report from 0x55bc63988000 osd,0
|
|
2019-05-21 11:00:56.335 7f09ba4a9700 20 mgr.server handle_report updating existing DaemonState for osd,0
|
|
2019-05-21 11:00:56.335 7f09ba4a9700 20 mgr update loading 0 new types, 0 old types, had 204 types, got 1198 bytes of data
|
|
2019-05-21 11:00:56.335 7f09ba4a9700 10 mgr.server handle_report daemon_health_metrics [SLOW_OPS(0|(0,0)),PENDING_CREATING_PGS(0|(0,0))]
|
|
2019-05-21 11:00:56.335 7f09ba4a9700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] <== osd.3 v2:<ip>:6826/44153 4 ==== mgrreport(osd.3 +0-0 packed 1198 daemon_metrics=2) v7 ==== 1262+0+0 (crc 0 0 0) 0x55bc63863c00 con 0x55bc637e3a80
|
|
2019-05-21 11:00:56.335 7f09ba4a9700 4 mgr.server handle_report from 0x55bc637e3a80 osd,3
|
|
2019-05-21 11:00:56.335 7f09ba4a9700 20 mgr.server handle_report updating existing DaemonState for osd,3
|
|
2019-05-21 11:00:56.335 7f09ba4a9700 20 mgr update loading 0 new types, 0 old types, had 204 types, got 1198 bytes of data
|
|
2019-05-21 11:00:56.335 7f09ba4a9700 10 mgr.server handle_report daemon_health_metrics [SLOW_OPS(0|(0,0)),PENDING_CREATING_PGS(0|(0,0))]
|
|
2019-05-21 11:00:56.335 7f09ba4a9700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] <== osd.3 v2:<ip>:6826/44153 5 ==== pg_stats(8 pgs tid 0 v 0) v2 ==== 6078+0+0 (crc 0 0 0) 0x55bc63863880 con 0x55bc637e3a80
|
|
2019-05-21 11:00:56.335 7f09ba4a9700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] <== osd.0 v2:<ip>:6802/42959 5 ==== pg_stats(16 pgs tid 0 v 0) v2 ==== 11841+0+0 (crc 0 0 0) 0x55bc63a56a80 con 0x55bc63988000
|
|
2019-05-21 11:00:56.335 7f09ba4a9700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] <== osd.1 v2:<ip>:6810/43357 4 ==== mgrreport(osd.1 +0-0 packed 1198 daemon_metrics=2) v7 ==== 1262+0+0 (crc 0 0 0) 0x55bc63a5b180 con 0x55bc63988900
|
|
2019-05-21 11:00:56.335 7f09ba4a9700 4 mgr.server handle_report from 0x55bc63988900 osd,1
|
|
2019-05-21 11:00:56.335 7f09ba4a9700 20 mgr.server handle_report updating existing DaemonState for osd,1
|
|
2019-05-21 11:00:56.335 7f09ba4a9700 20 mgr update loading 0 new types, 0 old types, had 204 types, got 1198 bytes of data
|
|
2019-05-21 11:00:56.335 7f09ba4a9700 10 mgr.server handle_report daemon_health_metrics [SLOW_OPS(0|(0,0)),PENDING_CREATING_PGS(0|(0,0))]
|
|
2019-05-21 11:00:56.339 7f09ba4a9700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] <== osd.1 v2:<ip>:6810/43357 5 ==== pg_stats(3 pgs tid 0 v 0) v2 ==== 2682+0+0 (crc 0 0 0) 0x55bc63a5b500 con 0x55bc63988900
|
|
2019-05-21 11:00:56.343 7f09ba4a9700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] <== mgr.8297 <ip>:0/589 3 ==== mgrreport(mgr.z +0-0 packed 38) v7 ==== 72+0+0 (crc 0 0 0) 0x55bc63a57180 con 0x55bc6398b600
|
|
2019-05-21 11:00:56.343 7f09ba4a9700 4 mgr.server handle_report from 0x55bc6398b600 mgr,z
|
|
2019-05-21 11:00:56.343 7f09ba4a9700 20 mgr.server handle_report updating existing DaemonState for mgr,z
|
|
2019-05-21 11:00:56.343 7f09ba4a9700 20 mgr update loading 0 new types, 0 old types, had 204 types, got 38 bytes of data
|
|
2019-05-21 11:00:56.343 7f09ba4a9700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] <== client.4391 <ip>:0/2330424331 3 ==== mgrreport(rgw.rgw +0-0 packed 286) v7 ==== 325+0+0 (crc 0 0 0) 0x55bc63a5ae00 con 0x55bc63989f80
|
|
2019-05-21 11:00:56.343 7f09ba4a9700 4 mgr.server handle_report from 0x55bc63989f80 rgw,rgw
|
|
2019-05-21 11:00:56.343 7f09ba4a9700 20 mgr.server handle_report updating existing DaemonState for rgw,rgw
|
|
2019-05-21 11:00:56.343 7f09ba4a9700 20 mgr update loading 0 new types, 0 old types, had 204 types, got 286 bytes of data
|
|
2019-05-21 11:00:56.343 7f09c6f93700 1 -- <ip>:0/582 --> [v2:<ip>:6800/582,v1:<ip>:6801/582] -- mgrreport(unknown.x +0-0 packed 38) v7 -- 0x55bc63863500 con 0x55bc63989200
|
|
2019-05-21 11:00:56.343 7f09ba4a9700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] <== mgr.8266 <ip>:0/582 3 ==== mgrreport(mgr.x +0-0 packed 38) v7 ==== 72+0+0 (crc 0 0 0) 0x55bc63863500 con 0x55bc6398b180
|
|
2019-05-21 11:00:56.343 7f09ba4a9700 4 mgr.server handle_report from 0x55bc6398b180 mgr,x
|
|
2019-05-21 11:00:56.343 7f09ba4a9700 20 mgr.server handle_report updating existing DaemonState for mgr,x
|
|
2019-05-21 11:00:56.343 7f09cc79e700 1 --2- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> <ip>:0/42090 conn(0x55bc6398ad00 0x55bc63a91080 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x55bc639dfe60 tx=0x55bc639b6d80).handle_read_frame_epilogue_main read frame epilogue bytes=32
|
|
2019-05-21 11:00:56.343 7f09ba4a9700 20 mgr update loading 0 new types, 0 old types, had 204 types, got 38 bytes of data
|
|
2019-05-21 11:00:56.343 7f09ba4a9700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] <== mon.2 <ip>:0/42090 3 ==== mgrreport(mon.c +0-0 packed 798 daemon_metrics=1) v7 ==== 3013+0+0 (secure 0 0 0) 0x55bc63a5aa80 con 0x55bc6398ad00
|
|
2019-05-21 11:00:56.343 7f09ba4a9700 4 mgr.server handle_report from 0x55bc6398ad00 mon,c
|
|
2019-05-21 11:00:56.343 7f09ba4a9700 20 mgr.server handle_report updating existing DaemonState for mon,c
|
|
2019-05-21 11:00:56.343 7f09ba4a9700 20 mgr update loading 0 new types, 0 old types, had 204 types, got 798 bytes of data
|
|
2019-05-21 11:00:56.347 7f09ce7a2700 1 --2- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> <ip>:0/42049 conn(0x55bc6398a880 0x55bc63a90b00 secure :-1 s=THROTTLE_DONE pgs=282 cs=0 l=1 rx=0x55bc63992ed0 tx=0x55bc639b7d00).handle_read_frame_epilogue_main read frame epilogue bytes=32
|
|
2019-05-21 11:00:56.347 7f09ba4a9700 20 mgr.server handle_report got config {admin_socket={2=/tmp/ceph-asok.TMN9Jr/$name.asok},auth_client_required={2=cephx},auth_cluster_required={2=cephx},auth_service_required={2=cephx},chdir={2=},crash_dir={2=/ceph/build/out},debug_asok_assert_abort={2=true},debug_auth={2=20/20},debug_mgrc={2=20/20},debug_mon={2=20/20},debug_ms={2=1/1},debug_paxos={2=20/20},enable_experimental_unrecoverable_data_corrupting_features={2=*},erasure_code_dir={2=/ceph/build/lib},filestore_fd_cache_size={2=32},heartbeat_file={2=/ceph/build/out/$name.heartbeat},keyring={0=$mon_data/keyring},leveldb_block_size={0=65536},leveldb_cache_size={0=536870912},leveldb_compression={0=false},leveldb_log={0=},leveldb_write_buffer_size={0=33554432},log_file={2=/ceph/build/out/$name.log},mgr_initial_modules={2=dashboard restful iostat},mon_allow_pool_delete={1=true},mon_cluster_log_file={2=/ceph/build/out/cluster.mon.$id.log},mon_data={2=/ceph/build/dev/mon.c},mon_data_avail_crit={1=1},mon_data_avail_warn={1=2},mon_host={2=[v2:<ip>:40565,v1:<ip>:40566] [v2:<ip>:40567,v1:<ip>:40568] [v2:<ip>:40569,v1:<ip>:40570]},mon_osd_backfillfull_ratio={2=0.990000},mon_osd_full_ratio={2=0.990000},mon_osd_nearfull_ratio={2=0.990000},mon_osd_reporter_subtree_level={1=osd},mon_pg_warn_min_per_osd={1=3},ms_bind_msgr1={2=true},ms_bind_msgr2={2=true},osd_crush_chooseleaf_type={2=0},osd_failsafe_full_ratio={2=0.990000},osd_pool_default_erasure_code_profile={2=plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd},osd_pool_default_min_size={1=1},osd_pool_default_size={1=3},pid_file={2=/ceph/build/out/$name.pid},plugin_dir={2=/ceph/build/lib},rbd_default_features={0=61},run_dir={2=/ceph/build/out}} ignored {}
|
|
2019-05-21 11:00:56.347 7f09ba4a9700 10 mgr.server handle_report daemon_health_metrics [SLOW_OPS(0|(0,0))]
|
|
2019-05-21 11:00:56.347 7f09ba4a9700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] <== mon.1 <ip>:0/42049 3 ==== mgrreport(mon.b +0-0 packed 798 daemon_metrics=1) v7 ==== 3013+0+0 (secure 0 0 0) 0x55bc6386c000 con 0x55bc6398a880
|
|
2019-05-21 11:00:56.347 7f09ba4a9700 4 mgr.server handle_report from 0x55bc6398a880 mon,b
|
|
2019-05-21 11:00:56.347 7f09ba4a9700 20 mgr.server handle_report updating existing DaemonState for mon,b
|
|
2019-05-21 11:00:56.347 7f09ba4a9700 20 mgr update loading 0 new types, 0 old types, had 204 types, got 798 bytes of data
|
|
2019-05-21 11:00:56.347 7f09ba4a9700 20 mgr.server handle_report got config {admin_socket={2=/tmp/ceph-asok.TMN9Jr/$name.asok},auth_client_required={2=cephx},auth_cluster_required={2=cephx},auth_service_required={2=cephx},chdir={2=},crash_dir={2=/ceph/build/out},debug_asok_assert_abort={2=true},debug_auth={2=20/20},debug_mgrc={2=20/20},debug_mon={2=20/20},debug_ms={2=1/1},debug_paxos={2=20/20},enable_experimental_unrecoverable_data_corrupting_features={2=*},erasure_code_dir={2=/ceph/build/lib},filestore_fd_cache_size={2=32},heartbeat_file={2=/ceph/build/out/$name.heartbeat},keyring={0=$mon_data/keyring},leveldb_block_size={0=65536},leveldb_cache_size={0=536870912},leveldb_compression={0=false},leveldb_log={0=},leveldb_write_buffer_size={0=33554432},log_file={2=/ceph/build/out/$name.log},mgr_initial_modules={2=dashboard restful iostat},mon_allow_pool_delete={1=true},mon_cluster_log_file={2=/ceph/build/out/cluster.mon.$id.log},mon_data={2=/ceph/build/dev/mon.b},mon_data_avail_crit={1=1},mon_data_avail_warn={1=2},mon_host={2=[v2:<ip>:40565,v1:<ip>:40566] [v2:<ip>:40567,v1:<ip>:40568] [v2:<ip>:40569,v1:<ip>:40570]},mon_osd_backfillfull_ratio={2=0.990000},mon_osd_full_ratio={2=0.990000},mon_osd_nearfull_ratio={2=0.990000},mon_osd_reporter_subtree_level={1=osd},mon_pg_warn_min_per_osd={1=3},ms_bind_msgr1={2=true},ms_bind_msgr2={2=true},osd_crush_chooseleaf_type={2=0},osd_failsafe_full_ratio={2=0.990000},osd_pool_default_erasure_code_profile={2=plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd},osd_pool_default_min_size={1=1},osd_pool_default_size={1=3},pid_file={2=/ceph/build/out/$name.pid},plugin_dir={2=/ceph/build/lib},rbd_default_features={0=61},run_dir={2=/ceph/build/out}} ignored {}
|
|
2019-05-21 11:00:56.347 7f09ba4a9700 10 mgr.server handle_report daemon_health_metrics [SLOW_OPS(0|(0,0))]
|
|
2019-05-21 11:00:56.347 7f09ba4a9700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] <== osd.2 v2:<ip>:6818/43755 4 ==== mgrreport(osd.2 +0-0 packed 1198 daemon_metrics=2) v7 ==== 1262+0+0 (crc 0 0 0) 0x55bc63a5a700 con 0x55bc63988d80
|
|
2019-05-21 11:00:56.347 7f09ba4a9700 4 mgr.server handle_report from 0x55bc63988d80 osd,2
|
|
2019-05-21 11:00:56.347 7f09ba4a9700 20 mgr.server handle_report updating existing DaemonState for osd,2
|
|
2019-05-21 11:00:56.347 7f09ba4a9700 20 mgr update loading 0 new types, 0 old types, had 204 types, got 1198 bytes of data
|
|
2019-05-21 11:00:56.347 7f09ba4a9700 10 mgr.server handle_report daemon_health_metrics [SLOW_OPS(0|(0,0)),PENDING_CREATING_PGS(0|(0,0))]
|
|
2019-05-21 11:00:56.347 7f09ba4a9700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] <== osd.2 v2:<ip>:6818/43755 5 ==== pg_stats(5 pgs tid 0 v 0) v2 ==== 4219+0+0 (crc 0 0 0) 0x55bc63a5a380 con 0x55bc63988d80
|
|
2019-05-21 11:00:56.347 7f09cbf9d700 1 --2- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> <ip>:0/42008 conn(0x55bc6398a400 0x55bc63a90580 secure :-1 s=THROTTLE_DONE pgs=281 cs=0 l=1 rx=0x55bc63a2a060 tx=0x55bc63ab2700).handle_read_frame_epilogue_main read frame epilogue bytes=32
|
|
2019-05-21 11:00:56.347 7f09ba4a9700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] <== mon.0 <ip>:0/42008 3 ==== mgrreport(mon.a +0-0 packed 798 daemon_metrics=1) v7 ==== 3013+0+0 (secure 0 0 0) 0x55bc6386ca80 con 0x55bc6398a400
|
|
2019-05-21 11:00:56.347 7f09ba4a9700 4 mgr.server handle_report from 0x55bc6398a400 mon,a
|
|
2019-05-21 11:00:56.347 7f09ba4a9700 20 mgr.server handle_report updating existing DaemonState for mon,a
|
|
2019-05-21 11:00:56.347 7f09ba4a9700 20 mgr update loading 0 new types, 0 old types, had 204 types, got 798 bytes of data
|
|
2019-05-21 11:00:56.347 7f09ba4a9700 20 mgr.server handle_report got config {admin_socket={2=/tmp/ceph-asok.TMN9Jr/$name.asok},auth_client_required={2=cephx},auth_cluster_required={2=cephx},auth_service_required={2=cephx},chdir={2=},crash_dir={2=/ceph/build/out},debug_asok_assert_abort={2=true},debug_auth={2=20/20},debug_mgrc={2=20/20},debug_mon={2=20/20},debug_ms={2=1/1},debug_paxos={2=20/20},enable_experimental_unrecoverable_data_corrupting_features={2=*},erasure_code_dir={2=/ceph/build/lib},filestore_fd_cache_size={2=32},heartbeat_file={2=/ceph/build/out/$name.heartbeat},keyring={0=$mon_data/keyring},leveldb_block_size={0=65536},leveldb_cache_size={0=536870912},leveldb_compression={0=false},leveldb_log={0=},leveldb_write_buffer_size={0=33554432},log_file={2=/ceph/build/out/$name.log},mgr_initial_modules={2=dashboard restful iostat},mon_allow_pool_delete={1=true},mon_cluster_log_file={2=/ceph/build/out/cluster.mon.$id.log},mon_data={2=/ceph/build/dev/mon.a},mon_data_avail_crit={1=1},mon_data_avail_warn={1=2},mon_host={2=[v2:<ip>:40565,v1:<ip>:40566] [v2:<ip>:40567,v1:<ip>:40568] [v2:<ip>:40569,v1:<ip>:40570]},mon_osd_backfillfull_ratio={2=0.990000},mon_osd_full_ratio={2=0.990000},mon_osd_nearfull_ratio={2=0.990000},mon_osd_reporter_subtree_level={1=osd},mon_pg_warn_min_per_osd={1=3},ms_bind_msgr1={2=true},ms_bind_msgr2={2=true},osd_crush_chooseleaf_type={2=0},osd_failsafe_full_ratio={2=0.990000},osd_pool_default_erasure_code_profile={2=plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd},osd_pool_default_min_size={1=1},osd_pool_default_size={1=3},pid_file={2=/ceph/build/out/$name.pid},plugin_dir={2=/ceph/build/lib},rbd_default_features={0=61},run_dir={2=/ceph/build/out}} ignored {}
|
|
2019-05-21 11:00:56.347 7f09ba4a9700 10 mgr.server handle_report daemon_health_metrics [SLOW_OPS(0|(0,0))]
|
|
2019-05-21 11:00:56.379 7f09b94a7700 10 mgr.server tick
|
|
2019-05-21 11:00:56.379 7f09b94a7700 10 mgr update_delta_stats v5
|
|
2019-05-21 11:00:56.379 7f09b94a7700 10 mgr.server operator() 32 pgs: 6 active+clean, 26 active+clean+remapped; 3.8 KiB data, 4.1 GiB used, 36 GiB / 44 GiB avail; 295/603 objects misplaced (48.922%)
|
|
2019-05-21 11:00:56.379 7f09b94a7700 10 mgr.server operator() 1 health checks
|
|
2019-05-21 11:00:56.379 7f09b94a7700 20 mgr.server operator() health checks:
|
|
{
|
|
"MGR_ZABBIX_SEND_FAILED": {
|
|
"severity": "HEALTH_WARN",
|
|
"summary": {
|
|
"message": "Failed to send data to Zabbix"
|
|
},
|
|
"detail": [
|
|
{
|
|
"message": "[Errno 2] No such file or directory: '/usr/bin/zabbix_sender': '/usr/bin/zabbix_sender'"
|
|
}
|
|
]
|
|
}
|
|
}
|
|
|
|
2019-05-21 11:00:56.379 7f09b94a7700 0 log_channel(cluster) log [DBG] : pgmap v5: 32 pgs: 6 active+clean, 26 active+clean+remapped; 3.8 KiB data, 4.1 GiB used, 36 GiB / 44 GiB avail; 295/603 objects misplaced (48.922%)
|
|
2019-05-21 11:00:56.379 7f09b94a7700 20 mgr.server send_report + osd,0 SLOW_OPS(0|(0,0))
|
|
2019-05-21 11:00:56.379 7f09b94a7700 20 mgr.server send_report + osd,0 PENDING_CREATING_PGS(0|(0,0))
|
|
2019-05-21 11:00:56.379 7f09b94a7700 10 monclient: _send_mon_message to mon.c at v2:<ip>:40569/0
|
|
2019-05-21 11:00:56.379 7f09b94a7700 1 -- <ip>:0/582 --> [v2:<ip>:40569/0,v1:<ip>:40570/0] -- monmgrreport(1 checks, 0 progress events) v2 -- 0x55bc63ba2780 con 0x55bc60121680
|
|
2019-05-21 11:00:56.379 7f09b94a7700 20 mgr.server adjust_pgs
|
|
2019-05-21 11:00:56.379 7f09b94a7700 10 mgr.server operator() creating_or_unknown 0 max_creating 1024 left 1024
|
|
2019-05-21 11:00:56.379 7f09b94a7700 20 mgr.server operator() misplaced_ratio 0.489221 degraded_ratio 0 inactive_pgs_ratio 0 unknown_pgs_ratio 0; target_max_misplaced_ratio 0.05
|
|
2019-05-21 11:00:56.475 7f09ce7a2700 1 --2- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> conn(0x55bc63c4fb00 0x55bc63a92c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).accept
|
|
2019-05-21 11:00:56.475 7f09cbf9d700 1 --2- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> conn(0x55bc63c4fb00 0x55bc63a92c00 unknown :-1 s=BANNER_ACCEPTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0
|
|
2019-05-21 11:00:56.475 7f09cbf9d700 10 monclient: handle_auth_request added challenge on 0x55bc63c4fb00
|
|
2019-05-21 11:00:56.475 7f09cbf9d700 10 mgr.server ms_handle_authentication ms_handle_authentication new session 0x55bc63ac47e0 con 0x55bc63c4fb00 entity client.admin addr
|
|
2019-05-21 11:00:56.475 7f09cbf9d700 10 mgr.server ms_handle_authentication session 0x55bc63ac47e0 client.admin has caps allow * 'allow *'
|
|
2019-05-21 11:00:56.475 7f09cbf9d700 1 --2- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> <ip>:0/521398965 conn(0x55bc63c4fb00 0x55bc63a92c00 crc :-1 s=READY pgs=4 cs=0 l=1 rx=0 tx=0).ready entity=client.8296 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
|
|
2019-05-21 11:00:56.511 7f09c8f97700 1 -- <ip>:0/582 <== mon.2 v2:<ip>:40569/0 35 ==== service_map(e2 1 svc) v1 ==== 886+0+0 (crc 0 0 0) 0x55bc63ace400 con 0x55bc60121680
|
|
2019-05-21 11:00:56.511 7f09c8f97700 4 mgr ms_dispatch2 active service_map(e2 1 svc) v1
|
|
2019-05-21 11:00:56.511 7f09c8f97700 4 mgr ms_dispatch2 service_map(e2 1 svc) v1
|
|
2019-05-21 11:00:56.511 7f09c8f97700 10 mgr handle_service_map e2
|
|
2019-05-21 11:00:56.511 7f09c8f97700 10 mgr.server operator() got updated map e2
|
|
2019-05-21 11:00:56.511 7f09c8f97700 10 mgr notify_all notify_all: notify_all service_map
|
|
2019-05-21 11:00:56.511 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.511 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.511 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.511 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.511 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.511 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.511 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.511 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.511 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.511 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.511 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.511 7f09bacaa700 20 mgr[restful] Unhandled notification type 'service_map'
|
|
2019-05-21 11:00:56.511 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.511 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.511 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.511 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.511 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.511 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.511 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.511 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.511 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.535 7f09c8f97700 1 -- <ip>:0/582 <== mon.2 v2:<ip>:40569/0 36 ==== service_map(e2 1 svc) v1 ==== 886+0+0 (crc 0 0 0) 0x55bc63acf800 con 0x55bc60121680
|
|
2019-05-21 11:00:56.535 7f09c8f97700 4 mgr ms_dispatch2 active service_map(e2 1 svc) v1
|
|
2019-05-21 11:00:56.535 7f09c8f97700 4 mgr ms_dispatch2 service_map(e2 1 svc) v1
|
|
2019-05-21 11:00:56.535 7f09c8f97700 10 mgr handle_service_map e2
|
|
2019-05-21 11:00:56.535 7f09c8f97700 10 mgr.server operator() got updated map e2
|
|
2019-05-21 11:00:56.535 7f09c8f97700 10 mgr notify_all notify_all: notify_all service_map
|
|
2019-05-21 11:00:56.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.535 7f09bacaa700 20 mgr[restful] Unhandled notification type 'service_map'
|
|
2019-05-21 11:00:56.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.711 7f09ba4a9700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] <== client.8296 <ip>:0/521398965 1 ==== command(tid 0: {"prefix": "mgr self-test module", "module": "zabbix", "target": ["mgr", ""]}) v1 ==== 101+0+0 (crc 0 0 0) 0x55bc63a78000 con 0x55bc63c4fb00
|
|
2019-05-21 11:00:56.711 7f09ba4a9700 4 mgr.server _handle_command decoded 3
|
|
2019-05-21 11:00:56.711 7f09ba4a9700 4 mgr.server _handle_command prefix=mgr self-test module
|
|
2019-05-21 11:00:56.711 7f09ba4a9700 20 is_capable service=py command=mgr self-test module read write addr - on cap allow *
|
|
2019-05-21 11:00:56.711 7f09ba4a9700 20 allow so far , doing grant allow *
|
|
2019-05-21 11:00:56.711 7f09ba4a9700 20 allow all
|
|
2019-05-21 11:00:56.711 7f09ba4a9700 10 mgr.server _allowed_command client.admin capable
|
|
2019-05-21 11:00:56.711 7f09ba4a9700 0 log_channel(audit) log [DBG] : from='client.8296 -' entity='client.admin' cmd=[{"prefix": "mgr self-test module", "module": "zabbix", "target": ["mgr", ""]}]: dispatch
|
|
2019-05-21 11:00:56.711 7f09ba4a9700 4 mgr.server _handle_command passing through 3
|
|
2019-05-21 11:00:56.711 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.711 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc63ac4900
|
|
2019-05-21 11:00:56.711 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc63ac4900
|
|
2019-05-21 11:00:56.711 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc63ac4900
|
|
2019-05-21 11:00:56.711 7f09bacaa700 20 mgr dispatch_remote Calling zabbix.self_test...
|
|
2019-05-21 11:00:56.711 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc63ac4900
|
|
2019-05-21 11:00:56.711 7f09bacaa700 -1 Remote method threw exception: KeyError:
|
|
2019-05-21 11:00:56.711 7f09bacaa700 -1 mgr handle_command module 'selftest' command handler threw exception: 'RuntimeError' object has no attribute 'message'
|
|
2019-05-21 11:00:56.715 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:56.715 7f09bacaa700 -1 mgr.server reply reply (22) Invalid argument Traceback (most recent call last):
|
|
File "/ceph/src/pybind/mgr/selftest/module.py", line 143, in handle_command
|
|
r = self.remote(command['module'], "self_test")
|
|
File "/ceph/src/pybind/mgr/mgr_module.py", line 1247, in remote
|
|
args, kwargs)
|
|
RuntimeError: Remote method threw exception: KeyError:
|
|
|
|
During handling of the above exception, another exception occurred:
|
|
|
|
Traceback (most recent call last):
|
|
File "/ceph/src/pybind/mgr/mgr_module.py", line 889, in _handle_command
|
|
return self.handle_command(inbuf, cmd)
|
|
File "/ceph/src/pybind/mgr/selftest/module.py", line 145, in handle_command
|
|
return -1, '', "Test failed: {0}".format(e.message)
|
|
AttributeError: 'RuntimeError' object has no attribute 'message'
|
|
|
|
2019-05-21 11:00:56.715 7f09bacaa700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] --> <ip>:0/521398965 -- command_reply(tid 0: -22 Traceback (most recent call last):
|
|
File "/ceph/src/pybind/mgr/selftest/module.py", line 143, in handle_command
|
|
r = self.remote(command['module'], "self_test")
|
|
File "/ceph/src/pybind/mgr/mgr_module.py", line 1247, in remote
|
|
args, kwargs)
|
|
RuntimeError: Remote method threw exception: KeyError:
|
|
|
|
During handling of the above exception, another exception occurred:
|
|
|
|
Traceback (most recent call last):
|
|
File "/ceph/src/pybind/mgr/mgr_module.py", line 889, in _handle_command
|
|
return self.handle_command(inbuf, cmd)
|
|
File "/ceph/src/pybind/mgr/selftest/module.py", line 145, in handle_command
|
|
return -1, '', "Test failed: {0}".format(e.message)
|
|
AttributeError: 'RuntimeError' object has no attribute 'message'
|
|
) v1 -- 0x55bc63a781e0 con 0x55bc63c4fb00
|
|
2019-05-21 11:00:56.719 7f09cbf9d700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> <ip>:0/521398965 conn(0x55bc63c4fb00 msgr2=0x55bc63a92c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 47
|
|
2019-05-21 11:00:56.719 7f09cbf9d700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> <ip>:0/521398965 conn(0x55bc63c4fb00 msgr2=0x55bc63a92c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed
|
|
2019-05-21 11:00:56.719 7f09cbf9d700 1 --2- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> <ip>:0/521398965 conn(0x55bc63c4fb00 0x55bc63a92c00 crc :-1 s=READY pgs=4 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted)
|
|
2019-05-21 11:00:56.719 7f09cbf9d700 1 --2- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> <ip>:0/521398965 conn(0x55bc63c4fb00 0x55bc63a92c00 crc :-1 s=READY pgs=4 cs=0 l=1 rx=0 tx=0).stop
|
|
2019-05-21 11:00:56.983 7f09ce7a2700 1 --2- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> conn(0x55bc63c4f200 0x55bc63892000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).accept
|
|
2019-05-21 11:00:56.983 7f09cbf9d700 1 --2- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> conn(0x55bc63c4f200 0x55bc63892000 unknown :-1 s=BANNER_ACCEPTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0
|
|
2019-05-21 11:00:56.987 7f09cbf9d700 10 monclient: handle_auth_request added challenge on 0x55bc63c4f200
|
|
2019-05-21 11:00:56.987 7f09cbf9d700 10 mgr.server ms_handle_authentication ms_handle_authentication new session 0x55bc63ac46c0 con 0x55bc63c4f200 entity client.admin addr
|
|
2019-05-21 11:00:56.987 7f09cbf9d700 10 mgr.server ms_handle_authentication session 0x55bc63ac46c0 client.admin has caps allow * 'allow *'
|
|
2019-05-21 11:00:56.987 7f09cbf9d700 1 --2- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> <ip>:0/2245973476 conn(0x55bc63c4f200 0x55bc63892000 crc :-1 s=READY pgs=4 cs=0 l=1 rx=0 tx=0).ready entity=client.8304 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0
|
|
2019-05-21 11:00:57.243 7f09c5790700 10 mgr tick tick
|
|
2019-05-21 11:00:57.243 7f09c5790700 4 mgr send_beacon active
|
|
2019-05-21 11:00:57.243 7f09c5790700 10 mgr send_beacon sending beacon as gid 8266
|
|
2019-05-21 11:00:57.243 7f09c5790700 10 monclient: _send_mon_message to mon.c at v2:<ip>:40569/0
|
|
2019-05-21 11:00:57.243 7f09c5790700 1 -- <ip>:0/582 --> [v2:<ip>:40569/0,v1:<ip>:40570/0] -- mgrbeacon mgr.x(75bce6bb-80ba-41f4-b684-5bdc04976167,8266, [v2:<ip>:6800/582,v1:<ip>:6801/582], 1) v8 -- 0x55bc636c6840 con 0x55bc60121680
|
|
2019-05-21 11:00:57.335 7f09c8f97700 1 -- <ip>:0/582 <== mon.2 v2:<ip>:40569/0 37 ==== mgrdigest v1 ==== 2026+0+0 (crc 0 0 0) 0x55bc5f5b4240 con 0x55bc60121680
|
|
2019-05-21 11:00:57.335 7f09c8f97700 4 mgr ms_dispatch2 active mgrdigest v1
|
|
2019-05-21 11:00:57.335 7f09c8f97700 4 mgr ms_dispatch2 mgrdigest v1
|
|
2019-05-21 11:00:57.335 7f09c8f97700 10 mgr handle_mgr_digest 1764
|
|
2019-05-21 11:00:57.335 7f09c8f97700 10 mgr handle_mgr_digest 254
|
|
2019-05-21 11:00:57.335 7f09c8f97700 10 mgr notify_all notify_all: notify_all mon_status
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09c8f97700 10 mgr notify_all notify_all: notify_all health
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09c8f97700 10 mgr notify_all notify_all: notify_all pg_summary
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09c8f97700 10 mgr handle_mgr_digest done.
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr[restful] Unhandled notification type 'mon_status'
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr[restful] Unhandled notification type 'health'
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.335 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.339 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.339 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.339 7f09bacaa700 20 mgr[restful] Unhandled notification type 'pg_summary'
|
|
2019-05-21 11:00:57.339 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.339 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.339 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.339 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.339 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.339 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.339 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.339 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.339 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.531 7f09c8f97700 1 -- <ip>:0/582 <== mon.2 v2:<ip>:40569/0 38 ==== log(2 entries from seq 0 at 2019-05-21 11:00:57.243660) v1 ==== 528+0+0 (crc 0 0 0) 0x55bc63be7d40 con 0x55bc60121680
|
|
2019-05-21 11:00:57.531 7f09c8f97700 4 mgr ms_dispatch2 active log(2 entries from seq 0 at 2019-05-21 11:00:57.243660) v1
|
|
2019-05-21 11:00:57.531 7f09c8f97700 4 mgr ms_dispatch2 log(2 entries from seq 0 at 2019-05-21 11:00:57.243660) v1
|
|
2019-05-21 11:00:57.531 7f09c8f97700 10 mgr notify_all notify_all: notify_all (clog)
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09c8f97700 10 mgr notify_all notify_all: notify_all (clog)
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr[restful] Unhandled notification type 'clog'
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr[restful] Unhandled notification type 'clog'
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.535 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.543 7f09c8f97700 1 -- <ip>:0/582 <== mon.2 v2:<ip>:40569/0 39 ==== service_map(e2 1 svc) v1 ==== 886+0+0 (crc 0 0 0) 0x55bc63acf600 con 0x55bc60121680
|
|
2019-05-21 11:00:57.543 7f09c8f97700 4 mgr ms_dispatch2 active service_map(e2 1 svc) v1
|
|
2019-05-21 11:00:57.543 7f09c8f97700 4 mgr ms_dispatch2 service_map(e2 1 svc) v1
|
|
2019-05-21 11:00:57.543 7f09c8f97700 10 mgr handle_service_map e2
|
|
2019-05-21 11:00:57.543 7f09c8f97700 10 mgr.server operator() got updated map e2
|
|
2019-05-21 11:00:57.543 7f09c8f97700 10 mgr notify_all notify_all: notify_all service_map
|
|
2019-05-21 11:00:57.543 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.543 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.543 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.543 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.543 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.543 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.543 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.543 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.543 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.543 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.543 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.543 7f09bacaa700 20 mgr[restful] Unhandled notification type 'service_map'
|
|
2019-05-21 11:00:57.543 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.543 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.543 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.543 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.543 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.543 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.543 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.543 7f09bacaa700 20 mgr Gil Switched to new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.543 7f09bacaa700 20 mgr ~Gil Destroying new thread state 0x55bc6341de60
|
|
2019-05-21 11:00:57.543 7f09cbf9d700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> <ip>:0/2245973476 conn(0x55bc63c4f200 msgr2=0x55bc63892000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 47
|
|
2019-05-21 11:00:57.543 7f09cbf9d700 1 -- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> <ip>:0/2245973476 conn(0x55bc63c4f200 msgr2=0x55bc63892000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed
|
|
2019-05-21 11:00:57.543 7f09cbf9d700 1 --2- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> <ip>:0/2245973476 conn(0x55bc63c4f200 0x55bc63892000 crc :-1 s=READY pgs=4 cs=0 l=1 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted)
|
|
2019-05-21 11:00:57.543 7f09cbf9d700 1 --2- [v2:<ip>:6800/582,v1:<ip>:6801/582] >> <ip>:0/2245973476 conn(0x55bc63c4f200 0x55bc63892000 crc :-1 s=READY pgs=4 cs=0 l=1 rx=0 tx=0).stop
|
|
2019-05-21 11:00:57.647 7f09c9f99700 -1 received signal: Terminated from killall ceph-mgr (PID: 818) UID: 0
|
|
2019-05-21 11:00:57.647 7f09c9f99700 -1 mgr handle_signal *** Got signal Terminated ***
|