Project

General

Profile

Bug #21028 » ceph-osd.34.log

Artem Karamyshev, 08/17/2017 06:00 PM

 
2017-08-17 18:03:37.050021 7fb064ca0700 0 log_channel(cluster) log [DBG] : 5.aa6 scrub starts
2017-08-17 18:03:37.271863 7fb064ca0700 0 log_channel(cluster) log [DBG] : 5.aa6 scrub ok
2017-08-17 18:09:32.774724 7fb078c81700 0 -- 172.28.4.130:6849/24323 >> 172.28.6.4:6808/28234 conn(0x7fb0a6e46000 :6849 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 27 vs existing csq=27 existing_state=STATE_STANDBY
2017-08-17 18:09:32.775448 7fb078c81700 0 -- 172.28.4.130:6849/24323 >> 172.28.6.4:6808/28234 conn(0x7fb0a6e46000 :6849 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 28 vs existing csq=27 existing_state=STATE_STANDBY
2017-08-17 18:23:44.197724 7fb0754c1700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 30.510771 secs
2017-08-17 18:23:44.197738 7fb0754c1700 0 log_channel(cluster) log [WRN] : slow request 30.510771 seconds old, received at 2017-08-17 18:23:13.686814: osd_op(client.138556388.0:22803 5.69 5:9608ec99:::rbd_data.a07ec7371e89d7.000000000000048f:head [stat,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected e28759) currently sub_op_commit_rec from 66
2017-08-17 18:27:48.230405 7fb0654a1700 0 log_channel(cluster) log [DBG] : 4.172 scrub starts
2017-08-17 18:27:48.423350 7fb0654a1700 0 log_channel(cluster) log [DBG] : 4.172 scrub ok
2017-08-17 18:36:31.731616 7fb078c81700 0 -- 172.28.4.130:6849/24323 >> 172.28.6.3:6828/16400 conn(0x7fb0c28c9800 :6849 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 21 vs existing csq=21 existing_state=STATE_STANDBY
2017-08-17 18:36:31.732395 7fb078c81700 0 -- 172.28.4.130:6849/24323 >> 172.28.6.3:6828/16400 conn(0x7fb0c28c9800 :6849 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 22 vs existing csq=21 existing_state=STATE_STANDBY
2017-08-17 18:37:19.807463 7fb079482700 0 -- 172.28.4.130:6849/24323 >> 172.28.6.4:6848/1028680 conn(0x7fb0ab6b0800 :6849 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 15 vs existing csq=15 existing_state=STATE_STANDBY
2017-08-17 18:37:19.810008 7fb079482700 0 -- 172.28.4.130:6849/24323 >> 172.28.6.4:6848/1028680 conn(0x7fb0ab6b0800 :6849 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 16 vs existing csq=15 existing_state=STATE_STANDBY
2017-08-17 18:42:24.893935 7fb079c83700 0 -- 172.28.4.130:6849/24323 >> 172.28.6.4:6851/27791 conn(0x7fb0a431e800 :6849 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 17 vs existing csq=17 existing_state=STATE_STANDBY
2017-08-17 18:42:24.898918 7fb079c83700 0 -- 172.28.4.130:6849/24323 >> 172.28.6.4:6851/27791 conn(0x7fb0a431e800 :6849 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 18 vs existing csq=17 existing_state=STATE_STANDBY
2017-08-17 18:43:07.153593 7fb078c81700 0 -- 172.28.4.130:6849/24323 >> 172.28.6.3:6847/1015073 conn(0x7fb0afd65000 :6849 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 17 vs existing csq=17 existing_state=STATE_STANDBY
2017-08-17 18:43:07.154344 7fb078c81700 0 -- 172.28.4.130:6849/24323 >> 172.28.6.3:6847/1015073 conn(0x7fb0afd65000 :6849 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 18 vs existing csq=17 existing_state=STATE_STANDBY
2017-08-17 18:45:02.227346 7fb079482700 0 -- 172.28.4.130:6849/24323 >> 172.28.6.4:6808/28234 conn(0x7fb09ef69800 :6849 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 29 vs existing csq=29 existing_state=STATE_STANDBY
2017-08-17 18:45:02.228371 7fb079482700 0 -- 172.28.4.130:6849/24323 >> 172.28.6.4:6808/28234 conn(0x7fb09ef69800 :6849 s=STATE_ACCEPTING_WAIT_CONNECT_MSG_AUTH pgs=0 cs=0 l=0).handle_connect_msg accept connect_seq 30 vs existing csq=29 existing_state=STATE_STANDBY
2017-08-17 18:45:51.359827 7fb0754c1700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 30.107036 secs
2017-08-17 18:45:51.359840 7fb0754c1700 0 log_channel(cluster) log [WRN] : slow request 30.107036 seconds old, received at 2017-08-17 18:45:21.252710: osd_op(client.111847128.0:563991 5.917 5:e89c64a3:::rbd_data.aaa54c1f03c1d1.00000000000000a3:head [stat,write 610304~4096] snapc 0=[] ondisk+write+known_if_redirected e28759) currently op_applied
2017-08-17 18:56:07.437474 7fb0754c1700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 30.397031 secs
2017-08-17 18:56:07.437487 7fb0754c1700 0 log_channel(cluster) log [WRN] : slow request 30.397031 seconds old, received at 2017-08-17 18:55:37.040348: osd_op(client.126396492.0:5548396 5.a05b2837 5:ec14da05:::rbd_data.6dc5615f16fd4e.0000000000000e05:head [write 2473984~409600] snapc 29=[29] ack+ondisk+write+known_if_redirected e28759) currently sub_op_commit_rec from 111

(3-3/4)