Project

General

Profile

Actions

Bug #13075

closed

ms async: msg throttle busy loops?

Added by Sage Weil over 8 years ago. Updated over 8 years ago.

Status:
Can't reproduce
Priority:
Urgent
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Q/A
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2015-09-13 18:16:42.364534 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.365541 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.366548 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.367555 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.368562 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.369569 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.370576 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.371583 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.372589 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.373595 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.374602 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.375609 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.376616 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.377623 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.378630 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.379637 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.380644 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.381651 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.382658 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.383665 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.384671 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.385677 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.
2015-09-13 18:16:42.386684 7f7d893b8700  1 -- 10.214.132.26:6805/28605 >> 10.214.132.26:0/1022128 conn(0x7f7d9bfc3000 sd=100 :6805 s=STATE_OPEN_MESSAGE_THROTTLE_MESSAGE pgs=1879 cs=1 l=1).process wants 1 message from policy throttle 100/100 failed, just wait.

/a/sage-2015-09-12_17:44:29-rados-wip-sage-testing---basic-multi/1052889
Actions #1

Updated by Haomai Wang over 8 years ago

Why I don't find "remote" dir at /a/sage-2015-09-12_17:44:29-rados-wip-sage-testing---basic-multi/1052889 ?

Is messenger thread stuck into busy loop?

Actions #2

Updated by Sage Weil over 8 years ago

  • Status changed from New to Can't reproduce

Haomai Wang wrote:

Why I don't find "remote" dir at /a/sage-2015-09-12_17:44:29-rados-wip-sage-testing---basic-multi/1052889 ?

Is messenger thread stuck into busy loop?

The run didn't finish so teuthology didn't gather logs.. i should have done that manually :(. Ignore for now until we see it again...

Actions #3

Updated by Greg Farnum over 8 years ago

Sage Weil wrote:

The run didn't finish so teuthology didn't gather logs.. i should have done that manually :(. Ignore for now until we see it again...

I think #4875 is going to get done soonish and should enable that in future!

Actions

Also available in: Atom PDF