Project

General

Profile

Actions

Bug #18472

closed

ceph osd slowrequest

Added by wangyali 王 over 7 years ago. Updated over 7 years ago.

Status:
Rejected
Priority:
Urgent
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
ceph-disk
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2017-01-10 10:27:35.075500 7fc7602ad700 0 log_channel(cluster) log [WRN] : 1 slow requests, 1 included below; oldest blocked for > 30.026027 secs
2017-01-10 10:27:35.075509 7fc7602ad700 0 log_channel(cluster) log [WRN] : slow request 30.026027 seconds old, received at 2017-01-10 10:27:05.049432: osd_op(client.10623560.0:10 notify.1 [create 0~0] 3.16dafda0 RETRY=2 ondisk+retry+write+known_if_redirec
ted e2880) currently reached_pg
2017-01-10 10:27:37.075729 7fc7602ad700 0 log_channel(cluster) log [WRN] : 2 slow requests, 1 included below; oldest blocked for > 32.026273 secs
2017-01-10 10:27:37.075735 7fc7602ad700 0 log_channel(cluster) log [WRN] : slow request 30.182386 seconds old, received at 2017-01-10 10:27:06.893318: osd_op(client.10204119.0:114939098 notify.1 [watch reconnect cookie 53243040 gen 4] 3.16dafda0 ondisk+wr
ite+known_if_redirected e2882) currently reached_pg
2017-01-10 10:27:38.075871 7fc7602ad700 0 log_channel(cluster) log [WRN] : 3 slow requests, 1 included below; oldest blocked for > 33.026404 secs
2017-01-10 10:27:38.075876 7fc7602ad700 0 log_channel(cluster) log [WRN] : slow request 30.955119 seconds old, received at 2017-01-10 10:27:07.120717: osd_op(client.10623572.0:10 notify.1 [create 0~0] 3.16dafda0 RETRY=1 ondisk+retry+write+known_if_redirec
ted e2882) currently reached_pg
2017-01-10 10:27:42.076428 7fc7602ad700 0 log_channel(cluster) log [WRN] : 4 slow requests, 1 included below; oldest blocked for > 37.026967 secs
2017-01-10 10:27:42.076433 7fc7602ad700 0 log_channel(cluster) log [WRN] : slow request 30.187493 seconds old, received at 2017-01-10 10:27:11.888906: osd_op(client.10204119.0:114939101 notify.1 [watch ping cookie 53243040 gen 4] 3.16dafda0 ondisk+write+k
nown_if_redirected e2882) currently reached_pg
2017-01-10 10:27:47.077129 7fc7602ad700 0 log_channel(cluster) log [WRN] : 5 slow requests, 1 included below; oldest blocked for > 42.027675 secs
2017-01-10 10:27:47.077135 7fc7602ad700 0 log_channel(cluster) log [WRN] : slow request 30.187451 seconds old, received at 2017-01-10 10:27:16.889656: osd_op(client.10204119.0:114939109 notify.1 [watch ping cookie 53243040 gen 4] 3.16dafda0 ondisk+write+k
nown_if_redirected e2883) currently reached_pg
2017-01-10 10:27:52.077891 7fc7602ad700 0 log_channel(cluster) log [WRN] : 6 slow requests, 1 included below; oldest blocked for > 47.028412 secs
2017-01-10 10:27:52.077904 7fc7602ad700 0 log_channel(cluster) log [WRN] : slow request 30.187554 seconds old, received at 2017-01-10 10:27:21.890290: osd_op(client.10204119.0:114939117 notify.1 [watch ping cookie 53243040 gen 4] 3.16dafda0 ondisk+write+k
nown_if_redirected e2883) currently reached_pg
2017-01-10 10:27:57.078494 7fc7602ad700 0 log_channel(cluster) log [WRN] : 7 slow requests, 1 included below; oldest blocked for > 52.029039 secs
2017-01-10 10:27:57.078499 7fc7602ad700 0 log_channel(cluster) log [WRN] : slow request 30.187579 seconds old, received at 2017-01-10 10:27:26.890891: osd_op(client.10204119.0:114939125 notify.1 [watch ping cookie 53243040 gen 4] 3.16dafda0 ondisk+write+k
nown_if_redirected e2883) currently reached_pg

Actions #1

Updated by David Galloway over 7 years ago

  • Project changed from 23 to Ceph
Actions #2

Updated by Samuel Just over 7 years ago

  • Status changed from New to Rejected

Well, that isn't necessarily a bug. That message happens when a request takes longer then 30s to be serviced, but there are a lot of ways that can happen. Most involve a cluster going through peering. Feel free to reopen with a lot more information about what happened.

Actions

Also available in: Atom PDF