Actions
Bug #21218
closedthrash-eio + bluestore (hangs with unfound objects or read_log_and_missing assert)
Status:
Resolved
Priority:
Urgent
Assignee:
David Zafman
Category:
-
Target version:
-
% Done:
0%
Source:
Tags:
Backport:
luminous
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
2017-09-01T21:24:33.959 INFO:teuthology.orchestra.run.smithi037.stdout: "health": {
2017-09-01T21:24:33.975 INFO:teuthology.orchestra.run.smithi037.stdout: "checks": {
2017-09-01T21:24:34.070 INFO:teuthology.orchestra.run.smithi037.stdout: "OSDMAP_FLAGS": {
2017-09-01T21:24:34.081 INFO:teuthology.orchestra.run.smithi037.stdout: "severity": "HEALTH_WARN",
2017-09-01T21:24:34.139 INFO:teuthology.orchestra.run.smithi037.stdout: "summary": {
2017-09-01T21:24:34.194 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "noscrub,nodeep-scrub flag(s) set"
2017-09-01T21:24:34.252 INFO:teuthology.orchestra.run.smithi037.stdout: }
2017-09-01T21:24:34.265 INFO:teuthology.orchestra.run.smithi037.stdout: },
2017-09-01T21:24:34.370 INFO:teuthology.orchestra.run.smithi037.stdout: "OBJECT_UNFOUND": {
2017-09-01T21:24:34.420 INFO:teuthology.orchestra.run.smithi037.stdout: "severity": "HEALTH_WARN",
2017-09-01T21:24:34.461 INFO:teuthology.orchestra.run.smithi037.stdout: "summary": {
2017-09-01T21:24:34.483 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "55/32900 objects unfound (0.167%)"
2017-09-01T21:24:34.504 INFO:teuthology.orchestra.run.smithi037.stdout: }
2017-09-01T21:24:34.633 INFO:teuthology.orchestra.run.smithi037.stdout: },
2017-09-01T21:24:35.093 INFO:teuthology.orchestra.run.smithi037.stdout: "PG_DEGRADED": {
2017-09-01T21:24:35.102 INFO:teuthology.orchestra.run.smithi037.stdout: "severity": "HEALTH_WARN",
2017-09-01T21:24:35.168 INFO:teuthology.orchestra.run.smithi037.stdout: "summary": {
2017-09-01T21:24:35.365 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "Degraded data redundancy: 110/65800 objects degraded (0.167%), 1 pg unclean, 1 pg degraded"
2017-09-01T21:24:35.384 INFO:teuthology.orchestra.run.smithi037.stdout: }
2017-09-01T21:24:35.485 INFO:teuthology.orchestra.run.smithi037.stdout: },
2017-09-01T21:24:35.520 INFO:teuthology.orchestra.run.smithi037.stdout: "REQUEST_STUCK": {
2017-09-01T21:24:35.679 INFO:teuthology.orchestra.run.smithi037.stdout: "severity": "HEALTH_ERR",
2017-09-01T21:24:35.688 INFO:teuthology.orchestra.run.smithi037.stdout: "summary": {
2017-09-01T21:24:36.108 INFO:teuthology.orchestra.run.smithi037.stdout: "message": "27 stuck requests are blocked > 4096 sec"
2017-09-01T21:24:36.125 INFO:teuthology.orchestra.run.smithi037.stdout: }
2017-09-01T21:24:36.242 INFO:teuthology.orchestra.run.smithi037.stdout: }
2017-09-01T21:24:36.311 INFO:teuthology.orchestra.run.smithi037.stdout: },
2017-09-01T21:24:36.359 INFO:teuthology.orchestra.run.smithi037.stdout: "status": "HEALTH_ERR",
2017-09-01T21:24:36.403 INFO:teuthology.orchestra.run.smithi037.stdout: "overall_status": "HEALTH_ERR"
2017-09-01T21:24:36.468 INFO:teuthology.orchestra.run.smithi037.stdout: },
but
ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF -1 0.52734 root default -3 0.26367 host smithi037 0 ssd 0.08789 osd.0 up 1.00000 0 1 ssd 0.08789 osd.1 up 1.00000 0.29178 2 ssd 0.08789 osd.2 up 1.00000 1.00000 -5 0.26367 host smithi134 3 ssd 0.08789 osd.3 up 1.00000 1.00000 4 ssd 0.08789 osd.4 up 1.00000 0.67581 5 ssd 0.08789 osd.5 up 1.00000 0.80031
/a/sage-2017-09-01_13:34:04-rados-wip-sage-testing2-2017-08-31-1648-distro-basic-smithi/1586491
Actions