Project

General

Profile

Actions
Copy link

Bug #21127

closed

qa/standalone/scrub/osd-scrub-repair.sh timeout

Added by Sage Weil over 6 years ago. Updated over 4 years ago.

Status:
Resolved
Priority:
Urgent
Assignee:
-
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
luminous
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

...
2017-08-24T22:15:30.126 INFO:tasks.workunit.client.0.smithi040.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:377: unfound_erasure_coded:  ceph -s
2017-08-24T22:15:30.129 INFO:tasks.workunit.client.0.smithi040.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:377: unfound_erasure_coded:  grep '1/1 unfound'
2017-08-24T22:15:30.131 INFO:tasks.workunit.client.0.smithi040.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:378: unfound_erasure_coded:  sleep 1
2017-08-24T22:15:30.165 INFO:tasks.workunit.client.0.smithi040.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:376: unfound_erasure_coded:  for f in '`seq 1 60`'
2017-08-24T22:15:30.169 INFO:tasks.workunit.client.0.smithi040.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:377: unfound_erasure_coded:  ceph -s
2017-08-24T22:15:30.210 INFO:tasks.workunit.client.0.smithi040.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:377: unfound_erasure_coded:  grep '1/1 unfound'
2017-08-24T22:15:30.221 INFO:tasks.workunit.client.0.smithi040.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:378: unfound_erasure_coded:  sleep 1
2017-08-24T22:15:30.247 INFO:tasks.workunit.client.0.smithi040.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:380: unfound_erasure_coded:  ceph -s
2017-08-24T22:15:30.270 INFO:tasks.workunit.client.0.smithi040.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:380: unfound_erasure_coded:  grep '4 osds: 4 up, 4 in'
2017-08-24T22:15:30.343 INFO:tasks.workunit.client.0.smithi040.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:381: unfound_erasure_coded:  ceph -s
2017-08-24T22:15:30.397 INFO:tasks.workunit.client.0.smithi040.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:381: unfound_erasure_coded:  grep '1/1 unfound'
2017-08-24T22:15:30.400 INFO:tasks.workunit.client.0.smithi040.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:381: unfound_erasure_coded:  return 1
2017-08-24T22:15:30.403 INFO:tasks.workunit.client.0.smithi040.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-repair.sh:54: run:  return 1

log indicates unfound objects are there,
2017-08-25T00:20:03.733 INFO:tasks.workunit.client.0.smithi040.stdout:2017-08-24 22:07:54.562699 7f59f1443700 10 mon.a@0(leader).mgrstat prepare_report 5 pgs: 4 active+clean, 1 active; 7 bytes data, 227 GB used, 3440 GB / 3667 GB avail; 3/4 objects degraded (75.000%); 1/1 objects unfound (100.000%), 4 health checks

but we're grepping for "1/1 unfound" instead of "1/1 objects unfound"?

/a/sage-2017-08-24_16:14:07-rados-wip-sage-testing-20170824a-distro-basic-smithi/1559945

Related issues 1 (0 open — 1 closed)

Copied to RADOS - Backport #21132: luminous: qa/standalone/scrub/osd-scrub-repair.sh timeoutResolvedSage WeilActions
Actions
Copy link
 #1

Updated by Sage Weil over 6 years ago

  • Status changed from 12 to Fix Under Review
Actions
Copy link
 #2

Updated by David Zafman over 6 years ago

Caused by:

commit fe81b7e3a5034ce855303f93f3e413f3f2dc74a8
Author: huanwen ren <>
Date: Wed Aug 16 16:21:20 2017 +0800

mon/pgmap: add objects prefix for unfound type
the objects prefix display indicates the scope of the "unfound",
    like objects "misplaced" err.
Signed-off-by: huanwen ren &lt;&gt;
Actions
Copy link
 #3

Updated by David Zafman over 6 years ago

We need to backport fe81b7e3a5034ce855303f93f3e413f3f2dc74a8 and this change together to luminous.

Actions
Copy link
 #4

Updated by Sage Weil over 6 years ago

  • Status changed from Fix Under Review to Pending Backport
Actions
Copy link
 #6

Updated by Nathan Cutler over 6 years ago

  • Copied to Backport #21132: luminous: qa/standalone/scrub/osd-scrub-repair.sh timeout added
Actions
Copy link
 #7

Updated by Greg Farnum over 4 years ago

  • Status changed from Pending Backport to Resolved
Actions
Copy link

Also available in: Atom PDF