Project

General

Profile

Bug #48842

qa/standalone/osd/osd-recovery-prio.sh: TEST_recovery_pool_priority failed

Added by Neha Ojha about 3 years ago. Updated about 3 years ago.

Status:
Resolved
Priority:
Normal
Assignee:
David Zafman
Category:
-
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2021-01-11T15:29:59.866 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:508: TEST_recovery_pool_priority:  return 2
2021-01-11T15:29:59.866 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:37: run:  return 1

/a/teuthology-2021-01-11_07:01:02-rados-master-distro-basic-smithi/5777307

History

#1 Updated by Neha Ojha about 3 years ago

2021-01-11T15:26:22.874 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:434: TEST_recovery_pool_priority:  cat td/osd-recovery-prio/dump.0.out
2021-01-11T15:26:22.875 INFO:tasks.workunit.client.0.smithi060.stdout:osd.0
2021-01-11T15:26:22.875 INFO:tasks.workunit.client.0.smithi060.stdout:{   
2021-01-11T15:26:22.875 INFO:tasks.workunit.client.0.smithi060.stdout:    "local_reservations": {
2021-01-11T15:26:22.875 INFO:tasks.workunit.client.0.smithi060.stdout:        "max_allowed": 1,
2021-01-11T15:26:22.876 INFO:tasks.workunit.client.0.smithi060.stdout:        "min_priority": 0,
2021-01-11T15:26:22.876 INFO:tasks.workunit.client.0.smithi060.stdout:        "queues": [],
2021-01-11T15:26:22.876 INFO:tasks.workunit.client.0.smithi060.stdout:        "in_progress": []
2021-01-11T15:26:22.876 INFO:tasks.workunit.client.0.smithi060.stdout:    },
2021-01-11T15:26:22.877 INFO:tasks.workunit.client.0.smithi060.stdout:    "remote_reservations": {
2021-01-11T15:26:22.877 INFO:tasks.workunit.client.0.smithi060.stdout:        "max_allowed": 1,
2021-01-11T15:26:22.877 INFO:tasks.workunit.client.0.smithi060.stdout:        "min_priority": 0,
2021-01-11T15:26:22.877 INFO:tasks.workunit.client.0.smithi060.stdout:        "queues": [],
2021-01-11T15:26:22.877 INFO:tasks.workunit.client.0.smithi060.stdout:        "in_progress": [
2021-01-11T15:26:22.877 INFO:tasks.workunit.client.0.smithi060.stdout:            {   
2021-01-11T15:26:22.878 INFO:tasks.workunit.client.0.smithi060.stdout:                "item": "1.0",
2021-01-11T15:26:22.878 INFO:tasks.workunit.client.0.smithi060.stdout:                "prio": 191,
2021-01-11T15:26:22.878 INFO:tasks.workunit.client.0.smithi060.stdout:                "can_preempt": true
2021-01-11T15:26:22.878 INFO:tasks.workunit.client.0.smithi060.stdout:            }
2021-01-11T15:26:22.878 INFO:tasks.workunit.client.0.smithi060.stdout:        ]
2021-01-11T15:26:22.879 INFO:tasks.workunit.client.0.smithi060.stdout:    }
2021-01-11T15:26:22.879 INFO:tasks.workunit.client.0.smithi060.stdout:}
2021-01-11T15:26:22.880 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:437: TEST_recovery_pool_priority:  cat td/osd-recovery-prio/dump.1.out
2021-01-11T15:26:22.880 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:437: TEST_recovery_pool_priority:  jq '.local_reservations.in_progress[0].item'
2021-01-11T15:26:22.880 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:437: TEST_recovery_pool_priority:  eval 'ITEM="1.0"'
2021-01-11T15:26:22.880 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:437: TEST_recovery_pool_priority:  ITEM=1.0
2021-01-11T15:26:22.881 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:438: TEST_recovery_pool_priority:  '[' 1.0 '!=' 1.0 ']'
2021-01-11T15:26:22.881 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:443: TEST_recovery_pool_priority:  cat td/osd-recovery-prio/dump.1.out
2021-01-11T15:26:22.881 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:443: TEST_recovery_pool_priority:  jq '.local_reservations.in_progress[0].prio'
2021-01-11T15:26:22.881 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:443: TEST_recovery_pool_priority:  PRIO=191
2021-01-11T15:26:22.882 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:444: TEST_recovery_pool_priority:  '[' 191 '!=' 191 ']'
2021-01-11T15:26:22.882 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:452: TEST_recovery_pool_priority:  cat td/osd-recovery-prio/dump.0.out
2021-01-11T15:26:22.883 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:452: TEST_recovery_pool_priority:  jq '.remote_reservations.in_progress[0].item'
2021-01-11T15:26:22.885 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:452: TEST_recovery_pool_priority:  eval 'ITEM="1.0"'
2021-01-11T15:26:22.885 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:452: TEST_recovery_pool_priority:  ITEM=1.0
2021-01-11T15:26:22.885 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:453: TEST_recovery_pool_priority:  '[' 1.0 '!=' 1.0 ']'
2021-01-11T15:26:22.886 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:458: TEST_recovery_pool_priority:  cat td/osd-recovery-prio/dump.0.out
2021-01-11T15:26:22.886 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:458: TEST_recovery_pool_priority:  jq '.remote_reservations.in_progress[0].prio'
2021-01-11T15:26:22.888 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:458: TEST_recovery_pool_priority:  PRIO=191
2021-01-11T15:26:22.888 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:459: TEST_recovery_pool_priority:  '[' 191 '!=' 191 ']'
2021-01-11T15:26:22.889 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:467: TEST_recovery_pool_priority:  cat td/osd-recovery-prio/dump.0.out
2021-01-11T15:26:22.889 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:467: TEST_recovery_pool_priority:  jq '.local_reservations.in_progress[0].item'
2021-01-11T15:26:22.892 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:467: TEST_recovery_pool_priority:  eval ITEM=null
2021-01-11T15:26:22.892 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:467: TEST_recovery_pool_priority:  ITEM=null
2021-01-11T15:26:22.892 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:468: TEST_recovery_pool_priority:  '[' null '!=' 2.0 ']'
2021-01-11T15:26:22.892 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:470: TEST_recovery_pool_priority:  echo 'The primary PG for test2 didn'\''t become the in progress item'
2021-01-11T15:26:22.892 INFO:tasks.workunit.client.0.smithi060.stdout:The primary PG for test2 didn't become the in progress item
2021-01-11T15:26:22.893 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:471: TEST_recovery_pool_priority:  expr 0 + 1
2021-01-11T15:26:22.893 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:471: TEST_recovery_pool_priority:  ERRORS=1
2021-01-11T15:26:22.894 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:482: TEST_recovery_pool_priority:  cat td/osd-recovery-prio/dump.1.out
2021-01-11T15:26:22.894 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:482: TEST_recovery_pool_priority:  jq '.remote_reservations.in_progress[0].item'
2021-01-11T15:26:22.897 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:482: TEST_recovery_pool_priority:  eval ITEM=null
2021-01-11T15:26:22.898 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:482: TEST_recovery_pool_priority:  ITEM=null
2021-01-11T15:26:22.898 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:483: TEST_recovery_pool_priority:  '[' null '!=' 2.0 ']'
2021-01-11T15:26:22.899 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:485: TEST_recovery_pool_priority:  echo 'The primary PG 2.0 didn'\''t become the in progress item on remote'
2021-01-11T15:26:22.899 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:486: TEST_recovery_pool_priority:  expr 1 + 1
2021-01-11T15:26:22.900 INFO:tasks.workunit.client.0.smithi060.stdout:The primary PG 2.0 didn't become the in progress item on remote
2021-01-11T15:26:22.902 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:486: TEST_recovery_pool_priority:  ERRORS=2

#2 Updated by David Zafman about 3 years ago

This can easily be explained by a slow test machine. The 10 second sleep wasn't enough time to get recovery initiated on pool2 (PG 2.0). So we aren't ready to examine the recovery reservation structures.

#3 Updated by David Zafman about 3 years ago

  • Status changed from New to In Progress
  • Assignee set to David Zafman
  • Pull request ID set to 38857

#4 Updated by David Zafman about 3 years ago

David Zafman wrote:

This can easily be explained by a slow test machine. The 10 second sleep wasn't enough time to get recovery initiated on pool2 (PG 2.0). So we aren't ready to examine the recovery reservation structures.

Actually both PGs need to be "recovering"

#5 Updated by Kefu Chai about 3 years ago

  • Status changed from In Progress to Resolved

Also available in: Atom PDF