Bug #48842
qa/standalone/osd/osd-recovery-prio.sh: TEST_recovery_pool_priority failed
Status:
Resolved
Priority:
Normal
Assignee:
David Zafman
Category:
-
Target version:
-
% Done:
0%
Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Component(RADOS):
Pull request ID:
Crash signature (v1):
Crash signature (v2):
Description
2021-01-11T15:29:59.866 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:508: TEST_recovery_pool_priority: return 2 2021-01-11T15:29:59.866 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:37: run: return 1
/a/teuthology-2021-01-11_07:01:02-rados-master-distro-basic-smithi/5777307
History
#1 Updated by Neha Ojha about 3 years ago
2021-01-11T15:26:22.874 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:434: TEST_recovery_pool_priority: cat td/osd-recovery-prio/dump.0.out 2021-01-11T15:26:22.875 INFO:tasks.workunit.client.0.smithi060.stdout:osd.0 2021-01-11T15:26:22.875 INFO:tasks.workunit.client.0.smithi060.stdout:{ 2021-01-11T15:26:22.875 INFO:tasks.workunit.client.0.smithi060.stdout: "local_reservations": { 2021-01-11T15:26:22.875 INFO:tasks.workunit.client.0.smithi060.stdout: "max_allowed": 1, 2021-01-11T15:26:22.876 INFO:tasks.workunit.client.0.smithi060.stdout: "min_priority": 0, 2021-01-11T15:26:22.876 INFO:tasks.workunit.client.0.smithi060.stdout: "queues": [], 2021-01-11T15:26:22.876 INFO:tasks.workunit.client.0.smithi060.stdout: "in_progress": [] 2021-01-11T15:26:22.876 INFO:tasks.workunit.client.0.smithi060.stdout: }, 2021-01-11T15:26:22.877 INFO:tasks.workunit.client.0.smithi060.stdout: "remote_reservations": { 2021-01-11T15:26:22.877 INFO:tasks.workunit.client.0.smithi060.stdout: "max_allowed": 1, 2021-01-11T15:26:22.877 INFO:tasks.workunit.client.0.smithi060.stdout: "min_priority": 0, 2021-01-11T15:26:22.877 INFO:tasks.workunit.client.0.smithi060.stdout: "queues": [], 2021-01-11T15:26:22.877 INFO:tasks.workunit.client.0.smithi060.stdout: "in_progress": [ 2021-01-11T15:26:22.877 INFO:tasks.workunit.client.0.smithi060.stdout: { 2021-01-11T15:26:22.878 INFO:tasks.workunit.client.0.smithi060.stdout: "item": "1.0", 2021-01-11T15:26:22.878 INFO:tasks.workunit.client.0.smithi060.stdout: "prio": 191, 2021-01-11T15:26:22.878 INFO:tasks.workunit.client.0.smithi060.stdout: "can_preempt": true 2021-01-11T15:26:22.878 INFO:tasks.workunit.client.0.smithi060.stdout: } 2021-01-11T15:26:22.878 INFO:tasks.workunit.client.0.smithi060.stdout: ] 2021-01-11T15:26:22.879 INFO:tasks.workunit.client.0.smithi060.stdout: } 2021-01-11T15:26:22.879 INFO:tasks.workunit.client.0.smithi060.stdout:} 2021-01-11T15:26:22.880 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:437: TEST_recovery_pool_priority: cat td/osd-recovery-prio/dump.1.out 2021-01-11T15:26:22.880 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:437: TEST_recovery_pool_priority: jq '.local_reservations.in_progress[0].item' 2021-01-11T15:26:22.880 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:437: TEST_recovery_pool_priority: eval 'ITEM="1.0"' 2021-01-11T15:26:22.880 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:437: TEST_recovery_pool_priority: ITEM=1.0 2021-01-11T15:26:22.881 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:438: TEST_recovery_pool_priority: '[' 1.0 '!=' 1.0 ']' 2021-01-11T15:26:22.881 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:443: TEST_recovery_pool_priority: cat td/osd-recovery-prio/dump.1.out 2021-01-11T15:26:22.881 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:443: TEST_recovery_pool_priority: jq '.local_reservations.in_progress[0].prio' 2021-01-11T15:26:22.881 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:443: TEST_recovery_pool_priority: PRIO=191 2021-01-11T15:26:22.882 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:444: TEST_recovery_pool_priority: '[' 191 '!=' 191 ']' 2021-01-11T15:26:22.882 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:452: TEST_recovery_pool_priority: cat td/osd-recovery-prio/dump.0.out 2021-01-11T15:26:22.883 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:452: TEST_recovery_pool_priority: jq '.remote_reservations.in_progress[0].item' 2021-01-11T15:26:22.885 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:452: TEST_recovery_pool_priority: eval 'ITEM="1.0"' 2021-01-11T15:26:22.885 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:452: TEST_recovery_pool_priority: ITEM=1.0 2021-01-11T15:26:22.885 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:453: TEST_recovery_pool_priority: '[' 1.0 '!=' 1.0 ']' 2021-01-11T15:26:22.886 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:458: TEST_recovery_pool_priority: cat td/osd-recovery-prio/dump.0.out 2021-01-11T15:26:22.886 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:458: TEST_recovery_pool_priority: jq '.remote_reservations.in_progress[0].prio' 2021-01-11T15:26:22.888 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:458: TEST_recovery_pool_priority: PRIO=191 2021-01-11T15:26:22.888 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:459: TEST_recovery_pool_priority: '[' 191 '!=' 191 ']' 2021-01-11T15:26:22.889 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:467: TEST_recovery_pool_priority: cat td/osd-recovery-prio/dump.0.out 2021-01-11T15:26:22.889 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:467: TEST_recovery_pool_priority: jq '.local_reservations.in_progress[0].item' 2021-01-11T15:26:22.892 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:467: TEST_recovery_pool_priority: eval ITEM=null 2021-01-11T15:26:22.892 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:467: TEST_recovery_pool_priority: ITEM=null 2021-01-11T15:26:22.892 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:468: TEST_recovery_pool_priority: '[' null '!=' 2.0 ']' 2021-01-11T15:26:22.892 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:470: TEST_recovery_pool_priority: echo 'The primary PG for test2 didn'\''t become the in progress item' 2021-01-11T15:26:22.892 INFO:tasks.workunit.client.0.smithi060.stdout:The primary PG for test2 didn't become the in progress item 2021-01-11T15:26:22.893 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:471: TEST_recovery_pool_priority: expr 0 + 1 2021-01-11T15:26:22.893 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:471: TEST_recovery_pool_priority: ERRORS=1 2021-01-11T15:26:22.894 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:482: TEST_recovery_pool_priority: cat td/osd-recovery-prio/dump.1.out 2021-01-11T15:26:22.894 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:482: TEST_recovery_pool_priority: jq '.remote_reservations.in_progress[0].item' 2021-01-11T15:26:22.897 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:482: TEST_recovery_pool_priority: eval ITEM=null 2021-01-11T15:26:22.898 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:482: TEST_recovery_pool_priority: ITEM=null 2021-01-11T15:26:22.898 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:483: TEST_recovery_pool_priority: '[' null '!=' 2.0 ']' 2021-01-11T15:26:22.899 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:485: TEST_recovery_pool_priority: echo 'The primary PG 2.0 didn'\''t become the in progress item on remote' 2021-01-11T15:26:22.899 INFO:tasks.workunit.client.0.smithi060.stderr://home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:486: TEST_recovery_pool_priority: expr 1 + 1 2021-01-11T15:26:22.900 INFO:tasks.workunit.client.0.smithi060.stdout:The primary PG 2.0 didn't become the in progress item on remote 2021-01-11T15:26:22.902 INFO:tasks.workunit.client.0.smithi060.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh:486: TEST_recovery_pool_priority: ERRORS=2
#2 Updated by David Zafman about 3 years ago
This can easily be explained by a slow test machine. The 10 second sleep wasn't enough time to get recovery initiated on pool2 (PG 2.0). So we aren't ready to examine the recovery reservation structures.
#3 Updated by David Zafman about 3 years ago
- Status changed from New to In Progress
- Assignee set to David Zafman
- Pull request ID set to 38857
#4 Updated by David Zafman about 3 years ago
David Zafman wrote:
This can easily be explained by a slow test machine. The 10 second sleep wasn't enough time to get recovery initiated on pool2 (PG 2.0). So we aren't ready to examine the recovery reservation structures.
Actually both PGs need to be "recovering"
#5 Updated by Kefu Chai about 3 years ago
- Status changed from In Progress to Resolved