Bug #55178: osd-scrub-test.sh: TEST_scrub_extended_sleep times out - RADOS - Ceph

Actions

Copy link

Bug #55178

open

osd-scrub-test.sh: TEST_scrub_extended_sleep times out

Added by Laura Flores about 2 years ago. Updated about 2 years ago.

Status:

New

Priority:

Normal

Assignee:

Ronen Friedman

Category:

Target version:

% Done:

Source:

Tags:

Backport:

quincy, pacific

Regression:

Severity:

3 - minor

Reviewed:

Affected Versions:

ceph-qa-suite:

Component(RADOS):

Pull request ID:

Crash signature (v1):

Crash signature (v2):

Description

/a/yuriw-2022-04-01_17:44:32-rados-wip-yuri3-testing-2022-04-01-0659-distro-default-smithi/6772689

2022-04-01T23:28:03.470 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:237: TEST_scrub_extended_sleep:  sleep 1
2022-04-01T23:28:04.475 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:231: TEST_scrub_extended_sleep:  (( i++ ))
2022-04-01T23:28:04.476 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:231: TEST_scrub_extended_sleep:  (( i < 15 ))
2022-04-01T23:28:04.477 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:241: TEST_scrub_extended_sleep:  '[' false = false ']'
2022-04-01T23:28:04.477 INFO:tasks.workunit.client.0.smithi082.stderr:/home/ubuntu/cephtest/clone.client.0/qa/standalone/scrub/osd-scrub-test.sh:243: TEST_scrub_extended_sleep:  return 1

osd.1.log around that time:

2022-04-01T23:28:03.650+0000 7f59ff80e700 20 osd.1 scrub-queue::scrub_time_permit should run between week day 2 - 3 now 5 - no
2022-04-01T23:28:03.650+0000 7f59ff80e700 20 osd.1 scrub-queue::scrub_sleep_time w/ extended sleep (20)
2022-04-01T23:28:03.650+0000 7f59ff80e700 15 osd.1 pg_epoch: 19 pg[1.0( empty local-lis/les=17/18 n=0 ec=17/17 lis/c=17/17 les/c/f=18/18/0 sis=17) [1,0,2] r=0 lpr=17 crt=0'0 mlcod 0'0 active+clean+scrubbing [ 1.0:  ] ] scrubber <>: add_delayed_scheduling sleep: 20000ms. needed? 1
2022-04-01T23:28:03.650+0000 7f59ff80e700 20 osd.1 pg_epoch: 19 pg[1.0( empty local-lis/les=17/18 n=0 ec=17/17 lis/c=17/17 les/c/f=18/18/0 sis=17) [1,0,2] r=0 lpr=17 crt=0'0 mlcod 0'0 active+clean+scrubbing [ 1.0:  ] ] scrubber <>: add_delayed_scheduling scrub state is PendingTimer, sleeping
2022-04-01T23:28:03.650+0000 7f59ff80e700 20  scrubberFSM  event: --^^^^---- RemotesReserved
2022-04-01T23:28:03.650+0000 7f59ff80e700 10 osd.1 pg_epoch: 19 pg[1.0( empty local-lis/les=17/18 n=0 ec=17/17 lis/c=17/17 les/c/f=18/18/0 sis=17) [1,0,2] r=0 lpr=17 crt=0'0 mlcod 0'0 active+clean+scrubbing [ 1.0:  ] ] scrubber <PendingTimer/>: scrubber event --<< send_remotes_reserved

PG 1.0 never left the "scrubbing" state.

Also seen in Pacific:
/a/yuriw-2022-01-25_03:40:28-rados-wip-yuri4-testing-2022-01-24-1706-pacific-distro-default-smithi/6639417