Project

General

Profile

Actions
Copy link

Bug #47680

closed

cephadm/test_dashboard_e2e.sh: AssertionError: Timed out retrying: expected [ '0', '1', '2', '3', '4', '5' ] to not include '3'

Added by Neha Ojha over 3 years ago. Updated about 3 years ago.

Status:
Can't reproduce
Priority:
Urgent
Assignee:
-
Category:
Component - Orchestrator
Target version:
-
% Done:

0%

Source:
Tags:
Backport:
Regression:
No
Severity:
3 - minor
Reviewed:
Affected Versions:
ceph-qa-suite:
Pull request ID:
Crash signature (v1):
Crash signature (v2):

Description

2020-09-28T11:23:25.217 INFO:tasks.workunit.client.0.smithi026.stdout:  0 passing (6m)
2020-09-28T11:23:25.217 INFO:tasks.workunit.client.0.smithi026.stdout:  1 failing
2020-09-28T11:23:25.222 INFO:tasks.workunit.client.0.smithi026.stdout:
2020-09-28T11:23:25.224 INFO:tasks.workunit.client.0.smithi026.stdout:  1) OSDs page
2020-09-28T11:23:25.225 INFO:tasks.workunit.client.0.smithi026.stdout:       when Orchestrator is available
2020-09-28T11:23:25.226 INFO:tasks.workunit.client.0.smithi026.stdout:         should create and delete OSDs:
2020-09-28T11:23:25.229 INFO:tasks.workunit.client.0.smithi026.stdout:     AssertionError: Timed out retrying: expected [ '0', '1', '2', '3', '4', '5' ] to not include '3'
2020-09-28T11:23:25.229 INFO:tasks.workunit.client.0.smithi026.stdout:      at Context.eval (https://smithi026:8443/__cypress/tests?p=cypress/integration/orchestrator/04-osds.e2e-spec.ts:95:35)
2020-09-28T11:23:25.230 INFO:tasks.workunit.client.0.smithi026.stdout:
2020-09-28T11:23:25.230 INFO:tasks.workunit.client.0.smithi026.stdout:
2020-09-28T11:23:25.230 INFO:tasks.workunit.client.0.smithi026.stdout:
2020-09-28T11:23:25.230 INFO:tasks.workunit.client.0.smithi026.stdout:
2020-09-28T11:23:25.231 INFO:tasks.workunit.client.0.smithi026.stdout:  (Results)
2020-09-28T11:23:25.231 INFO:tasks.workunit.client.0.smithi026.stdout:
2020-09-28T11:23:25.234 INFO:tasks.workunit.client.0.smithi026.stdout:  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
2020-09-28T11:23:25.246 INFO:tasks.workunit.client.0.smithi026.stdout:  │ Tests:        1                                                                                │
2020-09-28T11:23:25.246 INFO:tasks.workunit.client.0.smithi026.stdout:  │ Passing:      0                                                                                │
2020-09-28T11:23:25.247 INFO:tasks.workunit.client.0.smithi026.stdout:  │ Failing:      1                                                                                │
2020-09-28T11:23:25.248 INFO:tasks.workunit.client.0.smithi026.stdout:  │ Pending:      0                                                                                │
2020-09-28T11:23:25.248 INFO:tasks.workunit.client.0.smithi026.stdout:  │ Skipped:      0                                                                                │
2020-09-28T11:23:25.248 INFO:tasks.workunit.client.0.smithi026.stdout:  │ Screenshots:  1                                                                                │
2020-09-28T11:23:25.248 INFO:tasks.workunit.client.0.smithi026.stdout:  │ Video:        false                                                                            │
2020-09-28T11:23:25.248 INFO:tasks.workunit.client.0.smithi026.stdout:  │ Duration:     5 minutes, 40 seconds                                                            │
2020-09-28T11:23:25.248 INFO:tasks.workunit.client.0.smithi026.stdout:  │ Spec Ran:     orchestrator/04-osds.e2e-spec.ts                                                 │
2020-09-28T11:23:25.249 INFO:tasks.workunit.client.0.smithi026.stdout:  └────────────────────────────────────────────────────────────────────────────────────────────────┘
2020-09-28T11:23:25.249 INFO:tasks.workunit.client.0.smithi026.stdout:
2020-09-28T11:23:25.249 INFO:tasks.workunit.client.0.smithi026.stdout:
2020-09-28T11:23:25.249 INFO:tasks.workunit.client.0.smithi026.stdout:  (Screenshots)
2020-09-28T11:23:25.249 INFO:tasks.workunit.client.0.smithi026.stdout:
2020-09-28T11:23:25.250 INFO:tasks.workunit.client.0.smithi026.stdout:  -  /home/ubuntu/cephtest/clone.client.0/src/pybind/mgr/dashboard/frontend/cypress/s     (1280x720)
2020-09-28T11:23:25.250 INFO:tasks.workunit.client.0.smithi026.stdout:     creenshots/orchestrator/04-osds.e2e-spec.ts/OSDs page -- when Orchestrator is av
2020-09-28T11:23:25.251 INFO:tasks.workunit.client.0.smithi026.stdout:     ailable -- should create and delete OSDs (failed).png
2020-09-28T11:23:25.251 INFO:tasks.workunit.client.0.smithi026.stdout:
2020-09-28T11:23:25.251 INFO:tasks.workunit.client.0.smithi026.stdout:
2020-09-28T11:23:25.258 INFO:tasks.workunit.client.0.smithi026.stdout:================================================================================
2020-09-28T11:23:25.259 INFO:tasks.workunit.client.0.smithi026.stdout:
2020-09-28T11:23:25.259 INFO:tasks.workunit.client.0.smithi026.stdout:  (Run Finished)
2020-09-28T11:23:25.259 INFO:tasks.workunit.client.0.smithi026.stderr:tput: No value for $TERM and no -T specified
2020-09-28T11:23:25.260 INFO:tasks.workunit.client.0.smithi026.stdout:
2020-09-28T11:23:25.260 INFO:tasks.workunit.client.0.smithi026.stdout:
2020-09-28T11:23:25.262 INFO:tasks.workunit.client.0.smithi026.stdout:       Spec                                              Tests  Passing  Failing  Pending  Skipped
2020-09-28T11:23:25.262 INFO:tasks.workunit.client.0.smithi026.stdout:  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
2020-09-28T11:23:25.262 INFO:tasks.workunit.client.0.smithi026.stdout:  │ ✖  orchestrator/04-osds.e2e-spec.ts         05:40        1        -        1        -        - │
2020-09-28T11:23:25.262 INFO:tasks.workunit.client.0.smithi026.stdout:  └────────────────────────────────────────────────────────────────────────────────────────────────┘
2020-09-28T11:23:25.263 INFO:tasks.workunit.client.0.smithi026.stdout:    ✖  1 of 1 failed (100%)                     05:40        1        -        1        -        -
2020-09-28T11:23:25.263 INFO:tasks.workunit.client.0.smithi026.stdout:
2020-09-28T11:23:25.307 DEBUG:teuthology.orchestra.run:got remote process result: 1
2020-09-28T11:23:25.307 INFO:tasks.workunit:Stopping ['cephadm/test_dashboard_e2e.sh'] on client.0...

/a/teuthology-2020-09-28_07:01:02-rados-master-distro-basic-smithi/5476932

Actions
Copy link
 #1

Updated by Kiefer Chang over 3 years ago

The deleted OSD (id: 3) still exists after 5 minutes, need to investigate the reason.

Actions
Copy link
 #2

Updated by Neha Ojha over 3 years ago

  • Priority changed from Normal to Urgent

cephadm/test_dashboard_e2e.sh seems flaky, seeing a different failure

2020-10-01T07:57:28.823 INFO:tasks.workunit.client.0.smithi168.stdout:  0 passing (5m)
2020-10-01T07:57:28.823 INFO:tasks.workunit.client.0.smithi168.stdout:  1 failing
2020-10-01T07:57:28.823 INFO:tasks.workunit.client.0.smithi168.stdout:
2020-10-01T07:57:28.825 INFO:tasks.workunit.client.0.smithi168.stdout:  1) OSDs page
2020-10-01T07:57:28.825 INFO:tasks.workunit.client.0.smithi168.stdout:       when Orchestrator is available
2020-10-01T07:57:28.825 INFO:tasks.workunit.client.0.smithi168.stdout:         should create and delete OSDs:
2020-10-01T07:57:28.825 INFO:tasks.workunit.client.0.smithi168.stdout:
2020-10-01T07:57:28.825 INFO:tasks.workunit.client.0.smithi168.stdout:      Timed out retrying
2020-10-01T07:57:28.826 INFO:tasks.workunit.client.0.smithi168.stdout:      + expected - actual
2020-10-01T07:57:28.826 INFO:tasks.workunit.client.0.smithi168.stdout:
2020-10-01T07:57:28.826 INFO:tasks.workunit.client.0.smithi168.stdout:      -3
2020-10-01T07:57:28.826 INFO:tasks.workunit.client.0.smithi168.stdout:      +6
2020-10-01T07:57:28.826 INFO:tasks.workunit.client.0.smithi168.stdout:
2020-10-01T07:57:28.826 INFO:tasks.workunit.client.0.smithi168.stdout:      at Context.eval (https://smithi168:8443/__cypress/tests?p=cypress/integration/orchestrator/04-osds.e2e-spec.ts:308:61)
2020-10-01T07:57:28.826 INFO:tasks.workunit.client.0.smithi168.stdout:
2020-10-01T07:57:28.827 INFO:tasks.workunit.client.0.smithi168.stdout:
2020-10-01T07:57:28.827 INFO:tasks.workunit.client.0.smithi168.stdout:
2020-10-01T07:57:28.831 INFO:tasks.workunit.client.0.smithi168.stdout:
2020-10-01T07:57:28.832 INFO:tasks.workunit.client.0.smithi168.stdout:  (Results)
2020-10-01T07:57:28.835 INFO:tasks.workunit.client.0.smithi168.stdout:
2020-10-01T07:57:28.838 INFO:tasks.workunit.client.0.smithi168.stdout:  ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
2020-10-01T07:57:28.838 INFO:tasks.workunit.client.0.smithi168.stdout:  │ Tests:        1                                                                                │
2020-10-01T07:57:28.838 INFO:tasks.workunit.client.0.smithi168.stdout:  │ Passing:      0                                                                                │
2020-10-01T07:57:28.838 INFO:tasks.workunit.client.0.smithi168.stdout:  │ Failing:      1                                                                                │
2020-10-01T07:57:28.838 INFO:tasks.workunit.client.0.smithi168.stdout:  │ Pending:      0                                                                                │
2020-10-01T07:57:28.839 INFO:tasks.workunit.client.0.smithi168.stdout:  │ Skipped:      0                                                                                │
2020-10-01T07:57:28.839 INFO:tasks.workunit.client.0.smithi168.stdout:  │ Screenshots:  1                                                                                │
2020-10-01T07:57:28.839 INFO:tasks.workunit.client.0.smithi168.stdout:  │ Video:        false                                                                            │
2020-10-01T07:57:28.839 INFO:tasks.workunit.client.0.smithi168.stdout:  │ Duration:     5 minutes, 3 seconds                                                             │
2020-10-01T07:57:28.839 INFO:tasks.workunit.client.0.smithi168.stdout:  │ Spec Ran:     orchestrator/04-osds.e2e-spec.ts                                                 │
2020-10-01T07:57:28.839 INFO:tasks.workunit.client.0.smithi168.stdout:  └────────────────────────────────────────────────────────────────────────────────────────────────┘

/a/teuthology-2020-10-01_07:01:02-rados-master-distro-basic-smithi/5485887

Actions
Copy link
 #3

Updated by Neha Ojha over 3 years ago

/a/teuthology-2020-10-01_07:01:02-rados-master-distro-basic-smithi/5486069

Actions
Copy link
 #4

Updated by Neha Ojha over 3 years ago

/a/yuriw-2020-10-01_20:53:30-rados-wip-yuri-testing-2020-10-01-1128-distro-basic-smithi/5487068

Actions
Copy link
 #5

Updated by Kiefer Chang over 3 years ago

I created another issue #47742 to tracker the error in comment 2, 3, and 4.
The error says the OSDs are not created.

Actions
Copy link
 #6

Updated by Neha Ojha over 3 years ago

  • Status changed from New to Can't reproduce
Actions
Copy link
 #7

Updated by Ernesto Puerta about 3 years ago

  • Project changed from mgr to Dashboard
  • Category changed from 185 to Component - Orchestrator
Actions
Copy link

Also available in: Atom PDF