Project

General

Profile

Actions

Feature #10240

closed

expand test coverage for the upgrade suites

Added by Tamilarasi muthamizhan over 9 years ago. Updated about 9 years ago.

Status:
Resolved
Priority:
High
Category:
-
Target version:
% Done:

0%

Source:
Q/A
Tags:
Backport:
Reviewed:
Affected Versions:

Description

currently, upgrade suites have been optimized to run upgrades in parallel to a pile of mixed workloads[rados/rbd/rgw] thereby in most cases, upgrade gets over before some of the workloads actually run. so it appears like most workloads run post upgrade which is not much useful.

there are 2 things we can do to expand the test coverage for upgrades here,
1. run multiple combinations of mixed workloads when upgrade is running in parallel and also cover different upgrade sequences.
2. run a few workloads in parallel by itself, while upgrade is happening.also, for different upgrade sequences.

currently, the upgrade suite structure looks like,

ceph-qa-suite/suites/upgrade/<release>/parallel/workload/[+,rbd,rados,rgw]

for option 1, we need something like
ceph-qa-suite/suites/upgrade/<release>/parallel/workload/test1/[+ , rbd, rados, rgw]
ceph-qa-suite/suites/upgrade/<release>/parallel/workload/test2/[+, rbd,rados,rgw]
where test1, test2 have different workloads for rados/rbd/rgw.

for option2:
ceph-qa-suite/suites/upgrade/<release>/parallel/workload/[+, rbd, rados, rgw] where all the rbd,rados, rgw tasks run in parallel with upgrades.


Related issues 2 (0 open2 closed)

Related to teuthology - Feature #10233: Modify upgrade suites to run all workloads in parallelResolvedYuri Weinstein12/03/2014

Actions
Related to teuthology - Feature #10704: Implement "expand test coverage for the upgrade suites" for giant-x suiteResolvedYuri Weinstein01/30/2015

Actions
Actions #1

Updated by Yuri Weinstein over 9 years ago

  • Target version set to sprint19
Actions #2

Updated by Yuri Weinstein over 9 years ago

  • Description updated (diff)
Actions #3

Updated by Yuri Weinstein over 9 years ago

  • Status changed from New to In Progress
Actions #4

Updated by Zack Cerza over 9 years ago

  • Target version changed from sprint19 to sprint20
Actions #5

Updated by Yuri Weinstein over 9 years ago

  • Status changed from In Progress to 7
Actions #6

Updated by Yuri Weinstein over 9 years ago

For /upgrade/firefly-x/parallel/2-workload/ implemented two sub-dirs
parallel_run
sequential_run

First runs all workloads in parallel with upgrades and the seconds a la the old style - sequentially.

Test runs can complete only after http://tracker.ceph.com/issues/10270 fixed.

Possible next steps:
1. Add more workloads
2. Implement similar changes to other upgrades suites.

Tamil, pls comment and assign back to me.

Actions #7

Updated by Yuri Weinstein over 9 years ago

  • Status changed from 7 to Fix Under Review
  • Assignee changed from Yuri Weinstein to Tamilarasi muthamizhan
Actions #8

Updated by Zack Cerza over 9 years ago

  • Target version changed from sprint20 to sprint21
Actions #9

Updated by Yuri Weinstein over 9 years ago

See https://github.com/ceph/ceph-qa-suite/pull/293

Note:

- added test_cache-pool-snaps.yaml to both sequential_run and parallel_run dirs
- parallel_run has +
- sequential_run does not have +

Test run results - http://pulpito.front.sepia.ceph.com/teuthology-2015-01-12_10:50:31-upgrade:firefly-x-next-distro-basic-vps/

Actions #10

Updated by Zack Cerza about 9 years ago

  • Target version changed from sprint21 to sprint22
Actions #11

Updated by Zack Cerza about 9 years ago

  • Target version changed from sprint22 to sprint23
Actions #12

Updated by Zack Cerza about 9 years ago

  • Target version changed from sprint23 to sprint24
Actions #13

Updated by Zack Cerza about 9 years ago

  • Target version changed from sprint24 to sprint25
Actions #14

Updated by Yuri Weinstein about 9 years ago

  • Status changed from Fix Under Review to Resolved

All done, pls add a new ticket with more requirements for tests.

Actions

Also available in: Atom PDF