Project

General

Profile

Tasks #47497

mgr/dashboard: add visual regression testing

Added by Ernesto Puerta 4 months ago. Updated 4 months ago.

Status:
New
Priority:
Normal
Assignee:
-
Category:
dashboard/UI
Target version:
% Done:

0%

Tags:
testing
Reviewed:
Affected Versions:
Pull request ID:

Description

Currently cypress framework supports visual regression testing (comparing screenshots of a webpage/subpart under test with a given reference screenshot).

This will help reduce issues with styling/brandind changes and reduce the needs of manual testing & validation.

Downsides of this approach:
  • As already noted by Tiago, is that most pages are data driven, and hence dynamically changing. That makes hard to compare to fixed screenshots.
    • We can either test isolated/static elements of webpages (login page, about box, navigation, forms, ...)
    • Provide a given threshold for the matching algorithm (this would require manual tuning and hence is subject to making the test flapping)
    • Test isolated elements without back-end data: allowing dashboard to instantiate components (blank table, static landing page, ...)
    • Ensure the backend provides 'deterministic data' (feasible?)
    • Hide changing data by tagging those with some class (.dynamic) and making those invisible or deterministic.

History

#1 Updated by Ernesto Puerta 4 months ago

  • Description updated (diff)

Also available in: Atom PDF