Project

General

Profile

Cleanup #47118

mgr/dashboard: export test results in JUnit format

Added by Ernesto Puerta 5 months ago. Updated 4 months ago.

Status:
Resolved
Priority:
Normal
Assignee:
-
Category:
dashboard/general
Target version:
% Done:

0%

Tags:
Backport:
Reviewed:
Affected Versions:
Pull request ID:

Description

Jenkins support JUnit test output by means of the already installed JUnit plugin. This can help to better understand Jenkins failures (as it allows Jenkins to distinguish between build and testing failures). Additionally, it provides historical charts of number of tests failed, time to complete, improved error messages, it can be integrated with other Jenkins plugins (like Test Result Analyzer), and other features like coverage.

JUnit support could be added to the following dashboard tests:
  • make check: ctest might output XML with ctest -T Test, but the XML generated is not JUnit compatible. It either needs Jenkins XUnit Plugin instead. This XSL could also be tried to convert CTest XML into JUnit XML.
  • Dashboard front-end e2e tests: Cypress supports JUnit
  • API tests: while nose and pytest have native support for JUnit, we are using unittest, which does not. However, a third party tool (unittest-xml-reporting) can do the trick.

History

#1 Updated by Ernesto Puerta 5 months ago

  • Description updated (diff)

#2 Updated by Ernesto Puerta 5 months ago

  • Description updated (diff)

#3 Updated by Ernesto Puerta 5 months ago

  • Description updated (diff)

#4 Updated by Ernesto Puerta 5 months ago

  • Status changed from New to In Progress
  • Pull request ID set to 36771

#5 Updated by Lenz Grimmer 4 months ago

  • Status changed from In Progress to Resolved
  • Target version set to v16.0.0

Also available in: Atom PDF