Skip to main content

Flaky test cases table (TOP-50)

Shows the TOP-50 the most flaky test cases within the specified previous launches.

The test case is displayed in the table if test case status has changed at least once from Passed to Failed or from Failed to Passed in the specified previous launches.

Widget's parameters:

  • Launches count: 2-100. The default meaning is 30.

  • Launch name: required filed.

  • Include Before and After methods: optional.

Widget view

The widget has a table view with the following data displayed:

  • Test Case - link to the Step level of the last launch.
  • Switches - count of found results with often switches.
  • % of Switches - the percent of the fact switches and the possible.
  • Last switch - date and time of the last run, when the test item switches the status, displayed in “time ago” format (i.e. “10 minutes ago”).

On mouse hover, the system will display accurate start times.

note

In “Switches” column only Passed and Failed statuses are displayed (Passed - green, Failed - red).

important

The number of switches from one state to another of the test case with the same uniqueID is displayed in the format N from M where:

N is the number of changes of statuses.

M is the number of all possible changes of the item in selection (number of item runs=number of test executions minus number of executions with status Skipped minus 1).

On mouse hover, tooltip appears “N status changes from M possible times”.