Insights and Analytics

Tests and Runs insights and analytics guide

Currents Dashboard Insights allows you to analyze the behaviour and dynamics of your Playwright or Cypress test suite over time. You can use the insights to track the performance of your runs/build and tests over time and to identify the most problematic tests - most flaky and most failing - that are worth fixing.

See the notes below to discover how specific metrics are getting calculated.

Runs Status

Represents distribution of the outcomes of your builds/runs over time.

  • Overall runs - overall runs created during the selected period, regardless of their completion or the end state

  • Failed runs - runs that have 1 or more failed tests. Failed runs count includes cancelled and timed-out tests.

  • Passed runs - runs that have 0 failed tests. Passed runs count includes cancelled and timed-out tests.

  • Pass Rate - passed runs / overall runs

Runs Duration

Runs Duration chart represents the daily/weekly average duration of fully reported runs. A fully reported run is a run that wasn't cancelled and didn't time out.

Please note that cancelled or timed-out runs are excluded from the report.

Runs Completion

Runs Completion chart represents the distribution of runs by their completion over time.

  • Overall runs - overall runs created during the selected period, regardless of their completion or the end state

  • Fully reported runs - runs that weren't cancelled and didn't time out

  • Cancelled runs - see Canceling Runs

  • Timed out runs - see Run Timeouts

Spec / Tests Size Chart

Specs / Tests size chart represents the maximum daily/weekly amount of specs/tests for fully completed runs. A fully reported run is a run that wasn't cancelled and didn't time out.

Please note that cancelled or timed-out runs are excluded from the report.

  • Spec files - the maximum number of spec files detected in a run for the selected period

  • Tests - the maximum number of tests detected in a run for the selected period

Test Results Chart

Test Results Chart shows the distribution of tests outcome over time.

  • Total tests - overall tests recorded for the selected period, regardless of their outcome

  • Passed tests - tests that successfully completed all attempts without any exceptions or errors during its execution

  • Failed tests - tests that either failed or were skipped because of an error in beforeEach/beforeAll

  • Ignored test - tests that weren't run e.g. it.skip()

  • Success Rate - passed / (total - pending)

Tests Flakiness Chart

Test Results Chart shows the distribution of flaky tests over time.

  • Flaky tests - overall flaky tests detected for the period. See Flaky Tests

  • Flakiness rate - flaky tests count / passed tests count

Last updated