Test Results & Evidence

Every test run produces a complete evidence record. The Revenue Shield dashboard gives you a clear view of test status, run history, and the artifacts captured during each execution.

Dashboard Overview

The main dashboard displays the current status of each test in your suite. Each test shows:

• Status — Pass (green) or Fail (red) based on the most recent run
• Last run time — When the test last executed
• Next scheduled run — When the test will run again
• Run streak — Consecutive passes or failures

This view gives you an at-a-glance understanding of your store's checkout health without needing to drill into individual runs.

Run History

Click on any test to view its full run history. Each entry in the history includes:

• Pass or fail status
• Execution timestamp
• Total run duration
• Links to artifacts (screenshots, video, trace)

Run history is retained based on your plan's data retention period (7 days for Free, 30 days for Starter and Growth, 90 days for Agency).

Artifacts

Screenshots

Revenue Shield captures screenshots at key checkpoints during each test and on any failure. Screenshots are stored as PNG files and can be viewed directly in the dashboard or downloaded. On failure, the screenshot shows the exact state of the page when the test assertion did not pass.

Video Recordings

Every test run records a full video of the browser session. The video shows exactly what happened from the moment the browser opened your store to the point where the test completed or failed. Videos can be played directly in the dashboard or downloaded as WebM files.

Trace Files

Playwright trace files are captured for each run. These can be opened in the Playwright Trace Viewer for detailed step-by-step debugging, including DOM snapshots, network requests, and console output at each action.

Console Errors

Any JavaScript errors or warnings that appear in the browser console during a test run are captured and displayed alongside the test results. Console errors are often the first indicator of what caused a failure, especially when third-party scripts or app conflicts are involved.

Pass and Fail States

A test passes when every step in the flow completes successfully and all assertions are met. A test fails when any step does not complete within the expected timeout or an assertion returns false.

Common failure scenarios:

• An element (button, link, form field) is not found on the page
• A page does not load within the timeout period
• The cart does not update after an add-to-cart action
• The checkout page does not render after proceeding from cart

Exporting Data

On the Growth plan and above, you can export test results as CSV files. Exports include test name, status, timestamp, duration, and failure details for each run in the selected date range. This is useful for reporting, compliance, and sharing results with development teams.

Data Retention

Plan	Retention Period
Free	7 days
Starter	30 days
Growth	30 days
Agency	90 days

After the retention period, test results and artifacts are permanently deleted.