Out-of-the-Box Tests
During onboarding, Revenue Shield generates five automated tests that cover the most critical revenue paths on any Shopify store. These tests run without any configuration and adapt to your store's specific products and structure.
How OOTB Tests Are Generated
Revenue Shield reads your store's product catalog, collections, and storefront URL via the Shopify API. It then uses AI to select appropriate products, collections, and search terms that reflect real customer behavior on your specific store. The AI generates Playwright test scripts that navigate your live storefront in a real browser, interact with actual page elements, and verify that each step completes successfully.
The result is a test suite that is unique to your store, not a generic template. If your store sells shoes, the tests will navigate your shoe collections and add shoes to cart. If your store has a specific search experience, the search test will use terms that match your catalog.
The Five Standard Tests
1. Homepage to Product
This test loads your store's homepage, identifies a product link or featured product element, clicks through to the product detail page (PDP), and verifies the PDP renders with expected content (product title, price, images, and an add-to-cart button).
What it catches: Broken homepage navigation, missing product links, PDP rendering failures, JavaScript errors that prevent page load.
2. Collections to Product
This test navigates to a collection page, selects a product from the collection grid, and confirms the product detail page loads correctly. It validates that the collection-to-product browsing path is intact.
What it catches: Broken collection pages, missing product cards, filtering or sorting issues that hide products, failed transitions from collection to PDP.
3. Product to Cart
This test visits a product detail page, clicks the add-to-cart button, and verifies that the cart updates to reflect the added item. It checks both the cart count indicator and the cart page contents.
What it catches: Broken add-to-cart functionality, JavaScript errors from app conflicts, variant selection failures, cart API errors.
4. Search to Product
This test uses your store's search functionality to search for a known product term, verifies that results appear, clicks on a search result, and confirms the product page loads. It covers the full search-to-product discovery path.
What it catches: Broken search functionality, empty search results for valid terms, search-to-PDP navigation failures, search indexing issues.
5. Cart to Checkout
This test opens the cart page (with items already added) and proceeds to the Shopify checkout page. It verifies that the checkout page loads and the customer can begin entering their information. Revenue Shield does not complete a purchase or enter payment details.
What it catches: Cart-to-checkout transition failures, checkout page loading errors, payment gateway initialization failures, redirect issues.
Why These Five Tests
These five flows represent the minimum viable path a customer takes to complete a purchase on any Shopify store. If any one of them is broken, revenue is being lost. Together, they cover:
- Product discovery (homepage, collections, search)
- Purchase intent (add to cart)
- Transaction initiation (proceed to checkout)
Most silent revenue failures occur somewhere in these five paths. By monitoring them continuously, Revenue Shield detects the majority of checkout-breaking issues within minutes of their occurrence.
Customization
OOTB tests are fully managed by Revenue Shield and update automatically through the self-healing system. You do not need to edit or maintain them. If you want to test additional flows beyond the five standard tests, you can create custom tests from the dashboard.