Test Scheduling
Revenue Shield runs your tests on a configurable schedule using a cron-based system. The cadence you choose determines how quickly you are alerted to checkout failures.
Cadence Options by Plan
Each plan includes a minimum cadence. You can always set a longer interval, but not a shorter one than your plan allows.
| Plan | Minimum Cadence | Available Options |
|---|---|---|
| Free | 8 hours | 8h, 24h |
| Starter ($39/mo) | 1 hour | 1h, 2h, 4h, 6h, 12h, 24h |
| Growth ($79/mo) | 1 hour | 1h, 2h, 4h, 6h, 12h, 24h |
| Agency ($199/mo) | 15 minutes | 15min, 30min, 1h, 2h, 4h, 6h, 12h, 24h |
How Scheduling Works
Revenue Shield uses a cron-based scheduler (APScheduler) running on the backend. When you set a cadence, the system creates a recurring job that triggers your full test suite at the specified interval. Each scheduled run executes all of your active tests (both OOTB and any custom tests) in sequence.
The scheduler operates independently of your store's traffic patterns. Tests run at consistent intervals whether your store has zero visitors or peak traffic. This ensures that failures are detected even during off-hours when manual testing would not occur.
Timezone Support
By default, Revenue Shield uses the timezone configured in your Shopify store settings. You can override this in Settings → Scheduling if you prefer a different timezone for scheduling purposes.
All timestamps displayed in the dashboard, test results, and alert notifications reference your configured timezone.
Manual Triggers
You can trigger a test run at any time from the Revenue Shield dashboard by clicking Run Now. Manual runs execute the full test suite immediately, regardless of the scheduled cadence. They count toward your plan's monthly run allocation.
Manual triggers are useful for:
- Verifying that a fix resolved a reported failure
- Checking your store after a theme update or new app installation
- Running an immediate check before a high-traffic event
Run Limits
Each plan includes a monthly allocation of test runs:
- Free — 93 runs/month
- Starter — 4,000 runs/month
- Growth — Unlimited
- Agency — Unlimited
A single run includes the execution of all active tests in your suite. If you have five OOTB tests, one run executes all five. The dashboard displays your current run count and remaining allocation for the billing period.
Scheduling Best Practices
- High-GMV stores — Use the shortest cadence your plan allows. At $100K+/month in revenue, every hour of undetected checkout failure is significant.
- Peak seasons — Consider upgrading to Agency for 15-minute cadence during BFCM, holiday sales, or major launch events.
- Development stores — The Free plan's 3-times-daily cadence is sufficient for stores in development or staging.
- After deployments — Always trigger a manual run after deploying theme changes, installing apps, or updating store configuration.