Split Test Pro brings together the variant types, statistical rigor, and AI tooling that the biggest ecommerce teams pay enterprise prices for — at a price that makes sense for any store.
Test anything from a button color to a whole new theme. Style changes with CSS, content and DOM rewrites with JavaScript, A/B two entirely different URLs with redirect variants — and on Shopify, test an unpublished theme against your live one or an alternate product, collection, page or blog post template against the default.
AI
AI-powered anomaly detection
Split Test Pro watches every running experiment for sample-ratio mismatches, traffic drops, novelty effects, and trend divergence — surfacing problems before they cost you a quarter.
AI
Splitty, the AI test builder
Click Create with AI and Splitty opens on your own page: answer a few questions, pick a test idea, and it builds variants, targeting and traffic split — ready to launch or save as a draft.
Stats
Bayesian statistics
Beta-Binomial models for conversion tests, Normal distributions for revenue and engagement. Get probability-to-be-best and credible intervals — not p-values you have to interpret.
Stats
Continuous metrics
Move beyond binary conversions. Track revenue per session, AOV, and engagement value — Split Test Pro models them with full distributions, not just averages.
AI
AI results review
When an experiment ends, get a Claude-powered analysis with key findings, a clear recommendation (ship, iterate, or revert), and a projected revenue impact.
Variants
Variant screenshots
Auto-captured renders of every variant against your real page, so you can verify your CSS or JS actually applied — before a single visitor sees it.
Insights
Device & segment analysis
Slice results by desktop, tablet, and mobile to see how variants perform across audiences. Targeting, too: run tests for specific devices only.
Targeting
Precise URL & event targeting
Target by full URL, host, path, or fragment — and defer activation until a click, scroll, or custom event fires. Test only the visitors you care about.
Targeting
Custom traffic allocation
50/50 by default — or weight any way you want. Roll out risky variants to 10%, run multi-variant tests, or scale traffic to a winner gradually.
Platform
Works on any website
Drop a single script tag on any site to start testing — or install our Shopify app for a deeper integration with native funnel tracking. Same dashboard, same features, same stats either way.
Insights
Google Analytics 4 integration
Fires the standard experience_impression event so you can build GA4 audiences, segment your funnel by variant, and combine Split Test Pro with your full GA reporting.
Platform
Server-side testing & feature flags
Feature flags with rollouts and kill switches that your backend evaluates over a REST API or the Node SDK, and experiments whose variants set flag values — with exposures and conversions in the same Bayesian results. Included in every paid plan.
Platform
Team workspaces & invites
Invite teammates with Owner or Member roles, manage multiple stores from one account, and collaborate on experiments without sharing logins.
Insights
Real-time results dashboard
Results stream in continuously as events arrive — no batch jobs, no waiting overnight. Watch probability-to-be-best update live.
Four test types, one platform
Most A/B testing tools force you into a single mode — visual editor only, or hand-written JS only. Split Test Pro lets you mix and match: CSS for safe styling tweaks, JavaScript for content and DOM rewrites, redirect variants when you want to compare two completely different pages, and on Shopify theme tests and template tests that pit an unpublished theme or an alternate template against your live store. One variant can combine them.
Every variant is sandboxed and screenshot-verified before it goes live, so you catch broken selectors before your customers do.
02
Traffic allocation
Set the percentage of total traffic for each experience.
Traffic allocationSplit evenly
Control34%
Variant A33%
Variant B33%
AI that catches what you'd miss
Split Test Pro runs continuous anomaly checks on every live experiment. We detect sample-ratio mismatches, sudden traffic drops, zero-conversion variants, novelty effects, day-of-week patterns, and runaway tests — before they wreck your data.
Before launch, live checks flag a missing goal, page rule or variant, and Splitty can build the test for you. After the test, Generate analysis summarises the result and projects the revenue impact. You make the call — but you make it informed.
Sample-ratio mismatch detected
Variant B is receiving 62% of traffic, allocation is 50%.
AI-detected
Sample ratio normalized
Allocation back in balance after reweighting.
AI-detected
Conversion gap narrowing
Possible novelty effect on Variant A — re-checking in 24h.
AI-detected
Traffic dropped on Variant B
Down 38% in the last 4 hours — investigating cause.
AI-detected
Targeting matches 0 pages
URL pattern /products/* doesn't match any current pages.
AI-detected
Launch checks passed
Goal, page rule and variants all set.
AI-detected
Variant B reaches significance
88% probability to be best — projected lift +$8,400 / mo.
AI-detected
Time-to-significance revised
5 more days at current traffic to reach a winner.
AI-detected
Bayesian stats, in plain English
Most A/B tools show p-values. Split Test Pro shows you what you actually want to know: "What's the probability this variant is the best?" and "What's the likely lift?" — backed by Beta-Binomial models for conversions and Normal distributions for revenue and engagement.
You see credible intervals, not significance thresholds. You see expected revenue impact, not asterisks. And the answer updates in real time as data streams in.
Conversion rate comparisonCollecting data
Control4.03%
Variant A4.53%
Variant B4.19%
+12.4% uplift · Variant A
Variant A has a 12.4% higher conversion rate than control, the best of the 2 variants.
96.0%
Chance to beat control · Variant A
Moderate confidence
Results are still uncertain. Most teams wait for 95% before choosing a winner.
Very high confidence
Variant A has cleared the 95% mark most teams wait for.
Up and running in minutes
Paste a script tag on any website, or install our Shopify app from the App Store — either way, you're collecting data the same day with no engineer required.
Same dashboard, same stats engine, same AI tooling, wherever your store lives. No platform lock-in.
Snippet
<script
src="https://app.splittestpro.com/experiment.js"
data-api-key="YOUR_API_KEY"
data-api-url="https://app.splittestpro.com"
crossorigin="anonymous"
></script>
Activating…
Split Test Pro is active on your-store.com
Run your first test. Ship a winner.
Sign up free in under a minute — no credit card, no installation steps until you're ready.
