Convertibles vs SplitTesting.com: CRO Agency Comparison (2026)
Convertibles and SplitTesting.com are both execution-focused ecommerce CRO agencies, which makes this one of the closer calls on this site. SplitTesting.com, founded in New York by Dylan Ander and now part of the growth agency Acadia, runs data-driven CRO with its own AI-recommendation tool and a public 90-day money-back guarantee. Convertibles is an independent Shopify Plus specialist for $2M+ DTC brands that bundles testing, landing pages, speed, dev, and Google plus YouTube Ads under one team.
This page lays out where each fits, where they overlap, and how to pick.
At a Glance
- Convertibles: Shopify Plus only. Agency launched 2023, founding team brings 10+ years of prior Shopify development experience and a successful 8-figure brand exit. Full-stack DTC growth (CRO plus landing pages plus speed plus dev plus paid media). Multi-variation testing default (2 to 4 variants per test). Official Intelligems partner. 36 published case studies with $2.3M+/month in aggregate measured lift.
- SplitTesting.com: Founded in New York by Dylan Ander, an ecommerce operator who built and exited two brands before starting the agency; SplitTesting.com was later acquired by Acadia, a full-service growth agency. Data-driven CRO for ecommerce with a dedicated Shopify CRO service, full website overhauls, landing pages, a proprietary AI-recommendation tool for test predictions, and a publicly stated 90-day money-back guarantee. Recognized by Forbes as a top ecommerce marketing agency and partnered with UX firm Oddit since 2022. Contact form lists engagement budgets from under $5,000 to $20,000+/month.
- Pick Convertibles if: you are a $2M+ DTC brand on Shopify Plus and want an independent specialist where one team ships the tests and runs Google and YouTube Ads, with every published result measured at 95% significance.
- Pick SplitTesting.com if: you want a published money-back guarantee, you are not exclusively on Shopify, or you want access to the wider Acadia stack (paid media, SEO, retail media, analytics) around the CRO work.
Side-by-Side Comparison
| Dimension | Convertibles | SplitTesting.com |
|---|---|---|
| Platform focus | Shopify Plus specialist | Ecommerce broadly, with a dedicated Shopify CRO service line |
| Ownership | Independent, founder-operated | Part of Acadia (full-service growth agency) |
| Service scope | CRO, landing pages, speed, dev, Google plus YouTube Ads | CRO, full website overhauls, landing pages, data and creative audits; paid media, SEO, and retail media via parent Acadia |
| Paid media | Yes, inside the same team (Google plus YouTube Ads) | Not on SplitTesting.com's own service pages; available through Acadia as separate services |
| Testing approach | Multi-variation (control plus 2 to 4 variations) through Intelligems | Data-driven split testing guided by a proprietary AI-recommendation tool |
| Research toolkit | Analytics, session data, test archive across 1,000+ run tests | Dropoff analysis, heatmaps, user testing, surveys, eye mapping, AI test predictions |
| Guarantee | Discussed on strategy calls, scoped per engagement | 90-day money-back guarantee, publicly stated |
| Engagement gate | $2M+ annual revenue, Shopify Plus | Budget tiers listed from under $5,000 to $20,000+/month |
| Headline claims | 36 published case studies, $2.3M+/month aggregate measured lift | Clients citing 2x-5x conversion increases; Forbes top-agency recognition |
When Convertibles Is the Better Fit
You want one independent team, not an agency inside a holding group
Since the Acadia acquisition, SplitTesting.com's CRO sits alongside paid media, SEO, retail media, and analytics as separate service lines under one parent. That breadth is useful, but cross-service coordination is still cross-team coordination. Convertibles keeps testing, dev, speed, and Google plus YouTube Ads inside one small team, so a winning test changes ad creative the same week without a handoff.
You are on Shopify Plus and want platform depth as the default
SplitTesting.com serves ecommerce broadly with Shopify as one strong service line. Convertibles works on Shopify Plus only: checkout extensibility, theme architecture, app-stack conflicts, and speed are daily work, not one vertical among several.
You buy on published, test-level proof
Convertibles publishes 36 individual case studies with the variant, the lift, the significance level, and the monthly revenue impact stated. SplitTesting.com's public proof leans on testimonials and aggregate claims like 2x-5x conversion increases. If you want to inspect exactly what a test looked like before hiring the team that ran it, the published archive is the difference.
When SplitTesting.com Is the Better Fit
You want a published money-back guarantee
SplitTesting.com states a 90-day money-back guarantee on its site. Convertibles discusses terms on strategy calls but does not publish guarantees. If a stated risk-reversal is how you de-risk agency decisions, they lead on that.
You want one parent covering CRO plus retail media, SEO, and more
Through Acadia, SplitTesting.com sits next to Amazon and retail media management, paid media, SEO, and analytics services. A brand consolidating many channels under one holding group gets more surface area there than Convertibles, which deliberately stops at CRO plus Google and YouTube Ads.
You are below the $2M revenue gate or off Shopify
SplitTesting.com lists budget tiers starting under $5,000/month and serves ecommerce stores beyond Shopify. Convertibles' $2M+ Shopify Plus gate exists because multi-variation testing needs traffic; if you are not there yet, an agency built for your stage serves you better.
Testing Methodology Comparison
SplitTesting.com runs a research-heavy intake: data and creative audits, dropoff analysis, heatmaps, user testing, surveys, and eye mapping, with a proprietary AI-recommendation tool predicting which split tests to prioritize. The founder-built angle is real: Dylan Ander scaled and exited two ecommerce brands before starting the agency, and that operator lens shows in the cost-per-visit framing of its positioning.
Convertibles runs multi-variation tests (control plus 2 to 4 variations) through Intelligems, prioritized from analytics and an archive of 1,000+ tests run on Shopify Plus stores, with every published winner reaching 95% statistical significance before shipping to all traffic. Less tooling variety in the intake, more shipped variants per test cycle.
The honest framing: both agencies believe in data over opinions. The difference is what surrounds the testing: an AI-assisted audit engine inside a holding group versus a single-platform team that also owns dev and ads.
Proof and Track Record
Convertibles
36 published case studies, each an individual test with the result, significance level, and revenue impact stated, totaling $2.3M+/month in aggregate measured lift. Public client endorsements from Jones Road Beauty, Performance Golf, and Gymreapers. Proof is test-level and named.
SplitTesting.com
Client testimonials citing 2x-5x conversion-rate increases, Forbes recognition as a top ecommerce marketing agency, a 2022 partnership with UX firm Oddit, and the credibility of an exit to Acadia. Proof is testimonial-level and recognition-weighted.
The Bigger Picture
SplitTesting.com is what a strong operator-founded CRO agency looks like after a successful exit: absorbed into a larger growth platform, with more services around it and the founder moved on to new ventures. Convertibles is at the other end of that arc: independent, founder-operated, and deliberately narrow. Neither position is better in the abstract; they trade off breadth and institutional backing against focus and direct founder involvement. Pick based on which trade your brand needs this year.
Frequently Asked Questions
Is Convertibles the same kind of agency as SplitTesting.com?
Close, with two structural differences. Both are execution-focused ecommerce CRO agencies, but SplitTesting.com serves ecommerce broadly as part of the Acadia growth group, while Convertibles is an independent Shopify Plus specialist that bundles dev and Google plus YouTube Ads into one team for $2M+ DTC brands.
Who owns SplitTesting.com?
SplitTesting.com was founded in New York by Dylan Ander, who built and exited two ecommerce brands before starting the agency. It was later acquired by Acadia, a full-service growth agency covering retail media, paid media, SEO, CRO, and analytics.
Does SplitTesting.com or Convertibles run paid media?
Convertibles runs Google and YouTube Ads inside the same team that runs CRO. SplitTesting.com's own service pages focus on CRO; paid media, SEO, and retail media are available through its parent Acadia as separate service lines.
Does either agency offer a money-back guarantee?
SplitTesting.com publicly states a 90-day money-back guarantee. Convertibles does not publish guarantees; engagement terms are discussed on strategy calls and scoped per client.
Who is better for Shopify Plus brands specifically?
For $2M+ Shopify Plus DTC brands that want platform-exclusive depth with dev and paid media in one team, Convertibles is the more direct fit. SplitTesting.com also has a dedicated Shopify CRO service and fits brands that want the Acadia stack or a published guarantee.
What is the pricing comparison between Convertibles and SplitTesting.com?
Neither agency publishes exact pricing. SplitTesting.com's contact form lists monthly budget tiers from under $5,000 to $20,000+. Convertibles uses a flexible engagement model scoped per client and works with $2M+ DTC Shopify Plus brands.
How does each agency prove results?
Convertibles publishes 36 individual case studies, each reaching 95% statistical significance and shipped to 100% of traffic, totaling $2.3M+/month in aggregate measured lift. SplitTesting.com leads with client testimonials citing 2x-5x conversion increases and Forbes recognition. Convertibles' proof is test-level and named; SplitTesting.com's is testimonial-level and recognition-weighted.
Ready to Decide?
If you are a $2M+ DTC brand on Shopify Plus, book a strategy call and we will walk you through what a Convertibles program would look like on your store, including which tests we would run first and why.
Weighing other agencies too? See our Convertibles vs SplitBase comparison for the research-led DTC peer, or our Convertibles vs CRO Media comparison for the audit-led Shopify peer.