Squoosh AI
  • Blog
  • Partners
Sign inBook a demo→
Squoosh AI
  • Blog→
  • Partners→
  • Sign in→
Book a demo→
← BlogInsightsOctober 13, 2026

You have more test ideas than traffic

A live A/B test takes weeks of traffic, and most teams have a long list of ideas. Here is the arithmetic, and how to choose which ideas get the traffic.

ST
Squoosh Team
Insights
2 min read
You have more test ideas than traffic

Every growth team we talk to has the same problem, and it is not a shortage of ideas. It is a shortage of traffic to test them on.

The arithmetic

A live A/B test needs enough visitors on both versions to tell a real change from chance. How many depends on how often visitors convert and how big a change you hope to see.

Take a page where 3 in 100 visitors convert, and a change that lifts that by a tenth, from 3.0% to 3.3%. At the usual 95% confidence and 80% power, you need about 53,000 visitors on each version, so about 106,000 in all. A page with 30,000 visitors a month takes about three and a half months to answer that one question.

Now put ten ideas in the queue. Run one at a time, that is nearly three years of waiting. The list grows faster than the tests finish.

What teams do about it

Most teams do one of three things. They pick the idea they like best and test only that. They bundle several changes into one big test, which leaves them unable to say which change did the work. Or they ship without testing and hope.

Each one gives up what the test was for.

Test the ideas before you spend traffic on them

There is a way to keep every idea and still spend traffic carefully: run each idea past a village before it meets a live visitor.

Squoosh builds a village of AI people modeled on your customers, shows every version to the same villagers, and ranks the versions in under an hour. The comparison is fair because every idea meets the same village. The ideas at the top of the ranking are the ones worth weeks of live traffic. The rest can wait, or turn out not to need a test at all.

The live test still has the last word. The village decides which ideas go first.

How to use it

  • Write down every idea. Include the small ones. A long list is the point.
  • Run them all. Each idea is a version for the village to try, so adding one costs little.
  • Send the top one or two to live traffic. Spend your weeks of traffic where the ranking says the payoff is largest.
  • Compare as you go. When live results come in, check them against the ranking.

If your pages do not get much traffic, A/B testing without traffic goes through the same idea in more detail. More ideas than traffic is a good problem to have. The village lets you keep all the ideas and spend the traffic on the best ones.

Keep exploring

  • What is synthetic A/B testing?
  • See the Squoosh AI benchmark
  • Why bundling changes into one test backfires
  • Squoosh Bench: UX-1 on 318 real A/B tests

The Squoosh Dispatch

New research,
straight to your inbox.

Deep dives, release notes, and benchmarks. No promos, no tracking beyond the clicks.

Squoosh AISquoosh AI

We simulate how humans interact with digital experiences, so you can see what works before it goes live.

Product

  • Overview
  • How it works
  • Benchmark
  • Your data

Company

  • Partners
  • Careers
  • Press

Resources

  • Blog
  • Documentation
  • Support

Legal

  • Terms
  • Privacy
  • Trust center
© 2026 Squoosh, Inc.