Key takeaways
- Cost to fake is the variable that separates validation from encouragement: A signal becomes reliable in proportion to what the person who gave it spent in money, time, or reputation. Most "validated" ideas have evidence only from the cheapest tiers.
- Waitlist signups convert to paying customers at roughly 3%: According to Gaurav Vohra's 2025 analysis. The rate halves with each year on the list, and the waitlist vendors publishing signup benchmarks do not quote it.
- Sample size thresholds vary by signal tier: At a 6.6% average landing page conversion rate (Unbounce, Q4 2024, 41,000 pages, published by a landing-page vendor), 200 targeted visitors is the minimum before a conversion rate means anything.
- False negatives kill more good ideas than false positives waste time on bad ones: Wrong copy, wrong channel, or fewer than 200 visitors can reject a viable idea before it gets a fair test.
A startup idea is validated only when the evidence behind it would convince a stranger to pay. Most founders who ask whether their startup idea is actually validated already have data: a hundred waitlist signups, five enthusiastic conversations, a Reddit thread with 300 upvotes. None of that predicts whether someone outside your network will hand you money.
I built Preuve AI, a startup validation tool that scans 60+ data sources. After studying anonymized data from 6,000+ scanned ideas, one pattern repeats: founders collect evidence from the cheapest tier of the quality hierarchy, call it validation, and move to building. This is an audit rubric for evidence you already have, not another framework to go run.
Will your idea survive the market?
Preuve AI runs 10 agents against live market data and links every claim to a source. Free analysis in 60 seconds.
How do you tell if a demand signal is real?
A demand signal is only as real as what it cost the person who gave it to you. A survey response costs nothing to give. A pre-order costs real money and the psychological friction of a purchase decision. The gap between those two is where most founders stop collecting data and start calling it validation.
Rob Fitzpatrick wrote in The Mom Test (2013) that "compliments are worthless" and founders should seek "facts and commitments, not compliments." Signal hierarchies exist already: Getforge and Sheetventure both publish one, and they get the ordering right. But a hierarchy is a ladder, not a score. It ranks signals in theory. It says nothing about whether your hundred signups, from your one audience, through your one channel, actually mean anyone will pay.
The table below is the audit. Each row is an evidence type you might already have. Read across to see what it is actually worth, how many you need before it means anything, and how it gets inflated by flattery you did not notice.
| Evidence type | Cost to them | How many you need | How it gets faked | What it predicts |
|---|---|---|---|---|
| "I'd use that" (interview/survey) | Nothing | Unreliable at any sample size | Politeness, leading questions, social pressure | The problem description resonates when spoken aloud |
| Email / waitlist signup | 30 seconds, inbox noise | 1,000+ for a conversion pattern | Giveaways, Product Hunt launches, viral hooks | Topic interest, not purchase intent |
| Social engagement (upvotes, shares) | One click | Not meaningful in isolation | Novelty bias, algorithmic amplification, community norms | Curiosity, entertainment value |
| Scheduled call or demo request | 15-30 minutes of their time | 10-15 conversations | Networking, returning a favor, professional courtesy | The problem is real and acknowledged |
| Fake door click (buy flow without a product) | Psychological commitment to purchase | 200+ targeted visitors | Wrong traffic source, vague or absent pricing | Purchase intent at the shown price point |
| Pre-order or deposit | Real money (even if refundable) | 30-50 independent buyers | Friends and family, professional network | Willingness to pay at that exact price |
| Revenue from strangers | Full payment, non-refundable | 5-10 customers who found you independently | One-time consulting deals, personal referrals | Product-market fit |
A note on the sample sizes: these are directional minimums, not statistically rigorous thresholds. The waitlist figure comes from Vohra's measured 3% conversion rate: at 3%, you need roughly 1,000 signups to produce 30 conversions, enough to see whether a pattern exists. The fake-door figure comes from the industry-average 6.6% landing page conversion rate (Unbounce, Q4 2024, 41,000 pages, and Unbounce sells landing pages, so read it as primary data from a large sample rather than a neutral benchmark): at that rate, 200 visitors yield about 13 actions, the floor for a meaningful ratio.
The four tests founders are usually given, and the ones Fitzpatrick's "facts and commitments" rule reduces to, are financial commitment, active friction, behavior over opinion, and ignoring polite praise. All four map to the single column in this table labeled "cost to them." A friend saying "I'd totally use that" costs nothing. A stranger's credit card number costs something real. Most founders stop collecting evidence somewhere in the bottom three rows.
The column that matters most is the last one. A thousand signups tell you people are curious. Ten pre-orders from strangers tell you they will pay. One measures curiosity, the other measures a wallet, and conflating them shows up constantly in the anonymized dataset. The psychology of why founders conflate them is well-documented. This post is about the evidence itself.
How many signups do you need to validate an idea?
Wrong question. What matters is the conversion rate from signup to a higher-cost action. A thousand waitlist signups that never convert to a single pre-order or demo request validated nothing.
Search this question online and the entire first page belongs to waitlist tool vendors quoting their own benchmarks. Getwaitlist, Getlaunchlist, Waitlister, Welaunch: each one publishes a "how many signups you need" article, and each one's answer conveniently suggests that more signups on their platform are better. That is a conflict of interest, not a benchmark.
The one disinterested source I found: Gaurav Vohra's "The Waitlist Delusion" (June 2025) measured that waitlist signups convert to paying customers at roughly 3% within seven days. For signups that sat on a waitlist about six months, the figure holds at about 3%. After a year it halves to roughly 1.5%, and it halves again each year after that. Live signups (people who sign up when the product is actually available) converted at roughly 10%.
| What you measured | Baseline conversion | Source | What it means |
|---|---|---|---|
| Waitlist signup to paying customer | ~3% at 7 days | Vohra, "The Waitlist Delusion" (2025) | 97% of signups never become customers |
| Landing page visit to any action | 6.6% average | Unbounce, Q4 2024 (41K pages) | Below average = your page, not your idea |
| Live signup to paying customer | ~10% at 7 days | Vohra, "The Waitlist Delusion" (2025) | 3x the waitlist rate, because the product is real |
Forget how many signed up. Track the conversion rate to the next rung on the rubric, and compare it against the baseline for your category. If your validation landing page converts below that 6.6% average (Unbounce is a landing page builder, so they have an interest in the number looking accessible, but it is primary data from a large sample), the test measured your headline, not your market.
Skip weeks of manual research
Get complete market research, sourced proof, competitor map, and pricing data for your idea instantly.
What counts as real validation?
Real validation is evidence that a named kind of buyer will pay an actual number for a fix to a problem they already spend time or money trying to solve. Drop the buyer, the number, or the problem and it stops being validation, even if it is technically true.
Three patterns show up constantly in evidence that looks like validation but proves the wrong thing.
They wanted the free tier, not the product.
If you offered a free plan, a free trial, a lead magnet, or a demo alongside your validation test, the signup data is contaminated. People who signed up for the free thing are not the same population as people who would pay for the real thing. It is the contamination I see most often in the anonymized scans.
They reacted to novelty, not need.
Product Hunt launches and Reddit threads measure curiosity. A hundred upvotes on r/SideProject means a hundred people enjoyed the read. It says nothing about who would pay. Post the same pitch where your actual buyers congregate and you will get a different number, probably smaller, definitely more honest.
Your network responded, not the market.
Your first fifty beta signups. Your LinkedIn. Your Slack group. People who already know your name. Their engagement is filtered through social pressure and goodwill, not purchase intent. Remove everyone who could name you from the dataset. What remains is your actual signal.
Imagine this evidence came from a stranger's product. Would you put money in? If not, what you have is encouragement, not validation, and the honest move is to say so before the build decision rather than after it. The fake door test sits in the upper tiers of the table above.
Can a good idea fail a validation test?
Yes, a good startup idea can fail a validation test. When the test itself is poorly designed, it produces a false negative, which is more dangerous than a false positive because it kills a real idea before it ever gets a fair trial.
Three ways a good test lies to you.
The landing page described the wrong thing. Your value proposition was accurate but used the wrong words for the audience. Headline and CTA wording alone can change a landing page's conversion rate by multiples. If you wrote one version of the page and tested it once, you tested your copywriting, not your idea.
The audience was wrong. A B2B compliance tool tested on r/startups tells you whether hobbyist founders care about enterprise compliance. They do not. A consumer product tested through a founder's LinkedIn tells you whether professional contacts find it interesting, not whether strangers will pay. The channel decides who sees the test.
The sample was too small. With 50 visitors and 2 signups, your conversion rate is 4%. With 200 visitors and 8 signups, it is also 4%, but the second number is meaningfully more reliable. Evan Miller explains why: you must fix sample size in advance, and peeking at data until you see significance invalidates the test. Under 200 targeted visitors in a weekend is not a result. It is a coin flip.
The diagnostic: run the same test again with one variable changed. Different copy, different channel, or a larger sample through the same channel. Fails twice, in front of two different audiences, and the idea is the problem. Fails once but works somewhere else, and the first test was the problem, not the idea.
The most quoted number in this field is CB Insights' finding that 42% of startup failures cite "no market need," which comes from their 2014 post-mortem of 110 startups and has been reframed by their later research. Whichever edition you take, it does not distinguish founders who tested properly and found nothing from founders who tested badly and walked away from something that might have worked. From the outside, those look the same. From the inside, you can tell, if you audit the evidence honestly.
If this audit tells you that your evidence is weaker than you thought, I wrote a complete market validation framework that covers the five steps from customer definition to willingness-to-pay testing. For a sourced second opinion on the idea itself, here is how the scan works and where you can run one. It will not audit your evidence for you. It will tell you whether the market behind it is real.
FAQ
How do you know if your startup idea is validated?
A startup idea is validated when you have evidence that a named kind of buyer will pay an actual number for a fix to a problem they already spend time or money on. The evidence must come from people outside your personal network, must involve a real cost to them (time, money, or reputation), and must reach a sample size large enough to distinguish signal from noise. Interview praise, waitlist signups, and social media engagement alone do not meet this bar.
What is the difference between interest and validation?
Interest is free to give. Validation costs something. An email signup is interest. A pre-order with a credit card is validation. The gap between the two is where most founders stop collecting evidence. The key test: did the person incur a real cost (money, time, or reputation) to give you this signal?
How many customer interviews count as validation?
Interviews rarely count as validation on their own, regardless of the number, because social pressure biases every conversation toward encouragement. What matters is whether the interviewee described a specific problem they already spend money or significant time solving, and whether they took a concrete next step (scheduled a follow-up, made an introduction, placed a deposit). Five interviews with concrete commitments outweigh fifty with compliments.
Can waitlist signups validate a startup idea?
Not on their own. Gaurav Vohra's 2025 analysis found that waitlist signups convert to paying customers at about 3% within seven days, and the rate halves with each additional year. A waitlist measures topic interest, not purchase intent. To extract a validation signal from a waitlist, measure the conversion rate from signup to a higher-cost action like scheduling a demo or paying for early access.
What is the most reliable startup validation signal?
Revenue from a stranger who found you without a personal introduction. That person discovered the product, evaluated it against alternatives, and decided it was worth paying for. No social pressure, no novelty bias, no favor to a friend. Five paying strangers are a stronger signal than a thousand waitlist signups.
Vincent
5 years in B2B growth, building Preuve AI in public. 82% of ideas it scores aren't ready, the point is finding out in 8 minutes, not 3 months.
Follow on X →
Building is expensive. Validation is free.
Run your idea through 10 AI agents before you write a line of code. Every claim source-linked.
