Introduction
Shipping does not end discovery. It changes the instrument. Before launch you tested with prototypes and strangers; after launch you test with a live product and real behavior. The shape is the same: a hypothesis, the riskiest assumption, one metric, a threshold set in advance, a decision rule. First you run validation loops to prove the first version does what the evidence said. Then, only then, growth loops to compound what works.
- What is product experimentation and how is it different from discovery?
- What is the difference between validation and growth experiments?
- Why should a startup validate before trying to grow?
§The previous three whitepapers took a team from a hunch to a written position, to a direction, to a business whose assumptions were listed with numbers and dates. Something has now shipped. This whitepaper is about the moment most founders treat as the finish line and is really a change of instrument.
§Before launch, you had prototypes and strangers. You learned by watching someone tap through a thing that did not work behind the screen. After launch, you have a live and the real behavior of real users, which is a better instrument and a more dangerous one, because behavior at small scale is mostly noise, and a team that reads noise as signal will chase it for a year.
§ 0.1Build, measure, learn, as a loop#
§Eric Ries's build-measure-learn is the lineage, and the second whitepaper owns its theory. The point worth repeating here is the one most often lost: it is a , not a phase. The output is not a product; it is learning, and the learning is the input to the next turn. A team that builds, measures once, and moves on has not run the loop. It has shipped a feature and read a number.
§The loop should be as short as it can be while still teaching something. Short because a short loop lets a small team turn many times before the runway ends. Not shorter, because a loop that turns before it has learned anything is motion, not progress, and the failure modes chapter is full of teams that mistook velocity for learning.
§ 0.2Why validation comes before growth#
§This is the ordering the whitepaper insists on, and it is the one founders most want to skip.
§A startup that has just shipped is desperate for the number to go up, and growth makes numbers go up. But growth applied to a product that does not yet retain is the fastest way to lose money, because every acquired user leaks out the bottom and takes the acquisition cost with them. Sean Ellis, who coined growth hacking, is blunt about the precondition: you do not pour users into a product until the product holds them. Retention is the container. Growth is the water. A team that pours before it has a container has a wet floor and an empty budget.
§ 0.3The same shape at both stages#
§Validation and growth feel different and are the same discipline. Both begin with a that can be wrong. Both name the riskiest assumption. Both pick one metric and one threshold before the test runs. Both end with a rule that was decided in advance, so that the result is read honestly rather than argued into whatever the team hoped. The difference is only the question: validation asks does this work, growth asks how do we get more of what works.
§Because the shape is shared, Part I teaches it once, in the abstract, and Parts II and III apply it to the two stages. Part IV is the system that keeps the loops turning: a backlog, a cadence, instrumentation a small team can maintain, and a way of making learning compound. Part V is how it fails, which at this stage is mostly statistical theater and growth before retention.
§ 0.4What this whitepaper is not#
§It is not the pre-launch testing of the third whitepaper, though of experiments reappears here run against a live product instead of a prototype. It is not the theory of validated learning, which the second whitepaper owns. It is not strategy or the business model, which the fourth and fifth own and which these loops feed back into. And it is not growth at scale, with a growth team and a paid-acquisition engine; that is a later-stage problem, and a team of one to five that reaches it will have a different book to read. This whitepaper is the first year after launch, run as a series of small, honest bets.
§The hospitality case from the previous whitepapers appears where it fits, but much of this one is necessarily about the general shape, because experimentation is where the collection's discipline, a claim, a number, a date, meets the one instrument that does not lie if you read it honestly: what people actually do.
The first version is a hypothesis too. Validate that it works before you spend a cent making it bigger.
- Eric Ries, The Lean Startup (2011), on build-measure-learn. theleanstartup.com
- Ash Maurya, Running Lean, 3rd ed. (2022), on continuous experimentation. leanstack.com/books
- Sean Ellis and Morgan Brown, Hacking Growth (2017), on the growth process. www.hackinggrowth.com