phase 4 of 4
Learn: keep what paid
This phase hands off one thing: one tested change, then the loop.
- Tracking planWhat to record at every stage of the pipeline so that, months from now, the data can answer which triggers pay, which detectors are right, which leads reply, and which messages work, and can train models that do it…
- Funnel and metricsThe funnel is the ladder a person climbs from "found" to "paid". This page defines both ladders, the one rule for picking the constraint, every metric once (the formula, the window and the event it reads), how a sign-up…
- Experimentation engineEvery stage has a knob: a prompt, a rule, an offer, an opener, a send time. The experimentation engine picks which knob to test, assigns at random, reads the result against a rule written before launch and records what it learned.
- Improvement loopEvery number the pipeline records gets a line it shouldn't cross. When a metric crosses its line, the loop fires: it diagnoses which part broke, writes one hypothesis, and hands a test to the Experimentation engine.