Experimentation · A/B · Incrementality · Traction

RGM° · Tools

Experiment Planner

Design rigorous tests in three test families: A/B conversion tests (sample size + duration), incrementality tests (geo holdouts + power), and traction tests (rapid early-stage validation). Get a downloadable test plan you can defend.

Step 1 — Pick your test type

A/B conversion test inputs

Your current CVR — what control performs at
Smallest relative lift you care about (10% = lift baseline by 10% relative)
95% standard; 90% acceptable for low-risk tests
80% standard; 90% for higher-stakes tests
Free training · Experimentation discipline
From hunches to validated learning

A good test design saves months. A bad one costs months. RGM training walks through hypothesis writing, prioritization (ICE/RICE), power analysis, and how to read results honestly. Free, no signup.

Start the training →
Methodology & sources
  1. Lewis, R. A. & Rao, J. M. (2015). "The Unfavorable Economics of Measuring the Returns to Advertising." Microsoft Research / NBER.
  2. Standard sample-size formulas via Evan Miller's A/B test calculator methodology.
  3. Meta Conversion Lift documentation.
  4. Google Conversion Lift documentation.
  5. Common Thread Collective & Tinuiti incrementality testing case studies.
  6. Croll, A. & Yoskovitz, B. (2013). Lean Analytics. O'Reilly.
Done