Write the hypothesis and agree on an exposure unit.
From experiments
to evidence.
Design better tests. Quantify uncertainty. Make defensible decisions.
Experiment outcomes
Estimated treatment lifts
Portfolio signals
Choose a detectable effect, alpha and statistical power.
Review allocation balance and expected event counts.
Interpret effect size, confidence interval and limitations.
Experiment portfolio
| EXPERIMENT | SECTOR | EXPOSURES | RELATIVE LIFT | TWO-SIDED P | INDICATION |
|---|
A statistically detected difference does not establish causality without valid assignment, measurement, and protocol integrity.
Statistical analysis
Compare two independent conversion proportions. Calculations update from stored experiment counts, not fabricated model predictions.
Observed conversion rates
Absolute treatment difference
Diagnostic checks
Illustrative unit economics
Sample-size planner
Approximate the sample size needed per arm for a two-sided independent-proportions z test, assuming equal allocation, fixed design and the specified uplift.
Design parameters
Scenario simulator
Explore the sampling variability implied by the observed rates. The simulation uses a seeded normal approximation, not real-world future events or a Bayesian posterior.
Simulated treatment effects
These simulated differences reflect estimated variance under a simplified model. The proportion above zero is not the probability that the treatment truly works.
Reports & data
Export your projects for reproducibility and transparent review. Saved work stays in this browser unless explicitly exported.
Download evidence
Keep analysis results, experiment definitions, warnings and the export timestamp. Report conclusions are explicitly conditional.
Restore a workspace
JSON imports replace current experiments after confirmation. Existing work is never deleted automatically.
Interpret with care
Independent two-proportion z test, Newcombe-Wilson confidence intervals, allocation checks, power approximation, seeded resampling approximation, and exportable documentation.
Randomization quality, absence of contamination, treatment compliance, unbiased outcomes, external validity, multiple-test adjustment, or a causal effect by itself.
Pre-register a primary metric and stopping rule, validate instrumentation, examine guardrails, and investigate sample-ratio mismatch before deciding.