A/B testing + experimentation primitives
Visual primitives for the Mufflermen experimentation cockpit — built against real workshop hypotheses (quote-instant-pricing, parts-3d-viewer-hero, bay-availability-realtime). Conversion + AUD ARPV + booking completion metrics. Visual reference only — no real backend wired.
A/B testing + experimentation primitives is a reusable Oak Flats Muffler Men UI primitive with documented states, accessibility expectations, theme behavior, and implementation evidence.
A/B testing + experimentation primitives: Visual primitives for the Mufflermen experimentation cockpit — built against real workshop hypotheses (quote-instant-pricing, parts-3d-viewer-hero, bay-availability-realtime). Conversion + AUD ARPV + booking completion metrics. Visual reference only — no real backend wired.
Experiment card
Status / variant / sample / significance / lift chips composed on the shared DashboardCard surface.
Hypothesis statement
Because-we-believe-will-cause-measured-by sentence with chip-pickable observation, change, outcome, metric, threshold.
Variant traffic allocator
Stacked allocation bar + per-variant sliders + must-sum-to-100 indicator. Composes VariantPicker.
Sample size calculator
Baseline + MDE + power + variants → required N per variant + total N + estimated time-to-detect chip.
Significance threshold
α radio (0.01 / 0.05 / 0.10), one-sided / two-sided toggle, correction picker (Bonferroni / FDR / None).
Stat power gauge
Current power radial meter + tone-shifting + sample-size needed-to-reach-target chip. Composes RadialMeter.
Multi-arm bandit
Per-arm traffic flow over time + exploration / exploitation balance chip + winning-arm prediction chip.
Holdout group toggle
Enable / disable + holdout % slider + audience filter chips. Composes RolloutSlider.
Sequential testing
Peeking-corrected p-value curve + early-stopping α boundary annotation. Composes AreaChart.
Bayesian posterior
Density curve per variant + 95% credible-interval overlays + P(beat baseline) chip per arm.
Decision recommendation
Recommendation chip (Ship / Continue / Stop loss / Insufficient power) + reasoning + expected impact + confidence.
Experiment archive
Sortable archive table — ran-from / ran-to / winner / final lift / decision / retrospective link. Composes DataTable.
Stop rule editor
Stop condition chips (Min sample / Significance / Time / Manual / Guardrail) with per-rule thresholds.
CUPED variance
CUPED variance-reduction chip — % reduction + covariate + power-points-gained chip.
Full console
Composed cockpit wiring experiment list + hypothesis + traffic + sample size + significance + power + bandit + holdout + sequential + Bayesian + decision + stop rules + CUPED + archive.