← Dashboard
201 rooms available
More classroom tools
Data Analysis ready-made rooms
Change room type

Data Analysis

Survivorship bias, visualization integrity, statistical rigor.

Ready-made classroom8 turns
Data Analysis room
correlation vs causation
T
Student says: “Users who use Feature X retain 40% better. The data is clear. We should i...”
1 · Data Analysis

The PM Wants to Invest $2M Based on a Correlation

Rehearse this
Explain selection bias to a non-technical stakeholder and propose the right analysis (A/B test) before committi...
Signal
misconception
Move
diagnose
Output
feedback
Ready-made classroom8 turns
Data Analysis room
survivorship bias
T
Student says: “I surveyed our power users and they all said they love the onboarding flo...”
2 · Data Analysis

We Only Studied the Survivors

Rehearse this
Identify survivorship bias and teach that the most important data often comes from the people you DIDN'T study...
Signal
misconception
Move
diagnose
Output
feedback
Ready-made classroom8 turns
Data Analysis room
data visualization integrity
T
Student says: “Look at this chart — revenue is up 50%! I started the Y-axis at $900K so...”
3 · Data Analysis

The Chart That Proves the Wrong Thing

Rehearse this
Teach honest data visualization: Y-axis integrity, representative baselines, and the difference between informi...
Signal
misconception
Move
diagnose
Output
feedback
Ready-made classroom8 turns
Data Analysis room
statistical rigor and p-hacking
T
Student says: “The A/B test has been running for 2 days and the variant is winning with...”
4 · Data Analysis

Peeking at the A/B Test Before It's Done

Rehearse this
Teach why peeking at experiments inflates false positives, and how to resist organizational pressure to call ex...
Signal
misconception
Move
diagnose
Output
feedback
Ready-made classroom8 turns
Data Analysis room
metric selection and Goodhart's Law
T
Student says: “We increased daily active users by 30% this quarter! The push notificatio...”
5 · Data Analysis

Optimizing the Wrong Metric

Rehearse this
Teach Goodhart's Law: distinguish between metrics that measure value and metrics that measure gaming, and desig...
Signal
misconception
Move
diagnose
Output
feedback