Conclusion
This chapter made uncertainty something we can compute with.
You learned that:
- a sample space contains possible outcomes
- an event is a set of outcomes
- probability rules keep uncertainty consistent
- random variables turn outcomes into numerical values
- distributions assign probabilities to values
- expectation is a probability-weighted average
- variance measures spread around the mean
- covariance measures co-movement, not causation
- independence means one event does not change another event's probability
- conditional probability changes the context
- Bayes' rule updates probability after evidence
- named distributions encode common modeling assumptions
The Main Skill
The main skill is to ask what uncertainty a probability statement is describing.
Is it about an event, a random variable, a label distribution, a loss value, or a belief after evidence?
That question prevents many mistakes. It keeps you from treating a model score as certainty, an expectation as a guaranteed outcome, or a covariance as proof of causation.
It also keeps probability tied to modeling assumptions. A distribution depends on the possible outcomes, the context, and the way probability mass is assigned. Changing any of those can change the answer.
What Comes Next
Numerical computation comes next.
Probability gives exact formulas. Numerical computation asks how those formulas behave when computers use finite-precision numbers.
Keep This Question Nearby
When a model outputs a probability, ask:
What uncertainty is this number describing, and what assumptions produced it?