Revision notes

Chapter 11 Probability Distributions: Foundation

The key points, rules to remember, tables and diagrams from all 5 lessons, on one page for quick revision. To keep a copy, use your browser's Print and choose "Save as PDF".

Lesson 1

Random variables, inverse images and their types

From outcomes to numbers to probabilities

  1. Sample space S All outcomes of the experiment.
  2. Random variable X Attach a real number X(ω) to each outcome.
  3. Inverse images Group the outcomes that give each value x.
  4. Probabilities P(X = x) = probability of the event X⁻¹(x).
Value of X−3−113Total
Number of points in inverse image13318
Value of X123456Total
Points in inverse image135791136

Discrete or continuous?

  • Discrete (counting) Range is finite or countably infinite.
    • Number of heads in 3 tosses: 0, 1, 2, 3
    • Number of tosses until the first head: 1, 2, 3, …
    • Customers arriving at a counter in an hour: 0, 1, 2, …
  • Continuous (measuring) Range is an interval of real numbers.
    • Lifetime of a bulb: any value in [0, ∞)
    • Distance from the centre of a disc of radius r to a random point: [0, r]
    • Time taken to complete a phone call
A discrete variable can even be defined on a continuous sample space, for example X(ω) = 1 for every ω in [0, 1].

Key takeaways: a random variable is a function X : S → ℝ. Its inverse image X⁻¹(x) is the event "X = x", and counting the points in inverse images is how we begin to find probabilities. Discrete random variables take a list of values (counting); continuous ones take every value in an interval (measuring) and give probability 0 to each single value.

Read the full lesson

Lesson 2

Discrete random variables: probability mass and cumulative distribution functions

F(x) = P(X ≤ x) = Σ f(x_i) for x_i ≤ x; f(x_k) = F(x_k) − F(x_(k−1)); P(a < X ≤ b) = F(b) − F(a).

— pmf and cdf
Running totals of 0.1, 0.3, 0.5, 0.1
xx < 00 ≤ x < 11 ≤ x < 22 ≤ x < 3x ≥ 3
F(x) for example 200.10.40.91

Two descriptions of the same distribution

  1. pmf f Probabilities at each value.
  2. Add up to x F(x) = Σ f(x_i), x_i ≤ x.
  3. cdf F Staircase defined for every real x.
  4. Read the jumps f(x_k) = F(x_k) − F(x_(k−1)).

Then back to step 1: pmf f

Either function contains all the probability information about X.

Key takeaways: a pmf has non-negative values that add to 1; use that to find unknown constants, rejecting any value that makes a probability negative. The cdf F(x) = P(X ≤ x) is a right-continuous staircase rising from 0 to 1, and its jumps are the probabilities. Watch strict and non-strict inequalities: for a discrete variable P(X < a) and P(X ≤ a) can differ.

Read the full lesson

Lesson 3

Continuous random variables: probability density and distribution functions

Discrete and continuous side by side

  • Discrete pmf f(x) = P(X = x)
    • Σ f(x) = 1
    • F(x) = Σ f(x_i), x_i ≤ x
    • F is a staircase
    • f(x_k) = jump of F
  • Continuous pdf f(x), a density
    • ∫ f(x) dx = 1
    • F(x) = ∫₋∞ˣ f(u) du
    • F is continuous
    • f(x) = F′(x); P(X = a) = 0

pdf: f(x) ≥ 0 and ∫₋∞^∞ f(x) dx = 1. P(a ≤ X ≤ b) = ∫ₐᵇ f(x) dx = F(b) − F(a). F(x) = ∫₋∞ˣ f(u) du and f(x) = F′(x). P(X = a) = 0.

— Continuous random variables

Key takeaways: for a continuous random variable, probability is area under the density curve. Use total area 1 to find constants. Single points carry no probability, so < and ≤ give the same answers. Integrate f to get F, differentiate F to get f, and use F(b) − F(a) as a quick route to interval probabilities.

Read the full lesson

Lesson 4

Mathematical expectation: mean and variance

E(X) = Σ x f(x) or ∫ x f(x) dx; Var(X) = E(X²) − [E(X)]²; E(aX + b) = aE(X) + b; Var(aX + b) = a²Var(X).

— Expectation and variance
xf(x)x f(x)x² f(x)
00.100
10.30.30.3
20.51.02.0
30.10.30.9
Total11.63.2

Key takeaways: the mean is the probability-weighted average of the values; the variance is the mean squared deviation, most easily found as E(X²) − [E(X)]². A linear change aX + b multiplies the mean by a and adds b, but multiplies the variance by a² and ignores b. For continuous variables, every Σ becomes an ∫.

Read the full lesson

Lesson 5

Special discrete distributions: one point, two point, Bernoulli and binomial

P(X = x) = ⁿCₓ pˣ qⁿ⁻ˣ, x = 0, 1, 2, …, n, where q = 1 − p. Mean μ = np, variance σ² = npq.

— Binomial distribution B(n, p)

The family of special discrete distributions

  • One point P(X = x₀) = 1
    • Mean x₀, variance 0
  • Two point Values x₁, x₂ with p, q
    • Mean px₁ + qx₂
    • Variance pq(x₂ − x₁)²
  • Bernoulli Ber(p) Two point with x₁ = 1, x₂ = 0
    • Mean p, variance pq
  • Binomial B(n, p) Successes in n independent Bernoulli trials
    • P(X = x) = ⁿCₓ pˣqⁿ⁻ˣ
    • Mean np, variance npq

Key takeaways: a Bernoulli variable records one success or failure (mean p, variance pq); a binomial variable counts successes in n independent trials with constant p, with P(X = x) = ⁿCₓpˣqⁿ⁻ˣ, mean np and variance npq. For "at least one" use 1 − P(X = 0). Draws without replacement change p from trial to trial, so they are not binomial.

Read the full lesson

Privacy · Terms · Refunds · Delivery