• Practice
  • About 18 min
  • 5 practice questions

Classical and axiomatic probability, and odds

Find probabilities with the classical definition and counting, check whether an assignment of probabilities obeys the axioms, and convert between probability and odds.

If something looks wrong, please tell us.

By the end of this lesson you can

  • Use P(A) = n(A)/n(S) for equally likely outcomes, counting with combinations and permutations.
  • State Kolmogorov's three axioms and the limitations of the classical definition.
  • Decide whether a given assignment of probabilities to outcomes is permissible.
  • Convert odds in favour or against into a probability, and back.

In earlier classes probability was found from observed frequencies (the a posteriori view). This lesson gives two exact definitions: the classical one, which needs equally likely outcomes, and the axiomatic one, which works in general and includes the classical one as a special case.

The classical definition

If an experiment has n exhaustive, mutually exclusive and equally likely outcomes, and m of them are favourable to an event A, then P(A) = m/n. In set language:

P(A) = n(A)/n(S) = (number of cases favourable to A)/(exhaustive number of cases in S), when all outcomes are equally likely.

— Classical (a priori) probability

The classical definition has two limitations: it needs a finite number of outcomes (so it cannot handle toss until a head appears), and it needs those outcomes to be equally likely (so it cannot handle a loaded die). These limitations led to the modern, set-based definition.

The axiomatic approach

The axiomatic approach was set out by the Russian mathematician A. N. Kolmogorov in 1933. Let S be a finite sample space and P a real-valued function on its events. P(A) is a probability function if it satisfies three axioms:

  1. [P₁] Non-negativity: P(A) ≥ 0 for every event A.
  2. [P₂] Additivity: if A and B are mutually exclusive, P(A ∪ B) = P(A) + P(B). More generally, for mutually exclusive A₁, ..., Aₙ, P(A₁ ∪ ... ∪ Aₙ) = P(A₁) + ... + P(Aₙ).
  3. [P₃] Normalisation: P(S) = 1.

Two results (stated without proof in the textbook) connect the axioms to practice. If outcomes are equally likely, P(A) = n(A)/n(S) satisfies the axioms. If they are not, assign to each point aᵢ of S = {a₁, ..., aₙ} a number pᵢ with every pᵢ ≥ 0 and p₁ + p₂ + ... + pₙ = 1, and define P(A) as the sum of the pᵢ for the points in A; this also satisfies the axioms. Any such numbers, even irrational ones, are allowed.

Worked example 1: is the assignment permissible?

An experiment has exactly three mutually exclusive outcomes A, B and C. (i) P(A) = 0.3, P(B) = 0.5, P(C) = 0.2: all non-negative and the sum is 1.0, so permissible. (ii) P(A) = 0.6, P(B) = 0.5, P(C) = −0.1: the sum is 1, but P(C) is negative, so not permissible. (iii) P(A) = 0.4, P(B) = 0.4, P(C) = 0.3: all non-negative, but the sum is 1.1, so not permissible. (iv) P(A) = 1/√2, P(B) = 1 − 1/√2, P(C) = 0: permissible, since 1/√2 ≈ 0.707 lies between 0 and 1 and the sum is 1.

Worked example 2: two dice

Two fair dice are rolled. Find the probability that the sum is 8. n(S) = 36. Favourable outcomes: (2, 6), (3, 5), (4, 4), (5, 3), (6, 2), so n(A) = 5 and P(A) = 5/36. Note that (2, 6) and (6, 2) are different outcomes because the dice are distinguishable.

Worked example 3: drawing balls

A bag has 5 red and 3 green balls, and two are drawn at random together. n(S) = ⁸C₂ = 28. (i) Both red: ⁵C₂ = 10 ways, so P = 10/28 = 5/14. (ii) One of each colour: ⁵C₁ × ³C₁ = 15 ways, so P = 15/28. (iii) Both green: ³C₂ = 3, so P = 3/28. Check: 10 + 15 + 3 = 28, so the three probabilities add to 1, as they must for mutually exclusive and exhaustive events.

Worked example 4: arrangements

The five letters of the word TAMIL are arranged at random. Find the probability that the arrangement begins with T and ends with L. n(S) = 5! = 120. With T and L fixed at the ends, the middle three letters can be arranged in 3! = 6 ways. So P = 6/120 = 1/20.

Odds

Odds compare the chances for an event with the chances against it. If an event A can happen in a ways and fail in b ways (all equally likely), the odds in favour of A are a : b and the odds against A are b : a. Then P(A) = a/(a + b). Conversely, if P(A) = p, the odds in favour are p : (1 − p) and the odds against are (1 − p) : p.

Odds and probability

  • Odds in favour a : b
    • P(A) = a/(a + b)
    • P(Ā) = b/(a + b)
    • Example 3 : 5 gives P(A) = 3/8
  • Odds against b : a
    • P(A) = a/(a + b) still
    • Read carefully which number is first
    • Example: against 4 : 11 gives P(A) = 11/15

Worked example 5: odds from a selection

Two people are chosen at random from 4 men and 3 women. Find the odds in favour of both being women. n(S) = ⁷C₂ = 21 and n(A) = ³C₂ = 3, so the number of unfavourable cases is 21 − 3 = 18. Odds in favour = 3 : 18 = 1 : 6, and P(A) = 1/(1 + 6) = 1/7, which agrees with 3/21.

Key takeaways: classical probability counts equally likely cases; the axioms require non-negative probabilities that add to 1 and are additive for mutually exclusive events; a proposed assignment fails if any value is negative or the total is not 1; odds a : b in favour mean P = a/(a + b).

Check your understanding

  1. 1. Two fair dice are rolled. What is the probability that the sum is 7?

    1. 1/6
    2. 7/36
    3. 1/12
    4. 5/36
    Show answer

    Answer: A. Favourable outcomes: (1, 6), (2, 5), (3, 4), (4, 3), (5, 2), (6, 1), which is 6 out of 36. So P = 6/36 = 1/6.

  2. 2. A card is drawn from a well-shuffled pack of 52. What is the probability that it is a king?

    1. 1/4
    2. 1/52
    3. 1/13
    4. 4/13
    Show answer

    Answer: C. There are 4 kings among 52 cards, so P = 4/52 = 1/13.

  3. 3. The odds against an event A are 3 : 8. What is P(A)?

    1. 3/8
    2. 3/11
    3. 5/11
    4. 8/11
    Show answer

    Answer: D. Odds against 3 : 8 means 3 ways to fail and 8 ways to happen, so P(A) = 8/(3 + 8) = 8/11. 3/11 would be P(Ā).

  4. 4. An experiment has four mutually exclusive and exhaustive outcomes. Which assignment of probabilities is permissible?

    1. 0.2, 0.3, 0.4, 0.2
    2. 0.25, 0.35, 0.15, 0.25
    3. 0.5, 0.5, 0.1, −0.1
    4. 0.6, 0.2, 0.1, 0.0
    Show answer

    Answer: B. 0.25 + 0.35 + 0.15 + 0.25 = 1.00 and all are non-negative. The first set adds to 1.1, the third contains a negative value, and the last adds to only 0.9.

  5. 5. Two balls are drawn together from a bag of 4 blue and 6 white balls. What is the probability that both are blue?

    1. 2/15
    2. 4/25
    3. 2/5
    4. 1/3
    Show answer

    Answer: A. n(S) = ¹⁰C₂ = 45 and n(both blue) = ⁴C₂ = 6. So P = 6/45 = 2/15. 4/25 = (4/10)² would be the answer only if the first ball were replaced.

Privacy · Terms · Refunds · Delivery