• Foundation
  • About 18 min
  • 5 practice questions

Conditional probability and its properties

Understand how knowing that one event has happened changes the probability of another, use P(E|F) = P(E ∩ F)/P(F), and apply the properties of conditional probability.

If something looks wrong, please tell us.

In earlier classes probability measured the uncertainty of an event in a random experiment. Often, though, we have partial information: we know the card drawn is a face card, or that the sum on two dice is 8. Does such information change the chance of another event? It usually does, and the tool for handling it is conditional probability. It leads on to the multiplication rule, independence and Bayes' theorem in the later lessons. Throughout, outcomes are equally likely unless stated otherwise.

An example first

Throw a fair die. The sample space is S = {1, 2, 3, 4, 5, 6}. Let E = 'the number is greater than 3' = {4, 5, 6} and F = 'the number is even' = {2, 4, 6}. Without any information, P(E) = 3/6 = 1/2. Now suppose we are told that F has happened: the number is even. Only the outcomes 2, 4, 6 are now possible, and they are still equally likely. Of these, 4 and 6 are greater than 3. So the probability of E, given that F has occurred, is 2/3, not 1/2. The information has changed the probability.

Definition

In the example, the favourable outcomes were those in E ∩ F = {4, 6}, and we divided by the outcomes of F. In general, with equally likely outcomes, P(E|F) = n(E ∩ F)/n(F). Dividing numerator and denominator by n(S) gives the general definition, used for any events:

If E and F are events of the same sample space and P(F) ≠ 0, the conditional probability of E given F is P(E|F) = P(E ∩ F)/P(F).

Finding P(E|F) by counting

  1. Restrict the sample space to the outcomes of F
  2. Count the outcomes of F that are also in E (that is, E ∩ F)
  3. P(E|F) = n(E ∩ F) ÷ n(F)
Knowing that F has occurred makes F the new sample space.

Properties of conditional probability

  1. P(S|F) = P(F|F) = 1, because S ∩ F = F and F ∩ F = F, giving P(F)/P(F).
  2. If A and B are events and P(F) ≠ 0, then P((A ∪ B)|F) = P(A|F) + P(B|F) − P((A ∩ B)|F). If A and B are disjoint, P((A ∪ B)|F) = P(A|F) + P(B|F).
  3. P(E′|F) = 1 − P(E|F), since E and E′ are disjoint and together make up S.
  4. 0 ≤ P(E|F) ≤ 1, because E ∩ F is part of F.

Proof of property 2. By the distributive law, (A ∪ B) ∩ F = (A ∩ F) ∪ (B ∩ F). Using the addition rule, P((A ∪ B) ∩ F) = P(A ∩ F) + P(B ∩ F) − P(A ∩ B ∩ F). Dividing every term by P(F) gives the result. Conditional probability on F therefore behaves exactly like ordinary probability on the smaller sample space F.

Worked examples

Worked example 1: from given probabilities

P(E) = 0.5, P(F) = 0.4 and P(E ∩ F) = 0.2. Find P(E|F), P(F|E), P(E ∪ F) and P(E′|F). P(E|F) = 0.2/0.4 = 0.5. P(F|E) = 0.2/0.5 = 0.4. P(E ∪ F) = 0.5 + 0.4 − 0.2 = 0.7. P(E′|F) = 1 − 0.5 = 0.5. Note that P(E|F) and P(F|E) are usually different.

Worked example 2: cards

Twenty cards numbered 1 to 20 are mixed and one is drawn. Given that the number is even, what is the probability that it is a multiple of 3? F = even numbers: 10 outcomes. E ∩ F = even multiples of 3 = {6, 12, 18}: 3 outcomes. P(E|F) = 3/10. (Without the information, P(E) = 6/20 = 3/10 as well; here the information happens not to change the probability, an idea taken up in lesson 3.)

Worked example 3: two dice

Two dice are thrown and the sum is 8. What is the probability that one of the dice shows 3? F = sum 8 = {(2, 6), (3, 5), (4, 4), (5, 3), (6, 2)}: 5 outcomes. Those with a 3: (3, 5) and (5, 3). So P(E|F) = 2/5.

Worked example 4: coins

Three fair coins are tossed. Given that at least two heads appear, find the probability that all three are heads. F = {HHT, HTH, THH, HHH}: 4 outcomes, of which only HHH has three heads. P = 1/4, whereas without the information P(HHH) = 1/8.

Key takeaways

  • P(E|F) is the probability of E when F is known to have occurred.
  • P(E|F) = P(E ∩ F)/P(F), defined only when P(F) ≠ 0.
  • With equally likely outcomes, P(E|F) = n(E ∩ F)/n(F): F becomes the new sample space.
  • Conditional probability obeys the usual rules: P(E′|F) = 1 − P(E|F) and the addition rule.
  • P(E|F) and P(F|E) are generally different.

Check your understanding

  1. 1. P(E) = 0.6, P(F) = 0.3 and P(E ∩ F) = 0.2. What is P(E|F)?

    1. 1/3
    2. 2/3
    3. 1/2
    4. 0.18
    Show answer

    Answer: B. P(E|F) = P(E ∩ F)/P(F) = 0.2/0.3 = 2/3. (0.18 is P(E) × P(F), which is not the conditional probability.)

  2. 2. A fair die is thrown and the number is even. What is the probability that it is 6?

    1. 1/3
    2. 1/6
    3. 1/2
    4. 2/3
    Show answer

    Answer: A. Given 'even', the possible outcomes are 2, 4, 6, equally likely. Only one of them is 6, so the probability is 1/3.

  3. 3. If P(E|F) = 0.4, what is P(E′|F)?

    1. 0.4
    2. 0.24
    3. 0.6
    4. 1
    Show answer

    Answer: C. Conditional probability obeys the complement rule: P(E′|F) = 1 − P(E|F) = 1 − 0.4 = 0.6.

  4. 4. Two dice are thrown and the sum is 8. What is the probability that one of the dice shows 3?

    1. 1/3
    2. 1/6
    3. 2/5
    4. 1/5
    Show answer

    Answer: C. Sum 8 occurs as (2, 6), (3, 5), (4, 4), (5, 3), (6, 2): 5 outcomes. Two of them, (3, 5) and (5, 3), contain a 3. P = 2/5.

  5. 5. Assertion (A): For any event F with P(F) ≠ 0, P(S|F) = 1, where S is the sample space. Reason (R): S ∩ F = F, so P(S|F) = P(F)/P(F).

    1. Both A and R are true, and R is the correct explanation of A
    2. Both A and R are true, but R is not the correct explanation of A
    3. A is true, but R is false
    4. A is false, but R is true
    Show answer

    Answer: A. Every outcome of F is in S, so S ∩ F = F and P(S|F) = P(S ∩ F)/P(F) = P(F)/P(F) = 1. R is the reason for A.

Privacy · Terms · Refunds · Delivery