- Practice
- About 20 min
- 5 practice questions
Conditional probability and independent events
Find conditional probabilities P(B/A), use the multiplication theorem for draws with and without replacement, and test and use independence of events.
If something looks wrong, please tell us.
By the end of this lesson you can
- Find P(B/A) from the definition or by reducing the sample space.
- Use the multiplication theorem P(A ∩ B) = P(A) P(B/A) for successive draws.
- Test whether two events are independent and use P(A ∩ B) = P(A) P(B) when they are.
- Know that complements of independent events are independent, and that mutually exclusive events with non-zero probabilities are never independent.
New information changes probabilities. If a friend tells you the die shows an odd number, the chance that it shows 5 is no longer 1/6. Conditional probability measures chances after such information, and independence describes the situation where the information makes no difference.
Conditional probability
Roll a die. The probability of an odd number greater than 2 is P({3, 5}) = 2/6 = 1/3. But if we are told the die shows an odd number, the possible outcomes shrink to {1, 3, 5}, and the probability that it is greater than 2 becomes 2/3. The favourable outcomes are the same; the condition has reduced the outcomes we count among. This is conditional probability.
P(B/A) = P(A ∩ B)/P(A), provided P(A) > 0. It is read: the probability of B, given that A has happened.
With equally likely outcomes this is the same as n(A ∩ B)/n(A): count within the reduced sample space A. Conditional probabilities obey the usual rules; for instance P(B̄/A) = 1 − P(B/A).
Worked example 1: a die with a condition
A die is rolled and shows an even number. Find the probability that it is greater than 3. A = even = {2, 4, 6}, B = greater than 3 = {4, 5, 6}, A ∩ B = {4, 6}. So P(B/A) = (2/6)/(3/6) = 2/3. In the reduced space {2, 4, 6}, two of the three outcomes qualify.
Worked example 2: from given probabilities
Given P(A) = 0.5, P(B) = 0.4 and P(A ∩ B) = 0.2. (i) P(A/B) = 0.2/0.4 = 0.5. (ii) P(B/A) = 0.2/0.5 = 0.4. (iii) P(Ā/B) = 1 − P(A/B) = 0.5. (iv) P(A/B̄) = P(A ∩ B̄)/P(B̄) = (0.5 − 0.2)/(1 − 0.4) = 0.3/0.6 = 0.5. Notice that P(A/B) = P(A/B̄) = P(A): knowing whether B happened does not change the chance of A. We meet this again under independence.
Multiplication theorem
Rearranging the definition gives the multiplication theorem: P(A ∩ B) = P(A) · P(B/A) = P(B) · P(A/B). It is the natural tool for events in sequence, such as successive draws.
Worked example 3: with and without replacement
A bag has 5 red and 3 green balls. Two balls are drawn one after the other. Find the probability that the first is red and the second green. (i) With replacement: the bag is the same for the second draw, so P = (5/8)(3/8) = 15/64. (ii) Without replacement: after a red ball is removed, 7 balls remain, 3 of them green, so P = P(R₁) · P(G₂/R₁) = (5/8)(3/7) = 15/56. In (ii) the first draw changes the chances for the second.
Independent events
Events are independent if the occurrence or non-occurrence of one does not affect the probability of the other. Formally, A and B are independent if and only if P(A ∩ B) = P(A) · P(B); when P(A) > 0 this is the same as P(B/A) = P(B). Events A₁, A₂, ..., Aₙ are mutually independent if the product rule holds for every sub-collection, in particular P(A₁ ∩ A₂ ∩ ... ∩ Aₙ) = P(A₁) P(A₂) ... P(Aₙ).
Theorem. If A and B are independent, so are Ā and B, A and B̄, and Ā and B̄. Proof of the last: P(Ā ∩ B̄) = 1 − P(A ∪ B) = 1 − P(A) − P(B) + P(A)P(B) = [1 − P(A)][1 − P(B)] = P(Ā) P(B̄).
Mutually exclusive versus independent
-
Mutually exclusive
- A property of the sets: A ∩ B = ∅
- P(A ∩ B) = 0
- If one happens, the other cannot
-
Independent
- A property of the probabilities
- P(A ∩ B) = P(A) P(B)
- If one happens, the other's chance is unchanged
If P(A) > 0 and P(B) > 0, mutually exclusive events cannot be independent (since then P(A ∩ B) = 0 but P(A)P(B) > 0), and independent events cannot be mutually exclusive.
Worked example 4: finding a missing probability
A and B are independent, P(A) = 0.3 and P(A ∪ B) = 0.65. Find P(B). Let P(B) = p. Then 0.65 = 0.3 + p − 0.3p = 0.3 + 0.7p, so 0.7p = 0.35 and p = 0.5. Check: 0.3 + 0.5 − 0.15 = 0.65.
Worked example 5: three independent attempts
Three archers hit a target independently with probabilities 1/2, 2/3 and 3/4 (made-up figures). Each shoots once. (i) At least one hit: the complement is all three missing, with probability (1/2)(1/3)(1/4) = 1/24, so P = 23/24. (ii) Exactly one hit: add the three cases, first only (1/2)(1/3)(1/4) = 1/24, second only (1/2)(2/3)(1/4) = 2/24, third only (1/2)(1/3)(3/4) = 3/24, giving 6/24 = 1/4.
Key takeaways: P(B/A) = P(A ∩ B)/P(A), or count within A; the multiplication theorem chains probabilities in sequence; without replacement the second probability changes. Independence means P(A ∩ B) = P(A)P(B), it carries over to complements, and it is a different idea from mutual exclusiveness.
Check your understanding
-
1. A die is rolled and shows an odd number. What is the probability that it is a prime?
- 1/2
- 1/3
- 2/3
- 1/6
Show answer
Answer: C. The reduced sample space is {1, 3, 5}. The primes in it are 3 and 5 (1 is not prime). So the conditional probability is 2/3.
-
2. If P(A) = 0.4 and P(A ∩ B) = 0.1, what is P(B/A)?
- 0.25
- 0.04
- 0.4
- 0.5
Show answer
Answer: A. P(B/A) = P(A ∩ B)/P(A) = 0.1/0.4 = 0.25.
-
3. A and B are independent with P(A) = 0.2 and P(B) = 0.5. What is P(A ∩ B)?
- 0.7
- 0.6
- 0
- 0.1
Show answer
Answer: D. For independent events P(A ∩ B) = P(A) P(B) = 0.2 × 0.5 = 0.1. 0.6 is P(A ∪ B), and 0 would hold for mutually exclusive events.
-
4. Two cards are drawn one after the other without replacement from a pack of 52. What is the probability that both are aces?
- 1/169
- 1/221
- 1/26
- 4/663
Show answer
Answer: B. P = (4/52)(3/51) = 12/2652 = 1/221. With replacement it would be (4/52)² = 1/169.
-
5. A and B are mutually exclusive, with P(A) = 0.3 and P(B) = 0.4. Which statement is true?
- A and B are independent.
- P(A ∩ B) = 0.12
- A and B are not independent.
- P(A ∪ B) = 0.58
Show answer
Answer: C. Mutually exclusive gives P(A ∩ B) = 0, but P(A)P(B) = 0.12 ≠ 0, so they are not independent. Also P(A ∪ B) = 0.3 + 0.4 = 0.7, not 0.58 (that would be the value for independent events).
Sign in to keep track of the lessons you finish.