- Practice
- About 16 min
- 5 practice questions
Item analysis: difficulty index, discrimination index and distractors
Calculate the difficulty and discrimination of a test item from the upper and lower groups, and read a distractor table to decide whether to keep, revise or drop the item.
If something looks wrong, please tell us.
After a multiple-choice test, a careful teacher asks of each item: was it too easy or too hard, did it separate strong students from weak ones, and did every wrong option do its job? This is item analysis. Its formulas are short and appear often in exams, so practising them pays.
Upper and lower groups
Rank the papers by total score. Take a top group (for example the top quarter or so) and a bottom group of the same size, each with n students. For one item, count how many in the upper group (U) and in the lower group (L) answered it correctly. Different books use slightly different group sizes, so always use the sizes the question gives.
The two indices
| Index | Formula | What it tells you |
|---|---|---|
| Difficulty index (facility value, P) | (U + L) ÷ 2n | Proportion answering correctly; high means easy, low means hard |
| Discrimination index (D) | (U − L) ÷ n | How well the item separates upper from lower scorers |
P runs from 0 to 1. Items near the middle (around 0.5) usually discriminate best, though a few easy items are useful to start a test gently and a few hard ones to challenge the strongest. D runs from −1 to +1. A high positive D is good, a D near zero means the item does not separate the groups (for example when everyone gets it right), and a negative D means the weaker group did better than the stronger group. That points to a faulty item, such as a wrong key or a misleading stem.
Distractor analysis
Count how many in each group chose each option. A good wrong option attracts some of the lower group and fewer of the upper group. An option that nobody chooses adds nothing and should be replaced. A wrong option chosen by more of the upper group than the lower group suggests an ambiguous stem or a second defensible answer.
Worked example 1: both indices
In a class, the upper and lower groups each have 10 students. On one item, 9 in the upper group and 3 in the lower group answer correctly. Step 1: P = (9 + 3) ÷ (2 × 10) = 12 ÷ 20 = 0.6. Step 2: D = (9 − 3) ÷ 10 = 0.6. Answer: the item is of moderate ease and discriminates well, so keep it.
Worked example 2: reading a distractor table
Each group has 15 students. Option C is the key.
| Option | Upper group | Lower group |
|---|---|---|
| A | 1 | 5 |
| B | 0 | 0 |
| C (key) | 11 | 6 |
| D | 3 | 4 |
Step 1: check the totals: upper 1 + 0 + 11 + 3 = 15 and lower 5 + 0 + 6 + 4 = 15, so every student is counted. Step 2: P = (11 + 6) ÷ 30 = 17 ÷ 30, about 0.57. Step 3: D = (11 − 6) ÷ 15 = 5 ÷ 15, about 0.33. Step 4: option B attracted nobody, so it is a dead distractor. Answer: the item works acceptably, but replace B with a more plausible error. Options A and D drew more from the lower group, which is what good distractors do.
Worked example 3: a negative index
Each group has 15 students; 4 in the upper group and 9 in the lower group choose the keyed answer. Step 1: D = (4 − 9) ÷ 15 = −5 ÷ 15, about −0.33. Step 2: a negative value means better students did worse on this item. Step 3: check the key and wording; perhaps the keyed answer is wrong or a distractor is also correct. Answer: do not use the item until it is repaired.
Difficulty = (U + L) ÷ 2n. Discrimination = (U − L) ÷ n. A negative D means the item is faulty and a distractor nobody picks is useless.
Key takeaways
- A higher P means an easier item.
- D shows how well an item separates strong from weak students.
- Negative D: check the key and wording.
- Replace distractors that nobody chooses.
- Use the group sizes given in the question.
Check your understanding
-
1. With groups of 20 each, U = 14 and L = 6 on an item. The discrimination index is:
- 0.50
- 0.70
- 0.30
- 0.40
Show answer
Answer: D. D = (U − L) ÷ n = (14 − 6) ÷ 20 = 8 ÷ 20 = 0.40.
-
2. With groups of 20 each, U = 14 and L = 6. The difficulty index is:
- 0.40
- 0.50
- 0.70
- 0.30
Show answer
Answer: B. P = (U + L) ÷ 2n = 20 ÷ 40 = 0.50.
-
3. An item has a discrimination index of −0.2. The most sensible first step is to:
- Keep it because it is so easy
- Add more items just like it
- Check the key and wording
- Treat it as a highly valid item
Show answer
Answer: C. A negative D means weaker students did better than stronger ones, which often signals a wrong key or an ambiguous stem.
-
4. An option chosen by no student in either group is best described as:
- A non-functioning distractor
- A highly plausible distractor
- A key with high validity
- A sign of a high difficulty index
Show answer
Answer: A. A distractor should attract some students who lack the knowledge. One that nobody picks should be replaced.
-
5. If every student in both groups answers an item correctly, then for that item:
- P is 0 and D is 1
- P is 0.5 and D is 1
- P is 1 and D is 0
- P is 1 and D is 1
Show answer
Answer: C. If U = L = n then P = 2n ÷ 2n = 1 and D = 0 ÷ n = 0. The item is very easy and does not discriminate.
Sign in to keep track of the lessons you finish.