• Practice
  • About 16 min
  • 5 practice questions

Item analysis: difficulty index, discrimination index and distractors

Calculate the difficulty and discrimination of a test item from the upper and lower groups, and read a distractor table to decide whether to keep, revise or drop the item.

If something looks wrong, please tell us.

After a multiple-choice test, a careful teacher asks of each item: was it too easy or too hard, did it separate strong students from weak ones, and did every wrong option do its job? This is item analysis. Its formulas are short and appear often in exams, so practising them pays.

Upper and lower groups

Rank the papers by total score. Take a top group (for example the top quarter or so) and a bottom group of the same size, each with n students. For one item, count how many in the upper group (U) and in the lower group (L) answered it correctly. Different books use slightly different group sizes, so always use the sizes the question gives.

The two indices

IndexFormulaWhat it tells you
Difficulty index (facility value, P)(U + L) ÷ 2nProportion answering correctly; high means easy, low means hard
Discrimination index (D)(U − L) ÷ nHow well the item separates upper from lower scorers

P runs from 0 to 1. Items near the middle (around 0.5) usually discriminate best, though a few easy items are useful to start a test gently and a few hard ones to challenge the strongest. D runs from −1 to +1. A high positive D is good, a D near zero means the item does not separate the groups (for example when everyone gets it right), and a negative D means the weaker group did better than the stronger group. That points to a faulty item, such as a wrong key or a misleading stem.

Distractor analysis

Count how many in each group chose each option. A good wrong option attracts some of the lower group and fewer of the upper group. An option that nobody chooses adds nothing and should be replaced. A wrong option chosen by more of the upper group than the lower group suggests an ambiguous stem or a second defensible answer.

Worked example 1: both indices

In a class, the upper and lower groups each have 10 students. On one item, 9 in the upper group and 3 in the lower group answer correctly. Step 1: P = (9 + 3) ÷ (2 × 10) = 12 ÷ 20 = 0.6. Step 2: D = (9 − 3) ÷ 10 = 0.6. Answer: the item is of moderate ease and discriminates well, so keep it.

Worked example 2: reading a distractor table

Each group has 15 students. Option C is the key.

Choices on one item
OptionUpper groupLower group
A15
B00
C (key)116
D34

Step 1: check the totals: upper 1 + 0 + 11 + 3 = 15 and lower 5 + 0 + 6 + 4 = 15, so every student is counted. Step 2: P = (11 + 6) ÷ 30 = 17 ÷ 30, about 0.57. Step 3: D = (11 − 6) ÷ 15 = 5 ÷ 15, about 0.33. Step 4: option B attracted nobody, so it is a dead distractor. Answer: the item works acceptably, but replace B with a more plausible error. Options A and D drew more from the lower group, which is what good distractors do.

Worked example 3: a negative index

Each group has 15 students; 4 in the upper group and 9 in the lower group choose the keyed answer. Step 1: D = (4 − 9) ÷ 15 = −5 ÷ 15, about −0.33. Step 2: a negative value means better students did worse on this item. Step 3: check the key and wording; perhaps the keyed answer is wrong or a distractor is also correct. Answer: do not use the item until it is repaired.

Difficulty = (U + L) ÷ 2n. Discrimination = (U − L) ÷ n. A negative D means the item is faulty and a distractor nobody picks is useless.

— Rule to remember

Key takeaways

  • A higher P means an easier item.
  • D shows how well an item separates strong from weak students.
  • Negative D: check the key and wording.
  • Replace distractors that nobody chooses.
  • Use the group sizes given in the question.

Check your understanding

  1. 1. With groups of 20 each, U = 14 and L = 6 on an item. The discrimination index is:

    1. 0.50
    2. 0.70
    3. 0.30
    4. 0.40
    Show answer

    Answer: D. D = (U − L) ÷ n = (14 − 6) ÷ 20 = 8 ÷ 20 = 0.40.

  2. 2. With groups of 20 each, U = 14 and L = 6. The difficulty index is:

    1. 0.40
    2. 0.50
    3. 0.70
    4. 0.30
    Show answer

    Answer: B. P = (U + L) ÷ 2n = 20 ÷ 40 = 0.50.

  3. 3. An item has a discrimination index of −0.2. The most sensible first step is to:

    1. Keep it because it is so easy
    2. Add more items just like it
    3. Check the key and wording
    4. Treat it as a highly valid item
    Show answer

    Answer: C. A negative D means weaker students did better than stronger ones, which often signals a wrong key or an ambiguous stem.

  4. 4. An option chosen by no student in either group is best described as:

    1. A non-functioning distractor
    2. A highly plausible distractor
    3. A key with high validity
    4. A sign of a high difficulty index
    Show answer

    Answer: A. A distractor should attract some students who lack the knowledge. One that nobody picks should be replaced.

  5. 5. If every student in both groups answers an item correctly, then for that item:

    1. P is 0 and D is 1
    2. P is 0.5 and D is 1
    3. P is 1 and D is 0
    4. P is 1 and D is 1
    Show answer

    Answer: C. If U = L = n then P = 2n ÷ 2n = 1 and D = 0 ÷ n = 0. The item is very easy and does not discriminate.

Privacy · Terms · Refunds · Delivery