- Foundation
- About 15 min
- 5 practice questions
Skinner: operant conditioning, reinforcement and punishment
Explain Skinner's operant conditioning, tell positive and negative reinforcement from punishment, and name the main schedules of reinforcement.
If something looks wrong, please tell us.
Thorndike showed that satisfying results strengthen a response. B. F. Skinner, an American psychologist, developed this idea into a full theory called operant conditioning. 'Operant' means a behaviour that operates on the environment, that is, a voluntary action that produces a consequence. Skinner's ideas are used in classrooms every day, often without teachers knowing the names.
The Skinner box
Skinner built a box, now called the Skinner box, in which an animal such as a rat or a pigeon could press a lever or peck a key. When a hungry rat happened to press the lever, a food pellet dropped in. The rat soon pressed the lever more and more often. The food was a consequence that strengthened the pressing. Skinner called any consequence that makes a behaviour more likely a reinforcer.
Reinforcement and punishment
Two simple questions sort out the four kinds of consequence. First, does the behaviour become more likely (reinforcement) or less likely (punishment)? Second, is something added (positive) or removed (negative)? 'Positive' and 'negative' do not mean good and bad here; they mean add and take away.
| Item | Something is added | Something is removed |
|---|---|---|
| Behaviour increases | Positive reinforcement: praise for completed homework | Negative reinforcement: an unpleasant thing is removed, e.g. no extra homework once the class finishes its work quietly |
| Behaviour decreases | Positive punishment: extra work given for talking | Negative punishment: playtime taken away for misbehaviour |
The commonest mistake is to think negative reinforcement is punishment. It is not: all reinforcement, positive or negative, increases a behaviour. Negative reinforcement increases a behaviour by taking away something unpleasant.
Skinner himself preferred reinforcement to punishment in teaching. Punishment may stop a behaviour for a while, but it does not show the learner what to do instead, and it can link the teacher and the subject with fear, as we saw in lesson 1. Reinforcing the right behaviour soon after it happens is usually more effective.
Shaping
Some behaviours are too complex to wait for. Skinner reinforced small steps that came closer and closer to the target, a method called shaping by successive approximations. A teacher who first praises a shy child for answering in one word, then for one sentence, then for a short explanation, is shaping speaking in class.
Schedules of reinforcement
- Continuous: every correct response is reinforced. Learning is quick, but the behaviour also stops quickly when reinforcement stops.
- Fixed ratio: reinforcement after a set number of responses (a reward for every 5 completed sums).
- Variable ratio: reinforcement after an unpredictable number of responses, varying around an average. This produces high, steady responding.
- Fixed interval: reinforcement for the first response after a set time (a weekly test every Friday).
- Variable interval: reinforcement for the first response after unpredictable periods of time (surprise checks of notebooks).
Worked example 1: name the consequence
(a) A student gets a star for reading aloud and reads aloud more. (b) A student's seat belt alarm stops beeping when she fastens the belt, so she fastens it sooner next time. (c) A student loses ten minutes of games for pushing and pushes less. Working: (a) a star is added and reading increases: positive reinforcement. (b) the beeping is removed and fastening increases: negative reinforcement. (c) games are removed and pushing decreases: negative punishment.
Worked example 2: name the schedule
(a) A worker is paid for every 20 bags she packs. (b) A teacher checks homework on random days. Working: in (a) reward depends on a set number of responses, so it is fixed ratio. In (b) reward depends on time, and the time is unpredictable, so it is variable interval. Students keep their homework up to date every day because they cannot predict the check.
Reinforcement increases a behaviour, punishment decreases it. Positive = something added; negative = something removed. Ratio schedules count responses; interval schedules count time.
Classical versus operant: in classical conditioning a stimulus comes before an automatic response (salivation); in operant conditioning a voluntary action comes first and its consequence follows. Key takeaways: Skinner's rats and pigeons, the four consequences, shaping, and the five schedules form the core of this topic.
Check your understanding
-
1. In operant conditioning, a reinforcer is anything that:
- Makes the behaviour it follows less likely
- Makes the behaviour it follows more likely
- Comes before an automatic response
- Is always unpleasant
Show answer
Answer: B. Skinner defined a reinforcer by its effect: it increases the behaviour it follows. Punishment is what makes behaviour less likely.
-
2. A teacher stops nagging as soon as a student starts his work, and the student starts work sooner the next day. This is:
- Positive reinforcement
- Positive punishment
- Negative reinforcement
- Negative punishment
Show answer
Answer: C. Something unpleasant (nagging) is removed and the behaviour (starting work) increases. Removal plus increase is negative reinforcement.
-
3. Taking away a child's mobile phone time because she was rude, so that rudeness decreases, is:
- Negative reinforcement
- Positive reinforcement
- Shaping
- Negative punishment
Show answer
Answer: D. Something pleasant is removed and the behaviour decreases. Removal plus decrease is negative punishment.
-
4. Rewarding small steps that come closer and closer to a target behaviour is called:
- Extinction
- Generalisation
- Shaping
- Spontaneous recovery
Show answer
Answer: C. Reinforcing successive approximations to the target behaviour is shaping.
-
5. A student is rewarded after every 10 correct answers. Which schedule is this?
- Fixed ratio
- Fixed interval
- Variable interval
- Variable ratio
Show answer
Answer: A. The reward follows a set number of responses (10), which is a fixed ratio schedule.
Sign in to keep track of the lessons you finish.