Overview
This lecture covers the basics of operant conditioning, its differences from classical conditioning, core theoretical concepts, experimental paradigms, and practical implications, including shaping, chaining, reinforcers, punishers, and challenges in behavior modification.
Introduction to Operant Conditioning
- Operant conditioning involves learning associations between behaviors and outcomes rather than between stimuli.
- Thorndike’s law of effect: behaviors with positive outcomes are more likely in the future, negative outcomes are less likely.
- Unlike classical conditioning, operant conditioning does not require conscious insight or understanding.
SRO Contingency Framework
- In operant conditioning, the learned association is stimulus-response-outcome (SRO).
- Stimulus (S): context or environmental cue.
- Response (R): behavior performed by the organism.
- Outcome (O): consequence that follows the response.
Reinforcement and Punishment
- Reinforcer: outcome that increases the likelihood of a behavior.
- Punisher: outcome that decreases the likelihood of a behavior.
- Positive = adding a stimulus; Negative = removing a stimulus.
- Four types: positive reinforcement, negative reinforcement, positive punishment, negative punishment.
Nature of Responses and Stimuli
- Initially thought responses were reflexive; later research shows animals can adaptively change behaviors to achieve the same outcome.
- Responses are best viewed as classes of behaviors (behavioral units) producing a desired effect.
- Discriminative stimulus: signals when a particular SRO contingency is in effect (context matters).
Operant Conditioning Paradigms
- Skinner box allows automated, flexible, and varied operant conditioning experiments using rats or pigeons.
- Rate of response increases with reinforcement, decreases with extinction (when reinforcement stops).
Classical vs. Operant Conditioning
- Classical: learning associations between two stimuli; outcome is delivered regardless of behavior.
- Operant: learning associations between behavior and outcome; outcome contingent on behavior.
Shaping and Chaining Complex Behaviors
- Shaping: reinforcing successive approximations of a complex behavior.
- Chaining: building complex behavior sequences by linking SRO contingencies where each step is a cue for the next.
Types and Effectiveness of Reinforcers and Punishers
- Primary reinforcers: satisfy basic biological needs (e.g., food).
- Secondary reinforcers: learned through association (e.g., money).
- Effectiveness of reinforcement depends on the organism’s state and reinforcement history.
- Punishment can reduce behavior but is less predictable and has more risks (emotional reactions, aggression).
- Effective punishment requires constant contingencies, awareness of concurrent reinforcement, careful intensity, and consideration of unpredictability in behavior changes.
Key Terms & Definitions
- Operant Conditioning — learning process involving associations between behaviors and their outcomes.
- Law of Effect — behaviors followed by positive outcomes increase, those followed by negative outcomes decrease.
- SRO (Stimulus-Response-Outcome) Contingency — the association learned in operant conditioning.
- Reinforcer — outcome that increases a preceding behavior.
- Punisher — outcome that decreases a preceding behavior.
- Discriminative Stimulus — a cue that signals when a specific behavior will produce a particular outcome.
- Shaping — reinforcing successive steps toward a complex behavior.
- Chaining — linking multiple SRO associations to build complex behaviors.
- Primary Reinforcer — satisfies a basic biological drive.
- Secondary Reinforcer — acquired value through association with a primary reinforcer.
Action Items / Next Steps
- Review the four categories of reinforcement and punishment.
- Read next chapter on neural substrates of operant conditioning.
- Prepare discussion points on ethical implications of punishment for class.