Audio Perception Lecture Notes

Introduction to Sound Perception

• Sound A vs. Sound B
  • Sound A: 100 Hz sine wave.
  • Sound B: 100 Hz + 150 Hz + 200 Hz.
  • Despite B having higher frequencies, A perceived as higher.
  • Importance of understanding how our ears perceive sound beyond just frequency detection.

Audio Illusions

• Series of audio illusions to illustrate sound perception.
• Recommendations for headphone use for enhanced experience.

Sydney Town Hall Organ

• History: Built in 1890, largest organ in the world.
• Feature: Mimics many instruments (one-person orchestra).
• Composition: 8,000 pipes to create varied sounds.
  • Types of Pipes: Wooden (deep sounds) and metal (brassy sounds).

Sound Production

• Pipes of the same length produce the same fundamental frequency.
• Different materials produce distinct overtones leading to different timbers.
• Overtones and Harmonics:
  • Overtones: Higher frequencies that affect sound quality.
  • Harmonics: Integer multiples of the fundamental frequency.

Low Frequencies in Organs

• Sydney Town Hall has a 64-foot pipe producing 8 Hz frequency.
• Organs generally can play down to 16 Hz with a 32-foot pipe.
• Historical Context:
  • Georg Joseph Vogler's portable organ using harmonics to create low frequencies for travel.

Shepard Tone Illusion

• Example from Super Mario 64: Endless staircase sound.
• Shepard Tone: Multiple frequencies played in octaves, creating illusion of continual ascent.
  • High notes fade while low notes rise, creating an infinite climb.
  • Emotional responses observed: anxiety, nervousness (e.g., in Dunkirk soundtrack).

Phantom Word Illusion

• Two speakers saying different words simultaneously leads listeners to perceive mixed words based on their expectations.
• Influence of context and familiarity on auditory perception.
• Mondegreens: Misheard phrases often influenced by visual or contextual cues.

Visual Cues Affecting Hearing

• McGurk Effect: Visual information can alter what we hear (e.g., "bear" vs. "fair").
• Sound and Visual Interplay: Perception is influenced by visual context.

Cocktail Party Effect

• Focus on one voice amidst background noise.
• Techniques:
  • Identifying the source of sound based on volume and directionality.
  • Sounds from different locations allow for easier focus.

Sound Localization

• Cues for Identifying Sound Source:
  1. Volume: Sound is louder in the ear closest to the source.
  2. Frequency Attenuation: High frequencies are dampened more than low frequencies.
  3. Time Delay: Sound arrives at one ear before the other.
  4. Phase Difference: Difference in arrival time at different points of the wave cycle.

Individual Variability in Sound Localization

• Unique ear shapes (pinna) affect sound perception and localization.
• Adaptability of the brain to new ear shapes, as demonstrated by a 1998 study.

Historical Developments in Sound Detection

• Early devices (topophone) for locating ships in fog.
• Use of sound mirrors in WWI to amplify sound for detecting planes.

Conclusion

• Acknowledge the complexity of auditory perception and illusions.
• Importance of critical thinking in discerning auditory information.
• Sponsor: Introduction to Brilliant for learning and enhancing problem-solving skills.