Immersive Sound

Definition

• Immersive sound is the sound experience we encounter in our daily lives.
• It allows us to perceive the position, distance, and environment of sounds around us.

Simulation of Immersive Sound

• At Imperial College London, the Audio Experience Design Team simulates immersive sound in virtual environments.
• Utilizes 31 loudspeakers to position sound sources realistically.
• Headphones can also be used to deliver sound directly to our ears.

Individual Differences in Hearing

• Each person's hearing system is unique due to:
  • Size of the external ear.
  • Distance between ears (head size).
  • Variation in shoulder and torso shapes affecting sound reception.
• Example: Different ear shapes lead to different sound perceptions.

Approaches to Create Realistic Sound Experiences

1. Adapt Technology to Individuals

• Acoustic Measurement: Use microphones at the entrance of the ear canal to measure how sounds are filtered by individual anatomical features.
  • This method is expensive and time-consuming.
• Simpler Technologies: Use 3D scanners or photos of the ear combined with machine learning to create an acoustic signature.

2. Adapt Individuals to Technology

• Past research indicates that people can adapt to altered spatial hearing cues.
• Example: Wearing tubes in ear canals can simulate a larger head, impacting sound localization.
• Training methods:
  • Virtual reality exercises to determine sound source positions.
  • Tasks reduce visual feedback over time, relying solely on auditory perception.

Sonicom Project

• Funded research project focusing on personalization of immersive audio.
• Explores both adapting technology to individuals and training individuals to adapt.

Applications Beyond Virtual Reality

• Important for individuals with altered hearing (e.g., hearing loss, cochlear implants).
• Cochlear implants can distort sound perception, affecting localization abilities.
• Improving Experiences: Develop better technology and training for cochlear implant users.

Virtual Reality Training for Cochlear Implant Users

• Developed games to help users navigate sound environments (e.g., cafes, shooting tasks).
• Goal: Enhance perceptual skills for better real-life application.
• Aims to improve the quality of life for users by allowing them to utilize spatial sound effectively.

Bears Project

• Funded by NIHR (National Institute for Health Research).
• Focuses on deploying immersive audio technology in NHS clinical practice.

Conclusion

• The research at Imperial College London aims to enhance immersive audio experiences and improve auditory skills for various populations.
• More information can be found on their website, including demonstrations of their technology.