🎧

Future of Computing: From Screens to Audio Interfaces

Jul 25, 2024

Future of Computing: From Screens to Audio Interfaces

Introduction

  • Personal anecdote: Observation of people glued to phones.
  • Realization: Everyone could benefit from less screen time.

Professional Background

  • Funded deep tech at ARPA-E.
  • Google X: Developed moonshot projects.
  • Founded iyo: Focus on creating new tech.

Need for New Computing Paradigm

  • Desire for natural interaction with computers.
  • Vision of a computer that speaks human language.
  • Key challenge: Computers need to handle genuine conversations rather than robotic commands.

Introduction to Audio Computers

  • Prototype reveal: Secret development for six years.
  • Design: Audio computers without screens.
  • Goal: Replace some tasks of visual computers with audio.

Audio-Based User Interface (AUI)

  • Natural language input: Conversations instead of commands.
  • Output: Use “auditory space” instead of visual displays.
  • Features: Ear-wearable device ensuring convenience and privacy.

Demonstration of Audio Interaction

  • Interactive example: Conversation between Jason and Q (voice assistant).
  • Natural conversation: Compared to structured voice commands.
  • Concept: Second-person neuroscience & collective thinking.

Neuroscience of Natural Language

  • Second-person neuroscience: Human collective thinking with conversations.
  • Efficiency: Spoken language is efficient and emotionally rich.
  • Application: Computers with natural language understanding.

Applications and Benefits

  • Email: Conversational briefings instead of typing.
  • Search: Natural queries instead of structured inputs.
  • App integration: All major apps could be redesigned for voice interaction.
  • Contextual understanding: Audio assistants build personal context.

Hands-Free and Heads-Up Goal

  • Reduction of screen time: Improve real-world interactions.
  • Privacy & convenience: Designed for daily wear.
  • Enhanced hearing: Mixed-reality audio experience.

Mixed Audio Reality

  • Concept: Like Apple Vision Pro but for audio.
  • Psychoacoustics: Virtual auditory spaces for high-fidelity sound.
  • Demonstration: Enhancing specific sounds in noisy environments.

Breadth of Audio Computing

  • Software-driven: Various audio transformations by software.
  • Developer potential: Infinite possibilities for audio apps.
  • Examples: Educational apps, fitness coaches, relaxation soundscapes.

Vision for the Future

  • Intuitive computing: Natural user experience without attention monetization.
  • Language: Computers that speak the user’s language.

Conclusion

  • Introduction of the world's first audio computer.
  • Goal to create a computing experience that aligns with human communication.
  • Call for a new era where machines interface with humans naturally.

Note: Applause and audience engagement indicated the positive reception.