Lecture Notes: Turning Chat GPT into a Smart Personal Assistant

Introduction

• Speaker: Lon
• Topic: Enhancing Alexa with Chat GPT capabilities
• Objective: Transform Chat GPT into a smart personal assistant and name it Jarvis

Key Points

Experience with Alexa

• Using Alexa for a year
• Limited to basic commands (e.g., turning lights on and off)
• Alexa's limitation in deep conversations

Chat GPT and Deep Conversations

• Chat GPT's superior ability in engaging deep conversations
• Goal: Integrate this capability into a personal assistant

Plan and Components

• Conversion Requirements:
  • Speech to Text
  • Feeding text to Chat GPT
  • Text to Speech synthesis

Naming the Assistant

• Chosen Name: Jarvis (inspired by Iron Man)
• Target functionalities include: contact support, deep conversation capabilities

Device and Platform

• Possible devices: Smartphone, Desktop, Raspberry Pi
• Initial choice: Desktop

Technical Components

• Libraries for Speech and Text Conversion:
  • OpenAI Whisper for Speech to Text
  • Tortoise.AI for Text to Speech
• Challenges:
  • Feeding text to Chat GPT

Working with Chat GPT APIs

• Lack of official APIs for Chat GPT
• Using unofficial APIs (Node.js, Python)
• Issues with session tokens and user experience

Integration with Siri

• Exploring ways to integrate Chat GPT with Apple’s Siri
• Solution: Use Siri Shortcuts to interface with GPT-3 API

Demonstration

• Example queries:
  • "Are you better than Alexa?"
  • "What is the meaning of life?"

Conclusion

• Recap of the experiment's success
• Future directions for videos and improvements
• Festive greeting: Happy Chinese New Year