Lecture Notes on Recent AI Developments

Introduction

• OpenAI 01 release is monumental.
• Some significant stories have been overshadowed.

Fay F Lee and Spatial Intelligence

• Fay F Lee: Prominent Chinese-American computer scientist.
• Known for ImageNet in AI and computer vision.
• New focus: Spatial Intelligence.
  • Impacts creation, design, learning, AR/VR, robotics.
  • World Labs: Developing large world models.
  • Goal: Enable understanding and interaction with 3D world.

Impact of Spatial Intelligence

• More fundamental than verbal intelligence.
• Helps in reasoning, moving, inventing.
• World Labs aims to create 3D worlds with physics, semantics.
• Potential for artists, designers, engineers to imagine and create.

AI in Medicine

• Opinion on AI reducing demand for human doctors.
• OpenAI's 01 model ("strawberry model") excels in medical diagnostics.
• Benchmark: Agent Clinic Med QA scores 80%.
• AI's role in diagnosing, interpreting medical images, treatment plans.
• Future prediction of reduced doctors' roles due to AI.

AI Performance and Scaling Laws

• New scaling laws show improvement without diminishing returns.
• OpenAI 01 model: Significant improvement in IQ tests.
• Terren Tao's feedback on AI's reasoning capabilities.
• Incremental improvement in AI could impact research tasks.

AI Consciousness Debate

• Industry leaders suggest AI might be slightly conscious.
• Controversial views on AI consciousness.

AI Agents and Testing

• Windows Agent Arena: New benchmark for AI agents on computers.
• Agents can reason, plan, act using language models.
• Expected progress in AI agents within 2 years.

Gen-3 Video-to-Video Technology

• Available for paid plans.
• Transforms input videos into different styles.
• Practical applications in CGI industry for pre-visualization.

Future AI Models and Expectations

• OpenAI's Orion model hinted for winter release.
• Anticipation of further advancements.

Closing Remarks

• Video demonstration of Runway's video-to-video capabilities.
• Continued growth and surprises in AI development expected.