OpenAI Strawberry Grok Innovations

Oct 21, 2024

Lecture Notes: OpenAI and Strawberry Grok Updates

Introduction

  • OpenAI released chain of thought models called Strawberry.
  • Launch of Strawberry Grok, providing chain of thought functionality with Grok's speed.
  • Response from OpenAI: Models now have real-time data access.
  • Introduction of SAUBURY GROK 2.0, with enhanced capabilities.

Features of Strawberry Grok

  • Chain of Thought Introspection: Enhances decision-making by thinking through answers.
  • Autonomous Agent Feature:
    • Added to Pocket Grok.
    • Capable of looking up answers if LLM doesn't have them.
    • Now available in Strawberry Grok, improving its effectiveness.

Demonstration

  • Setup: Demonstration of Strawberry Grok’s clean session.
  • Task: Asked for the forecast of Sunday's Green Bay Packers game.
    • Initial LLMs lack real-time information.
    • Previous chain of thought feature didn’t assist in real-time data.
    • Autonomous Agent now enables real-time data lookup.

Technical Details

  • Information Retrieval: Uses chain of thought and seeks secondary sources to verify.
  • Model Switching: Switched from Mixtrel to LAMA 3.2 for better results.
  • Token Usage:
    • Configure PocketGrok for local provider to save tokens.
    • Comparison to unlimited talk/text funding on cell phones.

Advanced Logic

  • Boolean Logic: Forces double-checking by finding agreeing sources.
  • Challenges:
    • Predicting game location and weather was complex.
    • Managed ambiguity without being told the current date.
  • Logic Tuning:
    • Leaning towards skeptical results.
    • Customizable settings for less cynical functionality.

Learning and Memory

  • Retention of Information: Accumulates and retains information.
  • Disabling Features: Can demonstrate learning even with features off.
  • Persistence:
    • Live demo on Streamlit doesn’t retain data.
    • Local setups can retain and learn based on hardware capacity.

Summary

  • AI with Pocket Grok can learn and remember autonomously.
  • Discussion of AI capabilities and previous conversations.

Closing

  • Segment: AI Tips with Jay.
  • All rights reserved by AI Tips with Jay.