🤖

Insights on Human-Computer Interaction and AI

Aug 21, 2024

Lecture Notes: Human-Computer Interaction and AI

Speaker Introduction

  • Assistant Professor at UC Berkeley, School of Information
  • Research in human-computer interaction (HCI)
    • Focus areas: education, healthcare, justice
    • Social computing and human-centered AI
  • Publications in top venues: AC CHI, CSCW, EMNLP
  • Media coverage: Venture Beat, Wired, The Guardian
  • WT Grant Foundation scholar, Nvidia advisory board
  • PhD from Stanford

Large Language Models and AI

  • Context: Two years since ChatGPT release
  • Implications for work and product management
  • Quote by Russell Ackoff on problems as complex, interrelated messes
  • 80% organizational data is messy and unstructured

XKCD Comic on Machine Learning

  • Illustrates ML as a process of trial and error
  • Importance of correct data processing

Second Wave of AI

  • Shift from generating new data to synthesizing existing data
  • AI deeply embedding into workflows
  • Transition from internet era to quantum era
    • Unlimited information and processing capabilities

Project on Data Synthesis with AI

  • Use of AI for data synthesis rather than generation
  • Challenges with unstructured data
  • Audience experiences with AI processing
    • Issues with data structure, accuracy, stochastic nature

Evaluating AI Models

  • Difficulty in evaluating AI due to non-determinism
  • Vibe-based evaluations as a user-centric approach
  • Reliability and accuracy concerns

High-Stakes AI Applications: Hospital Example

  • Google Translate in medical settings
  • Example of translation errors causing potential harm
  • Discussion on reliability and liability

Implications for Product Managers

  • AI tools are stochastic and non-deterministic
  • Changes in pricing models due to AI integration
  • Importance of reliability (accuracy and verifiability)

AI Project at UC Berkeley

  • Collaboration with students
  • Three workflows for product managers:
    • Q&A widget
    • Pain Point Tracker
    • User Insights Widget

Demonstration of Built Tool

  • Analysis of user data for patterns and insights
  • Example with Notion App Store reviews
  • Widgets for specific tasks in product management
  • Evaluation of tool's usefulness and flexibility in real-world tasks

These notes capture the essence of the lecture on human-computer interaction and AI, highlighting the main topics discussed and providing a summary of the speaker's insights and projects.

Full transcript