AI Agent Workflow Setup with Siri

Sep 28, 2024

Setting up an AI Agent Workflow with Siri in NAN

Overview

  • Max from NAN explains how to set up a workflow template in NAN to interact with an AI agent via a Hey Siri voice command.
  • The workflow allows Siri to converse with the AI agent, e.g., "Hey Siri, ask agent to tell me a joke."
  • The template enables context and statefulness to improve AI performance in real-world tasks.

Setting Up the Template

  1. Accessing the Template:

    • Start on the template page and click the "Use Workflow" button.
    • If familiar with the template library, click "Import"; otherwise, copy and paste into your NNN account.

  2. Configuring Credentials:

    • Provide necessary credentials on the setup page.
    • Use an OpenAI account or create new credentials if needed.
    • Enter your OpenAI API key or skip if using another model.

  3. Selecting AI Models:

    • For different models, break the connection between the AI agent and chat model.
    • Use Grok for a free option or connect with open source models like Lama.
    • Recommended: Use a faster model like 4.0 Mini for voice use cases.

  4. Saving the Workflow:

    • Save the configured workflow.

Setting Up Apple Shortcut

  1. Download Shortcut:

    • Use the link in the setup steps sticky note to download the Apple shortcut.
    • Send to an iOS device via email or AirDrop if necessary.

  2. Installing on macOS:

    • Open the downloaded shortcut in the Shortcuts app.
    • Add the shortcut.

  3. Configuring the Shortcut:

    • Change the URL to the webhook trigger URL from the NNN workflow.
    • Ensure you switch from test URL to production URL.

  4. Activate Shortcut and Test:

    • Save and activate the workflow.
    • Test using Siri commands.

Customizing the Template

  • The template is a starting point for customization.
  • Possible enhancements include integrating data from apps like Notion.
  • Use system messages or user text to reference additional data.

Community Engagement

  • Share custom versions of the workflow with the community.
  • Upload creations or share with Max for potential feature in future vlog updates.
  • Connect with Max on Twitter and LinkedIn.

Closing

  • Encouragement to explore and customize the workflow further.
  • "Happy Flowgrounding" sign-off from Max.