🤖

Automating Social Media Analysis Process

Feb 22, 2025

Lecture: Automating Competitor Video Analysis Using Airtable and Make

Overview

  • Objective: Automate the process of spying on competitor's social media (specifically TikTok) and downloading their videos, captions, stats, and video transcriptions into Airtable.
  • Tools Used:
    • Airtable
    • Make (previously Integromat)
    • Appify
    • Claude for AI script generation
    • Google Docs

Process Outline

  1. Setup Airtable Database

    • Create tables for users and videos.
    • Define fields for user profiles, video details, and links.
    • Implement views and filters to manage data entries and triggers.

  2. Automate Data Collection

    • Use TikTok profile scraper via Appify to collect videos and profile data.
    • Save collected data into Airtable.
    • Use webhook triggers for instant Airtable updates.

  3. Script Generation

    • Use AI (Claude or ChatGPT) to turn transcriptions into new viral video scripts.
    • Store scripts in Google Docs and link them back to Airtable.

Detailed Steps

1. Building the Airtable Database

  • Base Setup: Create a base named "Social Spy and Viral Scripts".
  • Tables and Fields:
    • Users Table:
      • Fields: Username, Channel (Single Select - TikTok, Facebook, etc.), Profile Pic, Followers, Last Video Created, etc.
      • Use formula fields to manage timestamps and other derived data.
    • Videos Table:
      • Fields: Media (attachments), Captions (long text), Likes, Shares, Views, etc.
      • Link to Users table.
      • Include fields for video attributes (height, width, duration) and SRT files for transcripts.
    • Scripts Table:
      • Fields for document IDs and links to generated scripts.
      • Link back to related videos.

2. Building Automations with Make

  • Initial Setup: Use Make to connect Airtable with Appify and other services.
  • Appify Integration:
    • Use TikTok profile scraper to automate video data collection.
    • Handle user authorization and API key management.
    • Configure batch processing for fetching videos with constraints on number and date.
  • Watch Records vs. Webhooks:
    • Prefer webhooks for real-time updates in Make workflows.
    • Alternative: Polling Airtable for updates with scheduled checks.

3. Data Processing and Script Generation

  • Data Handling:
    • Extract video attributes and user profiles from Appify results.
    • Update Airtable records with fetched data.
  • Script Generation with AI:
    • Use Claude to analyze video transcriptions and generate new scripts.
    • Store resulting scripts in Google Docs.
    • Tailor AI prompts to incorporate brand-specific creative briefs.

4. Testing and Finalization

  • Test Automation Flows:
    • Ensure data flows correctly from TikTok -> Appify -> Airtable -> Google Docs.
    • Test AI script generation and document creation.
  • Community Resources:
    • Join "NoCode Architects" for access to templates and community support.

Tips and Considerations

  • Always test automations step-by-step; fix errors as they appear.
  • Use minimal video count and recent dates during initial setups to avoid exceeding API limits.
  • Customize AI prompts in Claude to better fit brand and content needs.
  • Consider using paid plans for Airtable and other services for optimal performance.

Conclusion

This lecture provides a comprehensive guide to automating the process of social media data analysis and script generation. By leveraging Airtable, Make, Appify, and AI tools like Claude, users can streamline content creation workflows effectively.

Full transcript