Lecture Notes: Automating Competitor Analysis with Airtable and TikTok Scraper

Introduction

• Overview of creating an automation to monitor competitor's social media.
• Aim: Download TikToks to Airtable with captions and stats.
• Utilize TikTok scraper and Airtable for automation.
• System can be expanded to other platforms like Instagram.

Setting Up Airtable Database

Creating the Database

• Start with a blank Airtable database.
• Add columns to handle various data points:
  • Social Profile Name: Select channel (e.g., TikTok, Facebook, YouTube, Instagram).
  • Profile Information: Username, Channel, Profile Picture.
  • Metrics: Number fields for followers, following, total likes, total videos, etc.
  • Additional Fields: Attachment for profile picture, checkboxes for run now and verified status, formula for record ID.

Building the Videos Table

• Columns: User reference, media info, caption, stats (likes, shares, views, saves), dimensions (height, width, duration), comments, SRT (transcript download).
• Link videos to user profiles.

Automations Setup

• Use Airtable automations to manage triggers and updates.
• Run TikTok scraper to collect data and update Airtable records.

Automation with TikTok Scraper

Setting Up Appify

• Appify integration for scraping TikTok profiles.
• Use Appify's TikTok profile scraper actor.
• Manage API connections and data retrieval.

Trigger and Data Flow

• Use Airtable's "Run Now" checkbox to trigger data collection.
• Appify processes the profile, returns data to Airtable.
• Data captured includes videos, profiles, captions, and stats.

Using Make.com

• Automate data transfer from Appify to Airtable.
• Use webhooks for instant data updates.

Generating Viral Scripts

Script Generation Process

• Use captured transcription to generate new scripts.
• Integrate Claude for text generation, optionally can use ChatGPT.
• Script generation based on predefined creative briefs.

Final Data Handling

• New scripts saved in Google Docs.
• Airtable updated with links to generated scripts.

Managing Automations

• Turn on automations after testing and setup.
• Continuous monitoring and script generation based on new videos.

Community and Resources

• Join NoCode Architects for templates and further automation examples.
• Access to blueprints and active community support.

Conclusion

• The system provides comprehensive competitor analysis via automated social media scraping.
• Easily adaptable and expandable to other platforms and use-cases.