Automating Video Creation with AI Tools

Sep 28, 2024

Automating Mid Journey and Luma Labs Video Generation

Overview

  • Automate video creation using Mid Journey and Luma Labs.
  • Create faceless videos for platforms like TikTok and YouTube.
  • Use Airtable for scene building and automation.

Tools and Technologies

  • Airtable: For organizing scenes and managing workflows.
  • Mid Journey: For generating consistent images with animations.
  • Luma Labs: To create video content.
  • Make.com: For building automation workflows.
  • Go API: Not an official Mid Journey API but used for automation.
  • JSON to Video: For merging video clips into a single movie.

Workflow Steps

Setup Airtable

  • Movie Definition: Set parameters like aspect ratio and resolution.
  • Scene Table: Define scene status, image prompts, and use sample images with Mid Journey CF directive.
  • Automation: Automate image generation and video creation.

Scene Creation and Automation

  1. Add Scenes: Define each scene in Airtable.
  2. Generate Images: Use image prompts and CF directives to maintain style consistency.
  3. Select Images: Choose the best image from generated options to upscale.
  4. Generate Video: Create videos for each scene using Luma Labs.
  5. Compile Movie: Use JSON to Video for merging individual scene videos.

Detailed Steps

Airtable Configuration

  • Create tables: Movies and Scenes.
  • Define fields: Width, Height, Aspect Ratio, Scene Status, Image Prompts, etc.
  • Use formulas for calculations like Aspect Ratio.

Automation with Make.com

  • Trigger automation via webhooks in Airtable.
  • Use HTTP requests to interact with Go API.
  • Implement error handling and status checks.

Video Generation Process

  • Image Generation: Trigger Go API to generate and return images.
  • Upscaling: Select and upscale images for better video quality.
  • Video Creation: Use video prompts for animation in Luma Labs.
  • Final Compilation: Merge scene videos into a single output using JSON to Video.

Testing and Debugging

  • Test each automation phase separately for effectiveness.
  • Monitor tasks in Airtable for status updates.
  • Adjust prompts and settings based on output quality.

Final Output

  • Create compelling faceless videos with high consistency and style.
  • Utilize Make.com and Airtable for a streamlined video production process.

Additional Resources

  • No Code Architects Community: For templates, support, and shared knowledge among users.
  • Documentation and API References: Ensure understanding of APIs and tools in use.

Alerts

  • Mid Journey API used is unofficial; read terms and conditions.
  • Frequent updates to APIs may require adjustments to automation workflows.

Conclusion

  • Automation facilitates efficient video creation from scene setup to final video output.
  • This system is ideal for users looking to produce consistent video content efficiently.