Creating Films with AI Tools

Aug 20, 2024

Creating AI-Powered Films

Overview

  • Lecture on how to create a short film using AI tools.
  • Step-by-step process to create AI-powered films using different tools.

Process Overview

  1. Story Creation
    • Use Chat GPT to create the story/script.
  2. Image Generation
    • Generated images will be created from the story using an image generation tool.
  3. Video Creation
    • Use generated images to create videos with another AI tool.

Why Generate Images First?

  • No perfect AI tool for direct text-to-video generation currently available.

Step 1: Create the Story

  • Use Chat GPT for script creation.
  • Prompt for Chat GPT:
    • Generate keywords describing main characters.
    • Break the story into shots with keywords.
    • Option to replace story synopsis with your own and customize prompts.
    • Get sound effects recommendations for each shot.

Step 2: Generate Images with Leonardo AI

  • Leonardo AI Setup:
    • Dashboard: Click on image generation.
    • Copy main character keywords from Chat GPT and paste them.
    • Choose cinematic preset, adjust advanced settings (e.g., enable negative prompts).
    • Set aspect ratio to 16:9.
    • Click generate to create character images.
  • Repeat for all shots:
    • Copy each shot's story and keywords to generate relevant images.
    • Ensure consistent character appearance (e.g., clothes).

Step 3: Animate Images

  • Tools Tried:
    • Leonardo Generate Motion
    • Pabs (results not satisfactory)
    • Gen 2 from Runway (chosen for powerful features).
  • Upload images to Runway AI:
    • Click on 'Image to Video'.
    • Use motion brush for specific area controls.
    • Generate video and download.

Step 4: Download Sound Effects

  • Use Pixabay for free sound effects:
    • Copy sound effects from Chat GPT for each shot and download.

Step 5: Video Editing

  • Tips for Editing:
    • Mix sound effects with clips.
    • Add fade in/out transitions.
    • Use only suggested sound effects from Chat GPT.
    • Add adjustment layer for vignette effect.
    • Cover any watermarks with logos or text.

Accessing the Prompt Sheet

  • Instructions to access the prompt sheet from the video description:
    1. Click the provided link and verify as a human via ads.
    2. Close redirected pages as instructed.
    3. Generate link and unlock the prompt sheet.

Conclusion

  • Final note on the creative opportunities and sharing creations made with these tools.
  • Encouragement to subscribe for more AI content.