Overview
John, a cinematographer and director, demonstrates how he used AI video tools alongside real footage to create a cinematic trailer, sharing techniques and practical workflow tips for indie filmmakers working with limited budgets.
Introduction to Project and AI Tool
- The goal was to make a cinematic trailer for a non-existent film using a mix of AI-generated and real footage.
- LTX Studio, an AI video tool, was used from script to storyboard to AI-generated video.
- The chosen subject was a trailer adaptation of the novel "Blood Meridian" by Cormac McCarthy.
Workflow in LTX Studio
- Created storyboards by importing a script or story overview, then refining with genre, tone, and keywords.
- Characters were customized in the tool for age, appearance, and clothing, with options to add or refine characters as needed.
- Locations, scenes, and involved characters were detailed in the breakdown section.
- Storyboards were built out, with each scene represented visually; shots could be customized, referenced, or redrawn by hand.
- Additional tools included shot composition, uploading reference images, regenerating images, upscaling, object removal, facial expression changes, and camera angle adjustments.
- Scene aesthetics, character clothing, and sound elements were further customized.
Adding Motion and Customization
- Motion could be auto-generated by the AI or manually refined in the motion editor.
- Settings allowed for changing time of day, weather, style, and adding voiceover or scene sounds.
Real vs. AI Footage Integration Techniques
- The trailer began with real footage to leverage perceptual fluency, helping viewers accept subsequent AI-generated shots.
- AI was used for wide establishing shots, backgrounds, or to create scenes impossible to film in real life.
- Hybrid shots combined real actors on green screen with AI-generated backgrounds, composited together in Premiere Pro and Photoshop.
- Consistency between real and AI shots was achieved by matching perspective, lighting, and movement.
Case Study: Trailer Shot Breakdown
- The first three shots were real footage to set expectations.
- Shots four through six were fully AI-generated, focusing on establishing or experimental imagery.
- Shots seven through ten used hybrid workflows, blending green screen actors with AI backgrounds or compositing real and AI elements for visual effects.
- The final segment alternated between AI-generated and on-location shots, aiming to blur lines between real and artificial visuals.
Key Takeaways for Filmmakers
- Combining real and AI footage makes AI-generated shots more believable.
- As AI tools advance, precise control over character consistency, locations, and environments will be crucial.
- Viewers were encouraged to watch the trailer and guess which shots were AI-generated, testing the effectiveness of the blending techniques.