🎨

Creating Hand-Painted Animation Using EB Synth

Jul 9, 2024

Creating Hand-Painted Animation Using EB Synth

Introduction

  • EB Synth: Tool to create hand-painted animation from a live footage using a single frame painting.
  • Animator's Pain Point: Traditionally requires thousands of images for a few minutes of animation.
  • Solution: EB Synth requires only a few key frames to generate the animation.
  • Time-Saving Potential: Allows animators to engage in other activities while the animation is generating.

Getting Started

Requirements

  1. Video Footage: Example used - Johnny in a winter coat, shot against a green screen.
  2. Three Key Things:
    • Image Sequence of the video (generated in After Effects as PNG sequence).
    • Key frames to be painted.
    • Optional: Rotoscoping (masking out the subject).

Process

  1. Generate Image Sequence:
    • Open video in After Effects.
    • Render video as PNG sequence.
    • Save PNG images in a designated folder.
  2. Painting Key Frames:
    • Choose key frames that capture as much of the scene as possible.
    • Paint over selected key frames ensuring alignment with the video frame.
    • Save painted key frame(s) with specific naming convention (e.g., 100030.png).
  3. Rotoscoping:
    • Use green screen footage to generate a mask (black and white alpha sequence).
    • Caveat: Masking is optional unless background elements are added separately.

Using EB Synth

Interface Overview

  • Setting Paths: Input paths for source files (key frames, video, mask).
  • Parameters: Optional adjustments for style weight, video weight, and mask weight.
  • Frame Interval: Define which frames to stylize.
  • Output Directory: Name folders for output sequences for organization.

Steps

  1. Load Key Frames:
    • Drag and drop key frame folder into EB Synth.
    • Automatic detection of project directory, file extension, and frame numbering.
  2. Set Parameters:
    • Style Weight: Increase to make animation more stylized.
    • Video Weight: Increase to make animation closer to original footage.
    • Mask Weight: Adjust when dealing with transparent backgrounds.
  3. Frame Intervals:
    • Specify start and end frames for the animation.
    • Use multiple key frames for different intervals if necessary.
  4. Output Naming: Keep output folders organized by naming based on key frames.
  5. Run: Start the synthesis process.

Final Touches

  • Output Check: Review generated frames in the output folder.
  • Compositing: Final touches in After Effects or preferred software.
  • Example: Stylization and compositing demo by concept artist Jacob Evora.

Summary

  • EB Synth: A powerful tool to automate parts of the animation process, drastically reducing the workload on animators and allowing for high-quality stylized animations.

  • Ensures detailed alignment and respects artistic style, making the workflow efficient and rewarding.