Creating Hand-Painted Animation Using EB Synth

Introduction

• EB Synth: Tool to create hand-painted animation from a live footage using a single frame painting.
• Animator's Pain Point: Traditionally requires thousands of images for a few minutes of animation.
• Solution: EB Synth requires only a few key frames to generate the animation.
• Time-Saving Potential: Allows animators to engage in other activities while the animation is generating.

Getting Started

Requirements

1. Video Footage: Example used - Johnny in a winter coat, shot against a green screen.
2. Three Key Things:
   • Image Sequence of the video (generated in After Effects as PNG sequence).
   • Key frames to be painted.
   • Optional: Rotoscoping (masking out the subject).

Process

1. Generate Image Sequence:
   • Open video in After Effects.
   • Render video as PNG sequence.
   • Save PNG images in a designated folder.
2. Painting Key Frames:
   • Choose key frames that capture as much of the scene as possible.
   • Paint over selected key frames ensuring alignment with the video frame.
   • Save painted key frame(s) with specific naming convention (e.g., 100030.png).
3. Rotoscoping:
   • Use green screen footage to generate a mask (black and white alpha sequence).
   • Caveat: Masking is optional unless background elements are added separately.

Using EB Synth

Interface Overview

• Setting Paths: Input paths for source files (key frames, video, mask).
• Parameters: Optional adjustments for style weight, video weight, and mask weight.
• Frame Interval: Define which frames to stylize.
• Output Directory: Name folders for output sequences for organization.

Steps

1. Load Key Frames:
   • Drag and drop key frame folder into EB Synth.
   • Automatic detection of project directory, file extension, and frame numbering.
2. Set Parameters:
   • Style Weight: Increase to make animation more stylized.
   • Video Weight: Increase to make animation closer to original footage.
   • Mask Weight: Adjust when dealing with transparent backgrounds.
3. Frame Intervals:
   • Specify start and end frames for the animation.
   • Use multiple key frames for different intervals if necessary.
4. Output Naming: Keep output folders organized by naming based on key frames.
5. Run: Start the synthesis process.

Final Touches

• Output Check: Review generated frames in the output folder.
• Compositing: Final touches in After Effects or preferred software.
• Example: Stylization and compositing demo by concept artist Jacob Evora.

Summary

• EB Synth: A powerful tool to automate parts of the animation process, drastically reducing the workload on animators and allowing for high-quality stylized animations.

• Ensures detailed alignment and respects artistic style, making the workflow efficient and rewarding.