Notes on AI Video - Stable Diffusion Techniques

Introduction

• Focus on enhancing images using Stable Diffusion
• Tips for editing elements like people in motion, water, and other image components
• Aim to create high-quality images with minimal effort

Enhancing Water and Beach Waves

• Example Image: Created in 3ds Max and rendered in Corona
• Goal: Improve look of water and waves to make the beach realistic
• Steps:
  • Select the area to improve (beach waves)
  • Use prompt: "super realistic beach waves from the top"
  • Choose the model (e.g. Photon or original Stable Diffusion model)
  • Result: More realistic waves and natural shore appearance
  • Experiment with different iterations and noise strength for better results.

Improving Boat Waves

• Select the area around the motorboat for enhancement
• Use prompt: "wave tail from the moving yacht"
• Add negative prompt: "big waves" to avoid over-exaggeration
• Results show more depth and shadows, enhancing the image compared to 3D results
• AI saves time compared to searching for images for photo bashing.

Applying Motion Blur to 3D People

• Difficulty in achieving realistic motion blur manually in Photoshop
• AI offers more realistic motion blur, mimicking real-life photo effects
• Steps:
  • Use prompt: "super realistic Arabic lady walking in motion blur"
  • Select the person to improve and adjust parameters
  • Model choice: "Realistic Vision" for better results with people
  • Results may include AI hallucinations (e.g., extra limb) which can be regenerated
  • Experiment with denoising strength to find optimal balance (0.3 recommended).

Background and Landscape Generation

• AI can be used to swap out backgrounds or landscapes to save modeling time
• Example: Adding a pool to an image
  • Rough sketch of the pool created
  • Prompt: "super realistic water in the pool"
  • Use inpainting feature for improvements on generated images
  • Cropping and adding reflections can enhance results further.

Creating a Background Cityscape

• Generate realistic cityscapes based on rough sketches
• Use aerial perspective and reflections in prompts
• Experiment with different prompts to see variations in output
  • Examples: Adding fog to the scene
  • Check for lighting direction and other details for realism.

Conclusion

• Importance of experimentation with prompts and settings in Stable Diffusion
• AI tools can significantly speed up workflow while maintaining image quality
• Encouragement for feedback and sharing improvements in skills.