🌐

Creating AR Experiences with Lens Studio

Jul 1, 2024

Creating AR Experiences with Lens Studio

Introduction

  • Speaker: Tom from Object Space
  • Specializes in 3D and Augmented Reality (AR) art
  • Focus: Creating AR experiences using Lens Studio by Snapchat
  • Objective: Show how to create a full-body track lens for Snapchat and a world AR filter

Prerequisites

  • Previous video: Introduction to Lens Studio and building an AR avatar
  • Void NFT Model: Download from the official Void website for the tutorial
  • Software Needed:
    • Lens Studio (Snapchat's AR development platform)
    • Miximo (Adobe's rigging and animation platform; Adobe login required)
    • Optionally: Blender or Maya for advanced rigging (or use online converters)

Steps to Create Full Body Track Lens

  1. **Download Void NFT Model: **
    • Ensure the model is downloaded from the official website
  2. **Upload Model to Miximo: **
    • Prepare model by removing existing rig (using Blender, Maya, or online converters)
    • Convert FBX to OBJ (no rig information)
    • Upload OBJ to Miximo
  3. Rigging in Miximo:
    • Define chin, wrist, elbow, and knee positions for rigging
    • Download the newly rigged character in T-pose as FBX
  4. **Set Up in Lens Studio: **
    • Create a new project
    • Import the original FBX, stripped OBJ, and Miximo-rigged FBX
    • Add body tracking and match rig points with body attachment points
    • Scale and position the character
  5. **Apply Textures and Materials: **
    • Import and apply textures to the materials of the rigged model
    • Use Simple PBR material for base color

Creating a World AR Filter

  1. **Choosing Animations in Miximo:
    • Select animations from Miximo and apply them to the rigged character
    • Download the animated character as FBX
  2. **Using Lens Studio Templates: **
    • Open a world template (e.g., Animated World)
    • Replace template assets (e.g., Red Panda) with the animated Void model
    • Adjust collision touch box for interaction
    • Add materials and textures to the model
    • Enable shadows for the model**

Additional Tips

  • Use the Asset Library for pre-built assets and post effects in Lens Studio
  • Explore various post effects (e.g., VHS effect, analog TV effect) to add styles
  • Sync projects with Snapchat on mobile for testing and publishing
  • Customize project info: name, logo, preview video before publishing

Publishing Lenses

  • Set the lens public or private when publishing
  • Follow the submission process in Lens Studio

Closing Notes

  • Encourage creativity and sharing of AR filters
  • Tom's contact details and Ethereum address for donations provided
  • Join the Void community via Discord for more updates

Summary

  • Lens Studio and Miximo can be powerful tools for creating engaging AR experiences
  • Follow the tutorial to create body tracking and world AR filters
  • Explore, experiment, and share your AR creations