Using GenAI in Lens Studio | Scribe

    Using GenAI in Lens Studio

    • Tasha Penwell |
    • 17 steps |
    • 2 minutes
    1
    Lens Studio is a powerful and free augmented reality development tool created by Snap Inc., the company behind Snapchat. To begin creating your own AR experiences and Lenses, you'll need to download Lens Studio from the official Snap AR website: <https://ar.snap.com/download?lang=en-US> This software is completely free to use and provides a comprehensive set of features for both beginners and experienced developers. Lens Studio allows you to design, develop, and publish AR effects and experiences that can be used on Snapchat and other platforms. Key points about Lens Studio: - It's available for both Windows and macOS operating systems - Regular updates introduce new features and improvements - The latest version (5.2.1 as of October 22, 2024) includes advanced capabilities like 3D Upper Body Tracking and Mesh - It comes with sample projects and tutorials to help you get started By downloading Lens Studio, you'll gain access to a suite of tools that enable you to bring your creative AR ideas to life, whether you're an individual creator, educator, or part of a brand looking to engage with audiences through immersive experiences.
    2
    Open Lens Studio and select **Default** for our new project.
    3
    The dashboard is comprised of panels with specific features and functions. The two most important ones are found on the left side of the screen. The **Scene Hierarchy** contains elements needed for your filter. Notice some are automatically added.
    4
    The **Asset Browser** is used to house all the assets used in your filter.
    5
    On the right side of the screen, you will see the Preview. Notice that this Preview uses one of the models provided by Lens Studio. You can alternatively select to use yourself as the model to test images and asset placement.
    6
    You will also find a tab labeled **GenAI Suite**. Click on this tab to begin exploring.

    GenAI Tools

    7
    We can see some GenAI options are immediately available for use. Click **View Full GenAI Suite** to expand the options.
    8
    One of the new options in the full menu is Garment. Click on **Garment.**
    9
    With this tool, we can decide what type of garment we would like to create for the AR filter. This demo is selecting Hoodie
    10
    In the prompt, add a prompt for the text to image AI generation tool.
    11
    We added "hearts and flowers". Click on **Generate** to see the design result.
    12
    View the product design generated and iterate as necessary or click **Import to Project.**
    13
    Close out the Garment box
    14
    Click **Preview** tab to see the results on the model image.
    15
    You have the option to update the model to one that best suits your vision and demographic for this filter.
    16
    In this demo, we decided to use a Smiling Person. Continue to iterates as needed and publish when ready.
    17
    Lens Studio's GenAI Suite includes a powerful feature called Garment Generation, which is an advanced tool for creating virtual try-on experiences for upper body clothing. Garment Generation in Lens Studio allows creators to: - Transform 2D images of clothing into 3D virtual garments for real-time AR try-on experiences - Generate realistic upper body garments, including shirts, sweaters, coats, blazers, and hoodies - Create virtual try-on Lenses quickly and easily, without requiring extensive 3D modeling skills Learn more about how a fashion retailer is using this tool at <https://ar.snap.com/blog/lens-studio-5.0.17?lang=en-US>