Snap previewed an early version of its real-time, on-device image diffusion model at the Augmented World Expo, which can generate vivid AR experiences instantly. This prototype allows users to type in an idea and see it come to life in AR in real time. This advancement is due to Snap's breakthroughs in optimizing GenAI techniques for faster and more efficient performance on mobile devices. These techniques power various features like Bitmoji Backgrounds, Chat Wallpapers, Dreams, AI Pets, and AI Lenses.
New GenAI Tools for AR Creators
Snap introduced a new GenAI Suite in its AR authoring tool, Lens Studio. This suite enables AR creators to generate custom ML models and assets, significantly reducing the time needed to create high-quality Lenses. The GenAI Suite allows artists, creators, and developers to mix custom ML models with additional AR features, enhancing their creative capabilities.
Snap has collaborated with London’s National Portrait Gallery to create Lenses inspired by iconic portrait styles. Users can choose from these portrait-style Lenses, take a Snap, and submit it to the museum’s “Living Portrait” projection wall.
Lens Studio 5.0
The GenAI Suite is part of the new Lens Studio 5.0 release, which is designed for improved productivity, modularity, and speed. This update provides AR creators, developers, and teams with new tools to personalize their development workflow and build more complex projects.
Snapchat users will see Lenses with this generative model in the coming months, and it will be available to creators by the end of the year. Murphy highlighted that these advancements mark an exciting new direction for augmented reality, allowing for reimagined rendering and creation of AR experiences.
