Posted by Neal Poeppelmeier, Head of Product
Today we’re excited to continue our collaboration with Snap by bringing XR Cast to VidCon in Anaheim, CA. We know that creators are always on the lookout for new and compelling content for their followers—and our work with Snap allows for just that.
After our first collaboration in April, we saw the power and engagement users experienced in creating their own 3D selfie in a lens that can be used again and again. For this event, XR Cast will be available exclusively at Snap’s VidCon presence where top creators can get volumetrically captured and create their own Snapchat lens.
Leveraging our proprietary compression technology, we worked hand-in-hand with Snap to place the captures into Lens Studio. Within minutes, creators received their customized Lens, featuring their 3D recording in AR, which could be sized up or down, spun around and placed on any surface. Once creators shared their lenses, they could be easily re-shared by their followers, allowing fans to place their favorite creators in AR anywhere.
When it comes to creating content designed to be viewed by millions, we know that visual quality is particularly important. That’s why our team works hard to continuously improve the fidelity of our captures, paying particular attention to key areas like faces. At Vidcon we debuted new and improved captures driven by a number of our recent efforts in machine learning:
- Smarter Mesh Simplification: We’re using our semantic information about our captures to prioritize the mesh triangle budget on areas of high importance, particularly the face while simplifying less complex regions like the torso
- More Efficient Texture Atlas: Using available texture space more effectively allows for higher resolution heads and faces
- Modified Blending:Utilizing the efficient texture atlas and a higher fidelity face mesh in combination with a finely tuned blending approach shows improvement on the face
Keep a lookout for volumetric captures from your favorite creators on Snap—and be sure to add us on Snap to see some of our highlights.
