Meta’s 3D Codec Avatars Can Now be Generated with a Simple Smartphone Scan

Meta’s 3D Codec Avatars is a project consisting of deep generative model of 3D human faces that achieves state of the art reconstruction performance while being computationally efficient and adaptive to the rendering conditions during execution. This typically requires a hardware intensive setup, like MUGSY (171 cameras), but soon, a simple smartphone scan could be all it takes.

All you would need is a smartphone boasting a front-facing depth sensor, like the iPhone’s FaceID. Just pan the phone around your face, and then once more while copying 65 facial expressions. The entire process reportedly takes only 3.5-minutes to complete, but processing it will require hours using a PC with four high end GPUs over the cloud. This is somewhat similar to Epic Games’ RealityScan app.

Meta Quest 2 — Advanced All-In-One Virtual Reality Headset — 128 GB

• Keep your experience smooth and seamless, even as high speed action unfolds around you with a super-fast processor and high-resolution display. (Packaging may vary) Meta Quest packaging will continue to carry the Oculus name and logo during the transition to our new branding.
• Experience total immersion with 3D positional audio, hand tracking and haptic feedback, working together to make virtual worlds feel real.
• Explore an expanding universe of over 250 titles across gaming, fitness, social/multiplayer and entertainment, including exclusive blockbuster releases and totally unique VR experiences.
• Travel universes in blockbuster fantasies, scare yourself witless in horror adventures or collaborate with colleagues in innovative workspaces.
• Come together in incredible social spaces and multiplayer arenas as you take in live events with friends and family, find your new workout crew or join quests with fellow adventurers.

Telecommunication with photorealistic avatars in virtual or augmented reality is a promising path for achieving authentic face-to-face communication in 3D over remote physical distances,” said Meta.