Codec Avatars
Meta research project producing photorealistic 3D avatars by scanning a person's face and body across many expressions to build a computer model that can be driven in real time, transmitting encoded expression data rather than video.
As defined in Mark Zuckerberg #3
Where it comes up · 2
Most important claims · 7 of 7Search all claims for “Codec Avatars” →
- The distinguishing value of the Metaverse over a phone video call is that it lets people feel physically present together and participate in shared activities—playing games, holding meetings, mixed-reality hangouts—rather than merely seeing each other on a screen.Mark Zuckerberg #3
- Because a captured avatar reflects how you looked at the time of capture rather than your current state (hair length, shave, weight), and because people may scan a 'best version' of themselves, the technology raises unresolved psychological and identity questions about which version is really 'us'.Mark Zuckerberg #3
- The novel thing about this technology is conveying a sense of almost physical presence: the only thing not physically real is being in the same place, while the intimacy, trust, and nonverbal communication that previously required flying to be together are delivered by short-cutting the laws of physics to provide the social and psychological benefits of presence to anyone in the world.Mark Zuckerberg #3
- Avatar emotion expression should be tunable per person, since some people may prefer an avatar that emotes more strongly than their actual face does—for instance Zuckerberg, who has a relatively stiff physical expression, might want his avatar to better convey how he is actually feeling.Mark Zuckerberg #3
- More than half of communication in an actual conversation is not the words you speak but nonverbal cues and gestures, which is why Codec Avatars that render AI as a realistic person with gestures matter for making AI relationships feel real.Mark Zuckerberg — AI will write most Meta code in 18 months
- Codec Avatars work by scanning a person's face and body across many expressions to build a computer model, so that the headset can send an encoded version of what you should look like rather than a full video, making them both photorealistic and more bandwidth-efficient than transmitting video, especially 3D immersive video.Mark Zuckerberg #3
- Meta's goal is to move from lengthy detailed scans to a quick two-to-three minute scan using just a cell phone—waving it in front of your face and making expressions—that produces avatars of the same quality as the full studio scans, which is one of the last remaining technical challenges.Mark Zuckerberg #3