Person
1 episodes · 21 quoted claims
Meta's Codec Avatars research project builds a computer model of a person's face and body from scans taken in many expressions.
“And we've built a computer model of sort of each of our faces and and bodies, and, um, the different expressions that we make.”
Mark Zuckerberg says Codec Avatars are more bandwidth efficient than transmitting full video because the headset sends only an encoded version of the user's expression.
“it's also actually much more bandwidth efficient than transmitting a a full video, or especially a 3D immersive video of of a whole scene like this.”
Meta is working on a phone-based scan that would take two to three minutes and produce avatars of similar quality to the current detailed scans.
“But overall, have the whole process just be two to 3 min and then produce something that's of the quality of what we have right now.”
Mark Zuckerberg says Meta has received feedback that cartoon-style avatars in Workrooms feel less realistic to some users in meetings.
“people have a hard time with the fact that the avatars are so expressive and and and don't feel, you know, as as realistic in that environment”
Mark Zuckerberg says Meta Quest 3 has a stronger chipset than the Quest Pro at about a third of the cost.
“Quest Three, even though it's not, you know, the the Pro product, um, actually has a stronger chipset in it than the Pro line. At a 3rd of the cost.”
Meta worked with Qualcomm on a custom version of Qualcomm's next-generation VR and mixed reality chipset used in Quest 3.
“Qualcomm just came out with their next generation chipset for for VR and MR. Um, that we worked with them on a on a kind of custom version of it”
Mark Zuckerberg says the mixed reality cameras and sensors in Meta Quest 3 have several times the resolution of those in Quest Pro.
“So we got the resolution for the mixed reality cameras and sensors to be multiple times better in Quest Three.”
Mark Zuckerberg says Meta Quest 3 is about 40 percent thinner than earlier headsets, with better display and graphics.
“so you'll get better graphics. Uh, it's 40 thinner, so it's, um, so just more comfortable, uh, as well”
Meta shipped the Quest Pro headset the year before Quest 3 was announced, at a much higher price than Quest 3.
“obviously we shipped Quest Pro um last year, but it was one 500, um.”
Mark Zuckerberg said Meta Quest 3 was coming out in the fall of 2023.
“Quest Three coming out, um, later this fall.”
Mark Zuckerberg says headset passthrough uses multiple cameras and AI processing to remap the camera view to the wearer's eye position in real time.
“You need multiple cameras to capture the different angles and and sort of the three dimensional space. And then it's a pretty complex compute problem, an AI problem, to map that to your perspective”
Mark Zuckerberg says Meta's hand tracking progressed faster than he expected, and Meta built a piano-learning demo that uses it.
“We've been able to get way further on hand recognition in a shorter period of time than I expected”
Mark Zuckerberg predicts that by the end of the 2020s, rooms will contain about as many holograms as physical objects.
“By the end of this decade, we'll be living in a world where there are kind of as many holograms when you walk into a room as there are physical objects.”
Mark Zuckerberg says Meta memorializes accounts of deceased users for families but does not give families access to private messages.
“Like, we're not gonna give the family access to someone's messages, you know, for example.”
Meta is building a plain assistant called Meta AI that can be used in any chat thread and has no avatar face.
“It's called just Meta AI. It's simple, it, you know, you can chat with it in any of your threads. Um, it doesn't have a face, right?”
Meta created an AI dungeon master character embodied by Snoop Dogg as part of its early AI personas.
“Snoop Dogg is the dungeon master, which I think is just hilarious.”
Meta made AI characters based on Jane Austen and Marcus Aurelius for its initial AI launch.
“we made, we made one of Jane Austen and and one of, uh, Marcus Aurelius”
Meta is developing AI Studio, a platform intended to let anyone create AI characters like other user-generated content.
“we're also working on this platform that we call AI Studio. That's gonna make it so that, you know, over time, anyone will be able to create, you know, one of these AIs”
Mark Zuckerberg says the value of open sourcing a foundation model like Llama 2 outweighs the risks, after Meta's red-teaming assessment.
“the value of open sourcing. A foundation model like Llama two is significantly greater than, um, than the than the risks.”
Mark Zuckerberg describes Llama 2 as infrastructure for building products rather than a consumer product itself.
“Cause Llama two, by itself, it's not a consumer product, right? It's more of a piece of infrastructure that people could could build things with.”
Mark Zuckerberg says the first version of Facebook was mostly text, with one photo per profile and lists of interests.
“I started working on social networks when they were primarily text, right? The 1st version of Facebook, your profile, you know, you had one photo, and the rest of it was like lists of things that you were interested in.”