Lex Fridman Podcast - #398 – Mark Zuckerberg: First Interview in the Metaverse
Episode Date: September 28, 2023Mark Zuckerberg is CEO of Meta. Please support this podcast by checking out our sponsors: - LMNT: https://drinkLMNT.com/lex to get free sample pack - InsideTracker: https://insidetracker.com/lex to ge...t 20% off - Eight Sleep: https://www.eightsleep.com/lex to get special savings - AG1: https://drinkag1.com/lex to get 1 month supply of fish oil - NetSuite: http://netsuite.com/lex to get free product tour Transcript: https://lexfridman.com/mark-zuckerberg-3-transcript EPISODE LINKS: Mark's Facebook: https://facebook.com/zuck Mark's Instagram: https://instagram.com/zuck Mark's Threads: https://threads.net/@zuck Meta AI: https://ai.meta.com/ Meta Quest: https://www.meta.com/quest/ Meta Connect 2023: https://www.metaconnect.com PODCAST INFO: Podcast website: https://lexfridman.com/podcast Apple Podcasts: https://apple.co/2lwqZIr Spotify: https://spoti.fi/2nEwCF8 RSS: https://lexfridman.com/feed/podcast/ YouTube Full Episodes: https://youtube.com/lexfridman YouTube Clips: https://youtube.com/lexclips SUPPORT & CONNECT: - Check out the sponsors above, it's the best way to support this podcast - Support on Patreon: https://www.patreon.com/lexfridman - Twitter: https://twitter.com/lexfridman - Instagram: https://www.instagram.com/lexfridman - LinkedIn: https://www.linkedin.com/in/lexfridman - Facebook: https://www.facebook.com/lexfridman - Medium: https://medium.com/@lexfridman OUTLINE: Here's the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time. (00:00) - Introduction (08:38) - Metaverse (23:01) - Quest 3 (37:50) - Nature of reality (42:28) - AI in the Metaverse (59:26) - Large language models (1:05:23) - Future of humanity
Transcript
Discussion (0)
The following is a conversation with Mark Zuckerberg inside the Metaverse.
Mark and I are hundreds of miles apart from each other in physical space,
but it feels like we're in the same room, because we're appeared to each other
as photorealistic codec avatars in 3D with spatial audio.
This technology is incredible, and I think it's the future of how human beings connect to each other in a deeply meaningful way on the internet. These avatars can capture many
of the nuances of facial expressions that we use, we humans use to communicate
emotion to each other. Now I just need to work on upgrading my emotion,
expressing capabilities of the underlying human.
And now a quick few seconds mention of the sponsor.
Check them out in the description. It's the best way to support this podcast.
We've got an element for delicious electrolytes inside tracker for biological data,
8 sleep for delicious maps, AG1 for delicious health and that's sweet for probably delicious but I haven't
tasted it, a business management software. Choose wise my friends. Also if you want to work
with our team where I was hiring, go to lexframen.com slash hiring and now onto the full ad
reads, as always no ads in the middle. I tried to make this interesting but if you must
skip them friends please do check out the sponsors, I enjoy their stuff. Maybe you will too.
You never know until you try. This episode is brought to you by the thing I consume many
times a day. The thing I'm consuming currently as I am speaking the words I'm speaking, element, electrolyte drink spelled LMNT.
I do a low carb diet, sometimes a very low carb diet, and I usually eat only once a
day.
So that's fasting and low carbs, and for that you have to get your electrolytes right.
Electrolytes include sodium, potassium, magnesium, the proportions are really important.
The deliciousness of the proportions won't combine with water. It's also important, it turns out. It's also just
important to consume water and making water a little bit more delicious, which is what
element does. Is a win-win? That's what we call in the business of win-win friends. Get
a simple pack for free with any purchase. Try it.
Join me and try it at drinkelement.com slash wux.
Get a simple pack for free with any purchase at drinkelement.com slash wux.
This shows also brought to you by InsideTracker, a service I use to listen to my body
through the power of data science. So, from my body come signals, through blood tests,
to give information about whatever's going on in my body,
and that data is used with machine learning algorithms
to make suggestions about what you should do in your life.
Now, in this conversation about the metaverse,
where Mark and I are incredibly in a whole other plane
of existence, we have teleported into this place, while we're miles apart from each other in physical space,
and the virtual space we're right there together, shrouded in darkness.
I wonder if those entities that are driven by the content of our minds,
if they have biological-like signals,
if they need to make lifestyle and die decisions,
I wonder, one day we should be able to ask them.
Actually, that's one of the things that Meta announced,
which is really cool, which are the AI personalities.
And I do think, from just from a technical perspective,
it's super exciting and difficult to encapsulate
a particular personality like Snoop Dogg in an AI agent
where it reflects all the quirks, the weirdnesses,
but also the beauty of the character
of that particularly human being.
I love conversation in that task,
doing that thing technically,
super exciting, but I think it's super difficult. So I'm glad they're taking it on. Anyway,
get special savings for a limited time when you go to insettracker.com slash Lex. This
episode is also brought to you by A sleep and it's pod three mattress. It can cool down
or heat up the two sides of the bed separately. This actually makes me think
of that meme with the two kids are scared in the corner and they're looking at a bunny.
And I am those two scared kids in the corner thinking about the bunny where the bunny
represents the people that want their bed heated up. I don't know who does this, but I want to meet you. Maybe you have an eight sleep like in the Antarctic or somewhere in Northern Canada.
And but you also don't have heat and maybe you're out camping. I can't possibly construct
a situation in which you would use heat. I'm only half kidding, of course. Anyway, I
prefer to cool down the bed.
And it's an incredible experience, a cold bed with a warm blanket.
It's another place I teleport to in my mind when I go to the nap.
It's not a metaverse, it's a nop perverse.
And there I find a deep piece from the chaos of life.
And I return refreshed, ready to take the chaos of life and I return refreshed
Ready to take the chaos on once again
Anyway, check it out and get special savings when you go to a sleep.com slash Lex
This shows also brought to you by age you one another delicious thing I consume every day I just drink it like an hour ago is delicious is green and
Makes me feel like Popeye I grew up. I don't know like an hour ago. It's delicious, it's green, and it makes me feel like Popeye.
I grew up, I don't know how many years ago,
watching Popeye.
There was a stretch of time where I wanted to be Popeye.
I think I admired Popeye for being strong,
maybe because I wanted to be strong.
I always thought a man is supposed to be strong.
And so if I just eat my spinach, like Popeye did, I'll be strong. So hence the color green forever associated with strength.
And I'm also playing Diablo now, and that's one of the things you can increase
the strength, the exteriority, willpower, intelligence, all that kind of stuff. But strength still has that sexy sound to it.
And so every time I played Diablo actually, and I drink AG1, and it just makes me feel stronger
and better, and like I got my nutritional basis covered.
Anyway, they'll give you one month supply of fish oil when you sign up at drinkag1.com
slash relax.
This show is also brought to you by NetSuite,
an all-in-one cloud business management system. I still hold in me a little bit
of a flame that turns hopefully into a fire, which is a desire to contribute by
building stuff, whether it's working at a company or starting a company. And I'm
very cognizant of how difficult it is to run the company successfully,
whether you're looking at a huge company like Mehta or a tiny startup, all of it. And actually,
yes, all of it is a source of challenge and complexities and fear and anxiety and uncertainty, all of that.
But ultimately, the camaraderie of the people working
together, that's a deeply fulfilling, deeply meaningful pursuit, especially when
there's a big vision that you're reaching for. So I love people, ad companies,
working at a thing, chasing that big impossible vision. Actually, the meta
versus one such thing, Just the technical complexity of everything
involved is just really incredible from the headset software and the hardware, the cameras,
the scanning for the avat, all of it is just incredible. Anyway, if you want to figure out
how to run a business smaller, large successfully, you should be using the best tools like NetSuite.
You can start now with no payment or interest for six months.
Go to NetSuite.com slash Lex to access their one-of-a-kind financing program.
That's NetSuite.com slash Lex.
This is the Lex Readman podcast.
And now, dear friends, here's Mark Zuckerberg.
This is so great.
Lighting change.
Yeah, we put the light anywhere.
And doesn't feel awkward to be really close to you.
No, it does. I actually moved you, I moved you back a few feet before you got an headset. You were like right here.
I don't know if people can see this, but this is incredible.
The realism here is just incredible.
Where am I? Where are you, Mark?
Where are we?
You're in Austin, right?
No, I mean, this place.
We're shrouded by darkness with ultra-realistic
face and just feels like we're in the same room.
This is really the most incredible thing I've ever seen.
I'm sorry to be in your personal space.
I mean, we have done to just before.
Yeah, I was commenting to the team before that.
Even I feel like we've choked each other from further distances than it feels like we
are right now.
I mean, this is just really incredible.
I don't know how to describe it with words.
It really feels like we're in the same room.
Yeah.
It feels like the future.
This is truly truly incredible.
I just wanted to take it in.
I'm still getting used to it.
It's like, it's you.
It's really you.
But you're not here with me, right?
You're there wearing a headset, not wearing a headset. It's really, really incredible. So what can you describe what it takes currently
for us to appear so photorealistic to each other?
Yeah, so I mean, for background, we both did these scans for this research project that we have at Meta called Kodak avatars.
And the idea is that instead of our avatars being cartoony and instead of actually transmitting
a video, what it does is we've scanned ourselves in a lot of different expressions. And we've built a computer model of sort of each of our faces
and bodies and the different expressions that we make
and collapse that into a codec
that then when you have the headset on your head,
it can, it sees your face, it sees your expression
and it can basically send an encoded version
of what you're supposed to look like over the wire.
So in addition to being photorealistic,
it's also actually much more bandwidth-efficient
than transmitting a full video,
or especially a 3D immersive video of a whole scene like this.
And it captures everything, like the flaws,
like to me, the subtleties of the human face,
like even the flaws, that's like, that's all amazing.
It makes you, it makes it so much more immersive.
It makes you realize that like perfection
isn't the thing that leads to immersion.
It's like the little subtle flaws, like fr
like the fracals and like variations in color
and just wrinkles wrinkles all stuff
are very yeah asymmetry and just the different like the corners of the eyes like what your eyes do when
you smile all that kind of stuff yeah eyes are a huge part of it yeah I mean there's all the studies
that most of communication even when people are speaking is not actually the words that they're
saying right it's it's kind of the expression and and all that. So we try to capture that with the kind of classical
expressive avatar system that we have that's the kind of more cartoon design one you can kind of put
those kind of expressions on those faces as well, but there's obviously a certain realism that
comes with delivering kind of this phot this photo realistic experience that I just
think it's really magical.
I mean, this gets to the core of what the vision around virtual and augmented reality is,
if like delivering a sense of presence, as if you're there together, no matter where
you actually are in the world.
And I mean, this experience, I think, is a good embodiment of that where it's like,
coming into two completely different, halfway across the country.
And it just like, you know,
looks like you're just sitting right in front of me.
It's pretty wild.
Yeah, I can't, it's almost getting emotional.
It's like, it feels like a totally fundamental
new experience.
Like for me to have this kind of conversation
with loved ones, it would just change everything.
Maybe just to elaborate, so I went to Pittsburgh
and went to the whole scanning procedure
which has so much incredible technology,
so software and hardware going on.
But it is a lengthy process.
So what's your vision for the future of this
in terms of making this more accessible to people?
You know, it starts off with a small number of people doing these very detailed scans,
right, which is that's the version that you did and that I did.
And, you know, before there are a lot of people who who have done this kind of a scan for,
we probably need to kind of over-collect expressions
when we're doing the scanning
because we haven't figured out how much we can reduce that down
to a really streamlined process.
I'm gonna extrapolate from the scans that have already been done.
But the goal, and we have a project that's working on this already,
is just to do a very quick scan with your cell phone
where you just take your phone,
kind of wave it in front of your face for a couple of minutes, say a few sentences,
make a bunch of expressions, but overall have the whole process just be two to three minutes,
and then produce something that's of the quality of what we have right now.
So I think that that's one of the big challenges that remains.
And right now we have the ability to do the scans if you have hours to sit for one.
With today's technology, I mean, you're using a meta headset that exists.
It's a product that's kind of for sale now.
You can drive these with that.
But the production of these scans in a very efficient way is one of the last pieces that we still need to really nail.
And then obviously there's all the experiences around it.
I mean, right now we're kind of sitting in a dark room
which is familiar for your podcast.
But I think part of the vision for this over time
is not just having this be like a video call.
I mean, that's fine, it's cool,
or it feels like it's immersive,
but you can do a video call on your phone.
The thing that you can do in the metaverse
that is different from what you can do on a phone is like
doing stuff where you're physically there together
and participating in things together.
And we could play games like this.
We could have meetings like this in the future.
Once you get mixed reality and augmented reality,
we could have codec avatars like this and go into
a meeting and have some people physically there,
and have some people show up in this photorealistic form,
superimposed on the physical environment.
Stuff like that is going to be super powerful.
We got to still build out all those applications
in the use cases around it. I don't know, I think it's going to be super powerful. So we got to still build out all those kind of applications and the use cases around it.
But I don't know, I think it's going to be a pretty wild
next few years around this.
I mean, I just, I'm actually almost at a loss of words.
This is just so incredible.
This is truly incredible.
I hope that people like watching this
can get a glimpse of like how incredible it is.
It really feels like when in the same room.
Like there is that, I guess there's an uncanny valley
that seems to have been crossed here.
It looks like you.
Yeah, I mean, I think there's still a bunch of tuning
that I think will want to do
where different people emote to different extents.
So I think one of the big questions is,
when you smile,
how wide is your smile,
and how wide do you want your smile to be?
And I think getting that to be tuned on a per person basis
is gonna be one of the things that we're gonna need
to figure out.
It's like to what extent do you wanna give people control
over that?
Some people might prefer a version of themselves that's more emotive in their avatar than their
actual faces.
So, for example, I always get a lot of critique and shit for having a relatively stiff expression.
But I might feel pretty happy, but just make a pretty small smile.
So, I mean, maybe, you know, for me, it's actually, you know, it's like I'd want to have my
avatar really be able to better express, like how I'm feeling, than what, than how I can do physically.
So, I think that there's a question about how you want to tune that. But overall, yeah, I mean,
we want to start from baseline of capturing how people actually emote and express themselves.
And I mean, I think the initial version of this has been pretty impressive.
And like you said, I do think we're kind of beyond the uncanny valley here,
where it does feel like you.
It doesn't feel weird or anything like that.
I mean, that's going to be the meme that the two most monotone people are in a
metaverse together.
But I think that
actually makes it more difficult. The amazing thing here is that the subtleties of the expression
of the eyes, you know, people say I'm monotone and emotionalist, but I'm not. It's just this,
maybe my expression of emotion is more subtle usually like with the eyes. And that's one of the
things I've noticed is just how expressive the subtle movement of the like with the eyes. And that's one of the things I've noticed
is just how expressive the subtle movement
of the corners of the eyes are
in terms of displaying happiness or boredom
or all that kind of stuff.
I am curious to see, just to have never done one of these
before, I've never done a podcast
as one of these codec avatars.
And I'm curious to see what people think of it
because one of the issues that we've had in some of the VR and mixed reality work is it tends to feel a lot more profound when you're in it than the 2D videos capturing the experience.
So I think that this one, because it's photorealistic, may look kind of as amazing in 2D for people watching it as it feels, I think, to be in it. But we certainly have this issue where a lot of the other things, just it's like you feel
the sense of immersion when you're in it that doesn't quite translate to a 2D screen.
But I'm curious to see what people think.
Yeah, I'm curious to see if people could see that my heart is actually beating fast now.
This is super interesting.
Like that such intimacy of conversation can
be achieved remotely. This has been, you know, I don't do remote podcasts for this reason.
And this is like, breaks all that. This is just an incredible transition to something
else, to the different kind of communication, breaks all barriers, like geographic physical
barriers.
What you mentioned, do you have a sense of timeline in terms of how many difficult things have to be solved? And make this more accessible to like scanning with a smartphone?
Yeah, I mean, I think we'll probably roll this out progressively over time. So it's not going
to be like, we roll it out one day. Everyone has a codec avatar. We want to get more people scanned into the system, and then we want to start integrating
it into each one of our apps, making it so that I think that for a lot of the work style
things productivity, I think that this is going to make a ton of sense.
And a lot of game environments, I mean, this could be fine, but games tend to have their
own style, where you almost want to fit more with the aesthetic style of the game.
But I think for doing meetings, and one of the things that we get a lot of feedback on
workrooms, where people are pretty blown away by the experience and this feeling that
you can be remote, but feel like you're physically there around a table with people.
But then, we get some feedback that people have a hard time
with the fact that the avatars are so expressive
and don't feel as realistic in that environment.
So I think something like this
could make a very big difference for those remote meetings.
And especially with Quest III coming out,
which is going to be the first mainstream mixed reality
product where you're really taking digital, you know, expressions
of either a person or objects and overlying them on the physical world.
I think the ability to do kind of remote meetings and things like that where you're just remote
hang sessions with friends.
I think that's going to be very exciting.
So, yeah, rolling it out over the next few years, it's not ready to be like a kind of
mainstream product yet, but we just want to keep tuning in, keep getting more scans in there and
keep rolling it out into more of the features. Definitely in the next few years, you'll
be seeing a bunch more experiences like this.
I would love to see some celebrities scanned and some non-solubrities. I just, just more people to experience this.
I would love to see that.
This is something, I mean, on my mind,
but I'm literally at a loss of words.
Because it's very difficult to just convey
how incredible this is, how I feel the emotion,
how I feel the presence, how I feel like the subtleties
of the emotion in terms of like work meetings or any kind of, in terms of podcasts, this is awesome.
Not only do you even need your arms or legs.
Is that...
Well, we got to get that.
I mean, that's its own challenge.
And part of the question is also, so you have the scan, then it takes a certain amount
of compute to go drive that, both for the sensors on the headset and then rendering it.
So one of the things that we're working through
is what is the level of fidelity that is optimal?
Right, you could do the full body in kind of a codec
and that can be quite intensive,
but one of the things that we're thinking about
is like all right, maybe you can kind of stitch a somewhat lower fidelity version of your body, but still have the main kind
of major movements.
But your face is really the thing that we have the most resolution on, in terms of being
able to read and express emotions.
I mean, like you said, if you move your eyebrows like a millimeter, I mean,
that really changes the expression of what you're you're emoting, whereas, you know, I mean,
moving your arm like an inch probably doesn't matter quite as much. So, so yeah, so I think
that we'll we do want to get all of that into here and that'll be some of the work over
the next period as well.
So you mentioned Quest 3, that's coming out. I've gotten a chance to try that too.
That's awesome.
So the, how did you pull off the mixtri- so it's not just virtual reality, it's mixtriality.
Yeah, I mean, I think it's going to be- it's going to be the first mainstream mixtriality
device.
I mean, obviously we shipped Quest Pro last year, but it was $1,500.
And part of what I'm super proud of is, you know, we try to innovate not just on pushing
the state of the art and delivering new capabilities, but making it so it can be available to everyone.
And, you know, we have this and it's coming out.
It's $500.
And in some ways, I think the mixed reality is actually better in Quest 3 than it was
than what we're using right now in Quest Pro.
So I'm really proud of the team for being able to deliver
that kind of innovation and get it out.
But some of this is just software you tune over time
and get to be better.
Part of it is you put together a product
and you figure out what are the bottlenecks in terms
of making it a good experience.
So we got the resolution for the mixed reality cameras
and sensors to be multiple times better in Quest 3.
And we just figured that that made a very big difference when we saw the experience that we were able to put together for Quest Pro.
And part of it is also that Qualcomm just came out with their next generation chipset for VR and MR,
and that we worked with them on a kind of custom version of it.
But that was available this year for Quest 3,
and it wasn't available in Quest Pro.
So in a way, Quest 3, even though it's not the Pro product,
actually has a stronger chipset in it
than the Pro line at a third of the cost.
So I'm really excited to get this in people's hands.
It does all the VR stuff that Quest 2
and the others are done too.
It does it better because the display is better.
And the chip is better, so you'll get better graphics.
It's 40% thinner, so it's more comfortable as well.
But the MR is really the big capability shift.
And part of what's exciting about the whole space right now is, you know,
this isn't like smartphones where companies put out a new smartphone every year
and you can almost barely tell the difference between that and the one the year before it.
Now for this, each time we put out a new headset, it has like a major new capability.
And the big one now is mixed reality, the ability to basically take digital representations of people or objects and superimpose them on the world.
Basically, there's one version of this is you're going to have these
augments or holograms and experiences that you can bring into your living room
or a meeting space or office. Another thing that I just think is going to be a much simpler innovation
is that there are a lot of VR experiences today that don't need to be fully immersive.
And if you're playing a shooter game or you're doing a fitness experience, sometimes people
get worried about swinging their arms around.
Am I going to hit a lamp or something?
And am I going to run into something?
So having that in mixed reality, actually, it's just a lot more comfortable for people.
You kind of still get the immersion and the 3D experience, and you can have an experience
that just wouldn't be possible in the physical world alone, but by being anchored to and being
able to see the physical world around you, it's like, it just feels so much safer and more
secure.
And I think a lot of people are really going to enjoy that too.
So yeah, I'm really excited to see how people use it.
But yeah, Quest III coming out later this fall.
Yeah, and I got to experience it
with other people sitting around
and there's a lot of furniture.
And so you get to see that furniture
and you get to see those people.
And you get to see those people
like enjoy the ridiculousness of you like swinging your arms.
I mean, presumably their friends of yours,
even if they make fun of you,
they there's a lot of love behind that. And that you got to experience that. That's a really
fundamental, different experience than just pure VR with like, with zombies coming out of walls.
And yeah, it's like someone shooting at you and you hide behind your real couch in order to
duck the fire. Yeah. It's incredible how it's all integrated, but also like subtle stuff like
in a room with no windows,
you can add windows to it.
And you can look outside as the zombies run towards you,
but like it's still nice view outside, you know?
Yeah, it's really, and so that's pulled off
by having cameras on the outside of the headset
that do the pass through,
and that technology is incredible to do that
on a headset.
Yeah, it's not just the cameras.
You basically need to, you need multiple cameras to capture the different angles and, and
sort of the three-dimensional space.
And then it's a pretty complex compute problem, an AI problem, to map that to your perspective,
right?
Because the cameras aren't exactly where your eyes are, because no two people's eyes are,
you're not going to be in exactly the same place.
You kind of need to get that to line up
and then do that basically in real time
and then generate something that
looks that kind of feels natural
and then superimpose whatever digital objects
you want to put there.
So yeah, it's a very interesting technical challenge
and I think we'll continue tuning this for the years to come as well,
but I'm pretty excited to get this out
because I think Quest 3 is gonna be the first device
like this with that millions of people are gonna get.
That's mixed reality.
And it's only when you have millions of people
using something that you start getting
the whole developer community really starting
to experiment and build stuff
because now there are gonna be people who actually use it.
So I think we'll get, you know, we got some of that flywheel going
with Quest Pro, but I think it'll really get accelerated
once Quest 3 gets out there.
So yeah, I'm pretty excited about this one.
Plus there's hand tracking.
Without, you don't need to have a control.
So the camera is not just doing the pass-through
of the entire physical reality around you,
it's also tracking the details of your hands in order to use that for gesture recognition.
We've been able to get way further on hand recognition in a shorter period of time than I expected.
So that's been pretty cool.
Did you see the demo experience that we built around?
Yeah, the piano. learning to play piano.
Yeah, it's incredible.
You're basically playing piano on a table,
and that's without any controller.
And like, how well it matches physical reality
with no latency, and it's tracking your hands
with no latency, and it's tracking all the people
around you with no latency, integrating physical reality and digital reality.
Obviously, that connects to this Kodak avatar,
which is in parallel, allows us to have ultra-realistic copies
of ourselves in this mixed reality.
It's like, it's all converging towards like an incredible
digital experience in the metaverse.
To me obviously I love the intimacy of conversations, so even this is awesome.
But do you have other ideas of what this unlocks of like something like codec avatar unlocks
in terms of applications, in terms of things were we able to do?
Well, there's what you can do with avatars overall
in terms of superimposing digital objects
on the physical world.
And then there's kind of psychologically
what is having photorealistic do.
So I think we're moving towards a world where
we're gonna have something that looks like normal glasses
where you can just see the physical world be able to see holograms and in that world
I think that
They're gonna be you know not too far off
You know maybe you know by the end of this decade will be living in a world where there are kind of as many holograms when you walk into a room as there are physical objects
And it really raises this interesting question about what are
about, you know, a lot of people have this phrase where they call the physical world the real world.
And I kind of think increasingly, the physical world is super important, but I actually think
the real world is the combination of the physical world and the digital world's coming together.
But until this technology, they were sort of separate.
It's like you access the digital world through a screen.
And maybe it's a small screen that you carry around
or it's a bigger screen where you sit down to your desk
and you strap in for a long session.
But they're fundamentally divorced and disconnected.
And I think part of what this technology is going to do
is bring those together into a single
coherent experience of what the modern real world is, which is, and it's got to be physical
because that we're physical beings.
So the physical world is always going to be super important.
But increasingly, I think a lot of the things that we kind of think of can be digital holograms.
I mean, any screen that you have can be a hologram,
in any media, in any book, art,
it can basically be just as effective as a hologram
as a physical object, any game that you're playing
a board game or any kind of physical game cards,
ping pong, things like that.
They're often a lot better as holograms
because you can just kind of snap your fingers
and instantiate them and have them show up.
You know, it's like you have a ping pong table show up
in your living room,
but then you can snap your fingers and have it be gone.
So, I think that's super powerful.
So I think that it's actually an amazing thought experiment
of like how many physical things we have today
that could actually be better as interactive holograms.
But then beyond that, I think the most important thing, obviously, is people.
So the ability to have these mixed high-outs, whether they're social or meetings,
where you show up to a conference room, you're wearing glasses,
or a headset in the very near term, but hopefully by over the next
five years glasses or so. And you know, you're there physically, some people are there
physically, but other people are just there as holograms. And it feels like it's them
who are right there. And also, by the way, another thing that I think is going to be fascinating
about being able to blend together the digital and physical worlds in this way is we're also going to be able to embody
AIs as well. So I think you'll also have meetings in the future where you're basically,
you know, maybe you're sitting there physically and then you have, you know,
a couple of other people who are there's holograms and then you have like Bob,
the AI who's an engineer on your team who's helping with things and he can now be embodied as a
You know as a realistic avatar as well and just join the meeting in that way. So I think that that
That's gonna be pretty compelling
As well. So then okay, so what can you do with photorealistic avatars compared to
Kind of the more expressive ones that we have today.
Well, I think a lot of this actually comes down to acceptance of the technology.
And because all the stuff that we're doing, I mean, the motion of your eyebrows,
the motion of your eyes, the cheeks, and all of that,
there's actually no reason why you couldn't do that on an expressive avatar, too.
I mean, it wouldn't look exactly like you, but you can make a cartoon version of yourself and
still have it be almost as expressive.
But I do think that there's this bridge between the current state of most our interactions
in the physical world and where we're getting in the future with this kind of hybrid, physical and digital world, where I think it's going to be a lot easier for people to
kind of take some of these experiences seriously with the photorealistic
avatars to start. And then I'm actually really curious to see where it goes
longer term. I could see a world where people stick to the photorealistic and
maybe they modify them to make them a little bit more interesting, but maybe fundamentally we like photo realistic things.
But I can also see a world that once people get used to the photo the photo realistic
avatars and they get used to these experiences that I actually think that there could be
a world where people actually prefer being able to express themselves in kind of non-ways that aren't so tied to their physical reality.
And so that's one of the things that I'm really curious about. And I don't know,
in a bunch of our internal experiments on this, one of the things that I thought was
psychologically pretty interesting is people have no issues blending photorealistic stuff and not. So, you know, we can have a, you know,
for this specific scene that we're in now,
we happen to sort of being in a dark room.
I think part of that aesthetic decision,
I think was based on the way you like to do your podcast.
But we've done experiences like this,
where you have like a cartoony background,
but for the realistic people who you're talking to.
And we seem to, like people just seem to just think
that that is completely normal, right?
It doesn't bother you, it doesn't feel like it's weird.
Another thing that we've experienced with is basically
you have a photorealistic avatar that you're talking to.
And then right next to them,
you have an expressive kind of cartoon avatar.
And that actually is pretty normal too.
Right?
It's not that weird, right?
To basically being interacting with different people
in different modes like that.
So I'm not sure.
I think it'll be an interesting question
to what extent these photorealistic avatars are like,
a key part of just transitioning from being comfortable
in the physical world to this kind of new modern real world that that kind of includes
both the digital and physical or if this is like the long term way that it stays.
That's that's a I think that they're going to be uses for both the expressive and the
photorealistic over time.
I just don't know what the balance is going to be.
Yeah, it's a really good, interesting philosophical question. But to me, in the short term, the photo realistic is amazing to what I would prefer, like you
said, the work room, but like on a beach with a beer, just to see a body of mine remotely
on a chair next to me drinking a beer.
I mean, that as realistic as possible is an incredible experience.
So I don't want any fake hats on him.
I don't want any just chilling with it with a friend,
drinking beer, looking at the ocean while not being in the same place together.
I mean, that, yeah, that experience is just, it's a fundamentally,
it's just a high quality experience, a friendship, whatever we seek in
friendship, it seems to be present there.
In the same kind of realism I'm seeing right now,
this is totally a game changer.
So to me, I can see myself sticking with this
for a long time.
Yeah, and I mean, it's also its novel,
and it's also a technological feat, right?
It's like being able to pull this off is like,
it's like a pretty impressive,
and I think to some degree, it's just this kind of like awesome experience.
But I'm already sorry to interrupt. I'm already forgetting that you're not real.
Like this really, so it's like I am a novel.
It's just an avatars version of me.
But it's a deep philosophical question, yes.
But I mean, but here's some of the, so I put the sound this morning and I was like, all right, like it's like, okay, so my hair is a
little shorter in this than my physical hair is right now. I probably need to go get a haircut.
And like, and I actually, I did happen to shave this morning, but if I hadn't,
you know, I could still have this photorealistic avatar that is more cleanly shavon, right?
Even if I'm a few days in physically.
So I do think that they're gonna start
to be these subtle questions that seep in
where the avatar is realistic in the sense of this is
kind of what you looked like at the time of capture,
but it's not necessarily temporarily accurate
to exactly
what you look like in this moment.
And I think that we're going to end up being a bunch of questions that come from that
over time that I think are going to be fascinating too.
You mean just like the nature of identity of who we are?
Are we the people, you know how people do like, like some are beach body, or the people
be for the scan,
they'll try to loosen way and look their best and sexiest
with the nice hair and everything like that.
I mean, it does raise the question of,
you know, if a lot of people interacting
with the digital version of ourselves,
who are we really, are we the entity driving the avatar,
or are we the avatar?
Well, I mean, I think our physical bodies
also fluctuate and change your time too.
So I think there's a similar question of like,
which version of that are we?
There's like the, I mean, it's an interesting identity question
because all right, it's like, I don't know,
it's like weight fluctuates or things like that.
It's like, I think most people don't tend to think of themselves as the,
I don't know, it's an interesting psychological question.
So maybe some people, maybe a lot of people do think about themselves as the kind of worst
version. But, yeah, but I think a lot of people probably think about themselves
the best version. And, and then it's like what you are in a day to day basis,
doesn't necessarily map to either
of those.
I know that's, yeah, there will definitely be a bunch of social scientists and folks will
have to, you know, in psychologists, really there's going to be a lot to understand about
how our perception of ourselves and others shifted from this.
Well, this might be a bit of a complicated, dark question,
but one of the first feelings I had experienced in this
is I would love to talk to loved ones.
And the next question I have is I would love to talk to people
who are no longer here that are loved ones.
So like if you look into the future,
is that something you think about
who people pass away, but they can still exist in the metaverse, you can still have, you know,
talk to your father, talk to your grandfather and grandmother and a mother once they pass away.
The power of that experience is one of the first things my mind jumped to because it's like,
this is so real. Yeah, I think that there are a lot of norms
and things that people have to figure out around that.
There's probably some balance where, you know,
if someone has lost a loved one and is grieving,
there may be ways in which, you know,
being able to interact or relive certain memories
could be helpful, but then there's also probably
an extent to which it could become unhealthy.
And I'm not an expert in that.
So I think we'd have to study that
and understand it in more detail.
We have a fair amount of experience
with how to handle death and identity
and people's digital content through social media already, unfortunately, right?
Whether there's, unfortunately,
people who use our services die every day
and their families often wanna have access to their profiles
and we have whole protocols that we go through
where there are certain parts of it
that we try to memorialize,
so that way the family can get access to it,
so that way the account doesn't just go away immediately,
but then there are other things that are important,
kind of private things that that person has,
like we're not gonna give the family access
to someone's messages, for example.
So, so yeah, I think that there's some best practices,
I think from the current digital world
that we'll carry over, but yeah, I think that this will enable some different things.
Another version of this is how this intersects with AI is, right?
Because, and one of the things that we're really focused on is, we want the world to evolve
in a way where there isn't a single AI superintelligence,
but where a lot of people are empowered by having AI tools to do their jobs and make their lives better.
If you're a creator, and if you run a podcast like you do,
then you have a big community of people who are super interested to talk to you.
I know you'd love to cultivate that community and you interact with them online outside
of the podcast as well.
But I mean, there's way more demand both to interact with you.
And I'm sure you'd love to interact with the community more, but you just are limited
by the number of hours in the day.
So at some point, I think, making it so that you could build an AI version of yourself
that could interact with people, not if you die, but while you're here to help people
kind of fulfill this desire to interact with you and your desire to build a community.
And there's a lot of interesting questions around that. And that's obviously, it's not just in the metaverse.
I think we'd want to make that work across all the messaging platforms, WhatsApp and Messenger
and Instagram direct.
But there's certainly a version of that where if you could have an avatar version of yourself
in the metaverse that people can interact with and you could define that sort of an AI
version, people know that they're interacting with an AI, that it's not the kind of physical
version of you, but maybe that AI, even if they know it's an AI, is the next best thing,
because they're probably not going to necessarily all get to interact with you directly.
I think that could be a really compelling experience. There's a lot of things that we need to get right about it.
That, you know, we're not ready to release the version that a creator can kind of build a version of themselves yet, but we're starting to experiment with it in terms of releasing
a number of AI's that people can interact with in different ways. And I think that that is also
just going to be a very powerful set of capabilities that
people have over time.
So you've made major strides in developing these early AI personalities with the idea where
you can talk to them across the meta apps and have interesting, unique kind of conversations.
What can you describe your vision there
and these early strides and what are
some technical challenges there?
Yeah, so a lot of the vision comes from this idea
that I don't think we necessarily want there to be
like one big super intelligence.
We want to empower everyone to both have more fun,
accomplish their business goals,
everything that they're trying to do.
We don't tend to have one person that we work with on everything,
and I don't think in the future we're going to have one AI that we work with.
I think you're going to want a variety of these.
There are a bunch of different uses.
If some will be more assistant-oriented,
there's the plain and simple one that
we're building is called just meta AI. It's simple, you can chat with it in any of your
threads. It doesn't have a face, it's just more vanilla and neutral and factual, but it
can help you with a bunch of stuff. Then there are a bunch of cases that are more kind of business oriented. Let's say you want to contact a
small business. Similarly, that business probably doesn't want to have to staff someone to
man the phones, and you probably don't want to wait on the phone to talk to someone, but
they're having someone who you can just like talk to in a natural way who can help you if you're having an issue with a product
or if you want to make a reservation or if you want to buy something online, having the
ability to do that and have a natural conversation rather than navigate some website or have
to call someone and wait on hold, it's going to be really good both for the businesses
and for normal people who wanna interact with businesses.
So I think stuff like that makes sense.
Then there are gonna be a bunch of use cases
that I think are just fun, right?
So I think people are gonna,
I think that there will be AIs that can tell jokes,
so you can put them into chat thread with friends.
I mean, I think a lot of this
because we're like a social company, right?
I mean, we're fundamentally around helping people connect in different ways. And part of what I'm excited about is how do you
enable these kind of AIs to facilitate connection between two people or more, you know, put them
in a group chat, you know, make the group chat more interesting around whatever your interests
are, sports, fashion, trivia, video games.
I love the idea of playing, I think you mentioned Baldur's Gate, an incredible game,
just having an AI that you played together with, I mean, that seems like a small thing,
but it could deeply enrich the gaming experience.
I do think that AI's will make the NPCs a lot better in games too.
So that's a separate thing that I'm pretty excited about.
But yeah, I mean, one of the AIs that we've built that just in our internal testing, people
who love the most is like an adventure text-based, like a dungeon master. And I think, you know, part of what has been fun,
and we talked about this a bit,
but we've gotten some like real kind of cultural figures
to play a bunch of these folks
and be the embodiment and the avatar of them.
So Snoop Dogg is the dungeon master,
which I think is just hilarious.
Yes.
In terms of the next steps of, you know, if you mentioned, you mentioned Snoop to create
a Snoop AI.
So basically AI personality replica, a copy, or not a copy, maybe inspired by Snoop.
What are some of the technical challenges of that?
What does that experience look like for Snoop to be able to be?
Yes. of that, what does that experience look like for Snoop to be able to be that? So starting off creating new personas is easier because it doesn't need to stick exactly
to what that physical person would want, how they'd want to be represented.
It's like it's just a new character that we created.
So even though there's a Snoop in that case, he's basically an actor? He's playing the dungeon master, but it's not Snoop Dogg, right?
It's, it's, you know, over the dungeon master is. If you want to actually make it so that you have
an AI embodying a real creator, there's a whole set of things that you need to do to make sure that that AI is not going to say things
that the creator doesn't want, right? And that the AI is going to know things and be able
to represent things in the way that the creator would want, the way that the creator would
know. So I think that it's less of a question around like having the avatar express them.
I mean, that I think where it's like, we have our kind of V1 of that that we'll really
soon after Connect, but that'll get better over time.
But a lot of this is really just about continuing to make the models for these AI's, that they're just more and more,
I don't know, you could say reliable or predictable
in terms of what they'll communicate.
So that way, when you want to create the Lex Assistant AI
that your community can talk to,
you can, you know, you don't program them
like normal computers, you're training them,
their AI model is not, not normal computer programs,
but you want to get it to be predictable enough
so that way you can set some parameters for it.
And even if it isn't perfect all the time,
you want it to generally be able to stay within those bounds.
So that's a lot of what I think we need to nail for the creators. That's why that one's
actually a much harder problem, I think, than starting with new characters that you're creating
from scratch. So that one, I think, will probably start releasing sometime next year, not this year,
but experimenting with existing characters and the assistant and games and a bunch of different
personalities and experimenting with some small businesses. I think that stuff will be ready to do
this year and we're rolling it out, you know, basically right after Connect.
Yeah, I'm deeply entertained by the possibility of me sitting down with myself and saying, Hey, man, like, you need to stop the dad jokes or whatever.
The idea of a podcast between you and AI assistant Lex podcast.
I mean, there's just even the experience of a Kodak avatar, being able to freeze yourself,
like basically first mimic yourself.
So everything you do, you get to see yourself do it.
That's a surreal experience.
That feels like if I was like an ape looking at a mirror
for the first time realizing, like, oh, that's you.
But then freezing that and being able to look around,
like I'm looking at you, it's a,
I don't know how to put it into words,
but it just feels like a fundamental new experience.
Like I'm seeing maybe color for
the first time. I'm seeing I'm experiencing a new way of
seeing the world for the first time, because it's physical
reality, but it's digital. Like and realizing that that's
possible is just it's blowing my mind. It's just really
exciting. Because I lived most of my life before the internet
and experiencing the internet,
experiencing voice communication, video communication,
you think, well, there's a ceiling to this.
But this is making me feel like there might not be.
There might be that blend of physical reality
and digital reality.
It's actually what the future is.
Yeah, I think so.
It's a weird experience.
It feels like the early days of like a totally new way
of living.
And like there's a lot of people that kind of complain,
well, you know, the internet is not, that's not reality.
You need to turn all that off and go, you know, in nature.
But this feels like this will make those people happy.
I feel like, because it feels real.
The flaws and everything.
Yeah, well, I mean, a big part of how
we're trying to design these new computing products
is that they should be physical.
I think that's a big part of the issue
with computers and TVs and even phones is like,
yeah, I mean, maybe you can interact with them in different places, but they're fundamentally like you're sitting, you're still.
And I mean, people are just not meant to be that way.
I mean, I think you and I have this shared passion for sports and martial arts
and doing stuff like that, we're just moving around.
It's like so much of what makes us people is like, you move around.
You're not, we're not just like a brain and a tank, right? It's where, you know, the human experience
is a physical one. And so it's not just about having the immersive expression of the digital
world. It's about being able to really natively bring that together. And I do really think
that the real world is this mix of the physical and the digital.
The digital is, there's too much digital at this point for it to just be siloed to a small screen,
but the physical is too important, so you don't want to just sit down all day long at a desk.
So, I think that this is, yeah, I do think that this is the future.
This is, I think, the philosophical way that I would want the world to work in the future
is a much more coherently blended physical and digital world.
There might be some difficult philosophical and unethical questions we have to figure out as a society.
Maybe you can comment on this.
So the metaverse seems to enable, sort of of unlock a lot of experiences
that we don't have in the physical world.
And the question is like,
what is and isn't allowed in the metaverse?
You know, in video games, we allow all kinds of crazy stuff
and in physical reality, a lot of that is illegal.
So where's that line? Where's that gray area between video game and physical reality, a lot of that is illegal. So where's that line?
Where's that gray area between video game
and physical reality?
Do you have a sense of that?
Well, I think, I mean, there are content policies
and things like that, right?
In terms of what people are allowed to create.
But I mean, a lot of the rules around physical,
I think you try to have a society that is as free as possible,
meaning that people can do as much of what they want
unless you're gonna do damage to other people
and in fringe on their rights.
And the idea of damage is somewhat different
in a digital environment.
I mean, when I get into some world with my friends,
the first thing we start doing is shooting each other,
which obviously we would not do in the physical world
because you'd hurt each other. But obviously we would not do in the physical world, because you
heard each other. But in a game, that's like just, it's almost, you know, it's like just fun. And I'm even in like the lobby of a game, right? It's like, it's just, it's not even bearing on the game, which is kind of like a funny, sort of humorous thing to do.
So it's like, is that problematic? I don't think so, because it's fundamentally's fundamentally it's not you're not causing harm in that world. So I think that the part of the question
that I think we need to figure out is what are the ways where things could have been harmful
in the physical world that we will now be freed from that and therefore there should be
fewer restrictions in the digital world. And then there might be new ways in which there
could be harm in the digital world that there weren't the be new ways in which there could be harm in the
digital world that there weren't the case before. So there's more anonymity, right? It's,
you know, when you show up to a restaurant or something, it's like all the norms where you
pay the bill at the end. It's because, you know, you have one identity and you know,
the, you know, if you stiff them, then like, you know, life is a repeat game, and that's not going to work out well for
you.
But in a digital world where you can be anonymous and show up in different ways, I think
the incentive to act like a good citizen can be a lot less, and that causes a lot of issues
and toxic behavior.
So that needs to get sorted out.
So I think in terms of what is allowed, I think you want to just look at what
are the damages. But then there's also other things that are not related to kind of harm,
you know, less about what should be allowed, and more about what will be possible that are
more about the laws of physics. So right, it's like, if you wanted to travel to see me in person,
you'd have to get on a plane, and that would take a few hours to get here,
whereas we could just jump in a conference room
and put on these headsets,
and we're basically teleported into a space
where it feels like we're together.
So that's a very novel experience,
that it breaks down some things
that previously would have defied the laws
of physics for what it would take to get together.
And I think that that will create a lot of new opportunities.
So one of the things that I'm curious about is there are all these debates right now about
remote work or people being together.
And I think this gets us a lot closer to being able to work physically in different places,
but actually haven't feel like we're together.
So I think that the dream is that people will one day be able to just work wherever they
want, but we'll have all the same opportunities because you'll be able to feel like you're
physically together.
I think we're not there today with just video conferencing and the basic technologies that
we have, but I think part of the idea is that with something like this, over time, you could get closer to that. And that would
open up a lot of opportunities, right? Because then people could live physically where they want,
while still being able to get the benefits of being physically or kind of feeling like you're
together with people at work, all the ways that that helps to build more culture and build better
relationships and build trust,
which has to go real issues that if you're not seeing people in person ever. So, yeah, I don't know. I think it's going to be, it's very hard from first principles to
think about all the implications of a technology like this and all the good and the things
that you need to mitigate. So, you try to do your best to envision what things are going to be like and
accentuate the things that they're going to be awesome and hopefully mitigate
some of the downside things. But the reality is that we're going to be building
this out one year at a time. It's going to take a while. So we're going to just
get to see how it evolves and what developers and different folks do with it.
If you could comment, this might be a bit of a very specific technical question, but Alama too is incredible. You've released it recently. There's already been a lot of exciting
developments around it. What's your sense about its release and is there a Lama 3 in the future?
Yeah, I mean, I think on the last podcast that we did together, we were talking about the
debate that we were having around open sourcing Lama 2. And I'm glad that we did.
I think at this point, the value of open sourcing a foundation model like Lama 2 is significantly greater
than the risks.
In my view, we spent a lot of time to get very rigorous assessment of that and red teaming
it.
But I'm very glad that we released Lama 2.
I think the reception has been, it's just been really exciting to see how excited people
have been about it's just been really exciting to see how excited people have been about it.
And it's gotten way more downloads and usage than I would have even expected.
And I was pretty optimistic about it.
So that's been great.
Lama 3, I mean, there's always another model that we're training.
So, I mean, for right now, we train Lama 2
and we released it as an open source model
and right now the priority is building that
into a bunch of the consumer products,
all the different AIs and a bunch of different products
that we're basically building as consumer products.
Because Lama 2, by itself, it's not a consumer product, right? It's more of a bunch of different products that we're basically building as consumer products. Because LOMA2 by itself, it's not a consumer product, right?
It's more of a piece of infrastructure
that people could build things with.
So that's been the big priority
is kind of continuing to fine tune
and kind of just get LOMA2
and it's little branches that we built off of it
ready for consumer products that hopefully,
hundreds of millions of people will enjoy using those products in billions one day.
But yeah, we're also working on the future foundation models.
And I don't have anything new or news on that.
I don't know exactly when it's going to be ready.
I think just like we had a debate around Lama 2 and open sourcing it,
I think we'll need to have a similar debate and process to red team this and make sure that this is safe.
But my hope is that we'll be able to open source this next version when it's ready too.
But we're not close to doing that this month.
I mean, this is, it's a thing that we're still
somewhat early and working on.
Well, in general, thank you so much
for open sourcing Lama 2 and for being transparent,
but all the exciting developments around AI.
I feel like that's contributing to a really awesome
conversation about where we go with AI.
And obviously, it's really interesting to see all the same kind of technology integrated
into these personalized AI systems with AI personas, which I think when you put in
people's hands and they get to have conversations with these AI personas, you get to see interesting
failure cases,
where the things are dumb or they go into weird directions
and we get to learn as a society together.
What's too far, what's interesting, what's fun,
how much personalization is good, how much generic is good,
and we get to learn all of this.
And you probably don't notice yourself.
We have to all figure it out by using it, right?
Yeah, I mean, part of what we're trying to do with the initial AI is launch is having
a diversity of different use cases just so that people can try different things because
I don't know what's going to work. Are people going to like playing in the text-based
adventure games? Are they going to like having a comedian who can add jokes to threads or they can want
to interact with historical figures.
You know, we made one of Jane Austen and one of Marcus Aurelius and I'm curious to see
how that goes.
I'm excited for both.
Yeah.
It was a big fan.
I'm excited for both.
I have conversations with them.
I mean, yeah, that's, you know,
and I'm also excited to see, you know, the internet, I don't know if you heard can get kind of weird,
and I applaud them for it. So I get to see. Yeah. Yeah. So it'd be nice to see how weird they take it.
What kind of memes are generated from this? And I think all of it is a, especially in this early
stages of development, as we progress towards AGI,
it's good to learn by playing with those systems
and interacting with them,
and like a large scale, like you said.
Yeah, totally. I mean, that's why,
well, we're starting out with a set,
and then we're also working on
this platform that we call AI Studio,
that's going to make it so that,
over time, anyone will be able to create one of these AI's,
almost like they create any other UGC content
across the platform.
So I'm excited about that.
I think that, to some degree, we're not
going to see the full potential of this until you just
have the full creativity of the whole community
being able to build stuff, but there's a lot of stuff that we need to get right.
So, I'm excited to take this in stages.
I don't think anyone out there
is really doing what we're doing here.
I think that there are people who are doing
kind of like fictional or consumer oriented
character type stuff,
but the extent to which we're building it out
with the, you know, avatars
and expressiveness and making it so that they can interact across, you know, all of the
different apps and they'll have profiles and, you know, we'll be able to engage people
on Instagram and Facebook. I think it's just it's, it's going to be really fun.
Well, I'm still, so we're talking about AI,
but I'm still blown away this entire time
that I'm talking to Mark Zuckerberg,
and you're not here, but you feel like you're here.
I've done quite a few intimate conversations
with people alone in a room, and this feels like that.
So I keep forgetting for long stretches of time
that like we're not in the same room.
And for me to imagine a future where I can with a snap of a finger do that with anyone
in my life, the way we can just call right now and have this kind of shallow 2D experience
to have this experience like we're sitting next to each other is like, I don't think
I can, I don't think we can even imagine how that changes things, where you can immediately
have intimate one-on-one conversations with anyone.
That might, in a way, we might not even predict change civilization.
Well, I mean, this is a lot of a thesis behind the whole metaverse, it's giving people
the ability to feel like you're present with someone.
I mean, this is the main thing I talk about all the time, but I do think that there's
a lot to process about it.
I mean, from my perspective, I'm definitely here.
We're just not physically in the same place.
It's not like you're not talking to an AI, where I do, you know, this is...
So I think the thing that's novel is the ability to convey through technology
a sense of almost physical presence.
So the thing that is not physically real is us being in the same physical place, but
kind of everything else is.
And I think that that gets to this somewhat philosophical question about what
is the nature of kind of the modern real world. And I just think that that's, it really is
this combination of physical world and the presence that we feel, but also being able to combine
that with this increasingly rich and powerful and capable digital world that we have and
all of the innovation that's getting created
there.
So, I think it's super exciting because I mean the digital world is just increasing in
its capability and our ability to do awesome things, but the physical world is so profound
and that's a lot of what makes us human is that we're physical beings.
So, I don't think we want to run away from that and just spend all day on a screen. And that's like, you know,
it's one of the reasons why I care so much about
about helping to shape and accelerate
the these future computing platforms.
I just think this is so powerful.
And it's, you know, even though the current version
of this is like you're wearing a headset,
I just think this is gonna be by far the most human
and social computing platform that has ever existed and that's what makes me excited.
Yeah, I think just the linger on this kind of changing nature of reality, like what is real?
Maybe shifting it towards the sort of consciousness. So what is real is the subjective experience of a thing that makes it feel real versus
necessarily being in the same physical space because it feels like we're in the same physical space. Yeah, and that the conscious experience of it
that's probably what is real not like that the space time like the of it, like you're basically breaking physics
and focusing on the consciousness, that's what's real.
So whatever is going on inside my head.
But there were a lot of social and psychological things
that go along with that experience
that was previously only physical presence.
Right, I think that there's like an intimacy,
a trust, you know, there's a level of communication because so much
of communication is nonverbal and is based on expressions that you're sharing with someone
when you're in this environment.
Before those things would have only been possible, I got on a plane and flown to Austin and sat, you know, physically with you in the
same place. So I think we're, we're basically short-cutting those laws of physics and delivering
the social and psychological benefits of being able to be present and feel like you're there
with another person, which I think are real benefits to anyone in the world. And I think that, like you said, I think that is going to be a very profound thing.
And a lot of that is, that's the promise of the metaverse and why I think that that's the
next frontier for what we're working on. I started working on social networks when they were
primarily text, or the first version of Facebook, your profile,
you had one photo, and the rest of it
was like lists of things that you were interested in.
And then we kind of went through the period
where we were doing photos, and now we're kind of in the period
where most of the content is video.
But there's a clear trend where, over time,
the way that we want to express ourselves
and kind of get inside and content
about the world around us gets increasingly just richer and more vivid.
And I think the ability to be immersed and feel present with the people around you or the
people you care about is from my perspective, clearly the next frontier.
It just so happens that it's incredibly technologically difficult.
Right, it requires building up these new computing platforms and completely new software stacks
to deliver that, but I kind of feel like that's what we're here to do as a company.
Well, I really love the connection you have through conversation, and so for me, this
photorealism is really, really exciting. I'm really excited for this future
and thank you for building it.
Thanks to you and thanks to the amazing meta teams
that I've met, the engineers and just everybody I've met here.
Thank you for helping to build this future.
And thank you, Mark, for talking to me inside the metaverse. This is blowing my mind. I can't quite express. I would love to measure my heart rate this whole time.
It would be hilarious if you're actually like sitting in a beach right now.
I'm not. I'm in a conference room.
Okay. Well, I'm at a beach and if I'm not wearing any pants, I'm really sorry about that for anyone else who's watching me in physical space. Anyway, thank you so much for talking today.
This was, this really blew my mind.
It's one of the most incredible experiences in my life.
So thank you for giving that to me.
Awesome, awesome.
Glad you got to check it out.
And it's always fun to talk.
All right, I'll catch you soon.
See you later.
This is so, so amazing man.
This is so amazing.
amazing man. This is so amazing.