Moonshots with Peter Diamandis - 2 Ex-AI CEOs Debate the Future of AI w/ Emad Mostaque & Nat Friedman | EP #98

Episode Date: April 25, 2024

In this episode, Peter, Emad, and Nat debate the future of AI, predictions for the next few years, and their vision for AI’s future.  07:11 | The Uncertainty of AI Understanding 17:44 | The Future of AI Staffing 38:05 | AI Solutions for Complex Challenges Emad Mostaque is the former CEO and Co-Founder of Stability AI, a company funding the development of open-source music- and image-generating systems such as Dance Diffusion, Stable Diffusion, and Stable Video 3D.  Nat Friedman is an accomplished entrepreneur and software engineer, known for co-founding Xamarin, a platform for building mobile applications, and for serving as the CEO of GitHub, the world's leading software development platform. He is also an active investor and advisor in the tech industry, supporting innovative startups across various sectors. Learn more about Abundance360: https://www.abundance360.com/summit  ____________ I only endorse products and services I personally use. To see what they are, please support this podcast by checking out our sponsors:  Get started with Fountain Life and become the CEO of your health: https://fountainlife.com/peter/   AI-powered precision diagnosis you NEED for a healthy gut: https://www.viome.com/peter  ____________ I send weekly emails with the latest insights and trends on today’s and tomorrow’s exponential technologies. Stay ahead of the curve, and sign up now: Tech Blog Get my new Longevity Practices book for free: https://www.diamandis.com/longevity My new book with Salim Ismail, Exponential Organizations 2.0: The New Playbook for 10x Growth and Impact, is now available on Amazon: https://bit.ly/3P3j54J _____________ Connect With Peter: Twitter Instagram Youtube Moonshots Learn more about your ad choices. Visit megaphone.fm/adchoices

Imagine being the first person to ever send a payment over the internet. New things can be scary, and crypto is no different. It's new, but like the internet, it's also revolutionary. Making your first crypto trade feels easy with 24-7 support when you need it. Go to Kraken.com and see what crypto can be. Not investment advice. Crypto trading involves risk of loss. See Kraken.com slash legal slash ca dash pru dash disclaimer

for info on Kraken's undertaking to register in Canada. What I think happened in the last year, really, is the starting gun was fired. We spent a trillion dollars on 5G. Is AI more impactful than 5G? Of course it is. Do we actually know what's going on inside the models? We can measure everything and still we don't really quite understand mechanically what's happening inside them. They're not engineered and designed, they're kind of grown. AI is clearly more capable than humans now.

We know this is going to get better, when does it slow down? Right now it's a few companies doing this, but we need standards around it and we need the expansion. And again, every country will invest in this. Every company will invest in this. We're here to talk about what happened. I always say WTF just happened in the past year because a lot has happened.

Imad, you were on stage with me a year ago and things were amazing then, but a lot has happened. So I want to split this into a couple of parts. What just happened the last year? And then I want to talk about how far forward can you see? What do you expect is going to happen? I'd love to talk about the companies, the models, the dramas.

What did Ilya see? I think that's going to become a meme. Matt, do you want to kick us off? what did Ilya see? I think that's going to become a meme. Matt, do you want to kick us off? What's the big things that happened in the last calendar year in your mind? Well, yeah, it's been kind of an amazing year. I do think for people who just started paying attention to this sort of new AI

and deep learning revolution in November of 22, when ChatGPT came out, things probably seemed very fast because we had Stable Diffusion come out over the summer. Previously in 22, we had ChatGPT in November, and then just a few months later, GPT-4 came out, sort of demonstrated a new level of capabilities that were shockingly improved

over what was there previously. I do think there's a set of people who sort of extrapolated from those three data points in terms of the progress that was going to happen from there. It's incredible actually how quickly people can adapt to these new things. There was a point at which chat GPT blew everyone's minds. And then a few months later, it was sort of just something we accepted as part of the world, as part of reality. And we can very quickly enter this kind of slump, where's the new model, GPT-3, GPT-4

is boring now, when do we get GPT-5, come on, Sam, put it out already, what are you waiting for? You know, this kind of thing. So I think we had a little bit of that this year. And then over the course of the year, though, what we started to see, and I'd been waiting for this for a while, but we started to see real adoption taking off. And so, you know, back in 2020, GPT-3 had come out. So back in 2020, GPT-3 had come out, and in 21 when I was running GitHub, we put out GitHub Copilot, and it was, I guess, one of the first LLM commercial products, and I thought that

immediately after that there would be this rapid wave of commercialization of large language models because developers would have seen how capable they were, what they could do, and start building products with them, but it really took this kind of chat GPT moment before entrepreneurs, developers and product people started to do this. So what I think happened in the last year really is the starting gun was fired on the actual exploitation of these raw capabilities, the building of products, the working of them into companies and organizations. Now that's what we see, the adoption has been incredible.

ChatGPT is rumored to have gone from basically zero to $2 billion in revenue in just about a year. That's amazing. There's organizations like stability that put out models that have hundreds of millions of users. You have mid journey. You have Midjourney. You have now Google in the game, finally, with Gemini. I thought it was exciting to see them not only release Gemini,

but very quickly follow up with Gemini 1.5. And so there's a way in which Google has clearly internalized the pace here and the need to iterate and ship. And so that... I don't think a lot of people realize how far ahead Google was for a decade. Yeah. Right?

So Google had really developed a lot of the early tech here and said it's not ready for release. Right? They were being responsible to a great degree. And then how do you not release after Chachapetigo gets released?

They're shipping tilt now. They're going to ship. They're going to ship, yes. Imad, the open model story that you told us last year has really blossomed. And in fact, it's become sort of an ethos in the organization, right? It's like Elon is like really twisting the knife in with Sam and then says, but Grok's going to

be open now. Can you talk about what's happened in the last year in open? Will open win, do you think? And I'm curious for both you guys. And describe what open is versus closed for the audience here. Yeah, so proprietary AI is you don't see the code the way it's anything. It's provided as a service. Whereas open models and code

are ones that you can adapt to yourself, you can take, bring to your own data, and you own. And that's important, because these models are something a bit different. They're like extensions of our mind. And so the best analogy I've said is that these are actually like graduates. So they can code, they can write, they can sing.

They sometimes go a bit crazy when they try a bit too hard. You know, we'll give them better education. And so open models are like graduates that you hire, and then proprietary models are like consultants you bring in. Interesting. And in the early stages, we all needed consultants. Now people are saying, well, I want this for my own data. I want this for that.

And open allows for innovation to happen. So we've had now 330 million downloads of our models on Hugging Face. Wow. And what is Hugging Face for folks? It's GitHub, but for AI models. So it's where you go as a developer to download the models. And so people, millions and millions of developers are using this technology.

But then you look at the language model side, people are taking it, adapting it, and optimizing it to have innovations that are now catching up with even proprietary guys. But they're complementary. You will have your own team, and then you'll bring in the specialists. And I think that's the best way to think about this.

Because you can't outsource your internal intelligence from a personal company, even country level, to models that you don't know what the provenance are. And this is one of the debates that we saw over the last year. The first step was like, oh my God, exponential extrapolation. You know, as Nat said, kind of actually, the foundations for this were dug like maybe a decade ago. And now we've been filling in the cement

and now we're all building houses. And we're like, well, the houses will become skyscrapers. So it was like, well, they could kill us all and those, and those are valid things to discuss. Then it became about sovereignty. And well, GPT-4 is amazing, but I want my own version as well for my own private data. And so I think as we advance,

proprietary models will always beat open models. Proprietary will always be what? Open models. Because you can take the open model and bring your private data to it and optimize it. Because open models are like generalized graduates, as it were. But both of them need to exist. I think we'll see both of them continue to take off. Do we actually know what's going on inside the models? both of them continue to take off. Do we actually know what's going on inside the models? I was listening to a conversation with the chief scientist at

Anthropic, who will be on stage with us next year, and he's saying we actually don't understand really how these models work. Is that a fair statement? I mean, just so you understand, it's like like they're amazing

but we actually don't understand how how the weights and connections and all are really working i mean we we understand it at this like very micro level you know we can see the multiplications happening and we can see the signal moving to the next layer in the neural network but um it's actually sort of similar, although not the same mechanisms, to the way we don't have a perfect understanding of the way thinking happens in our brains. We don't, even though in the case of our brains, when we try to do the neuroscience

and understand what's happening at the neuron level and the organelle level, we're limited by our measurement, right? We can't measure the state of every single neuron in your brain while you're thinking. That's not something we have the sensing technology to do now. That's not a problem we have with these AI minds that we're building. We can measure everything.

And still, we don't really quite understand mechanically what's happening inside them. They're not engineered and designed. They're kind of grown. them. They're not engineered and designed. They're kind of grown. You know, they're the products of us, actually, because we have the internet, which digitized the world and put the sort of all the data we've produced online. And there's a way in which that process of building the internet was like a bootstrapping process for building AI, because it was a precondition to making AI. We digitized the world, we put all the contents online, and then we could use all that to sort of grow and train these AI models, but we don't quite know how they work.

Now, there's a new field, new not in time, but relatively small field called interpretability, which is about trying to understand what's going on in these things. What are they doing? How do they make the decisions that they make? Obviously, there's benefits if you can do that to making them better in all sorts of ways. You can make them smarter, maybe, and make better decisions. And you can also hope to make sure they do the thing you want them to do and not something else. But it's new. Elon put a tweet out, which I read during my opening remarks,

that said, we're going to have human-level AI next year, and by 2029, AI will be equivalent to all 8 billion people. Do you agree with that, Imad? Do you think it's going to move that fast? I think we had a big discussion about generalized AI, that can do everything,

and that was the focus of DeepMind and OpenAI. But for specific tasks, AI is clearly more capable than humans now. So for example, Google's Gemini Ultra model has a million, 10 million token context window. What does that mean? It means that someone can upload themselves debugging a piece of code in the code base and it'll correct it. And no human could ever do that. You know, our RAM isn't big enough. a piece of code in the code base and it'll correct it. And no human could ever do that.

RAM isn't big enough. On image now, we can generate images faster than anything, songs in seconds and other things. Let's talk about that a second. Sora was, I mean, pretty like, holy shit moment, right? And someone is doing it right at OpenAI with ChatGPT and then Sora. But I remember last year you told us it used to take like 30 seconds to generate on stability a single image. And then it was down to a second. And you've advanced the technology orders magnitude since then.

Yeah. So I think if we can put the thing up. Put up the slide. Stable image. Yeah. And then if we actually go to the next slide. Put up the slide, stable image. And then if we actually go to the next slide, talk about speed. Should I click this? Let's see. Oh, you can click this to give an idea of where it's gone.

So image was kind of one of the things that kicked this off in 2022. All of these images generated on a MacBook. On a MacBook. Just from description. And now we've perfected text and other things, but the next step after you can generate all these beautiful images is that you want to move

to control. So the models are just the first step. You have to have chat GPT and other things to make them useful. But then you want to be able to take that guy and say upscale. And that's all we said and upscaled him. You want to say replace a lion with a cat and we can now do that real time. You know? Or a tiger with a cat, and we can now do that real time. Or a tiger with a unicorn.

Replace background with a forest. So all of this you can do pretty much real time. Because if you look at the next slide from this, I said it was 20 seconds to one second. This is live real time. You can just type, and it automatically adjusts the cat. It gives them a hat. But then if you look at the optimization of that with the

next slide, this process here, we're just releasing a new distillation model today. We've got 200 cats with hats per second. 200 cats with hats per second. So that's your speed of image generation. That's a new unit of image generation. 50 milliseconds per image? Yeah, exactly. Because there's not enough cats on the internet, right?

So we're going to add more cats to the internet. Oh, 5 milliseconds. 5 milliseconds. 5 milliseconds, yeah. But I think with the new chips that are coming, and video's going to announce another one, we'll get up towards 1,000 images per second. So that's real live, that's live video. Times 30. Yeah, and so OpenAI's innovation,

there were two major things. There was the transformer architecture, the language models, and diffusion that drive the media models. They combine the two together. So our new image model, Stable Diffusion 3, which is the best-performing image model, combines those together as well.

So if you go forward a few slides from here. Next one. Skip. Another one. Another one. That's the upscaling. So you basically said upscale this image on the left, and you get the image on the right. We'll have that real time in a couple of years, so your boxy video games will look a lot more realistic.

So just literally as you can take an old game and play it in surreal life. Yes. But if you go to the next slide, these videos with our video model were all generated on a consumer graphics card with five gigabytes of VRAM So I mean the the point is it's this is in everybody's hands It's in everyone's hands and again, we haven't even optimized the data. So in an hour next slide We're releasing the world's most advanced 3d model. So all of these are just generated just from descriptions And so the fastest version of this does it in one second.

So you can generate that dragon. But then the next step is you'll be able to control every element, make its horns bigger, make these adjustments. So how long would that take for a normal creative person in kind of industry? A huge amount of time. But now it works on the edge.

And it works even faster in the cloud. PAUL LEWISOHNSKI. So a future here where you can be describing the video game you want created. And it's generating all the characters and generating the play. Yeah. And so if you go back a few slides to that thing with all the nodes. I think this is an important thing. Sorry. I didn't do the slides properly.

I think one of the things that we're having right now is this is a system we built called Comfy UI that's used by just about everyone now. So you take the face, the pose, the dress, and then you have that output. But if I share that image with you, it reconstructs the entire flow. Because last year was the year of creation, models that create. Then ChatGPT Comfy UI allowed you to control and compose them. And the next bit is bringing that all together because ChatGPT, all the knowledge that you build

from writing your speech, you don't have files anymore. You have flows with these models and assets there. I think that's the next step because, you know, when you go beyond just spitting out ideas to be able to control them like that, that's a huge deal. Amazing. And you're announcing this in an hour? The 3D model is releasing in an hour.

Open source to everyone. Give it up for Imad here. You really have, and I don't know if you're able to say this, I mean, you're driving revenue and soon at profitability. What's your financial? I can't say that publicly. You can't, okay. But it's going well. We're ahead of forecasts, that's all I can say.

Okay, all right. He told me backstage it was good. Yeah, okay, good. It did all right, yeah. Everybody, I want to take a short break from our episode to talk about a company that's very important to me and could actually save your life or the life of someone that you love.

The company is called Fountain Life. And it's a company I started years ago with Tony Robbins and a group of very talented physicians. You know, most of us don't actually know what's going on inside our body. We're all optimists. Until that day when you have a pain in your side, you go to the physician in the emergency room and they say, I'm sorry to tell you this, but you have this stage three or four going on. And, you know, it didn't start

that morning. It probably was a problem that's been going on for some time, but because we never look, we don't find out. So what we built at Fountain Life was the world's most advanced diagnostic centers. We have four across the U.S. today and we're building 20 around the world's most advanced diagnostic centers. We have four across the US today, and we're building 20 around the world. These centers give you a full body MRI, a brain, a brain vasculature, an AI-enabled coronary CT looking for soft plaque, a DEXA scan, a grail blood cancer test,

a full executive blood workup. It's the most advanced workup you'll ever receive. 150 gigabytes of data that then go to our AIs and our physicians to find any disease at the very beginning. When it's solvable, you're going to find out eventually. Might as well find out when you can take action. Found Life also has an entire side of therapeutics. We look around the world for the most advanced therapeutics that can add 10, 20 healthy years to your life. And we provide them to you at our centers. So if this is of interest to you, please go and check it out. Go to fountainlife.com backslash Peter.

When Tony and I wrote our New York Times bestseller, Life Force. We had 30,000 people reached out to us for Fountain Life memberships. If you go to fountainlife.com backslash Peter, we'll put you to the top of the list. Really, it's something that is, for me, one of the most important things I offer my entire family, the CEOs of my companies, my friends. It's a chance to really add decades onto our healthy lifespans. Go to fountainlife.com backslash Peter. It's one of the most important things I can offer to you as one of my listeners. All right, let's go back to our episode. I am curious about the idea of how far are we from having an AI that I can have a conversation with and say, I'd really like to create a new business that does this, this, and this.

And just have that, like a brainstorm partner AI. And it will do the incorporation. It will write the code. It will generate the marketing materials. And it will be able to, you know, we're all entrepreneurs here. That's all we, you know, find a problem, build a business, find a problem, build a business. How far are we from that reality of an AI created, well, I'll come back to the second part in a minute, but an AI that can be your thought partner and really staff up a company?

I think it's already happening gradually, and then maybe suddenly. We have, I think companies will, these models are neural, they're neural networks, and so I think the right way to think about it is that companies in the future will just be increasingly neural, and there'll be more and more of the company,

and what used to be the departments of the company that are single models or swarms of models that are doing work. I think it'll, you know, at some point, probably very soon, we'll look back on 2024 and say, God, do you remember when companies had like hundreds of people in the finance department doing accounts payable and just like transforming information from one form of text to another, essentially, in doing this coordination. And so I think you will have some form of both existing companies that just adopt more and more AI because it gives them advantages, it makes them more efficient, maybe it gives them

better customer service, people enjoy the responsiveness, intelligence, politeness, clarity, etc. of the AI counterparty. And you'll also have new companies that will be AI native, started from scratch, neural from the beginning. So some people may remember when Instagram was acquired by Facebook for a billion dollars, everyone was just marveling at the fact that a small company- 13 employees. 13 people could be worth a billion dollars.

How is that possible? And the joke was, you know, gosh, could you ever get down to a one person company that's worth a billion dollars? And we're like, this is clearly going to happen. Maybe eventually zero person company. So we talked about this getting ready. And I said, when are we going to have a scenario where a government, and we have some governments in the room here, says we're going to create a new regulation that allows an AI to incorporate on its own in our jurisdiction. I think it's a winning scenario because all of a sudden the AI incorporates, you get the tax base, and every AI incorporated company will move there. I think Wyoming's done that.

Wyoming's done that. They have a new structure called Aduna for a decentralized autonomous organization. I'm sorry, who has? Wyoming. Of all places. Yeah, we have some Wyoming fans here in the audience. Yeah, so technically that could happen today. Amazing.

I mean, I do think that that is a... So the speed of wealth creation? How should... So let's talk about what are the wow moments that might be possible in the next year? What are some crazy wow moments that you might see? I think one of the most important things is the accuracy and then these long context windows. Explain what the most important things is the accuracy and then these long context windows.

So you're absorbing information right now and it's quite high definition because you can see everything here and other stuff, but you're still writing it down. And the reason our organizations get big is because text is a lossy transmission format. We lose so much context. The final PDF loses all of that stuff. Now with the new Google models, Nat has some amazing companies in this space as well. You can upload hundreds of thousands of words, thousands of documents, and the AI can interpret them all at once.

It doesn't need to be trained on it. So you can upload all of your ideas and say, build a business based on this, and it will do that. Or you can upload a whole bunch of movies and then tell it to write a script that incorporates all of that and it will do that at inference time. But again, it's something superhuman. But we all have these massive repositories of all these ideas we've had. Being able to dump that now and then the AI, without having to be trained, spit back answers,

ideas and things like that, I think is a really huge step along with that composition step that I kind of discussed before. Yeah, I totally agree with that. I think there will be a couple things coming probably pretty soon. It's hard to predict exact timelines on these things. Sometimes things happen faster than you expect and sometimes a little slower. But one of the clearly amazing, clearly possible now products to build is a voice-to-voice model that's indistinguishable from talking to a human, maybe for a conversation of up to a couple minutes. What happens after a couple of minutes?

Well, maybe you can kind of just tell somehow that it's not quite human after a couple of minutes. I'm setting a milestone that I think is achievable this year. Maybe if you can do two minutes, you can do 12 minutes. I don't know. But yeah, you know, it's actually about all the technologies there, it all just has to be integrated. And so you need the sort of the ability to recognize speech is there, the ability to interpret it with a language model and generate responses is there, and then the ability to

turn that text into incredibly realistic voices there and kind of putting that all together into a package that has very low latency that's talking the way we talk where you can kind of interrupt me and maybe there's an avatar that's giving you this human like i mean aristotle was very impressive but i knew that that was not a real person right and so um i think we could yeah he was a real person. Yeah, that's right. And then I think the other thing that's a very big deal is this idea of autonomy and agents. There's been a lot of talk of it with AI over the last year. Today, these things are not agents.

They're tools. They're call and response. You go to chat GPT, you type something, you hit enter, you watch the response kind of stream back. And I think what people don't necessarily understand is that when these language models are responding to you, it's almost like a rap battle. They have a fixed amount of time to generate each word. And so they can't sort of sit there and ponder for a minute, you know, what they're going

to say. They have to talk to a metronome. And so that's why when you see the words that they're writing out, that's not like they've thought about it a lot and then you see the words. It's actually the thinking is happening during the output. And... Would you say that's how a human does it too? I often...

I mean, a lot of times... I often do think, yeah. Sometimes I'm really pissed off at what came out of my mouth because I didn't think about it in advance. Yeah, yeah, I think so. I mean, sometimes you have a conversation with a smart friend and you just forming the words to respond, you have a better idea. And so I think we definitely do that too. But the agent, the autonomy is about kind of increasing the unit of. But what if you could go do 10 or 100 steps? You're talking about an AI business. Do you trust it to come up with the title of the blog post that you're going to post?

Or do you trust it to actually come up with the whole idea of the marketing campaign, come up with the strategy for how to execute it, all of the content it's going to generate, the partners it will reach out to and negotiate advertising or whatever it's going to do, have those conversations, multi-step successfully all the way to measuring its results without supervision. I think that agency thing, we're starting to see it in programming. There was a very impressive demo a week or two ago of a company called Cognition that I think it was arguably the first really impressive demo of working agents in AI, and they did it with GPT-4.

So not with a brand new model, they did it by being very clever about the way they squeeze and distill the intelligence out of GPT-4 by repeatedly calling it and analyzing and evaluating its results and choosing the best ones and so sort of going from rap battle to like draft and redraft and sort of think and ponder about it a little bit harder mode and it can do hundreds of steps in programming successfully so I think you might okay I was gonna ask you one quick question then please jump into that how far out can you imagine right now? About three years.

Three years is a max. Yeah. How about you, Nate? Well you can dream. You can dream, yeah. So I actually, the thing I find easier is to think about the long term because- The asymptote of where we're- Yeah, and that's the key question of our time is the asymptote. It's like, we know this is going to get better.

When does it slow down and what's the shape of the curve to get there? You might, I cut you off. Apologies. No, it's fine. I think probably the thing to look forward to is the last couple of years. The first year was about the technology and the breakthroughs and the research last year was about the technology and the breakthroughs and the research. Last year was about the models. Next year, going forward,

no one will give a damn about the models. It's all about what you can do with the models, bringing them together, because the models have satisficed. They've got good enough, fast enough, and cheap enough. They will get even better, and there's probably two orders of magnitude improvements still in the speed and reliability of the model.

But this will really become about, and the stories of the next year will be about, we used this model to do this and it was amazing. And so I think that's one of the things to look at, and that's what Nat said about tying them all together. You've got the ingredients now, what are the recipes we're going to make? Very quickly, capital and regulation. I was in a conversation with the CEO of one of the major AI companies, and he was saying he's raising $3 billion.

And I said, you know, I have a venture fund. I said, great. And he said, what's your minimum? And he said, probably $100 million. I said, okay, well, that's out of my ballpark. And how quick do you think you're going to raise it and it goes next month i mean there is a lot of capital flowing in yeah i mean have you ever seen a capital rush faster than this um no no i mean i No. No. I mean, I think there are a couple of comparisons you can look at. I think the railways, when railway infrastructure was being laid in the UK, I think it was some double digit

percent of GDP investment. I think the solar explosion that's happening right now is actually pretty amazing. It's something like half a point of global GDP is being invested in solar. So those are pretty big. We're nowhere near that yet with AI. And so I actually think if AI keeps working, which it seems like it will, you should expect the future to look more like that railway or solar situation where you're measuring the investment in intelligence because it's so valuable. Intelligence, AI is intelligence. Intelligence is power. Power is valuable. It's power over nature. It's power over others. And so you'll probably measure the amount of investment in it in points of global GDP. And whether that happens in two years or 10 years, I'm not sure, but it seems likely. I mean, to put this in context, less money has been spent on private AI companies

than the Los Angeles-San Francisco railway that hasn't started yet. There you go. Wow. Right? But that's almost done, I heard. Really? Fantastic.

They haven't even started. We wrote down on it. The AI right now isn't infrastructure, but it should be. Talk about your vision there, because I find it very powerful. Your vision there in education, in health, talk to me. This is a next generation human operating system

because these AIs extend our capabilities. And again, you'll need the AIs that are open and the ones that are proprietary to have the best outcome for everyone. Because all of our companies here are all information systems, and we've seen how better it can be. So the total amount of spending in this will be trillions of dollars.

We spent a trillion dollars on 5G. Is AI more impactful than 5G? Of course it is. Should it be infrastructure? Of course it should be. Should the data be transparent? Of course it should, because you need to know how our railways are made, the information knowledge superhighway of the future.

Right now, it's a few companies doing this, but we need standards around it, and we need the expansion. And again, everyhighway of the future. Right now it's a few companies doing this, but we need standards around it and we need the expansion. And again, every country will invest in this, every company will invest in this. I mean, is anyone here who runs a company not investing in this? In some way, at least your time, right? Yeah, multiplied by every company in the world. So where are we percentage-wise at the investment in AI?

Are we at a fraction of 1% still? I would say so, yes. How about you, Nate? Seems likely. So a lot of upside still opportunity. It is crazy, though. I saw a tweet the other day. I mean, I live through.com and all these little tech bubbles.

And I saw a tweet the other day from someone that said, if you don't secure equity in an AI startup now, then your children will be chattel slaves for the machine god for all eternity. And I remember thinking, I don't remember anyone saying that during dot com. And then you switched around and bought some more GPUs, right? This is somehow a little bit more extreme than the prior bubbles. So I mean, look, I think Web3 kind of received a lot without any results, whereas now you're seeing impact here.

But again, you multiply this by the number of people it affects, the value created. It's insane, because it will go all to subtraction. You've had the foundations, now the base. Now you're building the houses. You're building a whole ecosystem around this. And the transformation that that has and the amount of capital is bigger than anything we've seen. Let me ask the question we're going to be debating today on the asymptote.

How concerned are you about digital superintelligence? I'm defining this for a purpose of conversation as AI a billion fold more advanced than the human being. How do you think about that? What's your position in that debate? Pro, con, any way? I can kick off. My belief is that humans can break the atom or we can go to Mars. And so my vision is every single nation, person, company, country, culture has their own AI, data sets and self-sovereign. Needs to figure out the governance of this because it's important, and then that AI is our collective intelligence, is the human colossus. So it isn't controlled by any one individual, it isn't embodied like that, but again, it's

amplifying all of us and it's solving every single problem that we can have. I think that's a positive version of the future. I think it seems really likely that, I mean, it seems undoubtable to me actually that intelligence is just a material process like muscle strength. We have organs called muscles, we use them to move. We have an organ called the brain and we use it to think. And so if you look at,

if you just sort of ask what that means, well, we've managed to exceed muscle strength with artificial machines, with machines hundreds of years ago. And we're gonna do that with brains too. We're gonna have artificial minds that are much more powerful than ours. And it's almost like you just have to be an AI doubter

not to believe that, or you have to not believe in human ingenuity. All the most brilliant people in the world are now working on this. And there's a huge amount of capital going into it in a way we've just started. And so the idea that it wouldn't improve seems hard to believe.

Did you know that your microbiome is composed of trillions of bacteria, viruses, and microbes, and that they play a critical role in your health? Research has increasingly shown that microbiomes impact not just digestion, but a wide range of health conditions, including digestive disorders from IBS to Crohn's disease, metabolic disorders from obesity to type 2 diabetes, autoimmune disease like rheumatoid arthritis and multiple sclerosis, mental health conditions like depression and anxiety, and cardiovascular disease.

Viome has a product I've been using for years called Full Body Intelligence, which collects just a few drops of your blood, saliva, and stool, and can tell you so much about your health. They've tested over 700,000 individuals and used their AI models to deliver key critical guidelines and insights about their members' health, like what foods you should eat, what foods you shouldn't eat, what supplements or probiotics to take, as well as your biological age and other deep health insights. And as a result of the recommendations that Viome has made to their members, the results have been

stellar. As reported in the American Journal of Lifestyle Medicine, after just six months, members reported the following, a 36% reduction in depression, a 40% reduction in anxiety, 36% reduction in depression, a 40% reduction in anxiety, a 30% reduction in diabetes, and a 48% reduction in IBS. Listen, I've been using Viome for three years. I know that my oral and gut health is absolutely critical to me. It's one of my personal top areas of focus. Best of all, Viome is affordable, which is part of my mission to democratize healthcare. If you want to join me on this journey and get 20% off the full body intelligence test, Best of all, Viome is affordable, which is part of my mission to democratize healthcare.

If you want to join me on this journey and get 20% off the full body intelligence test, go to Viome.com slash Peter. When it comes to your health, knowledge is power. Again, that's Viome.com slash Peter. Here's the challenge. It feels like potentially winner take all scenarios scenarios where if all of a sudden my company is able to utilize the most advanced AI

and build out the next generation of systems and I'm doing it with me and my versions of Haley and Aristotle that they're working 24 7. I'm feeding them as many GPUs as possible, and I have a chance to really outrun the competition.

And it used to be that in the early days of the mechanical world, if you were using mechanical systems to outrun the horse, that was a local phenomenon, right? But now this is a global phenomenon because my my bits are reaching around the world and you know when you say yeah you can do my marketing do my marketing campaigns it can do my scientific analysis it can do everything and you know i keep on hearing that is like not 10 years from now, not five years from now, but that's like a three-year scenario. I don't know how to think about that. I think the pace of change, you know, is going to be very high.

And global GDP growth has been kind of in the 2% range. And we have a society and civilization that's able to adapt to that amount of change per year. Mostly, not entirely. It's been a little bit higher before. Maybe it's going to be much higher very soon. And whether there's a huge spread of outcomes that come from that. I mean, even if you don't have the extermination scenarios, the extinction scenarios in mind. I think you actually should have other scenarios in mind. What does it mean to be human?

Is the economy human dominated 10 years from now or 15? Where are decisions made and who makes them? And then just this vision of sovereign AIs, it's a new level of potentially cooperation and competition between countries and sources of this kind of power. A lot of change is coming. We went through this before. We had the five big inventions of the 1880s through the 1920s. That was a wild time of transformation.

It's almost unimaginable. People who grew up with horse carts, you know, ended up riding on jet planes. And we're going to have at least probably much more than that amount of change happen this time. I'm going to go to you, Imad, next. But when you're about to go after this to part two of that tool, and I want you to be thinking about

how can AI help you solve the challenges you listed? How will AI threaten the dominant positions or the strengths that you have? And how will AI this year help you meet your 2024 goals, right? That's the goal to putting it to use. You might want to comment on that? And I want to also talk about medicine. And you're dedicated to using AI models to solve autism and cancer and death. Or let's just say sickness. Yeah, sickness.

Yeah, I mean, I just had a thought actually. We had Steve Jobs talk earlier. Maybe the AI is jet planes for the mind, right? There you go. There you go. But the kind of the impact here, there's a sociological impact we can extrapolate forward, but an ASI is just something we can't think. If you've got...

Advanced super intelligence ASI. Yeah. If you've got too many infinite supply of graduates, what do the existing graduates do? If the floor is raised, you don't need to hire as much, you become more efficient. What are the new jobs of the future in a knowledge-raised economy? We have to think about that because, as Nat alluded to, it's like slowly, slowly, then all at once, like a turkey. You know? Thanksgiving.

I think if you look at this, though, there's the negative side and there's the positive side. So I think I mentioned last year, Google's MedPAR model outperforms human doctors in medical diagnosis accuracy, but also empathy. And we have medical models like that. Anyone here who's had someone who's had multiple sclerosis, Alzheimer's, autism, something like that, you don't have comprehensive authority to update knowledge and nobody to guide you

through that process. And you lose agency. Well, guess what? We will make open source models and they will be available to everyone and you'll never be alone again through that. And then they'll be used for diagnosis and organizing all in all. So, describe that a little bit more so people can feel what that feels like. It means, again, if anyone's experienced that, someone comes to you and says, you have a

diagnosis of Alzheimer's for your father or autism for your child. You lose agency because you're like, what now? There's no cure, there's no treatment. Where do I even go for information? A lot of our stuff is a coordination issue. Whereas if we have a specialised medical model for that topic and retrieval augmentation and tie it into all these systems, you can have all that knowledge at your fingertips and it can help guide you empathetically through that. It can literally talk to you. It can connect you with other people going through the same process. And then the next step is it can organize

all the knowledge in this area, because there's so many promising treatments. But how does anyone here find out all the treatments about autism or cancer? There used to be patients like me, but it hasn't survived. But this, it supercharges that. And then you do that once,

and it's infrastructure for the 50% of people around the world that will have a diagnosis of cancer. And again, you've transformed it because there will always be someone with every single person that can connect them to the right information at the right time. So this is the positive view of the future and that creates boundless new potential in terms of both addressing our health, but science. And again, most of our science is based on files, a PDF, and we throw away

all the stuff that doesn't work. If you look at that knowledge flow of that image with the different things, and again, if I drag and send you that image, it'll reconstruct the whole flow. I think most of our things will go from files to flows, so we can remix our knowledge, so that we can find out what works and what doesn't work, and that's how we get breakthroughs. And is it true that most of the large language models were built on top of all the social media facebook websites and so but not crawling science magazines and most of the scientific databases out there science was a part of it but again what we did is big compute was a substitute for bad data it was like cooking

a steak for too long now we see that that high-quality data is even better, but we're only understanding what high-quality means. And this is why we need specialised models which are transparent, especially for things that affect things like health, education, and others. So I think dataset transparency will be a big deal, and this goes to Nat's point about interpretability as well.

You were given the example of Archive earlier, right? Science. One of the things that I think is amazing is the potential for these AIs to help us discover new science beyond interpolation or extrapolation, new laws of physics, new understandings of fundamental biology and chemistry.

Do you think that is possible? When are we going to see that? And speak one second to the Vesuvius challenge that you... Oh, sure. Yeah. I think definitely they will. Which, by the way, for me is like the most exciting thing. If you can unleash these AI models and say, go and create room

temperature superconductors, go and create life extension processes. So there's, in biology especially, biology, there's this sort of analogy that's been put out there that the language of physics was mathematics, the language of biology might be machine learning, because you're dealing with enormously complex systems, machine learning is great at sort of understanding those. And so the potential for AI to transform biology is enormous. I think it's all in the very earliest stages right now. And we have not yet had the kind of GPT-3,

let alone the chat GPT moment for biology and AI. I think it'll come soon. Since Google is our sponsor, I'm going to say the Gemini moment. There you go. The Gemini moment hasn't occurred yet. Is it the Bard moment maybe? I don't know. But it's coming. And I'm involved with some companies that are

training enormous models to help synthesize and design proteins. There are a few great efforts out there to do this. And the capabilities that are popping out of these things are incredible. The ability to describe a target, describe a structure, and just have it produce a sequence of amino acids that you can then synthesize and test in the lab for safety and efficacy. It can short circuit a huge part of this sort of cognitive work and experimental work that's been necessary historically for drug design.

And so I think that's one thing. I think another thing is there will be a surge of new discoveries that happen as AI digests all the existing scientific literature. And so there's a whole area of study, which is meta-analysis, where people will study across papers to find connections and correlations across existing research that haven't been noticed. I'm bubbling with excitement on that notion and that idea. Yeah, so imagine, I have a friend, Shana Swan,

she's a scientist at Berkeley and does a bunch of research on environmental toxins. She spent two years running one meta analysis that I'm now working with her and trying to support her in the effort to use AI to automate this, Research on environmental toxins. She spent two years running one meta-analysis That you know I'm now working with her and trying to support her in the effort to use AI to automate this and it'll I mean in theory With these long context windows this could potentially happen in minutes And so I think new discoveries will pop out of that immediately and just because we're short on time I'm going to say you found Mount Vesuvius. Oh, yeah after the eruption

buried a number of parchment scrolls that were, if you imagine, buried under all of the ashes and soot and so forth. You took some of those scrolls, you x-rayed them, gathered the x-rayed data from those scrolls, and then you ran an order of a million dollar Vesuvius challenge, like an X Prize. Yeah. And the winner solved it. It worked, yeah. No, it's true. So, yeah, 2,000 years ago, Mount Vesuvius erupts. It buried the town of Herculaneum

under 65 feet of ash and mud. And then in the 1700s, some farmers digging a well found the villa at 65 feet down. And then later, during these tunneling excursions, people kept running into these little chunks of charcoal they didn't know what they were they turned out to be carbonized papyrus scrolls that were not openable physically they just sort of turned to dust in your hands when you open them they've been stored in a library in naples for years and we used a particle accelerator to scan them at super high resolution but then we needed to use AI and machine learning to unroll them.

They're so badly distorted by... How cool is that? You know, yeah. Imad, why don't you close us out here with what you're most excited about going forward. What's a vision of the world in the next one to three years that you want people to take away from here? I think this AI is augmenting, not replacing.

And so you see what Nat said, and I look at how creatives use it. AI can't do art. It can do content right now. But you can use it to riff and jam with, so you inflow more often. So the thing I'm most excited about is its impact upon education science over the coming

years because everyone will have access to all the knowledge that amplifies them. I think things like creativity are also great because it's great to create, but realistically, again, every single person in this room will just have access. This is the worst it will ever be. That's so important. This is the worst AI will ever be. And the lowest Bitcoin will ever be. That's so important. This is the worst AI will ever be. And the lowest Bitcoin will ever be too. Yeah.

And then view it amplifying yourself and there's nothing you can't achieve with this, I think. People are sitting down here with goals for the year, objectives they want to achieve, what is your top piece of advice for the CEO, entrepreneur, philanthropist here that has like, oh man, I'm trying to do more and more. What should they think about? Well, I think what's happening

or what's about to happen is sort of like we've just discovered a new continent with 100 billion people on it and they're willing to work for free for us. And you should probably factor that into your plans over the next few years because your competitors will. And because it'll benefit you enormously at home, at work, and your family.

We just discovered a new content with 100 million brilliant workers willing to work. 100 billion. 100, what's that? 100 billion. They're going to outnumber us. Yeah. Yeah. 100 billion.

Okay. And they'll work for a few watts of power. And so this is a good scenario. And I think it's very, very likely. And so I would, and I think, you know, this is sort of like being an internet native. You want to be an AI native. And you want to spend time using this stuff and not looking for the problems, but looking for the value and how to, what's it good at? What's it not good at?

How do you interact with it? It's amazing to see people use Stable Diffusion, for example. You've improved it so much over time, but there's a skill to being good at interacting with these models and partnering with them. And so I think we all have an advantage just to get that hands on ourselves. Imagine being a CEO of a company when electrification was happening and obviously every company should electrify and then not doing it in your own home. That would be strange. Amazing. Imad, you're going to be with us for the next few days.

So thank you so much for that. Nate, it's a pleasure to get to know you. Thank you for joining us this morning. Let's give it up for Nate and Imad.