TryShadowing
Shadow YouTube. Speak English.
Home
Browse
Dictation
NEW
My Library
en
0
days
Sign in
Jensen Huang: NVIDIA - The $4 Tri… — Lex Fridman shadowing | TryShadowing
TryShadowing
Shadow YouTube. Speak English.
Home
Browse
Dictation
NEW
My Library
en
0
days
Sign in
Home
Browse
Lex Fridman
Jensen Huang: NVIDIA - The $4 Trillion Company & the AI Revolution | Lex Fridman Podcast #494
Jensen Huang: NVIDIA - The $4 Trillion Company & the AI Revolution | Lex Fridman Podcast #494
Lex Fridman
·
2:25:58 · Mar 23, 2026
Start Shadowing
0:00
0:00
Record
×1
1x
VI
EN
JA
KO
ZH
FR
PT
TH
IT
DE
IPA
Pronunciation scoring isn't supported on this browser — you can still record and listen back.
The
following
is
a
conversation
Translating…
Turn on Record to capture your voice and get scored
Smart
Karaoke
Original
Line
1
/3113
0:00
The following is a conversation
0:01
with Jensen Huang, CEO
0:04
of Nvidia, one of the most important and influential
0:07
companies in the history of human civilization.
0:11
Nvidia is the engine powering the AI revolution,
0:14
and a lot of its success
0:15
can be directly attributed
0:17
to Jensen's sheer force of will
0:19
and his many brilliant bets and decisions
0:22
as a leader, engineer, and innovator.
0:26
This is the Lex Freedman podcast.
0:28
And now, dear friends, here's Jensen Huang.
0:33
You've propelled Nvidia into a uh new era in AI,
0:38
moving beyond his focus on chip scale design to now rack scale design.
0:42
And I think it's fair to say that uh winning for Nvidia for a
0:45
long time used to be about building the best GPU possible.
0:48
and you still do, but now you've expanded that to extreme
0:52
co-design of GPU, CPU,
0:54
memory, networking, storage, power, cooling,
0:57
software, the rack itself,
0:59
the pod that you've announced, and even the data center.
1:02
So, let's talk about extreme code design.
1:04
What uh is the hardest part of uh co-designing
1:06
a system with that many complex components
1:09
and design >> Yeah, thanks for that question.
1:12
So first of all, the reason why extreme code design is necessary is because
1:16
the problem no longer fits inside
1:19
one computer to be accelerated by one GPU.
1:24
The problem that you're trying to solve is
1:26
you would like to go faster
1:28
than the number of computers that you add.
1:31
So you added, you know, 10,000
1:33
computers, but you would like it to go a million times
1:38
Then all of a sudden
1:40
you have to take the algorithm,
1:43
you have to break up the algorithm, you have to refactor it,
1:46
you have to shard the pipeline,
1:48
you have to shard the data, you have to shard the model.
1:52
Now all of a sudden
1:53
when you distribute the problem this way,
1:56
not just scaling up the problem, but you're distributing the problem,
2:00
then everything gets in the way.
2:03
This is the AMD doll's law problem
2:05
where the amount of speed up you have for something
2:09
depends on how much of the total workload it is.
2:12
And so if computation
2:14
represents 50% of the problem
2:17
and I sped up computation
2:20
infinitely like a million times
2:22
you know I only sped up the total workload by a factor of two.
2:26
Now all of a sudden,
2:28
not only do you have to distribute the
2:30
computation, you have to, you know, shard the pipeline somehow.
2:34
Uh you also have to solve the networking problem
2:38
because you've got all of these computers are all connected together.
2:42
And so distributed computing at the scale that we do,
2:47
the CPU is a problem, the GPU is a problem, the networking is a
2:50
problem, the switching is a problem,
2:53
and distributing the workload across all these computers are a problem.
2:57
It's just a massively
2:58
complex computer science problem and so we just got to bring every
3:02
technology to bear otherwise
3:05
we scale up linearly
3:08
or we scale up based on
3:11
uh the capabilities of Moore's law which has largely slowed because Dernard's scaling has slowed.
3:16
I'm sure there's trade-offs there.
3:18
Plus you have a completely disperate disciplines here.
3:21
I'm sure you have specialists in each one of these high bandwidth memory,
3:24
the the networking, the NVL link, the nyx, the the optics and the copper
3:28
that you're doing, the power delivery, the cooling, all that.
3:30
I mean, there's like world experts in each of those.
3:33
How do you get them in a room together to figure out >> That's why
3:35
my staff is so large.
3:37
>> What's the pro can you take me through the process of the specialists and the generalists?
3:42
Like, how do you put together the rack when you know this the set
3:45
of things you have to shove into a rack together?
3:48
Yeah, >> like what does that process look like of designing it all
3:51
>> There's the the first question which is what is extreme code design?
3:55
You're we're optimizing across the entire stack of software
3:59
from architectures to chips to systems to system software to the algorithms to the applications. That's one layer.
4:05
The second thing that you and I just talked about is goes beyond
4:09
CPUs and GPUs and networking chips and
4:12
scale up switches and scale out switches.
4:15
And then of course you got to include
4:17
power and cooling and all of that because
4:20
you know all these computers are
4:22
extremely extremely power power hungry.
4:25
They do a lot of work and they're very energy efficient
4:28
but they in aggregate
4:30
still consume a lot of power.
4:31
And so that's one the first question is what is it?
4:34
The second question is
4:36
why is it and we just spoke about the reason you know you want
4:39
to distribute the workload so that you can exceed the benefit
4:43
of just increasing the number of computers
4:47
and and then the third question is how is it how do you do
4:50
it >> and and uh that's the that's kind of the miracle of this company
4:56
you know when you're designing a computer you have to have operating system of
4:59
computers when you're designing a company
5:02
you should first think about what is it that you want the company to produce.
5:06
You know, I see a lot of companies organization
5:08
charts and they all look the same.
5:09
Hamburger organization charts, software organization
5:12
charts and car company organization charts.
5:14
They all look the same.
5:16
And it doesn't make any sense to me.
5:18
You know, the goal of au of a company is to be the machinery,
5:21
the mechanism, the system that produces
5:25
the output and that output is the product that we like to create.
5:29
It is also designed
5:31
the architecture of the company should reflect
5:33
the environment by which it exists.
5:36
It almost directly says what you should do with the organization.
5:40
My direct staff is 60 people.
5:43
You know, I don't have one-on- ones with them because it's impossible.
5:46
You can't have you can't have 60 people on your staff
5:48
if you're, you know, going to get work done.
5:50
And >> so you still have 60 reports.
5:52
You still have more. Yeah.
5:56
>> And most stars at least have a foot in
5:59
almost all of them.
6:01
There's experts in memory, there's experts in CPUs,
6:04
there's experts in optical all Yeah.
6:07
GPUs and architecture, algorithms, design.
6:11
>> So, you constantly have an eye on the entire stack
6:14
and you're having to do like intense discussions
6:16
about the design of the entire stack >> and no conversation
6:20
is ever one person.
6:21
That's why I don't do one-on- ones.
6:23
We present a problem
6:24
and all of us attack it,
6:27
you know, because we're doing extreme code design
6:29
and literally the company is doing extreme code design all the time.
6:33
>> So even if you're talking about a particular component
6:36
like cooling networking, everybody's listening in.
6:41
>> And they can contribute
6:42
well this doesn't work for the for the power distribution.
6:44
This doesn't exactly >> this doesn't work for the for the memory.
6:48
This doesn't work for this. >> Exactly.
6:50
And whoever wants to tune out, tune out.
6:53
>> You know what I'm saying?
6:54
And the reason for that is because because the people who are on the
6:56
staff, they they know when to pay attention.
6:59
>> They're supposed, you know, something they could have contributed to, they didn't contribute to.
7:03
I'm going to call them out, you know, and so, hey, come on, let's get in here.
7:07
>> So, as you mentioned, Nvidia is this company that's adapting to the
7:11
>> So, at which point can you say,
7:14
>> did the environment change?
7:15
be began adapting sort of secretly
7:19
>> in the early days
7:20
from GPU for gaming maybe the early deep learning revolution to we're now going
7:25
to start thinking of it as an AI factory.
7:27
What does Nvidia do is produces AI.
7:30
Let's build a factory that makes AI >> I could I you could I could
7:32
reason through it just systematically.
7:35
Um we started out as as an accelerator
7:38
company but the problem with accelerators
7:40
is that the application domain is too narrow.
7:43
It has the benefit
7:44
of being incredibly optimized for the job.
7:47
You know, any specialist has that benefit.
7:49
The problem with intense
7:51
specialization is that of course your market reach is
7:56
but that's that's even fine.
7:58
The problem is the market size
8:01
also dictates your R&D capacity.
8:06
And your R&D capacity
8:08
ultimately dictates the influence and impact that you can possibly have in computing.
8:14
And so when we first started out in acceler
8:16
as an accelerator, very specific accelerator,
8:19
we always we always knew that that had that was going to be our first step.
8:23
We had to find a way to become accelerated computing.
8:26
But the problem is when you become a computing company,
8:29
it's too general purpose and it takes away from your specialization.
8:33
It turn I connected
8:34
two that are actually have fundamental tension.
8:39
The better computing company we become,
8:41
the worse we become as a specialist.
8:43
The more of a specialist,
8:45
the less capacity we have to do overall computing.
8:48
And so the that and I connected those two words together on purpose
8:53
that the company has to find
8:55
that really narrow path
8:58
step by step by step
9:00
to expand our aperture
9:02
of computing but not give up on the most important specialization that we had. Okay.
9:06
So the first step that we took
9:08
beyond acceleration was we invented the programmable pixel shader.
9:13
So that was the first step towards programmability.
9:16
our you know that was our first journey towards
9:19
moving into the world of computing.
9:20
The second thing that we did
9:22
was we we uh uh created
9:24
uh we put FP32 into our shaders.
9:27
That FP32 step IE
9:30
compatible FP32 was a huge step in the direction of computing.
9:36
It was the reason why
9:38
um all of the people who were working on
9:40
on um stream processors
9:42
and you know other types of data flow processors
9:45
discovered us and they say hey all of a sudden you know we might
9:48
be able to use this GPUs that's incredibly
9:50
computationally intensive and it's now
9:53
you know compliant with it e I can take my software that I was
9:57
writing you know previously on CPUs
9:59
and I could you know see about
10:01
you know using the GPU for that
10:04
and which led us to create put C
10:07
on top of FP32
10:09
was called we call CG
10:10
that CG path took us to eventually
10:13
CUDA CUDA step by step by step
10:17
um uh we well
10:19
putting CUDA on GeForce
10:21
that that was a strategic
10:22
decision that was very very hard to do
10:25
because it cost the company
10:27
enormous amounts of our profits and we couldn't afford it at the time
10:30
but we did it anyways because we wanted to be a computing
10:33
company a computing company
10:36
has a computing architecture.
10:37
A computing architecture has to be compatible
10:40
across all of the chips that we build.
10:42
>> Can you can you take me through that decision?
10:43
So, putting CUDA on GeForce
10:45
could not afford to do.
10:46
Can you explain that decision?
10:48
Why >> why boldly choose to do that anyway?
10:52
>> Can you explain that decision? >> Excellent.
10:53
That was that was the first
10:55
I would I would say that that was
10:58
the first um the first strategic
11:02
decision that that is as close to an existential
11:06
threat for people who don't know it turned out to be
11:09
spoiler alert one of the most
11:12
incredibly brilliant decisions ever made by a company.
11:15
So CUDA turned out to be
11:18
an incredible foundation for computation
11:20
uh in this AI infrastructure world.
11:22
So, so you're just setting the context.
11:25
It turned out to be a good decision.
11:27
>> Yeah, it turned out to have been a good decision.
11:28
I think the So, so here here's the way it went.
11:31
So, we invented this thing called CUDA
11:33
and um uh it expanded the the aperture
11:37
of applications that that we can accelerate with our accelerator.
11:42
The question is how do we
11:44
how do we attract developers to CUDA?
11:48
Because a computing platform is all about developers.
11:51
And developers don't come to a computing platform
11:56
just because you know it could perform something interesting.
12:00
They come to a computing platform because the install base is large.
12:04
Because a developer like anybody else wants to develop software
12:07
that reaches a lot of people.
12:08
So the install base
12:10
is in fact the single most important part of an architecture.
12:14
The architecture could attract enormous amounts of criticism.
12:18
For example, no architecture
12:21
has ever attracted more criticism than the x86.
12:25
You know, as as a less than
12:27
less than elegant architecture,
12:29
but yet it is the defining architecture of today.
12:32
It it gives you an example
12:34
that in fact so many
12:36
risk architectures which were
12:39
beautifully architected incredibly well-designed
12:44
by some of the brightest
12:45
computer scientists in the world
12:46
largely failed and so I've given you two examples where
12:51
one is you know one is elegant the other one's barely aesthetic
12:54
and so yet x86
12:57
survived >> install base is everything >> install base defines
13:00
an architecture not everything else is secondary. Okay.
13:04
And so there were other architectures at the time.
13:07
CUDA came out, Open CL was here.
13:09
There were you know there's several other competing architectures
13:12
but the the thing that the decision that we made that was good was
13:15
we said hey look
13:16
ultimately it's about um installed base and what is the best way we could
13:22
get a new computing architecture into the
13:26
By that time frame GeForce had become successful.
13:29
We were already selling
13:31
millions and millions of GeForce GPUs a year.
13:33
And we said, you know, we we ought to put CUDA
13:36
on GeForce and put it into
13:39
every single PC whether customers use it or not
13:43
and use it as a starting point of
13:46
cultivating our installed base.
13:48
Meanwhile, we'll go and
13:50
attract developers and we went to universities
13:54
and wrote books and taught classes and put CUDA everywhere.
13:58
And eventually people discover and at the time the PC was the primary computing vehicle.
14:03
There was no cloud and
14:05
we could put a supercomputer
14:06
in the hands of every researcher
14:08
in school, every scientist,
14:09
you know, every engineering school, every or every student in school and eventually
14:14
something amazing will happen.
14:15
Well, the problem was
14:17
CUDA increased our cost
14:19
of that GPU, which is a consumer product,
14:22
so tremendously it it
14:24
completely consumed all of the company's gross profit dollars.
14:29
And so, at the time, the company was probably,
14:31
you know, worth, I don't know, at the time, eight,
14:35
was it like $8 billion
14:37
or something like$67 billion
14:39
or something like that.
14:40
After we launched CUDA,
14:42
I recognized that it was going to
14:45
add so much cost, but it was something we believed in.
14:50
You know, our market cap went down to like $1.5 billion.
14:53
And so, we were down we were down there for a while
14:56
and and uh we clawed our way
14:59
way back slowly, but we carried CUDA on GeForce.
15:03
I always say that Nvidia is the house that GeForce
15:06
built because it was GeForce
15:08
that took CUDA out to everybody.
15:10
Researchers, scientists, um they discovered
15:14
CUDA on GeForce because they were all, you know, many of them were gamers.
15:19
Um many of them built their own PCs anyways
15:22
in a university lab.
15:24
many of them built clusters themselves
15:26
you know using using PC components and
15:29
and so that you know that's kind of how we got
15:31
>> and then that became the platform the foundation for the deep learning
15:35
>> that was also another great great observation
15:37
yeah >> that existential moment do you remember
15:40
like what were those meetings like
15:42
what were those discussions
15:44
like deciding as a company
15:46
risking everything >> well um I had I had to make it clear to the
15:51
board what we were trying to do
15:54
and and um uh the management team knew our gross margins were going to get crushed.
16:00
So you could imagine
16:02
a world where GeForce
16:04
would carry the burden
16:05
of CUDA and none of the gamers would
16:08
appreciate it and none of the gamers would pay for it.
16:11
You know, they only pay certain price and it doesn't matter what your cost is.
16:15
And so that you know, we we increased our cost by 50%
16:18
and that con consumed
16:20
and we were a 35% gross margin company.
16:23
And so it it was a it was quite a difficult
16:26
decision to make, but you could imagine that someday
16:29
this could go into workstations
16:31
and it would go into supercomputers
16:32
and and in those segments maybe we can capture more margin.
16:36
Um so you you could you could reason your way into being able to afford this.
16:42
Uh but it still took it took a decade.
16:45
>> But that but that's more like conversation with the board convincing them.
16:48
But you psychologically >> because Nvidia has continued to make
16:53
bold bets that predict the future
16:57
and in part especially now define the future.
17:01
So I'm almost looking for
17:04
wisdom about how you were able to make those decisions
17:07
to make leaps like that as a company.
17:14
Well, f first of all,
17:16
um I'm informed by
17:18
by by a lot of curiosity.
17:21
Uh at some point
17:22
there's a reasoning system
17:25
that that convinces me
17:28
uh so clearly this outcome will happen
17:32
that this will happen.
17:34
And so I believe I believe it in my mind.
17:36
And when I believe it in my mind,
17:38
you know, you know how it is.
17:39
You manifest a future.
17:42
And that future is
17:43
so convincing, there's no way it won't happen.
17:48
There's a lot of suffering in in between,
17:51
but you've got to believe what you believe.
17:52
>> So you you you envision the future.
17:56
>> And you essentially from a sort of engineering perspective manifest it. >> Yeah.
18:00
And and you you reason about how to get there.
18:02
You reason about why it it must exist.
18:05
Um and and um and you know, I reason
18:09
we all reason here.
18:10
the management team will reason about it.
18:12
All the people that I we spend a lot of time reasoning about it.
18:15
The thing the thing that
18:17
the next part of it is probably a skill thing which is
18:20
you know oftentimes in leadership
18:23
uh the leadership stays quiet or they learn about something and then they do
18:26
some manifesto and it's a brand new year and somehow at the end of
18:31
the year next year we're going to have a brand new plan,
18:34
big huge layoff this way, big huge organization
18:37
change this way, new mission statement,
18:40
brand new logos, um you know that kind of stuff.
18:43
Um, we've just never
18:45
I never do things that way.
18:47
When I learn about something
18:48
and it's starting to influence how I think, I'll make it very clear to
18:52
everybody near me that, you know, this this is interesting.
18:57
Um, this is going to make a difference.
18:59
Uh, this is going to impact that.
19:01
And I reason about things step by step by step.
19:04
often times I've already made up my mind
19:06
but I'll take every possible opportunity
19:09
external information new insights
19:12
new discoveries uh new engineering
19:14
you know revelations uh new milestones
19:17
developed I'll take those opportunities
19:20
and I'll use it
19:21
to shape everybody else's
19:24
belief system and I'm doing that literally
19:27
every single day I'm doing that with my board
19:30
I'm doing that with my management team I'm doing that with my employees
19:33
I'm trying to shape
19:35
their belief system such that when I come the day I say,
19:40
"Hey, let's buy Melanox."
19:43
It's completely obvious to everybody
19:45
that we absolutely should.
19:48
On the day that on the day that I that I said, "Hey guys,
19:51
let's go all in on deep learning."
19:54
And let me tell you why.
19:55
I've already been laying down the bricks
19:58
to different organizations inside the company.
20:01
every organization and every everybody
20:05
many of the people might have heard everything
20:07
most of the company heard hears of course pieces of it
20:11
and on the day that I announce it
20:14
um everybody's kind of bought into many pieces of it
20:19
and in a lot of ways I like to announce these things
20:23
and I imagine um that that
20:26
the employees are kind of saying you know Jensen what took you so long
20:30
and and in fact I've been shaping their belief system for some time and
20:34
therefore leadership sometimes it looks like you're leading from behind
20:39
>> but you've been shaping their you know to the point where on the day
20:42
that I declared it
20:43
100% buy in but that's what you want you want to bring everybody along
20:48
you know otherwise we announce something about deep learning and everybody goes what are
20:51
you talking about you know you announce
20:53
something about let's go allin on this thing
20:56
and and your your management team your board your employees your customers,
21:01
they're kind of like, where's this coming from?
21:02
You know, this is insane.
21:04
And so, so, uh,
21:06
GTC, in fact, if you go back in time, you look at look at
21:09
the keynotes, I'm also shaping
21:13
the belief system of my partners and the industry and and I'm using that
21:17
to shape, you know, the belief system of my own employees
21:20
and and and so by the time that I announce something,
21:24
like, for example, we just now we just announced Grock, we've been late.
21:29
I've been talking about the
21:30
stepping stones for two and a half years.
21:33
You guys just go back and
21:34
oh my gosh, they've been talking about it for two and a half years.
21:38
And so I've been laying the foundation step by step by step.
21:41
So when the time comes you announce it, everybody's,
21:43
you know, what took you so long?
21:44
>> But it's not just inside the company.
21:45
You're shaping the landscape,
21:46
the broader global landscape of innovation.
21:49
Like putting those ideas out there, you really are manifesting reality.
21:53
>> We don't build computers.
21:54
We actually don't build clouds.
21:56
We don't, as it turns out, we're a computing platform company
21:59
and so nobody can buy anything from us.
22:01
That's the weird thing.
22:03
You know, we ver we vertically
22:06
design vertically integrate to design and optimize,
22:10
but then we open up the entire platform
22:13
at every single layer
22:14
to be integrated into
22:16
other companies products and services and clouds and
22:19
supercomputers and OEM computers and
22:22
and so the amazing thing is
22:24
I can't do what I do
22:26
without having convinced them first.
22:28
And so most of GTC
22:30
is about manifesting a future
22:32
that by the time that we
22:34
my product is ready,
22:36
they're going what took you so long? Yeah.
22:40
Uh so one of the things you've been a believer
22:42
for a long time
22:44
is uh scaling laws broadly defined.
22:46
So are you still a believer in the in the scaling
22:49
>> Yeah, we have more scaling laws now.
22:51
>> So I think uh you've outlined
22:53
four of them with pre-training,
22:54
post- training, test time, and agentic scaling.
22:58
What do you think
22:59
when you think about the future,
23:01
deep future and the near-term
23:03
future, what are the blockers
23:06
that you're most concerned about that keep you up at night that you have
23:09
to overcome in order to keep scaling?
23:12
>> Well, we can go back and reflect on what people thought were blockers. >> Mhm.
23:16
So in the beginning we were the first the pre
23:19
pre-training scaling law you know people thought
23:23
uh well rightfully so that the amount of data that we have
23:26
high quality data that we have
23:28
um will limit the intelligence that we achieve and that scaling law was an
23:32
important very important scale law the larger the model
23:35
the correspondently more data
23:37
uh results in a better with a results in a smarter AI
23:41
and so that was pre-training
23:43
and Ilas Susker Ilas
23:45
we're out of data or something like that.
23:47
Pre-training is over or something like that.
23:49
The the industry panicked,
23:51
you know, that this is the end of AI.
23:54
And of course, of course, that's that's obviously not true.
23:57
Um, we're going to keep on scaling the amount of data that we h
24:00
have to to train with.
24:01
A lot of that data is probably going to be synthetic.
24:04
And that also confused people, you know, and and what people don't realize is
24:09
they've kind of forgotten
24:10
that most of the data that that we are training
24:14
uh that we teach each other with, inform each other with this is synthetic.
24:18
You know, I it's synthetic
24:20
because it didn't come out of nature. You created it. I'm consuming it.
24:26
I modify it, augment it,
24:29
I regenerate it, somebody else consumes it.
24:32
And so so we've now reached a level
24:35
where AI is able to
24:39
take ground truth, augment it,
24:43
enhance it, synthetically generate an enormous amount of data
24:47
and that part of post training
24:50
um continues to scale.
24:51
And so the amount of data that we could use
24:53
that is human generated
24:55
will be smaller and smaller and smaller.
24:57
the amount of data that we use to
25:00
uh train model uh
25:02
uh is going to continue to scale
25:04
to the point where
25:05
we're no longer limited
25:06
training is no longer limited by data is now limited by compute
25:10
and the reason for that is most of the data is synthetic
25:13
then the next phase
25:15
is uh test time
25:17
and um I I still remember people people telling me that inference
25:22
oh yeah that's easy
25:23
pre pre-training that's hard these are giant systems that people are talking about
25:27
inference must be easy
25:29
and so inference chips are going to be little tiny chips and
25:32
you know they're not they're not like Nvidia's
25:34
chips oh those are going to be
25:35
complicated and expensive and you know we could make and this is and in
25:39
the future inference is going to be the biggest market and it's going to
25:42
be easy and we're going to commoditize
25:44
and you know everybody can build their own chips and
25:47
and and that was always
25:49
illogical to me because
25:51
inference is thinking and I think thinking is hard
25:55
thinking is way harder than reading.
25:59
>> You know, pre-training is just
26:01
memorization and generalization, you know, and looking for patterns and relationships.
26:06
You're reading and reading
26:07
versus thinking, reasoning, solving problems,
26:11
taking un unexplored experiences,
26:17
new experiences, and breaking it down into
26:20
de decomposing it into,
26:22
you know, solvable pieces
26:24
that we then go off either through first principal reasoning or,
26:28
you know, through through uh previous examples,
26:30
prior experiences, you know, or or or
26:33
just uh uh exploration.
26:35
and and search and
26:37
you know trying different things and
26:39
that whole process of
26:41
post of of test time scaling.
26:43
Uh inference is really about thinking
26:46
and and it's about reasoning. It's about planning. It's about search.
26:50
It's about and so how could that possibly be computed?
26:54
And we were absolutely right about that you know so so test time scaling
26:58
is intensely comput intensive.
27:01
Then the question is okay now we're at inference and we're at test time scaling. What's beyond that?
27:06
Well, uh we have now created
27:09
you know one agentic
27:11
person and that one agentic
27:14
person has a large language model that we've now we've now you know developed.
27:18
But during test time, that agentic
27:20
system goes off and does research
27:23
and bangs on databases
27:25
and it goes on and you know uses tools and one of the most
27:28
important things it does is spins off and spawns off a whole bunch of
27:32
sub aents which means we're now creating large teams.
27:36
It's so much easier
27:38
to scale Nvidia by hiring more employees
27:42
than it is to scale myself.
27:44
>> And so the next scaling law is the agentic scaling law.
27:47
It's kind of like multip multiplying AI.
27:51
Multiplying AI, we could spin off agents as fast as you want to spin off agents.
27:55
And so, you know, I you have four scaling laws.
27:59
And and as we use the a agentic
28:02
systems, they're going to create a lot more data.
28:04
They're going to create a lot of experiences.
28:06
Some of it we're going to say, "Wow, this is really good.
28:09
We ought to memorize this."
28:12
>> That data set then comes all the way back to pre-training.
28:15
We memorize and generalize it.
28:17
We then refine it and fine-tune it
28:20
back into post training.
28:22
Then we enhance it even more with test time, you know, in the agent
28:26
agents agentic systems, you know, put it onto the indust industry.
28:30
And so this loop,
28:31
the cycle is going to go on and on and on.
28:34
It kind of comes down to basically
28:37
intelligence is going to scale
28:39
by one thing and it's compute.
28:41
But there's a tricky thing there that you have to anticipate and predict
28:45
which is some of these components.
28:48
It requires different kind of hardware
28:51
to really do it optimally.
28:53
So you have to anticipate
28:55
where the AI innovation is going to lead.
28:57
For example, mixture of experts with sparity.
29:00
>> With hardware, you can't just pivot on a week's notice.
29:04
You have to anticipate what that's going to look like.
29:06
That's >> that's so scary and difficult to do, right?
29:09
For example, uh these AI model architectures
29:12
are being invented about once every six months. >> Yeah. Right.
29:18
And uh system architectures
29:20
and hardware architectures kind of every 3 years.
29:26
And so you need to anticipate
29:28
what likely is going to happen,
29:30
you know, 2 3 years from now.
29:33
And there's a couple ways that you could do that.
29:34
First of all, we could do research internally ourselves.
29:36
And that's one of the reasons why we have basic research.
29:38
We have applied research.
29:40
We create our own models.
29:41
And so we have we have hands-on
29:43
life experience right here.
29:45
This is part of the code design that I'm talking about.
29:48
>> We're also the only AI company in the world that works with literally every
29:50
AI company in the world.
29:52
And to the extent that we can
29:54
um uh we try to get a sense of of what are the challenges
29:57
that people are experiencing.
29:58
>> So you're listening to the whispers
30:00
across the industry, the adabs. >> That's right.
30:03
You got to listen and and learn from everybody and have a have a
30:06
and then the the last part is to have an architecture
30:09
that's that's flexible that can adapt
30:12
and move with the wind and one of the benefits of of CUDA is
30:15
that it's you know on the one hand
30:18
an incredible accelerator on the other hand
30:21
it's really flexible and so that balance
30:24
incredible balance between otherwise we can't accelerate the the CPU
30:31
versus generalization so that we can adapt with changing algorithms.
30:35
That's really really important.
30:36
That's the reason why
30:37
why um CUDA has been so resilient
30:41
um on the one hand
30:42
and yet we continue to enhance it.
30:44
We're at CUDA 13.2
30:46
and so we're invol evolving
30:47
the architecture so fast
30:49
that we can stay with
30:51
you know with with
30:53
the modern al algorithms.
30:55
Um for example uh when mixture of experts came out
30:59
uh that's the reason why we had MVLink
31:01
72 instead of MVLink 8.
31:04
We could now take an entire
31:05
4 trillion 10 trillion parameter model and put it in one computing domain
31:10
as if it's running on one GPU.
31:13
Um I people probably
31:17
didn't notice I said it
31:19
but if you look at the architecture
31:21
of the Grace Blackwell
31:23
racks it was completely focused on doing one thing processing the LLM.
31:30
All of a sudden one year later
31:32
you're looking at a Vera Rubin rack.
31:34
It has storage accelerators.
31:38
It has this incredible new CPU called Vera.
31:41
It has Vera Rubin
31:42
and MVLink72 to run the LLMs.
31:46
It also has this new additional rack called Gro.
31:49
And so this entire rack system
31:52
is completely different than the previous one
31:56
and it's got all these new components in it.
31:58
And the reason for that is because the last one was designed to run
32:02
large language models inference
32:05
and this one is to run agents
32:07
and agents bang on tools
32:10
and Obviously the design of the
32:13
had to have been done
32:15
before claude code, codeex, open claw.
32:19
So you were anticipating
32:20
the future essentially and that that comes from what?
32:23
From the whispers, from the understanding what all the state of the artist is.
32:26
>> No, it's it's easier than that.
32:28
Uh you you just reason about it.
32:31
Uh first of all
32:32
just reason no matter
32:35
no matter what happens at some point
32:38
in order for that large language model to be a digital worker.
32:42
Let's just let's just use that metaphor.
32:45
Let's say that we want the LM to be a digital worker.
32:47
What does it have to do?
32:49
It has to access ground truth.
32:51
That's our file system.
32:52
It has to be able to do research.
32:54
It doesn't know everything.
32:55
We don't have and I don't want to wait until this AI
32:58
becomes, you know, universally
33:01
smart about everything past,
33:03
present, and future before I make it useful.
33:06
And so therefore, I might as well let it go do research.
33:09
It's obviously if it wants to help me, it's got to use my tools.
33:13
You know, a lot of people would say,
33:14
you know, um AI is going to completely destroy software.
33:18
We don't need software anymore.
33:19
We don't even need tools anymore. That's ridiculous.
33:21
Let's let's use the
33:23
let's use a thought experiment.
33:25
Uh, and you could just sit there, enjoy a glass of whiskey
33:28
and and think about all these things and it would become completely obvious
33:32
like if I were to
33:34
create the most amazing
33:36
ro the most amazing
33:38
agent that we can imagine in the next 10 years, let's say be a humanoid robot.
33:43
If that human or robot were to be created,
33:46
is it more likely that the human or robot comes into my house
33:50
and uses the tools that I have
33:52
to do the work that it needs to do?
33:54
Or does his hand turns into a
33:57
10- pound hammer in one instance,
33:59
turns into a scalpel
34:01
in another instance, and in order to boil water,
34:04
it beams, you know, microwaves
34:06
out of its fingers,
34:08
you know, or is it more likely just to use the microwave,
34:10
you know, and the first time it goes up to the microwave.
34:13
It probably doesn't know how to use it. But that's okay.
34:16
It's connected to the internet.
34:18
It reads the manual
34:20
of this microwave, reads it
34:23
instantly, becomes an expert, and so uses it.
34:26
>> And so I I think the
34:27
I just described in fact
34:29
almost all of the
34:32
properties of Open Claw.
34:35
>> You know, that it's going to use tools, that it's going to access files,
34:38
it's going to be able to do research,
34:40
it has IO subsystem.
34:42
And when you're done reasoning through it, reasoning about it through through it in
34:45
that way, um then you say, "Oh my gosh,
34:49
the impact to the future computing is deeply profound."
34:53
And the reason for that is I think we've just reinvented the computer.
34:57
And then now you say, "Okay,
34:59
when did we reason about that?
35:01
When did we reason about Open Claw?"
35:03
If you take the Open Claw
35:05
schematic that I used at GTC,
35:08
you will find it two years ago.
35:11
Literally two years ago at GTC,
35:14
I was talking about
35:15
Asgentic systems that exactly
35:19
reflect open claw today
35:21
and and of course the confluence
35:24
of of many things had to happen.
35:26
First of all, we needed
35:28
claude and and GPT
35:30
and you know all of these models
35:32
to reach a level of capability.
35:33
So so their innovation and their breakthroughs and their continual advances was really important.
35:38
And then of course somebody had to create a an
35:41
open- source you know
35:43
um project that that
35:45
uh was sufficiently robust
35:48
you know and sufficiently
35:49
complete and that we can all we can all put to put to work
35:53
and and I think openclaw
35:55
did for did for agentic
35:57
systems what chat GPT did for generative systems and and I just think it's
36:01
a very big deal.
36:02
>> Yeah, it's a really special moment.
36:03
I'm not exactly sure why it captured
36:07
so much of the world's attention, but it did more than cloud code and
36:10
codeex and so on
36:12
because consumers could reach it. >> Sure. Yeah.
36:14
But there there's also
36:16
so much of this is vibes and
36:18
and Peter uh I had a podcast with him.
36:20
He's a wonderful human being.
36:22
So part of it is also the humans that represent the thing.
36:25
Part of it is memes and the
36:27
>> cuz we're all trying to figure it out.
36:28
There's really serious and complicated security concerns about
36:32
when you have such powerful technology, how do you hand over your data so
36:36
they can do useful stuff, but then there's scary things associated with that.
36:39
And we as a civilization,
36:40
as individual people and as a civilization
36:42
figuring out how to find that right balance.
36:44
>> Yeah, we we uh we jumped on it right away and we sent a
36:47
bunch of security experts this way
36:49
>> and we did this thing called Open Shell.
36:51
It's it's already been
36:53
integrated into into open claw
36:55
>> and Nvidia put forward Nemo claw. >> Yep. Exactly.
36:59
>> The install is super easy.
37:01
It makes sure that uh it's secure.
37:03
>> We give you two out of three rights.
37:05
Agentic systems can can access sensitive information.
37:08
It can execute code and it can communicate externally.
37:14
>> We could keep things safe if we gave you two out of those three
37:17
capabilities at any time, but not all three.
37:21
And out of those two out of three capabilities,
37:22
we also give you access control based on based on um whatever rights that
37:27
you're given by enterprise.
37:28
And then we connected to a policy engine
37:31
that all these enterprises already have.
37:33
And so um we're going to try to do our best to to
37:37
uh help Open Claw become a a better claw.
37:40
So you eloquently explained
37:42
how we have a long history of blockers that we thought were going to be
37:45
blockers and we overcame them.
37:47
But now looking into the future, what do you think might be the blockers
37:49
now that it's clear that agents will be everywhere?
37:53
So it's obviously we're going to need compute.
37:55
So what is going to be the blocker for that scaling?
37:59
Power is a concern, but it's not the only concern.
38:02
But that's the reason why we're pushing so hard on extreme code design
38:07
so that we can
38:09
improve the tokens per second
38:12
per watt orders of magnitude every single year.
38:17
And so in the last 10 years,
38:19
Moors law would have
38:20
progressed computing about a 100 times in the last 10 years.
38:24
We progressed and scaled up computing by a million times in the last 10 years.
38:29
And so we're going to keep on we're going to keep on doing that
38:31
through extreme code design.
38:33
Um so energy efficiency
38:34
per per watt completely
38:37
affects the revenues of a company.
38:39
It affects the revenues of a factory
38:42
and we're just we're just going to push that to the limit so that
38:45
we can keep on driving token cost down
38:49
as fast as we can.
38:50
you know, the our computer
38:52
price is going up,
38:54
but our token generation
38:56
effectiveness is going up so much faster
38:58
that token cost is coming down.
39:00
It's just it it's coming down an order of magnitude every year.
39:04
>> So power that's an interesting one.
39:06
So the the way to try to
39:08
get around the power blocker is to try to with the tokens per second
39:12
per watt try to make it more and more efficient.
39:14
Of course, there's the question, how do we get more
39:16
>> We should also get more power.
39:17
>> That's a really complicated one.
39:18
And you've talked about small module nuclear power plants.
39:21
There's all kinds of ideas for energy.
39:23
Uh how much does it keep you up at night?
39:26
Uh the the bottlenecks
39:27
in the supply chain of AI
39:29
like ASML with EUV lithography
39:31
machines, TSMC with advanced packaging
39:34
like cos and uh SK HX with
39:37
high bandwidth memory all all the time and we're working on all the time.
39:41
No company in history
39:44
has ever grown at a scale that we're growing
39:47
while accelerating that growth.
39:49
It's >> And it's hard for people to even understand this
39:53
in the overall world of AI computing. We're increasing share.
39:58
And so supply chain upstream
40:00
and downstream are really important to us.
40:03
I spent a lot of time
40:05
um informing all the CEOs that I work with
40:09
what are the dynamics
40:10
that's going to cause
40:12
uh the growth to continue or even accelerate.
40:15
It's part of the reasons why
40:17
to the entire right hand side of me
40:20
were CEOs of practically the entire IT industry
40:24
upstream and practically the entire infrastructure industry downstream. Mhm.
40:32
And they were all
40:33
there were several hundred CEOs
40:35
and I don't think there's ever been keynotes where several hundred CEOs show up.
40:40
And and part of it is I'm telling them about our business condition now.
40:46
I'm telling them about
40:47
the growth drivers in the very near future and what's happening.
40:50
And I'm also describing
40:52
where are we going to go next
40:53
so that they could use all of this information
40:56
and all of the dynamics that are here
40:58
to inform how they want to
41:01
And so so I
41:02
I inform them that way like I inform my own employees.
41:06
And then of course then I make trips out to them
41:09
and make sure that hey listen I want you to know
41:12
this quarter, this coming year, this next year
41:15
these things are going to happen
41:17
and and if you look at the CEOs of the DRAM industry
41:21
um the number one DRAM
41:23
in the in the world was
41:25
DDR memory for CPUs in data centers.
41:29
About three years ago,
41:32
I was able to convince several of the CEOs
41:34
that even though at the time HBM memory was used quite scarcely,
41:39
you know, and and barely by
41:42
um that this was going to be a mainstream
41:45
memory for data centers in the future.
41:47
And at first it sounded ridiculous,
41:49
but several of the CEOs believed me and decided to invest
41:52
in building HBM memories.
41:55
Another memory was rather odd to put into a data center
41:59
is the low power memories that we use for cell phones.
42:03
And we wanted them to adapt them
42:05
for supercomputers in the data center.
42:07
And they go, cell phone memory for supercomputers.
42:11
And I explained to them why.
42:13
Well, look at these two memories, LPDDR5,
42:17
The volumes are so incredible.
42:20
All three of them had record years in history.
42:22
And these are these are 45 year old companies.
42:25
And so, you know, I that's part of my job is to
42:30
inform and shape, you know.
42:36
So, you're not just manifesting
42:37
the the future and maybe inspiring
42:40
Nvidia, the the the different engineers of the company.
42:43
You're you're manifesting the supply chain of the future.
42:46
So you're having conversations with TSMC,
42:49
with ASML, >> upstream, downstream, >> upstream, downstream.
42:52
So that's the >> GEV, Caterpillar.
42:56
>> Yeah, that's downstream from us. Yeah. Yeah. There you go. >> Yeah. The whole thing.
43:00
I mean, but that's so
43:02
>> there's so much incredibly
43:04
difficult engineering that happens
43:06
in the the entire semiconductor industry.
43:08
And it's just feels
43:11
scary how intricate the supply chain is, how many components there are, but it works somehow. Exactly.
43:19
The deep science, the deep engineering,
43:21
the incredible manufacturing, and so much of the manufacturing is already robotics,
43:26
but we have a couple of hundred suppliers
43:28
that contribute the technology that goes into our 1.3 million component rack.
43:36
>> Each rack is 1.3
43:38
one and a half million components.
43:41
There are 200 suppliers
43:43
across the Vera Rubin rack.
43:45
>> So, it's interesting that you don't list that as the thing that keeps you
43:47
up at night in the list of blockers.
43:49
>> But I'm doing I'm doing all the things necessary to
43:53
>> See, I can go to sleep because I checked it off.
43:55
I said, "Okay, you know, I I go I I can go to sleep
43:58
and I go, well, let's see what
44:01
um re let's reason about this.
44:02
What's important for us?"
44:03
Um because okay let's reason about this
44:06
uh because we changed the system architecture
44:09
from the original DGX1
44:11
that you remembered to uh MVLink
44:14
72 rack scale computing.
44:16
>> What's going to what does that what does that mean?
44:19
What does that mean to uh software?
44:21
What does that mean to engineering?
44:22
What does that mean
44:24
uh to how we design and test and what does that mean to the supply chain?
44:27
Well, one of the things that it meant
44:30
was we moved um supercomput
44:33
superco computer integration at the data center
44:37
into supercomputer manufacturing in the supply chain.
44:42
If you're doing that,
44:44
you also have to recognize you're going to move one
44:46
and and if if if
44:48
you're if you're, you know, total
44:50
footprint of whatever data center you're going to build, let's say you would like
44:55
to have, you know,
44:58
50 gawatts of supercomputers
45:00
that are running and it takes one week to manufacture that 50 gawatts of supercomputers.
45:08
Then each week in the supply chain,
45:11
the supercomputers are going to need a gigawatt of power.
45:13
And so so we're going to need the supply chain to increase the amount
45:17
of power it has to
45:18
build test to build and test the supercomputers
45:22
in the supply chain before I ship it.
45:24
>> Well, MVLink72 literally builds supercomputers
45:27
in the supply chain
45:28
and ships them two, three tons at a time per rack.
45:32
It used to be come they used to come in parts and we used
45:35
to assemble them inside the data center.
45:37
But that's impossible now because MVLink
45:39
72 is so dense.
45:41
And so that's an example.
45:42
And I would have to go
45:44
into, you know, I fly into the supply chain, go meet my partners, and
45:47
hey, I said, guess what?
45:49
So here's what we're going to do with
45:51
this is the way we used to build our DGXs.
45:54
We're going to build them this way.
45:55
This is going to be so much better because we're going to need them for inference.
45:59
The market for inference is, you know, coming.
46:02
The inflection point for inference is coming.
46:04
It's going to be a big market.
46:05
And so I first explain to them what's going on, why it's going to
46:08
happen, and then I then I
46:10
ask them to make several
46:13
billion dollars of capital investments
46:15
each and because they,
46:19
you know, they trust me and and I I I'm very respectful of them
46:22
and I I give them every opportunity to question me and I spend time
46:26
to explain things to people and I reason about it.
46:28
I draw them pictures and I reason about it in first principles
46:32
and by by the time I'm done with them there's no what to do.
46:35
>> So it's a lot of is about relationships
46:37
and building a shared
46:38
view of the >> Uh but do you worry about certain bottlenecks?
46:44
I mean what are the biggest bottlenecks in the supply chain?
46:47
Are are you worried about it ASML V tooling?
46:49
Are you are you worried about
46:51
the the packaging co-as packaging of TSMC
46:54
about how fast it could scale?
46:56
like you said, you're
46:57
not only growing incredibly fast, you're accelerating a growth.
47:00
So it it it feels like
47:02
every everybody in the supply chain and those are certainly bottlenecks
47:06
would have to scale up.
47:07
>> Are you having conversations
47:08
with them like how can you scale up faster?
47:12
>> Do you worry about it?
47:14
>> Because because I told them what I needed,
47:17
they understood what I need.
47:18
They told me what they're going to go do and I believe in what
47:21
they're going to >> Interesting.
47:22
That's great to hear.
47:24
So maybe if we can just linger on the power for a little bit.
47:27
Uh what are your hopes for
47:29
how to solve the energy problem?
47:30
One of the areas
47:32
le that I'm um
47:33
that I would love I would love
47:35
love us to talk about and just get the message out.
47:38
You know um our
47:41
our our power grid
47:43
is designed for the worst case condition
47:46
with some Well, 99%
47:50
of the time we're nowhere near the worst case condition because the worst case
47:53
condition is a few days in the winter, a few days in the summer and extreme weather.
47:59
Most of the time
48:01
we're nowhere near the worst case condition and we're probably running around call it 60% of peak.
48:08
And so 99% of the time
48:12
our power grid has excess power
48:15
and they're just sitting idle.
48:16
But they have to be there sitting idle because just in case when the
48:20
time comes hospitals have to be powered and you know infrastructure
48:23
has to be powered and airports have to run and so on so forth.
48:26
And so the question that I have is
48:28
whether we could go and
48:31
um help them understand
48:32
and create contractual agreements
48:35
and design computer architecture
48:36
systems, data centers such that
48:39
when they need um the maximum power for
48:45
infrastructure in society that the data centers would get less.
48:49
>> But that's in a very rare instance anyways.
48:51
And during that time, we either have our backup generator for that little part
48:54
of it or we just have our computers
48:56
shift the workload somewhere else or we have the computers just run slower.
49:01
You know, we could degrade our performance,
49:03
reduce our power consumption
49:06
and provide for, you know, slightly longer latency
49:09
response, you know, when somebody asks for, you know, asked for an answer.
49:13
And so I think that that
49:15
that way of using computers
49:17
of building data centers
49:18
instead of expecting 100% uptime
49:22
and these contracts that are really
49:24
really quite rigorous it's putting a lot of pressure on the grid
49:28
to be able to now they're going to have to
49:31
increase from their maximum.
49:33
I just want to use their excess.
49:35
It's just sitting there. Yeah.
49:36
That's not talked about enough.
49:38
So what's what's this what's stopping there? Is it regulation?
49:41
Is it >> I think it's it's a throughway problem.
49:45
Uh it starts with the end customer.
49:47
The end customer puts
49:49
puts requirements on the data centers
49:52
that they can never not be available. Okay.
49:57
So that the end customer expects perfection.
50:00
Now in order to deliver that perfection,
50:02
you need a combination of
50:04
backup generators and your
50:07
grid power supplier to deliver on perfection.
50:10
And so everybody's got to have 69s.
50:13
>> Well, I think first of all,
50:15
right now, we ought to have everybody understand that when the customer asks for
50:19
these things, you got somebody, you have somebody in your data center operations
50:23
team disconnected from the CEO.
50:25
I bet the CEO doesn't know this.
50:26
I'm going to talk to all the CEOs.
50:28
The CEOs are probably
50:30
not paying any attention to the contracts that are being signed.
50:34
And so everybody wants to sign the best contract of course and they go
50:37
down to the cloud service providers and the contract
50:41
the the two contract negotiators
50:44
that are you I could just see them now
50:46
>> you know negotiating these multi-year
50:47
contracts both sides want
50:50
you know the best contract
50:52
as a result the CSPs
50:55
then have to go down to the utilities and they expect the nine the
50:59
69s and so I think I think the first thing is just make sure
51:03
that that all of the customers,
51:05
the CEOs of the customers realize what they're asking for.
51:08
Now, the second thing is we have to build data centers that gracefully degrade.
51:13
And so, if the power, if the utility of the grid tells us,
51:16
listen, we're going to have to back you down to about 80%.
51:19
We're going to say that's no problem at
51:21
>> We're just going to move our workload around.
51:23
We're going to make sure that
51:25
data is never lost,
51:26
but we can reduce the
51:28
computing rate and use less energy.
51:31
the quality of service degrades a little bit
51:33
for the critical workloads
51:35
I shift that somewhere else right away
51:38
so I don't have that problem
51:39
and so you know whoever whichever
51:41
data center still has 100% uptime and so
51:44
how difficult of an engineering problem is that the smart dynamic allocation of power
51:48
in the data >> as soon as you could specify
51:50
you could engineer it
51:52
beautifully put so long as it obeys the laws of physics on first principles
51:57
I think we're good
51:58
>> what was the third thing you were mentioning
52:00
um so the Second thing is the the data centers
52:03
>> and the third thing is we need the
52:06
to also recognize that this is an
52:10
>> and and instead of instead of saying look
52:13
um it's going to take me 5 years to increase
52:16
my grid capability uh if you if you have if you're willing to take
52:20
power of this level of
52:23
guarantee I can make them available for you next month
52:27
and at this price
52:29
and so if utilities He's also offered
52:32
more segments of power delivery promises,
52:36
then I think everybody will figure out what to do with it. Yeah.
52:39
But there's just way too much waste in the in the grid right now.
52:42
We we should go after
52:43
>> Uh you've uh highly lauded Elon
52:46
and uh Xi's accomplishment
52:48
in Memphis in building
52:50
um Colossus Supercomputer probably in record time in just 4 months.
52:55
It's now at 200,000
52:57
GPUs and growing very quickly.
52:59
Is there something that you could speak to the
53:01
understand about his approach
53:03
that's instructive to the broadly to all the data center creators
53:06
that's um that enabled that kind of accomplishment
53:10
his approach to engineering his approach to the whole
53:13
management of construction everything
53:15
first of all Elon is
53:17
deep in so many different topics
53:19
um uh yet he's also
53:22
a really good systems thinker
53:24
>> and so he's able to think through multiple disciplines
53:28
and and um uh he
53:32
uh pushes things questions
53:35
everything whether number one
53:37
is it necessary number two
53:39
does it have to be done this way and number you know does it
53:42
have does it have to take this long
53:45
and and so so he
53:47
he has he has the he has the ability
53:51
uh to question everything
53:53
uh to the point where
53:54
everything is down to its minimal amount that's necess necessary.
53:58
You can't take anything else out
54:00
and and yet yet the the
54:02
uh the the the the
54:04
necessary um capabilities of the product retains,
54:08
you know, and so he's he is as minimalist
54:10
as you could possibly imagine
54:12
and he does it at a system system scale.
54:14
Um I I also love the fact that he he is um
54:18
he is represented he he is he is present
54:23
at the point of action. >> Mhm.
54:25
you know, he'll just go there
54:27
and if there's a problem, he'll just go there
54:29
and show me the problem.
54:31
You know, when you do all of this in combination,
54:34
you overcome a lot of previous
54:36
this is just the way we do it.
54:38
>> Um, you know, I'm I'm waiting for them.
54:42
I, you know, I mean, just everybody has a lot of excuses.
54:46
And and so and then and then the last thing is
54:48
when when you act personally with so much urgency,
54:52
uh it causes everybody else to act with urgency,
54:54
you know, and and every supplier has a lot of customers going on.
54:58
Every supplier has a lot of projects going on.
55:00
And he he make it he made it he makes it his business
55:04
that he's the top priority of everybody else's, you know, projects.
55:07
And so he does that by demonstrating it. >> Yeah.
55:09
I've been in a bunch of those meetings.
55:11
is it's fun to watch cuz really
55:13
not enough people ask the question like
55:15
okay so uh can this be done a lot faster and how
55:20
why does it have to take this long yeah >> and then that becomes an
55:23
engineering question often and yes I think when you get the ground truth of
55:28
actually I remember um
55:30
one of the times I was hanging out with him he literally is going
55:33
through the entire process how to plug in cables into a rack
55:36
and he's was working with engineer
55:39
on the ground that's doing that task and he's just trying to understand what
55:42
does that process look like so it can be less
55:46
and just building up that intuition from every single task
55:49
involved in uh putting together the data center.
55:52
You start to immediately
55:53
get a sense at the
55:56
detailed scale and at the broad system scale
55:59
of where the inefficiencies
56:01
are and so you can make it more and more and more efficient.
56:04
Plus, you have the big hammer of being able to say, "Let's do it totally different."
56:08
>> And remove all possible blockers. >> That's right.
56:11
>> Is there parallels in the Nvidia extreme systems code design approach that you see
56:15
in the way Elon approaches systems
56:18
>> Well, first of all, the code design is a ultimate systems engineering problem.
56:22
And so, we approach we approach the work that we do from that first from that principle.
56:27
Um the other thing that we do
56:29
uh and this is this is a a philosophy
56:32
that a thought a a state of mind I guess
56:37
a method that I started
56:41
uh 30 years ago
56:42
and it's called the speed of light.
56:44
The speed of light is not just about the speed.
56:46
Speed of light is my my
56:47
shorthand for u what's
56:50
what's the limit of what physics can do.
56:53
And so every single everything everything that we do is compared against the speed of light.
56:57
Um memory speed uh math speed
57:00
uh power cost time
57:04
effort number of people manufacturing cycle time.
57:09
And uh when you think about latency versus throughput,
57:12
uh when you think about cost
57:14
versus throughput, cost versus
57:17
capacity, all of these things,
57:20
uh you test against the speed of light
57:23
to achieve all of these different constraints separately.
57:28
And then when you consider it together,
57:31
you know, you have to make compromises
57:33
because a system that achieves extremely low latency
57:36
versus achie a system that achieves very high throughput
57:39
are architected fundamentally differently.
57:42
But you want to know what's the speed of light of a system
57:45
that achieves high throughput?
57:47
What's the speed of light of a system that achieves low latency?
57:52
And then when you think about the total system,
57:54
you can make trade-offs.
57:55
And so I I force everybody to think about what's this what the f
57:59
the first principles the limits
58:01
>> the physical limits um for everything before we
58:05
you know before we uh do anything
58:08
and and we test everything against that and so that's a good frame of
58:12
mind I don't love
58:14
the other methods which is continuous
58:19
>> the the problem with continuous improvement
58:21
it it first of all you should engineer
58:24
something from first principles at the speed you know with speed of light thinking
58:29
limited only by physical limits
58:32
and and physics limits
58:34
and um after that of course you would
58:37
improve it over time
58:39
um but I don't like going into a problem and somebody says hey you
58:43
know it takes 74
58:44
days to do this
58:46
>> right now and um we can do it for you in 72 days
58:49
>> you know I rather strip it all back to
58:52
>> and so first of all explain to me why it's 74
58:54
is in the first place
58:56
and let's know let's think about what's possible
58:58
today and if I were to to build it completely from scratch
59:03
you know how long would it take often times you'd be surprised and might
59:06
come to 6 days
59:08
now the rest of the 6 days to 74
59:11
could be very wellreasoned
59:13
and compromises and you know cost reductions
59:16
and all kinds of different things
59:18
but at least you know what they are
59:20
and then now that you know that six days possible
59:24
Then the conversation from 74 to 6
59:28
surprisingly much more effective
59:30
>> in such incredibly complex systems that you're working with is simplicity
59:33
sometimes a good huristic
59:35
to to reach for
59:37
I mean if I can just
59:40
I mean the pod
59:41
the Vera Rubin pod that you announced is just incredible
59:44
uh we're talking about seven chips
59:47
seven chip types five purpose-built
59:48
rack types 40 racks 1.2 two quadrillion
59:51
transistors, nearly 20,000 Nvidia dies,
59:56
over 1100 Ruben GPUs,
59:58
60 exoflops, 10 pabytes per second of scale bandwidth.
60:01
Uh, that's all just one
60:03
>> that's just one pod.
60:04
>> That's just >> Yeah, that's just one pod.
60:07
>> I mean, so you have the and then even the the NVL72
60:11
rack alone is 1.3
60:14
million components, 1300 chips, 4,000 lb crammed into a single 19inch wide rack.
60:19
And Lex, we'll probably kind of crank out about 200 of these pods
60:22
a week just to put in
60:25
>> the the amount of different components.
60:27
I suppose simplicity is impossible,
60:30
but is that a metric that you kind of
60:32
reach for in trying to design things?
60:35
>> You know, the phrase the phrase that I use most often is
60:39
we we need things to be as complex as necessary but as simple as possible.
60:43
And and so the question is is all that complexity there necessary?
60:48
And we ought to test for that and we ought to challenge that.
60:51
And then after that everything else above it,
60:54
you know, it's gratuitous.
60:56
>> But it's some of the most incredible
60:58
semiconductor industry broadly, but what Nvidia is doing
61:02
uh some of the greatest engineering in history.
61:06
So these systems are just truly truly marvels of engineering.
61:10
>> It is the most complex computer the world has ever made.
61:13
Yeah, the engineering teams.
61:14
I mean, I don't it's not a competition, but I don't know if if
61:16
it was like an Olympics of uh engineering teams.
61:19
I mean, TSMC does incredible engineering.
61:22
Like I said, ASML
61:23
at every scale, but Nvidia
61:25
is going to give them a run for their money.
61:27
>> Just incredible, incredible teams,
61:29
>> gold medal medalist in every single
61:31
in every single sport, all assembled right >> and have to work together
61:35
and report directly to you. This is wonderful.
61:37
Uh you've recently traveled to China.
61:40
Uh so it's interesting to ask you
61:44
uh China's been incredibly
61:45
successful in building up its technology sector.
61:48
What do you understand about
61:50
um how China is able to over the past 10 years build so many
61:54
incredible world-class companies, world-class
61:57
engineering teams and just this technology ecosystem
62:01
>> that produces so many um incredible products.
62:05
whole bunch of reasons for well first of all let's let's start let's start
62:08
with some facts 50% of the world's AI researchers are Chinese
62:13
plus or minus and
62:16
they're mostly in China
62:18
still we have many of them here
62:20
but there's amazing researchers still in China
62:23
um they their tech industry
62:27
showed up at precisely the right time
62:30
at the time of the mobile cloud era
62:33
uh their way of contributing was software and So this is a country's
62:36
in incredible science and math.
62:39
Uh really well educated kids.
62:42
Um uh their tech industry was created during the era of software.
62:48
They're very comfortable with modern
62:52
China is not one giant economic country.
62:56
It's got many provinces and cities
62:59
with mayors all competing with each other.
63:01
That's the reason why there's so many EV companies.
63:04
That's the reason why there's so many AI companies.
63:06
That's the reason why there's so many
63:08
every company you could imagine.
63:10
Um they all create
63:11
some of them and
63:13
and um as a result
63:16
they have insane competition
63:17
internally and you know what remains
63:21
is an incredible company.
63:24
Um they also have a um social culture
63:28
where where it's family first,
63:31
friends second and company third.
63:34
And so the amount of
63:40
conversation that goes back and forth
63:43
between they're essentially open source all the time.
63:47
So the fact that they contribute more to open source
63:50
is so sensible because
63:52
they're probably what are we protecting?
63:53
You know my engineers
63:55
their brothers are in that company their friends are in that company and they're all schoolmates.
64:00
you know the schoolmate concept
64:02
it's a you know one schoolmate
64:04
your brother for life
64:05
and um and so they
64:08
they they share knowledge very very quickly
64:12
and so there's no sense
64:13
keeping technology hidden you might as well put it on open source and so
64:17
the open source community then amplifies
64:20
accelerates the the innovation
64:22
process so you get this rapid
64:24
incredibly great talent rapid
64:27
innovation because of open source and just you the the nature of friends
64:32
and and um insane
64:34
competition among compet among the company what emerges
64:38
is incredible stuff and so
64:41
this is the fastest innovating
64:44
country in the world today and this is something that has everything that everything
64:47
that I've just said
64:48
is fundamental to just how the kids were grown
64:52
the fact that they have excellent education
64:54
the fact that they
64:55
parents want them to do well in school
64:57
the fact that they their culture that way.
65:00
These are, you know, these are just the thing about their country
65:03
and they showed up at a precisely
65:05
the time when technology
65:06
is going through that exponential.
65:09
>> Plus, culturally, it's pretty cool to be an engineer.
65:12
It connects to all the components that you're mentioning.
65:16
>> It's a it's a builder nation.
65:18
>> It's a builder nation.
65:19
>> Yeah, it's a builder nation.
65:20
Um, our country's leaders, incredible,
65:23
but they're mostly lawyers.
65:25
They're country's leaders and because we're they're trying to keep us safe.
65:28
uh rule of law, uh governing.
65:31
Their country was built out of poverty
65:35
and so most of their leaders are
65:38
incredible engineers, some of the brightest minds.
65:43
To take a small tangent because you mentioned open source,
65:46
I have to uh go to Perplexity
65:48
here, who you have been a a fan of a long time. >> I love it. Yeah.
65:52
>> And thank you for
65:53
releasing open source Neatron
65:55
3 Super, which you can also use inside Perplexity. look stuff up.
65:59
>> Uh which is uh 120 billion parameter open weight uh model.
66:05
>> Uh what's your vision with open source?
66:09
So you mentioned China
66:11
with with Deep Seek with Minia
66:13
with all these companies
66:15
really pushing forward the open- source
66:18
uh AI movement and Nvidia is really leading the way
66:22
in um close to state-of-the-art open source LMS.
66:27
What's your vision there?
66:30
if we're going to be a great AI computing company, we have to understand
66:33
how AI models are evolving.
66:36
>> One of the things that I love about Neotron
66:38
3 is it's it's not a just a pure transformer model.
66:42
It's transformer and SSM.
66:45
And uh we were early in
66:48
uh developing the the
66:50
uh conditional GANs which that progressive GANs which led
66:54
step by step to diffusion.
66:55
And so um the fact that we're doing basic research
66:59
in model architecture and in different domains
67:03
gives us visibility into
67:05
you know what kind of computing systems would do a good job for future
67:09
models and so it is part of our extreme codeesign strategy.
67:12
Second, um I think we we
67:17
right rightfully recognize that
67:20
on the one hand we want worldclass
67:23
models as products and they should be proprietary.
67:27
On the other hand,
67:29
we also want AI
67:30
to diffuse into every industry and every country,
67:34
every researcher, every And
67:37
if everything is proprietary,
67:39
it's hard to do research and it's hard to innovate
67:43
on top of around with.
67:46
And so open source is fundamentally
67:49
necessary for many industries
67:51
to join the AI
67:54
Nvidia has the scale
67:56
and we have the motives
67:58
to not only skills,
68:01
scale and motivation to
68:04
build and continue to build
68:06
these AI models for as long as we shall live.
68:09
And so therefore, we ought to do that.
68:11
We can open up, we can activate
68:14
every industry, every researcher,
68:17
you know, every country to be able to join the AI revolution.
68:21
There's a third reason which is
68:23
for that to recognizing
68:26
that AI is not just language.
68:28
These AIs will likely use
68:31
uh tools and models and sub aents
68:35
that were trained on other modalities of information.
68:39
Maybe it's biology or chemistry
68:41
or um you know
68:44
laws of physics or
68:45
you know fluids and thermodynamics
68:47
and not all of it is in language structure.
68:50
And so somebody has to go make sure
68:53
that weather prediction, biology,
68:56
AI, AI for biology,
68:59
physical AI, all of that stuff
69:02
stays can be pushed to the limits and pushed to the frontier.
69:05
We don't build cars, but we want to make sure every car company has
69:08
access to great models.
69:10
We don't we don't discover drugs, but I want to make sure that Lily
69:13
has the world's best
69:15
biology AI systems so that they can go use it for discovering drugs.
69:19
And so these three fundamental
69:21
reasons both in in recognizing that AI is not just the language
69:25
that AI is really broad
69:27
that we want to engage
69:28
everybody into the world of AI
69:30
and then also codees of AI.
69:32
>> Well, I have to say once again, thank you
69:35
uh for open sourcing
69:36
really truly open sourcing uh Neatron 3.
69:38
And >> yeah, I appreciate you were saying that we open source the models, we
69:41
open source the weights, we open source the data,
69:44
we open source how we created it.
69:46
>> Yeah, it's pretty amazing.
69:48
It's really It's really incredible.
69:51
You're originally from Taiwan
69:53
and have a close relationship with TSMC.
69:56
So I have to ask
69:57
uh TSMC I think
69:59
uh also is a legendary
70:01
company in terms of the engineering teams in terms of the incredible engineering work that they do.
70:06
uh what uh what do you understand about TSMC
70:09
culture and their approach that explains
70:12
how they're able to achieve this
70:14
singular unmatched success in
70:17
uh everything they're doing with semiconductors?
70:19
You know, first of all,
70:21
the deepest misunderstanding about TSMC
70:25
is that that um
70:29
their technology is all they have.
70:33
that somehow they they have a
70:36
really great transistor and if somebody shows up another transistor
70:39
game over >> it's the technology
70:43
and of course you know I I don't mean just the trans
70:46
transistor the metalization systems the packaging the 3D packaging
70:49
the silicon photonics the you know all of the technology that they have that
70:53
technology is really what makes the company special
70:56
their technology makes the company special
70:59
but their ability to
71:03
orchestrate the the demands
71:06
the the dynamic demands
71:08
of hundreds of companies in the world as they're moving up, shifting out,
71:14
you know, increasing, decreasing,
71:16
push pushing out, pulling in,
71:19
um changing from customer to customer,
71:22
uh wafer starting, wafer
71:24
stopping, uh emergency wafer starts, you know,
71:29
all of this dynamics
71:31
of the world's complexity
71:33
as the world is shapeshifting
71:35
all the time and somehow
71:38
they're running a factory
71:39
with high throughput, high yields,
71:42
really great costs, excellent customer service.
71:46
They they take their work ser they take their promises seriously.
71:50
when your wafer because they know that you're help they're helping you run your
71:53
company when the wafers
71:54
when the wafers were promised to show up the wafers show up
71:57
you know so that you could run your company
71:59
appropriately and so their system their manufacturing
72:02
system is completely miraculous
72:05
I would say then the second thing is their culture
72:07
this culture is uh
72:10
uh technology focused on one hand advancing technology
72:14
simultaneously customer serviceoriented on the other hand
72:18
a lot of C companies are very customer serviceoriented,
72:21
but they're not very excellent.
72:25
They're they're not at the bleeding edge of technology or a lot of companies
72:27
who are tech at the bleeding edge of technology,
72:29
but they're not the best customer service oriented company.
72:32
And so it just depends on
72:34
somehow they've they've balanced these two
72:36
and they're world class at both.
72:39
Um and then probably the third thing is the technology
72:42
that I most value in them
72:44
uh that they created this you know this this
72:47
uh intangible called trust.
72:50
I trust them to put my company on top of them.
72:54
That's a very big deal.
72:55
But they trust I mean there's a really close relationship there that you've established
72:58
and that trust is established
73:00
based on many years of performance.
73:02
But there's human relationships
73:03
involved there as well. three decades.
73:06
I don't know how many
73:07
tens, hundreds of billions of dollars of business we've done through them
73:11
and we don't have a contract. That's pretty great. Amazing. Okay.
73:16
There's a story uh that
73:19
in 2013 the founders of TSMC,
73:22
Morris Jang, offered you the chance to become TSMC's
73:24
chief Uh and you said you already had a job.
73:28
Is this story true? >> Story is true.
73:31
I didn't I didn't dismiss it. Yeah.
73:33
Um uh but I was I was deeply honored
73:36
and and of course
73:38
of course um uh I knew then as I know now TSMC
73:41
is one of the most consequential companies in >> Yeah.
73:45
And and Morris is one of the
73:47
the highest regarded executive
73:49
and and um business
73:51
and personal friend that I've that I've had in my life.
73:55
And um uh for him to ask is
73:59
uh uh um I I was humbled and and really honored.
74:05
Um but but the work that I'm doing here is really important
74:08
and I've seen you know
74:10
in my mind anyways
74:11
in my mind's eye
74:12
what Nvidia was going to be and what the impact that we could have
74:17
and um uh it was really important work
74:21
and it's my responsibility
74:22
you know my sole responsibility
74:24
to make this happen
74:25
and so I I
74:26
um uh I declined it
74:29
you know not not because it wasn't an incredible
74:33
offer Uh it it's an unbelievable offer.
74:36
Um but but I simply couldn't take it.
74:38
>> I think Nvidia, both Nvidia and TSMC
74:41
are two of the greatest companies in the history of human civilization.
74:46
Running either one, I'm sure, is incredibly
74:48
complicated effort and it takes
74:50
you have to truly be allin.
74:52
>> Uh everybody at every scale, not just at the CEO level, everybody is really
74:56
truly >> To accomplish this kind of complexity.
75:00
>> See, now I can help both companies. >> Exactly.
75:03
Um, so Nvidia is now the most valuable company in the world.
75:08
I have to ask, what is the
75:10
Nvidia's biggest moat as the folks in the tech sector say?
75:15
>> The edge you have that
75:17
protects you from the competition.
75:20
Our single most important
75:24
uh property as a company
75:27
is the install base
75:28
of our computing platform.
75:31
Our single most important thing is the invol
75:34
today is our is the installed base of CUDA.
75:37
Now the reason why
75:39
uh 20 20 years ago
75:43
of course there was no installed base
75:46
but what makes and if somebody if somebody came up with
75:49
with a guda or a tuda
75:51
uh it wouldn't make any difference at all.
75:54
And the reason for that is because
75:56
because it's never been just about the technology.
75:59
The technology of course was incredible visionary.
76:02
Um but it's the fact that the company was dedicated to it,
76:07
stuck with it, expanded its reach.
76:09
Um it wasn't three people that that made CUDA successful.
76:14
It was 43,000 people that made CUDA successful.
76:17
and the several million developers
76:19
that believed in us
76:21
um that trusted that we were going to continue to make CUDA 1 2
76:25
3 13 that they decided to port and dedicate their software on top of
76:30
it, their mountain of software on top of it.
76:32
And so the install base
76:34
is the number one most important advantage.
76:38
that installed base when you amplified
76:40
with the velocity of our execution
76:43
at the scale that we're talking about.
76:45
No company in history
76:47
had ever built systems of this complexity period.
76:51
And then to build it once a year is impossible.
76:56
And and that velocity
76:59
combined with the installed base
77:02
in the developer's mind
77:04
is just going to now take the developer's mind.
77:06
From the developers perspective,
77:08
if I support CUDA
77:11
tomorrow, it will be 10 times better.
77:13
I just have to wait 6 months on average.
77:16
Not only that, if I develop it on CUDA,
77:19
I reach a few
77:20
hundred million people computers.
77:24
I'm in every cloud.
77:25
I'm in every computer company.
77:26
I'm in every single industry.
77:28
I'm in every single
77:31
So if I created an open source package and I put it on CUDA
77:34
first, I get these both
77:37
attributes And not only that,
77:43
I trust 100% that Nvidia
77:47
is going to keep CUDA around and maintain it and
77:50
improve it and keep optimizing
77:51
the libraries for as long as they shall live.
77:56
You could take that to the bank.
77:58
And that last part, trust,
78:00
you put all that stuff together,
78:02
if I were a developer today,
78:04
I would target CUDA first.
78:07
I would target CUDA most.
78:09
And that's the reason that that I think in the final analysis is
78:13
our first that's even our first >> core advantage.
78:18
Our second one is our
78:21
>> The fact that we vertically
78:22
integrated this incredibly complex system,
78:25
but we integrated horizontally
78:27
into every single every single company's computers.
78:30
We're in the Google cloud, we're in Amazon, we're in Azure.
78:33
>> You know, we're ramping up AWS
78:35
like crazy right now.
78:36
We're in new companies like Corewave and Nscale.
78:40
We're in supercomputers at Lily.
78:43
We're in enterprise computers.
78:44
We're at the edge in radio base stations.
78:47
You know, I it's just crazy.
78:49
One architecture is in all these different systems.
78:51
We're in cars, we're in robots, we're in satellites,
78:54
we're out in space.
78:55
And so, so the fact that you have this one architecture
78:58
and the ecosystem is so broad, it basically covers every single industry in the world.
79:03
Well, how does the
79:04
how does the CUDA
79:06
install base evolve into the future with AI factories as a moat?
79:11
What do you what do do you think it's possible that Nvidia of the
79:13
future is all about the AI factory?
79:16
Well, the the unit of computing
79:18
used to be GPU
79:19
to us, then it became a computer.
79:22
Then it became a cluster.
79:23
Now it's an entire AI factory.
79:25
when I see a computer, when I see what Nvidia builds
79:28
in the old days, I would, you know, I visualize the chip
79:32
>> and then and then when I announced a new product,
79:34
you know, new generation, like
79:36
ladies and gentlemen, we're announcing ampear today.
79:38
I pick up the chip.
79:40
>> That was my mental model what I was
79:43
>> Today, I don't I wouldn't
79:45
picking up the chip is kind of still adorable, >> but it's adorable.
79:48
It It's not It's not
79:51
my mental model of what I'm doing.
79:52
My mental model is this giant
79:55
gigawatt thing that has power generation.
79:59
It's connected to the grid.
80:00
It's got cooling systems and networking of incredible monstrosity.
80:05
You know, 10,000 people are in there trying to install it.
80:09
Hundreds of networking engineers in there.
80:11
Thousands of engineers behind it trying to power it up.
80:14
>> You know, powering up one of those factories, as you know, it's not somebody
80:17
going, "It's on now."
80:20
takes thousands of people to bring it
80:22
>> So mentally you're actually when you're thinking about a single unit of compute,
80:26
you're like literally when you go to bed at night, you're thinking now about collection of racks.
80:31
So pods, not individual chips, >> entire infrastructure.
80:34
And I'm hoping my next click is when I'm thinking about building computers, it's,
80:38
you know, planetary scale.
80:40
That would be the next click.
80:42
What do you think about
80:43
the space angle that Elon has talked about doing compute
80:47
in space uh for solving some of the it makes
80:51
some of the energy issues
80:54
in terms of scaling energy easier
80:56
cooling issues is not easy.
80:58
Yeah, >> cooling well there's a large number of engineering
81:01
complexities involved with >> So what you know Nvidia has also announced
81:06
that >> you're already thinking about that.
81:08
>> Yeah, we're already there.
81:10
Uh, Nvidia GPUs are the first GPUs in space
81:14
and um I I didn't realize
81:16
it was it was so interesting to I would have declared it maybe
81:20
we're in space, you know,
81:22
little little astronaut suit on one of our GPUs.
81:27
Um but but we've been in space.
81:28
Uh it's the right place to do a lot of imaging.
81:32
>> You know, because those satellites have
81:33
really high resolution imaging systems
81:36
and they're sweeping the Earth,
81:37
you know, continuously now.
81:39
And um uh you want you know centimeter scale
81:43
you know imaging that is done continuously
81:46
uh for the world so that you know
81:48
you'll basically have real time telemetry of everything.
81:52
Uh you don't want to beam that back down to earth.
81:55
It's just you know
81:57
pabytes and pabytes of data.
81:58
You got to just do AI right there at the edge.
82:01
Throw away everything you don't need.
82:02
You've seen before didn't change
82:04
and then just keep the stuff that that you need.
82:06
And so AI ought to be done at the edge.
82:09
Um obviously we have we have uh 24/7
82:12
solar if we put it at the polars
82:15
and um uh but you know there's no conduction,
82:21
no convection and so
82:23
you know you're pretty much just radiation
82:26
and um uh but you know space is big I guess.
82:29
You know we're just going to put big giant radiators out there.
82:32
>> How crazy of an idea do you think it is?
82:33
Like is this is this 5 years out, 10 years out, 20 years out?
82:38
So, uh, we're talking about blockers for AI scaling.
82:41
You know, I'm just so much more practical.
82:42
I I look for where
82:44
where um I next
82:47
next bucket of opportunities are
82:51
Meanwhile, I'm cultivating space.
82:54
And so, I send I send engineers
82:56
uh to go work on the problem.
82:57
We're we're starting to we're learning a lot about it.
83:00
Um, how do we deal with radiation?
83:01
How do we deal with degrading performance?
83:04
How do we deal with um
83:05
uh continuous uh testing and addestation
83:08
of of um def defects and and
83:11
um you know how do we deal with redundancy
83:13
and how do we degrade
83:15
uh gracefully and things like that and so we could we could do uh
83:18
what what about software?
83:19
How do you think about software and and redundancy
83:22
and performance out in space?
83:24
Uh make it so that so that the computer never breaks.
83:28
It just gets slower, you know.
83:31
And um I so we could start doing a lot of engineer exploration
83:35
up front, but in the meantime, my my favorite answer is get eliminate waste.
83:41
>> You know, we've we've got all that idle power.
83:43
I want to evacuate
83:44
it as fast as possible. >> Yeah.
83:47
There Yeah, there's a lot of low hanging fruit here on Earth
83:50
uh that we can utilize
83:52
uh for the AI scaling.
83:54
Uh quick pause, quick 30 second thank you to our sponsors.
83:58
Check them out in the description.
84:00
It really is the best way to support this podcast.
84:02
Go to We got Perplexity
84:08
for curiositydriven knowledge exploration,
84:10
Shopify for selling stuff online,
84:13
Element for Electrolytes, Finn for customer service AI agents,
84:18
and Quo for a phone system
84:20
like calls, texts, contacts for your business.
84:23
Choose wisely, my friends.
84:25
And now back to my conversation with Johnson Kuang.
84:30
Do you think Nvidia
84:31
may be worth 10 trillion at some point?
84:36
Let's let's ask it this way.
84:38
What does the future
84:39
of the world look like where that where that's true?
84:45
I think that Nvidia's
84:47
growth is is um
84:51
uh extremely likely and in my mind inevitable.
84:55
And let me explain why.
84:57
We're the largest computer company in history.
85:00
That alone should beg the question why.
85:04
And the reason for of course uh two reasons.
85:06
First two foundational technical reasons.
85:10
The first reason is that computing went from being a retrievalbased file retrieval system.
85:16
Almost everything is a file.
85:18
We we pre pre-write
85:20
something, we pre-record something,
85:22
you know, we we draw something, we put it on the web, we put
85:24
in a file, and we we use a recommener
85:27
system, some smart filter
85:29
to figure out what to retrieve for you.
85:31
And so we were a pre-recording,
85:33
human pre-recording and file retrieving system.
85:36
That's what a computer is largely
85:39
to now AI computers are
85:41
contextually aware which means that it has to process
85:45
and generate tokens in real time.
85:47
So we went from a retrievalbased
85:49
computing system to a generativebased
85:51
computing We're going to need a lot more processing
85:55
in this new world
85:56
than in the old world.
85:58
We need a lot of storage in the old old world.
86:01
We need a lot of computation in this new world.
86:04
And so so that's that's the first part of it.
86:07
We fundamentally changed computing and the way how computing is done.
86:12
The only thing that would cause it to go back
86:15
is if this way of computation,
86:18
this way of computing generating
86:19
information that's contextually relevant,
86:22
situationally aware that is grounded on
86:26
new insight before it generates information.
86:29
this computationintensive way of doing computing
86:33
would only go back if it's not effective.
86:36
So if for the last 1015
86:38
years while working on deep learning
86:40
if at any single moment
86:43
I would have come to the conclusion that that
86:46
you know what this is not going to work out
86:49
I think this is a dead end or it's not going to scale it's
86:51
not going to solve this modality it's not going to be used in this application
86:54
then of course I would feel very differently about it but I think the
86:58
last five years has given me more confidence
87:02
than the last 10 years the previous 10 years the second idea
87:06
is computers because it was a storage system.
87:10
It was largely a warehouse.
87:13
We're now building factories.
87:16
Warehouses don't make much money.
87:20
Factories directly correlates with a company's revenues.
87:25
And so the computer did two things.
87:30
Not only did it change the way it did it,
87:33
its purpose in the world changed.
87:36
It's no longer a computer, it's a factory.
87:39
It's a factory is used for generation of
87:45
We're now seeing not only is this factory
87:48
generating products, commodities that people want to consume,
87:53
we're seeing that the commodities are so
87:55
interesting, so valuable so to so many different audiences
87:59
that the tokens are starting to segment like iPhones.
88:04
>> You have a free tokens,
88:06
you have premium tokens,
88:08
and you have several tokens in the middle.
88:10
And so intelligence, as it turns out,
88:13
you know, is a scalable product.
88:15
There's extremely high intelligence
88:17
products, tokens that you could that are used for specialized things.
88:20
People be willing to pay,
88:22
you know, the idea that somebody's willing to pay
88:25
$1,000 per million tokens
88:28
is just around the corner.
88:29
It's not if, it's only when.
88:32
And so so now we're seeing that
88:35
the commodity that this factory makes
88:38
is actually valuable and is revenue generating and profit generating.
88:42
How now the question is how many of these factories
88:45
can does the world need?
88:48
How much how many tokens does the world
88:52
And um how much is society willing to pay for these tokens?
89:00
what would happen to the world's economy
89:02
if the productivity were
89:04
to improve so What would happen?
89:08
Are we are we going to discover new drugs, new products, new services?
89:12
And so when you take these things in combination,
89:15
I am absolutely that the world's GDP is going to accelerate in growth.
89:22
I'm absolutely certain the percentage
89:25
of that GDP that will be used
89:28
for computation will be a 100 times more than the past
89:33
because it's no longer a storage unit.
89:35
It's a product generation unit.
89:39
And so when you look at it in that context
89:42
and then you back into
89:43
what is Nvidia's what does Nvidia
89:46
what does Nvidia do
89:48
and how much of that
89:50
new economics new industry would we have to benefit to address
89:56
I think we're going to be a lot lot bigger
89:58
and then the rest of it
90:00
to me is um
90:01
you go is it possible for Nvidia to be a
90:04
you know $3 trillion
90:06
revenues company in the near
90:08
The answer is of course yes.
90:10
And the reason for that
90:11
is because it's not limited by any physical limits.
90:15
There's nothing that I
90:16
see that says, you know, gosh,
90:19
um, $3 trillion is not possible.
90:22
And as it turns out, Nvidia
90:25
supply chain is the burden is
90:28
shared by 200 and the fact that we
90:33
scale out on the backs of with the partnership of this
90:38
The question is do we have the energy to do so?
90:41
And surely we will have the energy to do so.
90:45
And so all of these things combined
90:49
that number is just a number
90:51
you know and I still remember
90:52
Nvidia was a Nvidia was a the first time we crossed a billion dollars.
90:58
I was reminded of of a CEO who told me, you know, Jensen, it's
91:01
theoretically impossible for a fabulous semiconductor
91:04
company to exceed a billion dollars.
91:07
And and um I won't bore you with why, but but the
91:11
of course is illogical and there's a lot of evidence we're not.
91:15
And then there somebody told me, you know, Jensen, you'll never be
91:18
more than $25 billion
91:21
because of some other company.
91:22
Somebody told me that you'll never be,
91:24
you know, because and then so so the the
91:27
those aren't principled first principle
91:31
reason thinking and the simple
91:33
the simple way to think about that is what is it that we make
91:38
and how large is the opportunity
91:40
that we can create.
91:42
Now Nvidia is not in the market share business.
91:45
Almost everything that I just talked about don't exist.
91:48
>> That's the part that's hard.
91:51
You know, if Nvidia was a
91:53
was a was a $10 billion
91:55
company trying to take Nvidia's share,
91:57
then it's easy to to see for shareholders
92:00
that oh yeah, if they could just take 10%
92:03
share, they could be this much larger.
92:07
But it's hard for
92:08
people to imagine how large we could be because there's nobody I could take
92:12
share from, >> you know, and so
92:14
so I think that that's one of the challenges
92:17
for the world is is um the imagination of the future.
92:20
But I got plenty of time and I'll keep reasoning about it and I'll
92:23
keep talking about it and every single GTC
92:26
will become more and more real,
92:27
>> you know, and and and then more and more people will talk about one
92:30
of these days, you know, we'll we'll get there.
92:32
But I'm 100% we'll get there. >> Yeah.
92:34
this view of uh you know token factories
92:38
essentially this token per second per watt
92:40
and every token having value
92:43
like it's an actual thing that brings value and it brings different kinds of
92:47
value different amounts of value to different people but it's value that's the actual
92:50
product is really could be loosely thought of as the token and so you
92:53
have a bunch of token factors and it's very easy
92:56
first principles to imagine a future given all the potential things that AI can
93:00
solve that you're going to need an exponential
93:03
number more of token factories.
93:06
>> And and what's really interesting,
93:07
the reason why I was so excited about it,
93:09
the iPhone of tokens arrived.
93:11
>> What do you call Wait, are you saying open clause iPhone? >> that's interesting. Uh >> Yeah, agents. True. >> Agents in general.
93:19
The iPhone of tokens arrived.
93:21
Uh it is the fastest growing application in history.
93:24
It went straight up. >> went straight up. >> That says something. >> Yep.
93:28
There's no question OpenClaw
93:29
is the iPhone of tokens.
93:31
Yeah, there's something truly as you know
93:34
something truly special happening
93:36
from about December where people really woke up to the power of claw code
93:41
of codeex of open claw.
93:44
Um, I mean, I've
93:46
embarrassed to admit that on the way here in the airport,
93:52
this first time I've done this in public,
93:54
I was programming quote unquote
93:57
by talking to my laptop
93:59
and I was embarrassed because I was pretending like I'm talking to a human colleague.
94:03
>> Uh I'm not sure how I feel about the future where everybody
94:07
>> is walking around talking to their AI,
94:10
but it's such an efficient way to get stuff done
94:13
>> and and it's it's more likely
94:15
that your AI is bothering you all the time.
94:18
And the reason for that
94:19
is because it's getting stuff done so fast.
94:22
>> Is reporting back to you.
94:23
I got that done.
94:24
You know, what do you want me to do next?
94:26
You know, it that's the part that I think most people don't realize is
94:30
mo the person who's going to be chatting with them, texting them most
94:34
is their is their claws or lobster.
94:37
>> What an incredible future.
94:39
Uh I read that you attribute a lot of your success to your ability
94:42
to work harder than anyone and withstand more suffering than
94:46
So, we can list many of the things that entails.
94:50
I mean, dealing with failure,
94:52
the constant engineering problems we've talked about,
94:55
the the human problems,
94:58
uncertainty, responsibility, exhaustion, embarrassment,
95:01
the near-death company moments that you've mentioned,
95:05
um, but also the pressure
95:07
now as the CEO of this
95:10
company that economies and nations
95:14
strategize around, uh, plan
95:17
their, um, financial allocations
95:20
around plan their in AI infrastructure
95:22
around how do you deal with this much pressure?
95:26
What gives you strength
95:27
given how many nations
95:31
and peoples depend on
95:37
I'm conscious about the fact that
95:41
um Nvidia success is very important to United States.
95:47
We generate enormous amounts of tax tax revenues.
95:51
Uh we establish technology leadership for our nation.
95:54
Technology leadership is important for national security.
95:57
National security not just in one aspect of national security.
96:01
All aspects of national security.
96:03
When our country is more prosperous,
96:05
we could do a better job with domestic
96:07
policies and helping social
96:09
social benefits because we're generating
96:12
so much re-industrialization in the United States.
96:15
We're creating mountains of jobs.
96:17
We're helping shift um
96:21
how we how we how we build things
96:25
uh back to United States in so many different plants,
96:28
chips, computers, and of course these AI factories.
96:32
I'm completely aware that
96:35
that um and I have I have the benefit
96:37
and this is a real real
96:39
um a real gift
96:41
uh with with uh mainstream
96:44
investors, teachers, policemen who
96:48
have somehow for whatever reason
96:51
invested in Nvidia or because they watch Jim Kramer
96:54
um bought some stock and now are millionaires. >> Mhm.
96:57
And um I I am completely aware of that circumstance.
97:03
I'm aware of the circumstance that
97:05
that Nvidia is central to a very large network of ecosystem
97:13
partners behind us and downstream from us.
97:16
And so the way the way I deal with that is exactly
97:19
what I just did.
97:20
I reason about what is it what is it that we're doing?
97:26
um what is it causing?
97:27
What's the impact that has
97:29
other people benefit you know
97:31
positively or even even
97:34
um uh through great burden for example the supply
97:38
and and the question is
97:42
uh therefore what are you going to do about it
97:44
and almost everything that
97:46
I feel I break it down I reason about okay
97:50
what's the circumstance what is what has changed what's hard
97:54
um and what am I going to do about it and I I break
97:57
it down, decompose the problem.
98:00
And the de the decomposition
98:03
of these turns it into
98:08
manageable things that I can do.
98:09
And the only thing that I after that I could do is did you do it?
98:14
Did you either do it or did you get somebody else to do it?
98:17
And if you didn't do it,
98:18
you you reason that you need to do it and you didn't do it and
98:21
you get didn't get anybody else to do it, then stop crying about it, you know.
98:26
And so, and so, so I I'm I'm
98:28
fairly I'm fairly uh
98:31
>> uh tough on myself.
98:32
And but I also break things down so that so that um
98:36
uh I don't panic.
98:38
Uh I can go to sleep because I've made the list of things that
98:41
needed to be done.
98:43
And I've made sure that
98:44
everything that could put our company in harm's way, could put my partners in
98:48
harm's way, put our industry in harm's way, I've told somebody.
98:54
Everything that I feel
98:56
could put anybody in harm's way, I've told someone.
99:00
And I've told that someone who could do something about it.
99:03
And so I've gotten it off my chest
99:05
or I'm doing something about it.
99:07
And so after that,
99:09
Lex, what else can you do?
99:10
>> So given all the in
99:12
insane intense amount of suffering
99:15
on the journey of building up Nvidia,
99:19
you have you hit low points >> Oh yeah. Oh yeah, sure. All the time. All the time.
99:27
>> And there you just break down the >> into pieces.
99:31
>> See what you can do about it.
99:33
>> And and part of
99:35
And you know, Lex, part of it part of it is forgetting.
99:39
One of the most important
99:40
attributes of AI learning as you know is right systematic forgetting.
99:44
You you need to know when to forget some things.
99:47
You can't memorize everything.
99:49
You can't keep everything.
99:50
and and you know you want to you don't want to carry everything.
99:53
One of the things that I do very quickly
99:55
is I decompose the problem.
99:56
I reason about the problem and I I share the load with it.
99:59
When I say I tell everybody,
100:01
I'm essentially sharing that burden.
100:04
>> As quickly as possible.
100:06
Whatever worries me, tell somebody else.
100:08
Don't just keep it, you know, decompo.
100:10
Don't don't freak them out.
100:13
decompose the problem into smaller parts
100:16
and get people to so and and inspire them to be able to go
100:19
do something about it.
100:20
But part of it is just just forgetting,
100:23
you know, I a lot of it is you got to be tough on
100:26
yourself, you know, just come on, stop crying about it, let's get going,
100:30
you know, and and then you get out of bed.
100:32
And then the other part is is
100:33
um you you you're attracted to the next shiny light, the next future,
100:38
you know, the next opportunity,
100:39
the next Okay, that's behind us. Let what's next? It's a lot.
100:43
I think you know you watch this with great athletes.
100:46
They they um just worry about the next point.
100:50
>> The last point is behind them.
100:52
The the you know, the setback,
100:56
you know, and and then and because I do so much of my job
101:00
publicly, >> you know, Lex, you do a fair amount of your job publicly, too.
101:04
And so, so I do a lot of my job publicly.
101:07
And so, um, you know, I I say a lot of things that that
101:11
seem sensible at the time or funny at the time.
101:13
Mostly it's just because it's funny to me at the time
101:15
and then, you know, you reflect on it's less money, but but >> Yeah.
101:20
No, trust me, I know.
101:22
But you basically allow yourself to be pulled by
101:25
the light of the future.
101:26
Forget the past and just keep >> That's right.
101:28
>> Keep keep working towards that.
101:30
I mean, you did say there's this kind of
101:32
famous thing you said that
101:34
um if you knew how hard it would be
101:37
to build Nvidia, uh it turned out to be
101:41
what is it a million times more hard than you anticipated
101:45
that you wouldn't do it?
101:47
>> But is isn't you know when I hear that
101:51
that's probably true about everything worth doing, right? >> Exactly.
101:55
That is by the way what I was trying to explain
101:57
is that there's a
101:59
there's a incredible superpower
102:01
of being um being
102:04
being uh have the mind of a
102:07
>> You know, and I say to myself often times when I look at something
102:11
and and almost almost everything
102:15
um my first thought is how hard can it be?
102:19
>> You know, and so
102:21
and so you get yourself into that mode.
102:22
How hard could it be?
102:24
and and nobody's ever done it. It looks gigantic.
102:28
It's going to cost hundreds of billions of dollars.
102:31
It's going to take, you know, all this.
102:32
And you just go, "Yeah, but how hard could it be?"
102:35
You know, how hard could it be?
102:37
>> And and so, so you got to get yourself into that state of mind.
102:40
You don't want to you don't want to actually
102:45
everything and all the setbacks and all the trials and tribulations
102:48
and all the disappointments.
102:49
You don't want to simulate all that in advance.
102:51
You don't want to know that.
102:52
You don't you don't you want to go into a new experience thinking it's
102:55
going to be perfect.
102:56
It's going to be great.
102:57
It's going to be incredibly fun.
102:59
And then while you're there,
103:01
you know, you need to have
103:03
you need to have endurance.
103:04
You need to have grit
103:05
so that when the setbacks
103:07
actually happened and those setbacks are going to surprise you, the disappoints
103:11
disappointments aren't going to surprise you.
103:13
You know, the embarrassments
103:14
are going to surprise you, the humiliations
103:16
are going to surprise you.
103:17
Um you just can't let now you just got to turn on the other
103:20
bit which is just forget about it.
103:22
move on, keep keep moving.
103:24
And and to the extent that
103:27
to the extent that
103:29
my assumptions about the future
103:32
and why the future is going to manifest,
103:36
so long as those assumptions and that
103:40
doesn't change or didn't change materially,
103:43
then I should expect that the output won't change.
103:45
And so my simulated
103:47
output of the future
103:49
is still going to happen.
103:50
And if it's still going to happen,
103:53
I'm still going to go after it.
103:54
I believe it's going to, you know, and so
103:56
there's a combination of two or three human characteristics.
104:01
The ability to go into a into an experience fresh-minded,
104:05
the ability to forget the setbacks,
104:08
the ability to believe in yourself,
104:11
you know, to believe what you believe and stay
104:14
stay true to that belief.
104:16
Um, but you're constantly re-evaluating. >> Mhm.
104:20
This combination of three, four, five things
104:23
I think is is really important for resilience.
104:27
And and um and you know, I I'm I'm fortunate that that whatever whatever
104:33
life experience has led to this,
104:35
I've got kind of those four or five things.
104:37
You know, I'm always curious, always learning.
104:40
I'm always learning from everybody.
104:42
You know, I'm always asking my and because I'm humble about about about
104:46
everything, I'm always thinking,
104:48
gosh, they did that so nicely.
104:50
They did that so wonderfully.
104:52
You know, I wonder what they're thinking through.
104:55
How do they, you know, so I'm simulating
104:57
everybody in a lot of ways,
104:59
you know, I'm emulating
105:00
almost everybody I watch, right?
105:01
you're you're empathetic towards
105:03
towards everything that they do that that you're observing and respect and
105:07
and so you you're constantly learning and
105:10
you know >> you're now one of the wealthiest
105:13
people on earth, one of the most successful humans on earth.
105:18
Is it harder to be humble
105:19
and to be able to
105:21
do you feel the effect of
105:22
money and power and fame
105:25
in making it harder for you to
105:28
sort of be wrong in your own head
105:32
enough hear out an opinion of somebody else when it disagrees with you and learn from them?
105:38
Those kinds of things. >> Um, surprisingly, no.
105:43
And and I would I would actually go the other way
105:46
because I do so much of my work publicly.
105:50
When I'm wrong, pretty much everybody sees it. >> You get humbled. >> Yeah.
105:55
And and uh and when I'm wrong, when I'm wrong or it didn't turn
105:59
out that way or
106:00
um you know, I mean,
106:03
most of the things that that I say outside
106:06
um I'm fairly certain about.
106:08
And the reason for that is because
106:10
because it's going to impact somebody else and I want to be quite concerned
106:13
about that and quite quite circumspect about that.
106:16
Um for stuff that that I'm reasoning about inside a meeting,
106:20
you know, a lot of things
106:22
could turn out differently.
106:23
And so, but it doesn't ever stop me from reasoning.
106:26
The way that that the way that I manage and lead,
106:29
I you know, I'm constantly
106:31
reasoning in front of people.
106:32
Even when I'm talking to you, you can kind of see me kind of
106:34
reasoning through >> And I want to make sure that you understand what I'm saying,
106:37
not because I told you,
106:40
>> because I'm so humble about what I'm about to tell you.
106:43
>> I kind of show you the steps that I got
106:46
>> And then you could decide whether you believe what I said in the end.
106:48
And so I'm doing that all day long in meetings
106:52
with all of my employees.
106:53
I'm constantly reasoning through.
106:54
Let me tell you, let me tell you what how I see it.
106:56
And I reason through it.
106:58
It gives everybody the opportunity
107:00
to intercept and say, "I disagree with that part."
107:04
>> The nice thing about reasoning through things and letting and letting people
107:07
interact with it is that they don't have to disagree with your outcome.
107:12
They can disagree with your reasoning steps
107:15
and they could pull me in different directions
107:17
and then we can reason forward.
107:19
And so we're we're kind of,
107:22
you know, collective patharching
107:26
method and it's really >> Yeah.
107:29
You have this way about you of when you're explaining stuff, I can feel
107:34
you actually reasoning on the spot
107:37
about it with a constant open-mindedness
107:40
where you could I I could feel like I could steer your thinking. Yeah.
107:44
And that's a that's really beautiful that you've been able to maintain that after
107:47
so many years of success and pain.
107:50
I think sometimes pain makes you
107:52
close you down a bit.
107:56
>> And I I think to maintain
107:57
>> tolerance for embarrassment I think is
108:00
>> that's that's the tolerance.
108:01
I mean that's a real thing. >> Yeah.
108:03
There's many years of embarrassing yourself.
108:06
Even those meetings knowing that there's people around you where you declared
108:10
one idea and it was shown that that idea was wrong and be able
108:13
to admit that and to grow from that.
108:15
That's not that's very difficult on a human level. >> Yeah.
108:18
Well, you know, they knew I was they knew that recently my first job
108:22
was was, you know, cleaning toilets.
108:24
So, >> I'm glad you maintain that same spirit of Denny's
108:28
um the the work.
108:30
I mean, that that was beautiful.
108:31
your whole journey from starting from Denny's is a beautiful one.
108:34
Uh let me ask you about video games.
108:38
So I'm a big gaming fan.
108:41
>> So I have to say thank you to Nvidia
108:43
for many years of incredible graphics.
108:47
>> by the way it it is GeForce
108:49
is our still to this day.
108:51
>> Our number one marketing strategy. Right.
108:55
People learn about Nvidia while they're in their teenage years. >> Mhm.
108:59
And then they go to college and they know who Nvidia is and they
109:02
and then in the beginning it's just you know playing Call of Duty you
109:06
know you know Fortnite and then later they're using CUDA and then later
109:09
they're using Nvidia and you know
109:12
Blender and Do and Auto.
109:16
>> I mean I should say I I mentioned to a friend that I'm
109:19
uh talking with you.
109:21
He said oh they make great gaming GPUs. >> Yeah. Exactly. Exactly.
109:27
you know, there's there's more to it, but but yeah.
109:30
Yeah, people really love the it really brought a lot of joy to a lot of people.
109:34
The the the hardware really brings these worlds to life.
109:38
>> Uh there was some controversy
109:40
around this uh with DLSS 5. Yeah.
109:44
>> Can you explain to me the drama around this?
109:46
Uh I guess people
109:49
gamers online were concerned that it
109:51
makes games look like AI slop.
109:54
>> Uh what do you think of this drama?
109:56
Yeah, I think their their perspective
109:59
makes sense and I could see where they're coming from
110:03
because I don't love AI slob myself.
110:05
You know, all of the the AI generated
110:08
content increasingly um looks similar
110:12
and they're all beautiful
110:14
and and I can so I can I'm empathetic towards what they're what they're thinking.
110:18
Um that's just not what DLSS
110:20
5 is trying to do.
110:21
I showed several examples of it,
110:24
but DLSS5 is 3D conditioned, 3D guided.
110:30
It's ground truth structure data guided.
110:33
And so, so the artist determine the geometry.
110:36
We are completely truthful
110:39
to the geometry maintain so in every single frame.
110:43
Um it's uh conditioned by the textures,
110:46
the artistry of the artist.
110:49
And so every single frame
110:51
it enhances but it doesn't change anything.
110:55
Now the question is
110:56
the question about DLSS5
111:00
also lets because it's
111:02
the system is open
111:03
you could train your own models to determine
111:06
and you could even in the future prompt it
111:09
you know I want it to be a toune shader.
111:11
I want it to look like this kind of, you know, so you can
111:13
give it even an example
111:15
and it would generate in the style of that
111:19
all consistent with the artistry,
111:22
you know, the style,
111:23
the intent of the artist.
111:25
And so all of that
111:27
is done for the artist
111:30
so that they can create something that is more beautiful
111:34
um but still in the style that they want.
111:37
I think that they got the impression
111:40
that the the games are going to come out the way the games are
111:44
shipped the way they do
111:46
and then we're going to post-process it.
111:48
That's not what DLSS
111:49
is intended to do.
111:50
DLSS is integrated with the artist.
111:54
And so it's it's about
111:55
giving the artist the tool of AI,
111:58
the tool of generative AI.
111:59
They could decide not to use it.
112:00
You know, >> I think people are very sensitive to human faces. >> Yeah.
112:04
And we're now living in this moment, which I think is a is a
112:07
beautiful one, which is
112:09
people are sensitive to AI slop.
112:11
>> It it puts a mirror to ourselves
112:13
to help us realize that what we seek as imperfections,
112:16
what we seek is
112:18
sometimes not perfect graphics,
112:20
it helps us understand
112:21
what we find compelling
112:23
in the worlds we create. >> And that's beautiful.
112:25
And as long as it's tools that help us create those >> Yeah, that's right. >> It's it's wonderful. >> That's right.
112:30
It's yet another tool.
112:31
and they want the generative
112:33
uh models to generate
112:36
the opposite of photoreal. >> Yeah.
112:39
It'll do that too.
112:40
And so it's just yet another tool.
112:42
I think the um
112:43
the gamers might might also appreciate
112:46
that that um in the last couple years
112:50
we we introduced uh skin shaders
112:55
to the game developers
112:57
and many of those games have skin shaders that include
113:00
subs subsurface scattering that make skin look more skin-like.
113:05
And so the industry's
113:08
game developers are looking for more and more and more tools
113:11
to express their art.
113:13
And so this is just yet more one more tool they could decide what to use. >> Ridiculous question.
113:17
Uh what do you think is the greatest
113:19
or most influential game ever made?
113:22
Maybe from Nvidia's perspective. >> Doom. Unquestionably.
113:26
That was the start of the 3D.
113:28
I would say Doom from a from a
113:30
the intersection of the cultural implication
113:33
as well as the industry
113:35
turning a PC into a gaming device.
113:38
That was a very important moment.
113:40
Now, of course, flight simulation companies were before it
113:44
>> and um but they just didn't have the popularity that Doom did to have
113:47
made the industry turned the PC from a
113:51
office automation tool into a
113:54
personal computer for families and gamers and things like that.
113:57
And so Doom was really impactful there.
113:58
From a from an actual game technology
114:01
perspective, I would say Virtual Fighter.
114:03
And so we we're great friends with both of them, you know.
114:07
And then there's games more recently.
114:09
I mean, Cyberpunk 2077,
114:12
really nice GPU, accelerated
114:15
graphics, like fully ray >> fully ray traced.
114:19
Um, also I like I personally I'm a huge fan of Skyrim,
114:22
uh, Elder Scrolls and the,
114:25
you know, it's been released a long long time ago, but people release mods
114:28
and they I mean it it's like a different game and it just allows
114:34
me to replay the game over and over and it get
114:37
it makes you realize
114:39
you can reexperience in a totally new way
114:42
the world you already
114:44
>> So I I do that all the time.
114:46
One of my favorite games just walk around Skyrim.
114:48
We created this thing called RTX Mod. >> Yeah.
114:51
It's a modding tool.
114:53
>> And allows it allows
114:54
the community to inject
114:56
the latest technology into an old
115:00
>> Of course, like what makes a great video game is not just graphics.
115:03
It's also story and character development. But that's right.
115:06
Beautiful graphics can add to the
115:09
the immersion, the the feeling like it's another place you're transported to.
115:16
uh what's uh you said
115:18
I think accurately that the AGI
115:19
timeline question rests on your definition of
115:26
So let let's let me ask you about a possible timelines here.
115:31
Let's this ridiculous definition perhaps
115:33
of what AGI is but
115:36
a an AI system that's able
115:38
to essentially do your job.
115:41
So run, no grow
115:47
and run a successful
115:49
technology company that's worth >> a good one or A1.
115:54
>> No, it has to it has to be worth more than a billion
115:58
more more than a billion dollars.
116:01
So you know, you know how hard it is to do all those components.
116:06
So how far are we away from that?
116:10
So we're talking about open claw
116:13
that does all the incredibly
116:15
complex stuff that are required to
116:18
to first of all innovate
116:20
to find customers to sell to them to to manage to build a team
116:25
of some agents some humans
116:27
all that kind of stuff.
116:28
Is this 5 10 15 20 years away?
116:31
>> I think it's now I think we've achieved
116:34
>> You think you can have a company run by an AI system like this? >> Possible.
116:38
And the reason for that is this.
116:39
You said a billion
116:40
and you didn't say forever
116:42
and and so for example
116:45
uh it is not out of the question
116:48
that uh a claw was able to create a
116:53
web service some interesting
116:56
little app that all of a sudden
117:01
you know a few billion people used
117:04
for 50 and then
117:07
it went out of business again shortly after.
117:09
Now, we saw a whole bunch of those type of companies during the internet
117:12
era and most of the those websites
117:15
were not anything more sophisticated
117:18
than what Open Claw could generate today. >> Interesting.
117:21
Achieve virality and monetize that virality. >> Yeah.
117:24
It's just that I don't know what it is,
117:26
but I I couldn't have predicted any of those companies at the time either.
117:29
You know, >> you're going to get a lot of people excited with that statement. >> Yeah.
117:33
It's like, what do you mean?
117:34
I can I can just uh launch an agent and
117:37
u make a lot of money?
117:38
Well, by the way, it's happening right now, right?
117:40
You know that when when you go to China,
117:42
uh you're going to see you're going to see um a whole bunch of
117:45
people uh teaching their getting their claws to try to go out and look
117:49
for jobs and, you know,
117:51
do work, make money.
117:53
And and I'm not I'm not actually I wouldn't be surprised if some social
117:57
thing happened or somebody created a a digital
118:01
influencer, super super cute.
118:04
um or some social application
118:06
that you know feeds your little tomagotchi
118:09
or something like that and and it become an
118:12
out of the blue an instant success.
118:15
A lot of people use it for a couple of months and it kind of dies away.
118:18
Now the odds of of of
118:22
you know 100,000 of those agents
118:25
um building Nvidia 0%.
118:28
And and then and then the the one part that I will I will
118:31
do um and I and I I want to make sure we all do
118:35
is to recognize that people are really worried about their jobs
118:40
and and um I just want to remind them
118:43
that the purpose of your job
118:47
and the tasks and the tools
118:49
that you use to do your job
118:51
are related, not the same.
118:53
I've been doing my job for 33 years.
118:55
I'm the longest running tech CEO in the world.
118:57
34 years and the tools that I've used to do my job has changed
119:03
continuously in the last 34 years and sometimes quite dramatically
119:08
you know over the course of a couple two three years
119:11
and and the the the one story that I I I really want to
119:14
make sure that everybody hears
119:16
is the story the the
119:18
first job that every that computer scientists said
119:21
AI researchers said was going to go away was radiology
119:25
because computer vision was going to achieve superhuman
119:28
levels and it did.
119:30
CV computer vision was superhuman
119:33
in 2019 20 maybe
119:36
maybe a little bit later 2020. >> Okay.
119:39
And so it's been a long time since computer vision has been superhuman.
119:42
And so the prediction was radiologists
119:45
would go away because
119:46
studying radiology scans was
119:49
thing of the past.
119:50
AI will do that.
119:50
Well, they were absolutely right.
119:54
Computer vision is completely superhuman.
119:57
Every radiology platform and package
119:59
today is driven by AI.
120:02
And yet the number of radiologists grew.
120:06
And so the question is why?
120:07
And we now have a shortage of radiologists in the world.
120:11
And so one the alarmist
120:15
warning went too far and has scared people
120:18
from doing this profession that is so important to society.
120:23
And so it did harm.
120:25
Now why was it wrong?
120:26
The reason why is because
120:29
the purpose of a radiologist,
120:30
the purpose is to diagnose disease
120:33
and help patients and doctors diagnose disease.
120:38
And because we're able to study scans
120:40
so much faster now,
120:42
you could study more scans.
120:44
You could diagnose better.
120:46
You could you could um impatient faster.
120:50
We can see people more.
120:52
the hospitals are making more money.
120:54
You have more patients in the hospital.
120:55
You need more radiologists.
120:57
I mean the the amazing thing is
121:00
it's so obvious this was going to happen.
121:03
The number of software engineers at NVIDIA is going to grow, not decline.
121:08
And the reason for that is because the purpose of a software engineer
121:12
and the task of a software engineer for coding are related, not the same.
121:16
I wanted my software engineers to solve problems.
121:18
I didn't care how many lines of code they
121:22
You know, but their job,
121:23
their purpose of their job didn't change.
121:25
Solving problems, working as a team, diagnosing
121:28
problems, evaluating the result,
121:32
looking for new problems to solve innovation,
121:35
connecting dots, you know, none of that stuff is going to go away.
121:39
>> So, you think it's possible that
121:41
let's even take coding, you think the number of programmers
121:43
in the world might increase, not decrease?
121:47
>> And the reason for that is this.
121:49
What is the definition of coding?
121:52
I believe that is the definition coding as of today
121:55
is simply specifying specification
121:59
and maybe if you want to be rather
122:02
directive you could even give it an architecture
122:05
of the software that you're you wanted to write.
122:08
So the question is how many people could do that?
122:11
Describe a specification for
122:12
a computer to go
122:14
telling the computer what to go build. How many people?
122:17
I think we just went from 30 million
122:19
to probably 1 And so
122:23
every every carpenter in the future
122:26
will be a coder.
122:27
Except a carpenter with AI
122:30
is also an architect.
122:33
They just increased the value that they could deliver to the customer.
122:36
Their artistry just elevated tremendously.
122:43
I believe that every
122:44
accountant is, you know, also your financial analyst,
122:47
also your financial adviser.
122:49
So all of these professions
122:51
have just been elevated
122:53
and if I were a carpenter,
122:54
I sees a I see AI, I would just completely go berserk.
122:58
You know, the services I can bring to my clients, if I were a
123:02
plumber, completely go berserk.
123:04
and the the people that are currently
123:06
programmers and software engineers, I think they're at the cutting edge
123:10
of understanding intuitively how
123:13
to communicate with the agents
123:16
using natural language in order to design
123:19
the best kind of >> That's right.
123:20
So over time they'll converge but I think uh
123:24
there's still value in getting I think
123:27
uh learning how to program
123:28
like learning what programming languages
123:30
are uh the old the old kind of programming
123:34
uh what what are good practices for programming languages what are design principles for
123:39
programming languages for large software
123:43
>> and and the reason for that
123:45
lex and you know I just say for the audience I think
123:49
the goal of the goal of specification,
123:52
the artistry of specification,
123:54
the goal and the artistry of it
123:56
um is going to depend on
123:59
what problem you're trying to solve.
124:01
when I'm thinking when I'm thinking about giving the company strategies
124:04
and um formulating corporate directions and things that we should do
124:10
um I describe it at a level
124:13
that is specific that people
124:18
generally understand the direction
124:20
and it's actionable they it's so specific enough that they can take action on
124:25
it but I underspecify
124:27
it on purpose so that enable
124:30
43 3,000 amazing people
124:33
to make it even better than I imagined.
124:36
And so when I'm working with engineers,
124:39
when I'm working with people,
124:41
um, I think about
124:42
who what problem am I trying to solve?
124:45
Who am I working with?
124:47
And the level of
124:50
specification, the level of architecture
124:52
definition relates to that.
124:56
And and so everybody's
124:59
going to have to learn how
125:01
where in the spectrum of coding they want to be.
125:03
Writing a specification is coding.
125:06
And so you might decide to be
125:08
quite prescriptive because there's a very specific outcome you're looking for.
125:12
You might decide that
125:14
you know this is an area you want to be much more exploratory.
125:17
And so you might underspecify
125:19
and enable you to go back and forth with the AI
125:22
to even push your own boundaries of creativity.
125:25
And so this artistry
125:27
of where you are in the spectrum,
125:28
this is the future of coding.
125:31
>> But just to linger on it, outside of coding, I think a lot of
125:34
people rightfully so uh are worried about their jobs, have a lot of anxiety
125:39
about their jobs, especially in the white collar sector.
125:43
Um I don't think any of us know
125:47
what to do uh with tumultuous
125:51
times that always come when automations
125:53
and new technology arrives.
125:55
And I just first of all I think um
126:01
we all need to have compassion
126:02
and the responsibility to feel sort of the burden
126:06
of what the actual suffering feels like for individual people and families that lose their job.
126:11
I think whenever you have
126:12
transformative technology like that's coming with with artificial intelligence,
126:16
there's going to be a lot of pain
126:18
and I don't know what to do about that uh pain.
126:21
Hopefully, it creates much more opportunities for those same people
126:25
uh for the same kind of job as
126:29
uh the tooling evolves
126:31
and makes them more productive
126:33
and makes it more fun hopefully as it does in the programming.
126:36
I've I haven't I've been having so much fun programming, I have to say.
126:38
like I've never had this much fun.
126:40
So hopefully it makes their job
126:42
automates the boring parts and makes
126:44
the creative parts uh the ones that the the human beings are responsible for.
126:49
But still there's going to be a lot of pain and suffering.
126:52
So my first recommendation
126:53
before and this is now how I deal with anxiety.
126:56
In fact, we just talked about it earlier.
126:59
>> Enormous anxiety about the future, enormous anxiety about the pressure, enormous anxiety about uncertainty.
127:05
I first break it down
127:07
and then I'm going to tell myself,
127:10
okay, there are some things you can do something about.
127:13
There are some things you can't do anything about,
127:15
but for the stuff that you can do something about, let's reason reason about
127:18
it and let's go do it.
127:20
>> If we were to hire a new college graduate today
127:23
and I have a choice between two,
127:26
one that have that is no clue
127:29
what AI is and one that is expert in using AI.
127:34
I would hire the one who's expert in using AI.
127:38
If I had an accountant,
127:39
a marketing person, the one that is expert in using AI,
127:44
supply chain, customer service,
127:47
a salesperson, business development,
127:50
a lawyer, I would hire the one who is expert in using AI.
127:55
And so I would I would advise that every college student,
127:59
every every teacher should encourage their student to to go use AI.
128:04
Every college student should graduate and be an expert in AI.
128:08
And every everybody, if you're a carpenter,
128:11
if you're, you know, electrician, go use AI.
128:15
Go see what it can do
128:17
to transform your current job. Elevate yourself.
128:21
If I were a farmer, I would absolutely use AI.
128:24
If I were a pharmacist,
128:25
pharmacist, I would use AI.
128:27
I want to see how what it could do to elevate my job
128:30
so that I could be the I could be the innovator
128:33
to revolutionize this industry myself.
128:36
>> And so that that would be the first thing that I would do.
128:38
And and then I would also
128:40
I would also help them.
128:42
Um it is the case that the technology
128:46
will dislocate and will eliminate many tasks.
128:52
If and because it will automate it.
128:54
If your job is the task
128:57
if your job is the task
128:58
then you're very highly
129:00
going to be If your
129:04
job's purpose includes you certain tasks. Mhm.
129:08
>> Then it it's vital that you go learn how to use AI to automate those tasks.
129:12
And then there's the world of spectrum in
129:14
>> And by the way, the beautiful thing about
129:17
AI, so the the the
129:19
chatbot is you can break down
129:23
you have anxiety and you can break down the problem by talking to it.
129:28
Like I've I've recently
129:29
it's really just incredible
129:31
how much you can think through your life's problems
129:33
and through and I don't mean like therapy problems.
129:35
I mean like very practically,
129:38
okay, I'm worried about my literally I'm worried about my job.
129:40
What are the skills?
129:41
What are the steps I need to take?
129:42
How do I get better at AI?
129:44
Everything you just said, you can literally ask and it's going to give you
129:47
a point by point.
129:49
I mean, it's just a great life coach. Period.
129:51
This >> I don't know how to use AI.
129:53
And the AI goes, well, let me show you. >> Exactly.
129:55
It's very meta, but
129:57
>> it's kind of incredible.
129:59
So, people definitely should.
130:00
>> You can't walk up to Excel and say, I don't know how to use Excel. You're done.
130:03
I mean that's really what AI has done for me in all walks of
130:06
life is that initial friction
130:09
of being a beginner of using a thing for the first time.
130:11
I can literally ask about any single thing.
130:14
>> What are the first steps I need to take? >> That's right.
130:17
>> And and that that handholding
130:18
that it does removing the friction
130:21
of uh all the experiences that the world offers
130:24
is you know like like I mentioned to you offline you mentioned
130:27
I'm I'm going to China and Taiwan. >> So awesome. for you.
130:32
Where do I go?
130:33
What where do I go?
130:34
How do I all those questions immediately
130:36
answered and it's beautiful?
130:37
>> Well, when you when you go to Taiwan,
130:39
just ask AI, what are Jensen's
130:42
favorite restaurants in Taiwan?
130:44
>> And it'll actually Oh, yeah. Yeah. >> Is it accurate? Okay. >> Yeah. Yeah. All right.
130:47
>> It's all over all over Taiwan.
130:50
>> Well, you're you're a rock star over there and um and like we also
130:53
mentioned offline, maybe our paths will cross,
130:56
which would be really wonderful in Computex GTC Taiwan.
131:01
Uh do you think there are some things about
131:05
human nature about human
131:08
that is fundamentally non-computational
131:12
maybe something a chip
131:14
no matter how powerful
131:16
uh can never replicate?
131:17
I don't know if the chip will ever get nervous
131:20
and that's the you know of course
131:22
the conditions by which
131:24
uh that causes anxiety or nervousness
131:27
or whatever emotion um
131:31
I believe that AI
131:33
will be able to recognize
131:35
those and understand those.
131:38
I don't think my chips will feel those
131:41
and therefore the how how that anxiety, how that feeling, how that excitement,
131:46
how that how that
131:48
you know all of those feelings manifest
131:52
in human performance for example
131:55
extremely amazing human performance, athletic
131:57
performance, you know, average or lesser than average.
132:01
um that that entire
132:02
spectrum of human performance
132:04
that comes out of
132:06
exactly the same circumstances
132:08
for different people manifesting
132:11
in different outcome manifesting in different performance.
132:15
I I don't think
132:17
there's anything about anything that we're building that would suggest
132:22
that two different computers
132:24
being presented with all of exactly the same context
132:28
would per of course it would produce
132:30
statistically different outcomes but it's not because it felt >> Yeah.
132:34
The subjective boy there's something truly special about the subjective experience
132:41
that we humans feel.
132:42
Like I mentioned to you, I was
132:45
I was I was pretty nervous talking to you like I mentioned to you
132:48
that the hope the fear
132:50
the anxiety and just life itself
132:52
the richness of life
132:54
how amazing everything is how deeply we fall in love how
132:57
deeply our hearts get broken
132:59
how afraid we are of death and how
133:02
much pain we feel when our loved ones
133:04
pass away all of that the whole thing
133:07
I don't it's very hard to
133:09
think AI being able to
133:11
a computational device being able to do that but there's so many mysteries about
133:15
this whole thing that we're yet to uncover
133:18
that I am open to be surprised.
133:21
>> I've been surprised a lot over the past
133:23
>> few months and few years.
133:25
Scaling can create some incredible
133:27
miracles in the space of intelligence
133:31
>> has been truly marvelous to watch.
133:32
So I'm open to surprise
133:34
>> and and it's just really important to
133:36
to break down what is intelligence
133:38
and the word that word
133:40
we use all the time.
133:41
It's not a mysterious word.
133:43
Intelligence has a meaning,
133:45
you know, >> and it's a system that,
133:48
you know, it's it it's something that we do
133:51
that in includes perception
133:53
and understanding and reasoning and the ability to do plan and
133:56
you know that that loop
133:58
that loop is is
134:00
um the fundamentally what intelligence is.
134:04
Intelligence is not one word
134:06
that is exactly equal to humanity.
134:11
And that's I think it's really important to separate the two.
134:13
We have two words for that.
134:16
I'm not I don't over
134:18
fantasize about and I don't over romanticize about intelligence.
134:23
Intelligence is and people have heard me say it before.
134:26
I actually think intelligence is a commodity.
134:29
I'm surrounded by intelligent people.
134:33
And I'm surrounded by intelligent people more intelligent than I am in each one
134:36
of the spaces that they're in.
134:39
And yet I have a role in that circle.
134:42
It's actually kind of interesting.
134:45
They're more educated than I am.
134:49
They went to better schools than I did.
134:51
They're deeper than in any in this field that they're in. All of them.
134:55
I have 60 of them.
134:57
They're all superhuman to me.
134:59
>> And somehow I'm sitting in the middle
135:01
orchestrating all 60 of them.
135:03
And so you got to ask yourself,
135:05
what is what is it
135:07
about a dishwasher that allows that dishwasher
135:11
to sit in the middle of superhumans?
135:13
Does that make sense?
135:15
>> And so, but that's my point.
135:17
My point is intelligence
135:19
is a is a functional thing.
135:22
Humanity is not a not specified
135:26
It's a much much bigger word.
135:29
and and our life experience,
135:31
our tolerance for pain,
135:34
our determination, those are those are different words in intelligence.
135:39
And so the the thing that I I want to help the audience understand,
135:43
if I could give them one thing is is
135:46
intelligence is a word that we've elevated
135:48
to very high form over time.
135:50
the the word we should really elevate is humanity,
135:54
character, humanity, all of those things,
135:57
compassion, generosity, all of the things that you say
136:02
just now, >> I believe those are superhuman
136:05
powers and that now intelligence
136:07
is going to be commoditized
136:09
because we've spoken about it.
136:10
The most important thing is your education.
136:13
The most now even even when they said the most important thing is your education.
136:17
when you went to school,
136:18
there's more than just
136:20
knowledge that you gained.
136:22
>> And so, but unfortunately,
136:24
our society had put everything
136:26
into one single word.
136:28
And life is more than one word.
136:30
And I'm just telling you, my life would suggest
136:34
that being lower on the intelligence
136:38
curve than everybody around me
136:41
doesn't change the fact I'm the most successful.
136:43
And so and and I think I think that that kind of is I'm
136:47
trying hopefully to inspire everybody else that don't let this de
136:51
democratization of intelligence, this commoditization
136:54
of intelligence, you know, cause you anxiety.
136:59
You should be inspired by that. >> Yeah.
137:00
I I I think uh AI will help us celebrate humans more.
137:04
And I'm certainly humanity and human first.
137:10
And I I think what makes this world incredible is humans forever will be so.
137:15
And just AI is this incredible tool that makes us >> That's exactly right. >> Humans more powerful. >> That's exactly right.
137:21
>> Uh so much of the success of Nvidia
137:25
and um the lives of millions of people that I mentioned
137:28
uh depend on you.
137:31
Uh but you're just one human
137:33
like we mentioned u mortal like all of us.
137:36
Do you think about your mortality?
137:38
Are you afraid of death?
137:42
>> I really don't want to die.
137:44
Um, I have a great life.
137:46
I have a great family.
137:48
I have really important work.
137:54
this is this is not a once in a
137:58
once in a lifetime
138:00
experience suggests that it has been experienced
138:03
by many people just not one person.
138:06
Uh this is a once in a humanity experience
138:10
what I'm going through.
138:11
Uh Nvidia is one of the most consequential
138:13
technology companies in history.
138:15
We're doing very important work.
138:16
I take it very seriously.
138:20
and and so some of the some of the things that that of course
138:23
are are practical things
138:26
like how do we think about
138:27
succession planning and and
138:30
um I I'm famous in saying that I don't believe in succession
138:34
planning and and the reason the reason for that the reason for that isn't because I'm immortal.
138:41
Um the reason for that is because
138:43
if you're worried about
138:46
succession planning, if you're worried all that anxiety of succession planning, then what should
138:51
you do about it?
138:51
Then you break it all the way back down.
138:54
The most important thing you should do today
138:56
if you care about the future of your company
138:58
post you is to
139:00
pass on knowledge, information,
139:03
insight, skills, experience as often and continuously as you can.
139:08
which is the reason why I continuously
139:10
reason about everything in front of my team.
139:13
Every single meeting is about a reasoning meeting.
139:16
Every moment I spend inside a company, outside the company
139:20
is about passing on knowledge to people as fast as I can.
139:23
Nothing I learn ever sits
139:25
on my desk longer than, you know, a fraction of a second.
139:29
I'm passing that information, that know.
139:31
Oh my gosh, this is cool.
139:33
Before I even finish learning all of it myself,
139:36
I've already pointing it to somebody else. get on this.
139:38
This is so cool.
139:39
You're going to want to you're going to want to learn this.
139:41
And so I'm constantly
139:43
passing knowledge, empowering people,
139:46
elevating the capability of everybody around me so that
139:51
um the outcome that I that I seek
139:55
that I hope for
139:56
is that I die on the job,
139:58
you know, and and
139:59
hopefully I die on the job instantaneously.
140:01
You and there's no long periods of suffering, you know.
140:06
Well, from a fan perspective,
140:08
given your your uh
140:10
extremely um your enormous
140:15
positive impact on on civilization,
140:17
of course, I hope you keep going,
140:18
but also it's just fun to watch what is doing.
140:21
You're, you know, it's just the rate of innovation
140:24
and I'm a huge fan of engineering.
140:26
It's so much incredible
140:28
engineering is continuously being done by Nvidia.
140:30
It's just fun to watch.
140:32
It's a celebration of humanity.
140:33
is a celebration of great builders, a celebration of great engineering.
140:36
So it represents something special.
140:39
Uh so I hope
140:40
uh you and Nvidia keep going.
140:42
What gives you hope
140:44
about this whole thing we got going on about humanity?
140:47
About the future of humanity
140:48
when you look out and you think about the future quite a bit when
140:51
you look out 10, 20, 50, 100 years from now, what gives you hope?
140:56
I I've always had I've always had uh
140:59
uh great confidence in
141:02
in the in the kindness
141:06
uh the generosity um
141:11
the compassion, the human capacity.
141:14
I've always been extremely confident of that.
141:18
sometimes um more so than I should
141:25
and and I I get taken advantage of.
141:27
But it doesn't it doesn't ever
141:29
cause me not to.
141:31
I start with always
141:34
uh that that people want want to do good.
141:36
People want to um
141:40
uh help others uh
141:44
vastly I am proven right,
141:48
constantly proven right and and often
141:53
uh exceeds my expectations
141:56
and and so I have complete confidence in the human capacity.
142:01
I think the the the
142:03
thing that the things that give me
142:05
incredible hope is what I see
142:09
as as I extrapolate
142:11
as I what I see now is
142:13
possible and as I
142:16
um based on the things that we're doing
142:18
what will very likely happen
142:22
>> and and um and that there's so many things that we want to solve
142:27
there's so many problems we want to solve there's so any
142:31
things that we want to build.
142:32
There's so many good things that we want to do
142:35
that are now within our reach
142:37
and within the reach of my my lifetime.
142:40
You just can't possibly
142:43
not be romantic about that.
142:45
You know what I'm saying? >> Yeah.
142:46
What an exciting time to be alive. >> Like truly truly.
142:50
So >> how can you not be romantic
142:51
about about about that?
142:53
the the the fact that that
142:56
there is a there
142:58
it's a reasonable thing to expect
143:00
the end of disease.
143:02
It's a reasonable thing to expect.
143:04
It's a reasonable thing to expect
143:06
that pollution will be drastically reduced.
143:09
It's a reasonable thing to expect
143:12
that traveling at the speed of light
143:15
is actually in our future.
143:17
And then you know
143:18
not not for long distances but short distances
143:21
you know you people ask me how you well first of all
143:24
very soon I'm going to put a humanoid
143:26
on a spaceship and it's going to be you know my humanoid
143:29
and and we're going to send it out as soon you know as soon
143:32
as possible and it's going to keep improving and enhancing
143:35
along the flight >> and then when it's time
143:39
all of the all of my consciousness has already been you know
143:42
so much of my life has been uploaded in the internet
143:45
take all my inbox take everything that I've done, everything I've said,
143:48
you know, it's been collect and be becoming my AI
143:51
and um I'm just, you know, when the time comes,
143:54
you know, we just send that at the speed of light, catch up with
143:56
my Oh, that's brilliant.
144:01
I mean, but for me, that's sort of application
144:03
focused, but also for me the curiosity
144:07
uh maxing perspective, I just all of those mysteries.
144:11
It's so much fascinating scientific questions there.
144:14
Understanding the biological machine is is right around the corner.
144:18
It's it's not 10 years.
144:19
It's 5 years probably.
144:20
>> And then your biological
144:21
machine, the the human mind and cracking physics, theoretical physics open.
144:25
It's so >> Explaining consciousness,
144:27
that one would be awesome
144:29
>> and it's all within our reach.
144:31
>> Uh Jensen, thank you so much for everything you've done over the years.
144:34
Thank you for everything you're doing for the world.
144:36
Thank you for being who you are.
144:38
Uh, I can tell
144:39
you're a great human being
144:41
and uh, I wish you
144:44
incredible success this year.
144:45
I can't wait as a fan.
144:47
I can't wait to see what you do next and hopefully I'll see you in Taiwan.
144:50
And thank you so much for talking today. >> Thank you, Lex.
144:53
I had a great time
144:54
and and also if I could just say one more
144:56
>> and thank you for all the interviews that you do,
145:00
the depth, the the respect
145:02
that you go through with and the research that you do
145:06
uh to reveal, you know, for all of us,
145:09
uh the the amazing people that you've interviewed over the years.
145:13
I've enjoyed I I've enjoyed them immensely
145:15
and and and as an innovator
145:17
to have created this
145:19
long form unbelievable and and yet you know it's just captivating.
145:24
So anyways, thank you for everything you do.
145:26
>> It means the world. Thank you, Jess. >> Thank you, Lex.
145:29
Thank you for listening to this conversation with Jensen Kuang.
145:32
To support this podcast,
145:33
please check out our sponsors in the description
145:36
where you can also find links to contact me, ask
145:39
questions, give feedback, and so on.
145:42
And now let me leave you with some words from Alan K.
145:46
The best way to predict the future
145:49
is to invent it.
145:51
Thank you for listening
145:52
and hope to see you next time.
Like
Share
Lex Fridman
View all →
C1
Interviews
3:17:34
Narendra Modi: Prime Minister of India - Power, Democracy, War & Peace | Lex Fridman Podcast #460
Lex Fridman
7
C1
Interviews
Karaoke
4:34:10
Pavel Durov: Telegram, Freedom, Censorship, Money, Power & Human Nature | Lex Fridman Podcast #482
Lex Fridman
4
C1
Interviews
Karaoke
5:06:18
DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters | Lex Fridman Podcast #459
Lex Fridman
6
C1
Interviews
Karaoke
5:20:08
ThePrimeagen: Programming, AI, ADHD, Productivity, Addiction, and God | Lex Fridman Podcast #461
Lex Fridman
1
C1
Interviews
Karaoke
3:14:34
Terence Tao: Hardest Problems in Mathematics, Physics & the Future of AI | Lex Fridman Podcast #472
Lex Fridman
1
C1
Interviews
Karaoke
3:24:36
James Holland: World War II, Hitler, Churchill, Stalin & Biggest Battles | Lex Fridman Podcast #470
Lex Fridman
C1
Interviews
Karaoke
2:45:26
Dan Houser: GTA, Red Dead Redemption, Rockstar, Absurd & Future of Gaming | Lex Fridman Podcast #484
Lex Fridman
C1
Interviews
Karaoke
2:05:13
Deciphering Secrets of Ancient Civilizations, Noah's Ark, and Flood Myths | Lex Fridman Podcast #487
Lex Fridman
Suggested videos
C1
Interviews
3:17:34
Narendra Modi: Prime Minister of India - Power, Democracy, War & Peace | Lex Fridman Podcast #460
Lex Fridman
7
C1
Interviews
Karaoke
4:34:10
Pavel Durov: Telegram, Freedom, Censorship, Money, Power & Human Nature | Lex Fridman Podcast #482
Lex Fridman
4
C1
Interviews
Karaoke
5:06:18
DeepSeek, China, OpenAI, NVIDIA, xAI, TSMC, Stargate, and AI Megaclusters | Lex Fridman Podcast #459
Lex Fridman
6
C1
Interviews
Karaoke
5:20:08
ThePrimeagen: Programming, AI, ADHD, Productivity, Addiction, and God | Lex Fridman Podcast #461
Lex Fridman
1
C1
Interviews
Karaoke
3:14:34
Terence Tao: Hardest Problems in Mathematics, Physics & the Future of AI | Lex Fridman Podcast #472
Lex Fridman
1
C1
Interviews
Karaoke
3:24:36
James Holland: World War II, Hitler, Churchill, Stalin & Biggest Battles | Lex Fridman Podcast #470
Lex Fridman
C1
Interviews
Karaoke
2:45:26
Dan Houser: GTA, Red Dead Redemption, Rockstar, Absurd & Future of Gaming | Lex Fridman Podcast #484
Lex Fridman
C1
Interviews
Karaoke
2:05:13
Deciphering Secrets of Ancient Civilizations, Noah's Ark, and Flood Myths | Lex Fridman Podcast #487
Lex Fridman