Home Lex Fridman Episode
Lex Fridman · 2021-02-18

Jim Keller: The Future of Computing, AI, Life, and Consciousness | Lex Fridman Podcast #162

Legendary chip architect Jim Keller on graph-native AI hardware, Moore's law, consciousness, dreams, and the human side of engineering.

Jim Keller: The Future of Computing, AI, Life, and Consciousness | Lex Fridman Podcast #162
The guest

Jim Keller: Legendary microprocessor architect behind AMD's Zen, Apple, Tesla and DEC Alpha chips, now CTO of AI-hardware startup Tenstorrent. Widely regarded as one of the greatest engineering minds of the computing age.

What this episode covers

Jim Keller returns to Lex Fridman's podcast to discuss the future of computing, from the craftsmanship behind great processor design to why instruction sets barely matter. He explains Tenstorrent's bet on graph-native hardware built to run neural networks the way they are actually written, versus GPUs that emulate graphs with pixel-shader machinery. The conversation ranges across Moore's law as scaling-by-quantity, autonomous driving and software 2.0, and how brains, consciousness, and dreams might be re-engineered. It closes on intensely human territory: Steve Jobs and Elon Musk's leadership, benzodiazepine withdrawal and Jordan Peterson, love as a functional source of novelty, and advice to avoid groupthink.

Recommended on this episode

MediaRecommended

Software 2.0 (talk)

Andrej Karpathy

“which i think is great”
“andre gave this talk on youtube called software 2.0 which i think is great which is we went from programmed computers”— Jim Keller

The guest's own work

ProductBy the guest

Grayskull processor

Tenstorrent

“i think it's called the grace call processor introduced last year it's you know there's a bunch of measures of performance”— Lex Fridman

Also referenced (named, not recommended)

ProductReferenced

NVIDIA Tesla T4

NVIDIA

“368 trillion operations per second seems to outperform nvidia's tesla t4 system so these are just numbers”— Lex Fridman
ProductReferenced

Oculus

Oculus

“they're gonna have you know like the oculus kind of stuff it's gonna be so good when a projection to your eyes you think it's real”— Jim Keller
MediaReferenced

The Culture series (Iain Banks novels)

Iain Banks

“you know ian banks his stories so the the super smart ais there live mostly live in the world of what they call infinite fun”— Jim Keller
BookReferencedISBN verified

The Hitchhiker's Guide to the Galaxy

Douglas Adams

“when there's a book like a hitchhiker's guide to the galaxy and this is like a one sentence entry”— Lex Fridman

Big reveals from this episode

  • Keller claims x86 is 'arguably the worst architecture on the planet' yet one of the most popular, arguing instruction sets evolve slowly and 'don't matter very much.'
  • Contrarian take: 'the future of computing is inefficiency not efficiency' because scaling across many computers beats per-computer efficiency.
  • Tenstorrent built hardware that natively runs graphs rather than emulating them like GPUs do, the core thesis of the company.
  • Keller predicts AI will not just learn physics but 'understand physics in ways that we can't understand,' a step beyond Wolfram's physics-by-equation.
  • He frames consciousness as a half-second-behind, single-threaded post-hoc narrative running atop a massively parallel brain.
  • Personal revelation: Keller became 'an expert in benzo withdrawal,' detailing the suffering his brother-in-law Jordan Peterson endured.
  • On GameStop/Robinhood, he argues 'we know five percent of what really happened' and the people who made the most money aren't the ones being discussed.
  • Keller reveals he is writing a book about love, framing love as a 'function that generates newness and novelty.'

Worth remembering

  • On JavaScript: doing 'the crappy thing fast' and iterating by listening to developers often beats waiting for perfect.
  • Intel won partly by going open early (licensing x86 to ~seven makers) while rivals like Z80 stayed proprietary to one source.
  • On AMD's Zen, defining all module interfaces before writing RTL let teams test pieces independently and dramatically improved quality.
  • 'A beautiful design can't be bigger than the person doing it', good design matches human cognitive limits to module size.
  • A Tesla chose a tiny computer over a resistor to measure battery current because the computer was cheaper than the resistor.
  • Modern self-driving trains an arbitrarily large network that works, then refactors it down to what fits and is affordable to ship.
  • Keller preps his mind before sleep with problems he wants to solve, then directs and remembers his dreams to work on them.
  • He cites a statistic that roughly one-third of ocean bacteria die every day from viral invasion.
  • On fear of humiliation: 'you're the only person on the planet' who cares about your embarrassment; everyone else forgets it.
  • Love is functional: we habituate to everything except what we love, which keeps it new and makes us notice problems instantly.