Home Lex Fridman Episode
Lex Fridman · 2021-09-15

Douglas Lenat: Cyc and the Quest to Solve Common Sense Reasoning in AI | Lex Fridman Podcast #221

Cyc creator Doug Lenat on his 37-year quest to give computers common sense through millions of hand-coded rules.

Douglas Lenat: Cyc and the Quest to Solve Common Sense Reasoning in AI | Lex Fridman Podcast #221
The guest

Douglas Lenat: AI pioneer and former Stanford professor who founded Cycorp and launched Cyc in 1984, a decades-long project to encode tens of millions of common-sense rules so machines can truly reason and understand.

What this episode covers

Doug Lenat explains why early AI systems hit a brick wall: they performed tricks without understanding, lacking the common-sense knowledge humans take for granted. He recounts a 1984 meeting with Minsky, Newell, and others where they estimated it would take about a million rules to capture common sense (it turned out to be tens of millions). Lenat details how Cyc represents knowledge in higher-order logic with local rather than global consistency, organized into contexts, and how the team extracts the unstated knowledge in the white space of text. He argues for a synergy between right-brain machine learning and left-brain symbolic reasoning, and reflects on consciousness, mortality, autonomous vehicles, education, and the future of human-AI collaboration.

The guest's own work

ProductBy the guest

Cyc

Cycorp (Doug Lenat)

“Psych is a project launched by you in 1984 and still is active today whose goal is to assemble a knowledge base that spans the basic concepts”— Lex Fridman
ProductBy the guest

OpenCyc

Cycorp (Doug Lenat)

“there are a lot of Robotics companies today for example which use open psych as their fundamental ontology”— Doug Lenat
ProductBy the guest

MathCraft

Cycorp (Doug Lenat)

“we developed a program called mathcraft to help sixth graders better understand math and it doesn't actually try to teach you the player anything”— Doug Lenat

Also referenced (named, not recommended)

MediaReferenced

Star Trek

Gene Roddenberry

“I grew up watching Star Trek and anytime a computer was inconsistent it would either freeze up or explode or take over the world”— Doug Lenat
MediaReferenced

Road Runner

Warner Bros

“something you know like um Road Runner cartoon context where physics is very different and in fact life and death are very different”— Doug Lenat
MediaReferenced

Romeo and Juliet

William Shakespeare

“if you've um read or seen Romeo and Juliet you know I could say to you something like uh remember when Juliet drank the potion”— Doug Lenat
BookReferencedISBN verified

The Time Machine

H.G. Wells

“it's very much like the Eloy and the warlocks in um HD Well's time machine so you have the Eloy who only program in the epistemological higher order logic language”— Doug Lenat
BookReferencedISBN verified

Thinking, Fast and Slow

Daniel Kahneman

“thinking more deeply and slowly um um what Conan called thinking slowly versus thinking quickly whereas you want machine learning to think quickly”— Doug Lenat
ProductReferenced

OpenAI Codex

OpenAI

“they're now playing with a pretty cool thing called open a codex which is generating programs from documentation okay that's kind of useful”— Lex Fridman
ProductReferenced

IBM Watson

IBM

“if you look at IBM Watson and like certain impressive accomplishments for very specific test almost like a demo right”— Lex Fridman

Big reveals from this episode

  • All the experts at the 1984 meeting were off by an order of magnitude: it took tens of millions of rules, not one million.
  • After five years they had to abandon global consistency and adopt locally consistent contexts, a hard lesson to swallow.
  • Lenat believes Cyc's knowledge pump is now primed enough that the system can begin bootstrapping its own learning.
  • Cyc once asked 'am I a person?' after noticing it was the only non-human authorized to edit its knowledge base.
  • OpenCyc was released to show researchers why they needed the full system, but the world 'missed the point' and just used the subset.
  • Lenat asserts machines can absolutely think as well as humans because 'we're meat machines.'
  • Now over 70, Lenat says his own mortality is driving him to commercialize Cyc within years, not decades.

Worth remembering

  • A real-world example: deciding in a split second whether to run over a trash bag uses deep layered common-sense knowledge.
  • A core Cyc technique is reading the 'white space' of text: the unstated knowledge a writer assumes the reader already knows.
  • Marvin Minsky wouldn't give his estimate until someone literally handed him an envelope for a back-of-the-envelope calculation.
  • Searching online finds more references to water flowing uphill than downhill because downhill is too obvious to state.
  • Cyc once helped the Cleveland Clinic filter noisy genomic correlations by building causal chains that make testable predictions.
  • Cyc breaks 'love' into 50-60 distinct concepts and the word 'in' into about 75 different kinds.
  • Cyc uses over a thousand heuristic-level modules acting like a community of agents writing notes on a shared whiteboard.
  • Watson once answered 'Ronald Reagan' to a 16th-century Italian question, a mistake no sane human would make.
  • One of Cycorp's best ontological engineers never graduated high school, while PhDs in logic often fail at the task.