Home Lex Fridman Episode
Lex Fridman · 2022-09-21

Rana el Kaliouby: Emotion AI, Social Robots, and Self-Driving Cars | Lex Fridman Podcast #322

Emotion-AI pioneer Rana el Kaliouby on reading human feeling from faces, social robots, in-car sensing, and an empathy crisis.

Rana el Kaliouby: Emotion AI, Social Robots, and Self-Driving Cars | Lex Fridman Podcast #322
The guest

Rana el Kaliouby: Egyptian-American computer scientist who pioneered emotion-recognition AI. Founder of Affectiva (acquired by Smart Eye, where she is now deputy CEO) and author of the memoir Girl Decoded.

What this episode covers

Rana el Kaliouby traces her path from a childhood in Egypt and Kuwait to a PhD at Cambridge and a postdoc at the MIT Media Lab under Rosalind Picard, and the founding of Affectiva. The conversation digs into the science and limits of detecting emotion from the human face, arguing context and multimodal signals matter far more than naive 'smile equals happy' mappings. They explore social robotics, the movie Her, and whether AI companions that can leave us are a feature or a bug. A large segment covers Smart Eye's automotive driver- and interior-sensing work, including drowsiness, distraction, and alcohol detection, and a vision of the car as a wellness center. It closes on startup and investing advice, diversity in AI funding, and reflections on planning, parenting, and love.

Recommended on this episode

ProductRecommended

Day One

Bloom Built

“it's awesome”
“I've been doing journaling for almost 10 years now um I used an app called day one and it's awesome I just journal”— Rana el Kaliouby
MediaRecommended

Her

Spike Jonze

“I love the movie Her”
“The thing I love them I love the movie Her by the way but the thing I love the most about this movie”— Rana el Kaliouby
MediaRecommended

Huberman Lab

Andrew Huberman

“he has an amazing podcast”
“he has an amazing podcast Andrew humor is a neuroscientists from Stanford a good friend of mine”— Lex Fridman
BookRecommendedISBN verified

Why Greatness Cannot Be Planned

Kenneth Stanley

“super inspiring”
“super inspiring talk Kenneth Stanley he was at open AI he just laughed and here's a book called why greatness can't be planned”— Lex Fridman

The guest's own work

BookBy the guestISBN verified

Girl Decoded

Rana el Kaliouby

“founder of effectiva Deputy CEO of Smart Eye author of girl decoded and one of the most brilliant kind inspiring”— Lex Fridman

Also referenced (named, not recommended)

ProductReferenced

Kindle

Amazon

“let go of all my books ah you let go of your books yeah I switched to Kindle everything”— Rana el Kaliouby
MediaReferenced

Space Invaders

Taito

“your first computer was an Atari and Space Invaders was your favorite game uh is that when you first fell in love with computers”— Lex Fridman
ProductReferenced

Atari

Atari

“you've said that your first computer was an Atari and Space Invaders was your favorite game”— Lex Fridman
ProductReferenced

Smile Dating App

Smile Dating App

“smile dating app kind of took one particular angle which is humor it matches People based on their humor Styles”— Rana el Kaliouby

Big reveals from this episode

  • After 9/11 she briefly swapped her hijab for British hats at Cambridge before deciding to go back to the headscarf.
  • Describes taking off the hijab after 12 years amid divorce and political upheaval, calling it harder than putting it on.
  • A two-hour meeting with Rosalind Picard led to a postdoc offer that redirected her life and ended her plan to return to Egypt.
  • Her first NSF autism grant was rejected; Picard's reframe ('build it, show them, reapply') became a lasting lesson.
  • Lex narrates his own real-time anxiety about controlling his facial expressions during the interview.
  • The shutdown of the Jibo robot 'died' and traumatized her son, unlike any other broken gadget.
  • Reveals Smart Eye's CEO proposed acquiring Affectiva after roughly four months of near-daily FaceTime calls.
  • Cites Kenneth Stanley's 'Why Greatness Cannot Be Planned' to argue over-optimizing kills creativity.

Worth remembering

  • Her parents met when her father taught a COBOL class her mother enrolled in, then proposed when she refused to date.
  • She commuted between Cairo and Boston every few weeks during her MIT postdoc.
  • Claims roughly 90% of how we communicate is nonverbal facial expression.
  • Affectiva found people still emote facial expressions even when alone watching Netflix or driving.
  • A female engineer flagged that Google's phone-unlock model assumed users keep phones in pockets, which women's clothing often lacks.
  • Smart Eye tech has been selected by 14 leading car manufacturers across 94 car models.
  • To gather data, they got people progressively drunk on a closed racetrack with a safety driver.
  • New Roomba models tout state-of-the-art 'poop detection' to avoid running over pet messes.
  • Her daily affirmation 'my smile lights up the whole world' leads strangers on the street to compliment her smile.
  • Notes only about 20 of roughly 400 attendees at an investing 'Capital Camp' were women.