Home Lex Fridman Episode
Lex Fridman · 2016-09-27

Deep Learning for Computer Vision (Andrej Karpathy, OpenAI)

Deep Learning for Computer Vision (Andrej Karpathy, OpenAI)

Recommended on this episode

ProductRecommended

Keras

Keras (inferred)

“my go-to number one thing to look at”
“90% of the use cases are probably addressable with things like KAS. So KAS would be my go-to number one uh thing to look at.”— Andrej Karpathy
ProductRecommended

Torch

“I still really like Torch”
“I've used Torch for a long time. I still really like Torch. It's very lightweight, interpretable. It works just just fine.”— Andrej Karpathy

The guest's own work

ProductBy the guest

ConvNetJS

Andrej Karpathy

“this is comjs. uh this is um a deep learning library for training convolutional neural networks that I've that is implemented in JavaScript. I wrote this”— Andrej Karpathy
ProductBy the guest

arxiv-sanity.com

Andrej Karpathy

“I think this is a natural point to plug very briefly my archivesity.com. So this is the best website ever and what it does is it crawls archive”— Andrej Karpathy

Also referenced (named, not recommended)

ProductReferenced

TensorFlow

Google (inferred)

“Keras is a layer over TensorFlow or Theano. Uh and basically it's just a higher level API over either of those.”— Andrej Karpathy
ProductReferenced

Theano

“Keras is a layer over TensorFlow or Theano. Uh and basically it's just a higher level API over either of those.”— Andrej Karpathy
ProductReferenced

NVIDIA DIGITS DevBox

NVIDIA

“Nvidia uh has these digits dev boxes that you can buy. They have Titan X GPUs which are strong GPUs.”— Andrej Karpathy
ProductReferenced

NVIDIA DGX-1

NVIDIA

“you can buy DGX1, which has the newest Pascal P100 GPUs. Unfortunately, the DGX1 is about $130,000. So, this is kind of an expensive supercomputer.”— Andrej Karpathy
ProductReferenced

NVIDIA Titan X

NVIDIA

“They have Titan X GPUs which are strong GPUs.”— Andrej Karpathy
ProductReferenced

NVIDIA Tesla K80

NVIDIA

“those are powerful GPUs K80s that would be available to you”— Andrej Karpathy
ProductReferenced

Microsoft Azure

Microsoft

“Microsoft Azure is coming up, Azure is coming up with its own offering soon. Uh, so I think uh they've announced it and it's in some kind of a beta stage”— Andrej Karpathy
ProductReferenced

Cirrascale

Cirrascale (inferred)

“At OpenAI for example, you use Cirrus Scale. So Serale is much more a slightly different model. You can't spin up GPUs on demand, but they allow you to rent a box in the cloud.”— Andrej Karpathy
ProductReferenced

NVIDIA CUDA

NVIDIA

“we're talking about uh Nvidia releasing the CUDA library that allows you to efficiently create all these matrix vector operations and apply them on arrays of numbers.”— Andrej Karpathy
ProductReferenced

Caffe

“neural network called Alexet running in cafe. By interacting with the network, we can see what some of the neurons are doing.”— Andrej Karpathy