#206 – Ishan Misra: Self-Supervised Deep Learning in Computer Vision
0:00--:--
Speed
Listening elsewhere? Jump this view to your spot.
About this episode
<p>Ishan Misra is a research scientist at FAIR working on self-supervised visual learning. Please support this podcast by checking out our sponsors:<br />
– <b>Onnit</b>: <a href="https://lexfridman.com/onnit">https://lexfridman.com/onnit</a> to get up to 10% off<br />
– <b>The Information</b>: <a href="https://theinformation.com/lex">https://theinformation.com/lex</a> to get 75% off first month<br />
– <b>Grammarly</b>: <a href="https://grammarly.com/lex">https://grammarly.com/lex</a> to get 20% off premium<br />
– <b>Athletic Greens</b>: <a href="https://athleticgreens.com/lex">https://athleticgreens.com/lex</a> and use code LEX to get 1 month of fish oil</p>
<p><b>EPISODE LINKS:</b><br />
Ishan’s twitter: <a href="https://twitter.com/imisra_">https://twitter.com/imisra_</a><br />
Ishan’s website: <a href="https://imisra.github.io">https://imisra.github.io</a><br />
Ishan’s FAIR page: <a href="https://ai.facebook.com/people/ishan-misra/">https://ai.facebook.com/people/ishan-misra/</a></p>
<p><b>PODCAST INFO:</b><br />
Podcast website: <a href="https://lexfridman.com/podcast">https://lexfridman.com/podcast</a><br />
Apple Podcasts: <a href="https://apple.co/2lwqZIr">https://apple.co/2lwqZIr</a><br />
Spotify: <a href="https://spoti.fi/2nEwCF8">https://spoti.fi/2nEwCF8</a><br />
RSS: <a href="https://lexfridman.com/feed/podcast/">https://lexfridman.com/feed/podcast/</a><br />
YouTube Full Episodes: <a href="https://youtube.com/lexfridman">https://youtube.com/lexfridman</a><br />
YouTube Clips: <a href="https://youtube.com/lexclips">https://youtube.com/lexclips</a></p>
<p><b>SUPPORT & CONNECT:</b><br />
– Check out the sponsors above, it’s the best way to support this podcast<br />
– Support on Patreon: <a href="https://www.patreon.com/lexfridman">https://www.patreon.com/lexfridman</a><br />
– Twitter: <a href="https://twitter.com/lexfridman">https://twitter.com/lexfridman</a><br />
– Instagram: <a href="https://www.instagram.com/lexfridman">https://www.instagram.com/lexfridman</a><br />
– LinkedIn: <a href="https://www.linkedin.com/in/lexfridman">https://www.linkedin.com/in/lexfridman</a><br />
– Facebook: <a href="https://www.facebook.com/lexfridman">https://www.facebook.com/lexfridman</a><br />
– Medium: <a href="https://medium.com/@lexfridman">https://medium.com/@lexfridman</a></p>
<p><b>OUTLINE:</b><br />
Here’s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.<br />
(00:00) – Introduction<br />
(07:49) – Self-supervised learning<br />
(16:24) – Self-supervised learning is the dark matter of intelligence<br />
(20:17) – Categorization<br />
(28:50) – Is computer vision still really hard?<br />
(32:35) – Understanding Language<br />
(42:14) – Harder to solve: vision or language<br />
(48:59) – Contrastive learning & energy-based models<br />
(52:59) – Data augmentation<br />
(57:19) – Fixed audio spike by lowering sound with pen tool<br />
(1:05:33) – Real data vs. augmented data<br />
(1:09:16) – Non-contrastive learning energy based self supervised learning methods<br />
(1:12:54) – Unsupervised learning (SwAV)<br />
(1:15:37) – Self-supervised Pretraining (SEER)<br />
(1:20:44) – Self-supervised learning (SSL) architectures<br />
(1:26:43) – VISSL pytorch-based SSL library<br />
(1:29:38) – Multi-modal<br />
(1:37:06) – Active learning<br />
(1:42:45) – Autonomous driving<br />
(1:54:12) – Limits of deep learning<br />
(1:58:19) – Difference between learning and reasoning<br />
(2:03:26) – Building super-human AI<br />
(2:11:14) – Most beautiful idea in self-supervised learning<br />
(2:15:02) – Simulation for training AI<br />
(2:18:27) – Video games replacing reality<br />
(2:19:40) – How to write a good research paper<br />
(2:24:08) – Best programming language for beginners<br />
(2:25:01) – PyTorch vs TensorFlow<br />
(2:28:26) – Advice for getting into machine learning<br />
(2:30:31) – Advice for young people<br />
(2:32:58) – Meaning of life</p>