Skip to content
Download
#206 – Ishan Misra: Self-Supervised Deep Learning in Computer Vision

#206 – Ishan Misra: Self-Supervised Deep Learning in Computer Vision

Lex Fridman Podcast
Jul 31, 2021 0
Open in Clue

About this episode

<p>Ishan Misra is a research scientist at FAIR working on self-supervised visual learning. Please support this podcast by checking out our sponsors:<br /> &#8211; <b>Onnit</b>: <a href="https://lexfridman.com/onnit">https://lexfridman.com/onnit</a> to get up to 10% off<br /> &#8211; <b>The Information</b>: <a href="https://theinformation.com/lex">https://theinformation.com/lex</a> to get 75% off first month<br /> &#8211; <b>Grammarly</b>: <a href="https://grammarly.com/lex">https://grammarly.com/lex</a> to get 20% off premium<br /> &#8211; <b>Athletic Greens</b>: <a href="https://athleticgreens.com/lex">https://athleticgreens.com/lex</a> and use code LEX to get 1 month of fish oil</p> <p><b>EPISODE LINKS:</b><br /> Ishan&#8217;s twitter: <a href="https://twitter.com/imisra_">https://twitter.com/imisra_</a><br /> Ishan&#8217;s website: <a href="https://imisra.github.io">https://imisra.github.io</a><br /> Ishan&#8217;s FAIR page: <a href="https://ai.facebook.com/people/ishan-misra/">https://ai.facebook.com/people/ishan-misra/</a></p> <p><b>PODCAST INFO:</b><br /> Podcast website: <a href="https://lexfridman.com/podcast">https://lexfridman.com/podcast</a><br /> Apple Podcasts: <a href="https://apple.co/2lwqZIr">https://apple.co/2lwqZIr</a><br /> Spotify: <a href="https://spoti.fi/2nEwCF8">https://spoti.fi/2nEwCF8</a><br /> RSS: <a href="https://lexfridman.com/feed/podcast/">https://lexfridman.com/feed/podcast/</a><br /> YouTube Full Episodes: <a href="https://youtube.com/lexfridman">https://youtube.com/lexfridman</a><br /> YouTube Clips: <a href="https://youtube.com/lexclips">https://youtube.com/lexclips</a></p> <p><b>SUPPORT &#38; CONNECT:</b><br /> &#8211; Check out the sponsors above, it&#8217;s the best way to support this podcast<br /> &#8211; Support on Patreon: <a href="https://www.patreon.com/lexfridman">https://www.patreon.com/lexfridman</a><br /> &#8211; Twitter: <a href="https://twitter.com/lexfridman">https://twitter.com/lexfridman</a><br /> &#8211; Instagram: <a href="https://www.instagram.com/lexfridman">https://www.instagram.com/lexfridman</a><br /> &#8211; LinkedIn: <a href="https://www.linkedin.com/in/lexfridman">https://www.linkedin.com/in/lexfridman</a><br /> &#8211; Facebook: <a href="https://www.facebook.com/lexfridman">https://www.facebook.com/lexfridman</a><br /> &#8211; Medium: <a href="https://medium.com/@lexfridman">https://medium.com/@lexfridman</a></p> <p><b>OUTLINE:</b><br /> Here&#8217;s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.<br /> (00:00) &#8211; Introduction<br /> (07:49) &#8211; Self-supervised learning<br /> (16:24) &#8211; Self-supervised learning is the dark matter of intelligence<br /> (20:17) &#8211; Categorization<br /> (28:50) &#8211; Is computer vision still really hard?<br /> (32:35) &#8211; Understanding Language<br /> (42:14) &#8211; Harder to solve: vision or language<br /> (48:59) &#8211; Contrastive learning &#38; energy-based models<br /> (52:59) &#8211; Data augmentation<br /> (57:19) &#8211; Fixed audio spike by lowering sound with pen tool<br /> (1:05:33) &#8211; Real data vs. augmented data<br /> (1:09:16) &#8211; Non-contrastive learning energy based self supervised learning methods<br /> (1:12:54) &#8211; Unsupervised learning (SwAV)<br /> (1:15:37) &#8211; Self-supervised Pretraining (SEER)<br /> (1:20:44) &#8211; Self-supervised learning (SSL) architectures<br /> (1:26:43) &#8211; VISSL pytorch-based SSL library<br /> (1:29:38) &#8211; Multi-modal<br /> (1:37:06) &#8211; Active learning<br /> (1:42:45) &#8211; Autonomous driving<br /> (1:54:12) &#8211; Limits of deep learning<br /> (1:58:19) &#8211; Difference between learning and reasoning<br /> (2:03:26) &#8211; Building super-human AI<br /> (2:11:14) &#8211; Most beautiful idea in self-supervised learning<br /> (2:15:02) &#8211; Simulation for training AI<br /> (2:18:27) &#8211; Video games replacing reality<br /> (2:19:40) &#8211; How to write a good research paper<br /> (2:24:08) &#8211; Best programming language for beginners<br /> (2:25:01) &#8211; PyTorch vs TensorFlow<br /> (2:28:26) &#8211; Advice for getting into machine learning<br /> (2:30:31) &#8211; Advice for young people<br /> (2:32:58) &#8211; Meaning of life</p>

Listen to this episode in English to learn English

Podcast episodes are one of the highest-density ways to absorb English at native pace. #206 &#8211; Ishan Misra: Self-Supervised Deep Learning in Computer Vision from Lex Fridman Podcast gives you natural dialogue, unscripted speech, and vocabulary that actually appears in real conversations.

In the Clue app, every word in the transcript is tappable. Tap an unknown word, see the translation in your language instantly, and keep listening without breaking flow.

Episodes to Learn English

More podcasts in English