#206 – Ishan Misra: Self-Supervised Deep Learning in Computer Vision

Über diese Folge

<p>Ishan Misra is a research scientist at FAIR working on self-supervised visual learning. Please support this podcast by checking out our sponsors:<br /> &#8211; <b>Onnit</b>: <a href="https://lexfridman.com/onnit">https://lexfridman.com/onnit</a> to get up to 10% off<br /> &#8211; <b>The Information</b>: <a href="https://theinformation.com/lex">https://theinformation.com/lex</a> to get 75% off first month<br /> &#8211; <b>Grammarly</b>: <a href="https://grammarly.com/lex">https://grammarly.com/lex</a> to get 20% off premium<br /> &#8211; <b>Athletic Greens</b>: <a href="https://athleticgreens.com/lex">https://athleticgreens.com/lex</a> and use code LEX to get 1 month of fish oil</p> <p><b>EPISODE LINKS:</b><br /> Ishan&#8217;s twitter: <a href="https://twitter.com/imisra_">https://twitter.com/imisra_</a><br /> Ishan&#8217;s website: <a href="https://imisra.github.io">https://imisra.github.io</a><br /> Ishan&#8217;s FAIR page: <a href="https://ai.facebook.com/people/ishan-misra/">https://ai.facebook.com/people/ishan-misra/</a></p> <p><b>PODCAST INFO:</b><br /> Podcast website: <a href="https://lexfridman.com/podcast">https://lexfridman.com/podcast</a><br /> Apple Podcasts: <a href="https://apple.co/2lwqZIr">https://apple.co/2lwqZIr</a><br /> Spotify: <a href="https://spoti.fi/2nEwCF8">https://spoti.fi/2nEwCF8</a><br /> RSS: <a href="https://lexfridman.com/feed/podcast/">https://lexfridman.com/feed/podcast/</a><br /> YouTube Full Episodes: <a href="https://youtube.com/lexfridman">https://youtube.com/lexfridman</a><br /> YouTube Clips: <a href="https://youtube.com/lexclips">https://youtube.com/lexclips</a></p> <p><b>SUPPORT &#38; CONNECT:</b><br /> &#8211; Check out the sponsors above, it&#8217;s the best way to support this podcast<br /> &#8211; Support on Patreon: <a href="https://www.patreon.com/lexfridman">https://www.patreon.com/lexfridman</a><br /> &#8211; Twitter: <a href="https://twitter.com/lexfridman">https://twitter.com/lexfridman</a><br /> &#8211; Instagram: <a href="https://www.instagram.com/lexfridman">https://www.instagram.com/lexfridman</a><br /> &#8211; LinkedIn: <a href="https://www.linkedin.com/in/lexfridman">https://www.linkedin.com/in/lexfridman</a><br /> &#8211; Facebook: <a href="https://www.facebook.com/lexfridman">https://www.facebook.com/lexfridman</a><br /> &#8211; Medium: <a href="https://medium.com/@lexfridman">https://medium.com/@lexfridman</a></p> <p><b>OUTLINE:</b><br /> Here&#8217;s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.<br /> (00:00) &#8211; Introduction<br /> (07:49) &#8211; Self-supervised learning<br /> (16:24) &#8211; Self-supervised learning is the dark matter of intelligence<br /> (20:17) &#8211; Categorization<br /> (28:50) &#8211; Is computer vision still really hard?<br /> (32:35) &#8211; Understanding Language<br /> (42:14) &#8211; Harder to solve: vision or language<br /> (48:59) &#8211; Contrastive learning &#38; energy-based models<br /> (52:59) &#8211; Data augmentation<br /> (57:19) &#8211; Fixed audio spike by lowering sound with pen tool<br /> (1:05:33) &#8211; Real data vs. augmented data<br /> (1:09:16) &#8211; Non-contrastive learning energy based self supervised learning methods<br /> (1:12:54) &#8211; Unsupervised learning (SwAV)<br /> (1:15:37) &#8211; Self-supervised Pretraining (SEER)<br /> (1:20:44) &#8211; Self-supervised learning (SSL) architectures<br /> (1:26:43) &#8211; VISSL pytorch-based SSL library<br /> (1:29:38) &#8211; Multi-modal<br /> (1:37:06) &#8211; Active learning<br /> (1:42:45) &#8211; Autonomous driving<br /> (1:54:12) &#8211; Limits of deep learning<br /> (1:58:19) &#8211; Difference between learning and reasoning<br /> (2:03:26) &#8211; Building super-human AI<br /> (2:11:14) &#8211; Most beautiful idea in self-supervised learning<br /> (2:15:02) &#8211; Simulation for training AI<br /> (2:18:27) &#8211; Video games replacing reality<br /> (2:19:40) &#8211; How to write a good research paper<br /> (2:24:08) &#8211; Best programming language for beginners<br /> (2:25:01) &#8211; PyTorch vs TensorFlow<br /> (2:28:26) &#8211; Advice for getting into machine learning<br /> (2:30:31) &#8211; Advice for young people<br /> (2:32:58) &#8211; Meaning of life</p>