#306 – Oriol Vinyals: Deep Learning and Artificial General Intelligence

About this episode

<p>Oriol Vinyals is the Research Director and Deep Learning Lead at DeepMind. Please support this podcast by checking out our sponsors:<br /> &#8211; <b>Shopify</b>: <a href="https://shopify.com/lex">https://shopify.com/lex</a> to get 14-day free trial<br /> &#8211; <b>Weights &#38; Biases</b>: <a href="https://lexfridman.com/wnb">https://lexfridman.com/wnb</a><br /> &#8211; <b>Magic Spoon</b>: <a href="https://magicspoon.com/lex">https://magicspoon.com/lex</a> and use code LEX to get $5 off<br /> &#8211; <b>Blinkist</b>: <a href="https://blinkist.com/lex">https://blinkist.com/lex</a> and use code LEX to get 25% off premium</p> <p><b>EPISODE LINKS:</b><br /> Oriol&#8217;s Twitter: <a href="https://twitter.com/oriolvinyalsml">https://twitter.com/oriolvinyalsml</a><br /> Oriol&#8217;s publications: <a href="https://scholar.google.com/citations?user=NkzyCvUAAAAJ">https://scholar.google.com/citations?user=NkzyCvUAAAAJ</a><br /> DeepMind&#8217;s Twitter: <a href="https://twitter.com/DeepMind">https://twitter.com/DeepMind</a><br /> DeepMind&#8217;s Instagram: <a href="https://instagram.com/deepmind">https://instagram.com/deepmind</a><br /> DeepMind&#8217;s Website: <a href="https://deepmind.com">https://deepmind.com</a><br /> Papers:<br /> 1. Gato: <a href="https://deepmind.com/publications/a-generalist-agent">https://deepmind.com/publications/a-generalist-agent</a><br /> 2. Flamingo: <a href="https://deepmind.com/blog/tackling-multiple-tasks-with-a-single-visual-language-model">https://deepmind.com/blog/tackling-multiple-tasks-with-a-single-visual-language-model</a><br /> 3. Language Models are Few-Shot Learners: <a href="https://arxiv.org/abs/2005.14165">https://arxiv.org/abs/2005.14165</a><br /> 4. Emergent Abilities of Large Language Models: <a href="https://arxiv.org/abs/2206.07682">https://arxiv.org/abs/2206.07682</a><br /> 5. Attention Is All You Need: <a href="https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf">https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aa-Paper.pdf</a></p> <p><b>PODCAST INFO:</b><br /> Podcast website: <a href="https://lexfridman.com/podcast">https://lexfridman.com/podcast</a><br /> Apple Podcasts: <a href="https://apple.co/2lwqZIr">https://apple.co/2lwqZIr</a><br /> Spotify: <a href="https://spoti.fi/2nEwCF8">https://spoti.fi/2nEwCF8</a><br /> RSS: <a href="https://lexfridman.com/feed/podcast/">https://lexfridman.com/feed/podcast/</a><br /> YouTube Full Episodes: <a href="https://youtube.com/lexfridman">https://youtube.com/lexfridman</a><br /> YouTube Clips: <a href="https://youtube.com/lexclips">https://youtube.com/lexclips</a></p> <p><b>SUPPORT &#38; CONNECT:</b><br /> &#8211; Check out the sponsors above, it&#8217;s the best way to support this podcast<br /> &#8211; Support on Patreon: <a href="https://www.patreon.com/lexfridman">https://www.patreon.com/lexfridman</a><br /> &#8211; Twitter: <a href="https://twitter.com/lexfridman">https://twitter.com/lexfridman</a><br /> &#8211; Instagram: <a href="https://www.instagram.com/lexfridman">https://www.instagram.com/lexfridman</a><br /> &#8211; LinkedIn: <a href="https://www.linkedin.com/in/lexfridman">https://www.linkedin.com/in/lexfridman</a><br /> &#8211; Facebook: <a href="https://www.facebook.com/lexfridman">https://www.facebook.com/lexfridman</a><br /> &#8211; Medium: <a href="https://medium.com/@lexfridman">https://medium.com/@lexfridman</a></p> <p><b>OUTLINE:</b><br /> Here&#8217;s the timestamps for the episode. On some podcast players you should be able to click the timestamp to jump to that time.<br /> (00:00) &#8211; Introduction<br /> (05:18) &#8211; AI<br /> (20:14) &#8211; Weights<br /> (26:33) &#8211; Gato<br /> (1:01:22) &#8211; Meta learning<br /> (1:15:21) &#8211; Neural networks<br /> (1:37:46) &#8211; Emergence<br /> (1:44:30) &#8211; AI sentience<br /> (2:08:27) &#8211; AGI</p>