#86 – David Silver: AlphaGo, AlphaZero, and Deep Reinforcement Learning

Über diese Folge

<p>David Silver leads the reinforcement learning research group at DeepMind and was lead researcher on AlphaGo, AlphaZero and co-lead on AlphaStar, and MuZero and lot of important work in reinforcement learning.</p> <p>Support this podcast by signing up with these sponsors:<br /> &#8211; MasterClass: <a href="https://masterclass.com/lex">https://masterclass.com/lex</a><br /> &#8211; Cash App &#8211; use code &#8220;LexPodcast&#8221; and download:<br /> &#8211; Cash App (App Store): <a href="https://apple.co/2sPrUHe">https://apple.co/2sPrUHe</a><br /> &#8211; Cash App (Google Play): <a href="https://bit.ly/2MlvP5w">https://bit.ly/2MlvP5w</a></p> <p>EPISODE LINKS:<br /> Reinforcement learning (book): https://amzn.to/2Jwp5zG</p> <p><span style="font-weight: 400;">This conversation is part of the Artificial Intelligence podcast.</span>&#160;If you would like to get more information about this podcast go to <a href="https://lexfridman.com/ai">https://lexfridman.com/ai</a> or connect with @lexfridman on <a href="https://twitter.com/lexfridman">Twitter</a>, <a href="https://www.linkedin.com/in/lexfridman/">LinkedIn</a>, <a href="https://www.facebook.com/lexfridman">Facebook</a>, <a href="https://medium.com/@lexfridman">Medium</a>, or <a href="https://www.youtube.com/lexfridman">YouTube</a> where you can watch the video versions of these conversations. If you enjoy the podcast, please rate it 5 stars on <a href="https://podcasts.apple.com/us/podcast/artificial-intelligence/id1434243584">Apple Podcasts</a>, follow on <a href="https://open.spotify.com/show/2MAi0BvDc6GTFvKFPXnkCL">Spotify</a>, or support it on <a href="https://www.patreon.com/lexfridman">Patreon</a>.</p> <p>Here&#8217;s the outline of the episode. On some podcast players you should be able to click the timestamp to jump to that time.</p> <p>OUTLINE:<br /> 00:00 &#8211; Introduction<br /> 04:09 &#8211; First program<br /> 11:11 &#8211; AlphaGo<br /> 21:42 &#8211; Rule of the game of Go<br /> 25:37 &#8211; Reinforcement learning: personal journey<br /> 30:15 &#8211; What is reinforcement learning?<br /> 43:51 &#8211; AlphaGo (continued)<br /> 53:40 &#8211; Supervised learning and self play in AlphaGo<br /> 1:06:12 &#8211; Lee Sedol retirement from Go play<br /> 1:08:57 &#8211; Garry Kasparov<br /> 1:14:10 &#8211; Alpha Zero and self play<br /> 1:31:29 &#8211; Creativity in AlphaZero<br /> 1:35:21 &#8211; AlphaZero applications<br /> 1:37:59 &#8211; Reward functions<br /> 1:40:51 &#8211; Meaning of life</p>